2022-07-05T11:38:09.037 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-05T11:38:09.039 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi/6913409 --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} --name teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi --owner scheduled_teuthology@teuthology --verbose -- /home/teuthworker/archive/teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi/6913409/orig.config.yaml 2022-07-05T11:38:09.113 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-07-05T11:38:09.212 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi/6913409 branch: pacific description: fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} email: ceph-qa@ceph.io first_in_suite: false job_id: '6913409' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: pacific ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 494bbf8c4cff5775f04a6a479335587c213bcf08 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 494bbf8c4cff5775f04a6a479335587c213bcf08 kclient: mntopts: - nowsync selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pacific sha1: c4a8e5d15163d588b25b033c25ae416600cffaa5 owner: scheduled_teuthology@teuthology priority: 500 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 494bbf8c4cff5775f04a6a479335587c213bcf08 sleep_before_teardown: 0 suite: fs suite_branch: pacific suite_path: /home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: c4a8e5d15163d588b25b033c25ae416600cffaa5 targets: smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5QKMzL/K4geGCPmMUeRI+Bweq0opcMMOqXsc7sr8TBC33EWU3e/LjYcyUzsq64O6ceEQg7abi3VGkhGghBuo5kMkA6eR+YZduWYjhwOnTmaPE7Ru5dkKKJRgGfB3O5K1jBlKoiXows2WvSRb3evEKs0zQqW+4+m/ipxWVm/1uZyUQ5jN0BBkK7oOFOKi2+iY/s9l0J1XTdhk4pjxp6OvsAUMA9SLUAikPe04csgZCVCKjROzG/R9mK30g2ao7f/jJiN7l/KIMAr2Df+Dkq73do2aD1uNnMzukuJbf4BKuwRtO0bYrXWi135VMiDyHch5KYXypIR0dPlv4llqEKdwzrYdtO51GpH60b7FXpOwzWzib9v2jVbbmrlbp5DjKXcOUi31WnV68c3XXyremRRsV4BQDduWAvSIrqVK6zAo1Ex5nVoDe0otY8TCRLDWD+PJAd7/7iJGljMnQEyQV77eV4VJKxlO/+RqGNW0HHqzxrN632em3z07VhWyvFBC01/c= smithi110.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEGGOe18JIExJcyKbevpJQYx9Qmwz2lWAWbnNIzNGtCkiXZI8RHg9waVmAw7hMtcEfUEM/5NRpWb2eB/D22BXpPTMtYllwvSU6JPIm4PlC3ByOu7qx6xIS58EGGp6M01pLEECYDaiiEodVuoVZZZOANiOkfgU0yZnneaqYUo2hbYbh4H+QKAf6IUtLSvLMPNcszaqB6yv05pB48VP4pD6Sds78we2H7ySoE+EityJIkv2GQDC26btg9/sSx4htVWDeVCiDQdiwwFe7tVTmD6ZM9pON4I39VhwQBRKPS7BCD+smd8X9/D2jU+BUztfa/DhVOqppsEDnt5yLjXKgPXO/3lULQ5kiuBYNXFEl3AUcx7o/n9IFSv5t/cCstjpf5iG2ipkGxbEZTpX32HvwJGObkgMjIbKk2OS+AzOZAe6t1vXwU/cInB9l5RiB9vXZIBbvcjP1Nq9Ir1fn9pmug2hyeDqqHXWcgM9SCUW+P0tJKaLzGjQdvRnQoTSNJ300bVc= smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXRDhbFglBe9/XINsM1a9zMPHV8owLxx8mVaoqDmcjxx6Ysp4eezQ8MW0WQ6NJ233a0gw64nxP6BbfnsXmYbI30Q3zg7HzEzvbDpNZYfuppJ9n1u+ZhnwF8kyWuAIUebAjh9M8PGQ7NLBPj4e7aj2BsdFp8Q3JOUdaC13xPomTldhe+zyQYSlvfgyxaa7OGo1PhGp0cy29XBf1XjNIX5w+4lSIPv5k8HxMcuM5p+F2xkDXedt2k9TFF7lcjD33KIPIF4SS2KFI9LqWdb7GgpyM60ZlGO/i7xYar0kG11CBHn2qNxnc7bITWnRb7CUYHpE+9uBrBV/PzJHjrn0Wc/xADa/dpwjC+8yP8j4qKyxyDjj8w7gqBtm/aOpWPgp4pId4Jk3jnlZEi8RefOpKveVbdZ7YursSjw0zqjgiI2GTnr+9sEw55C4UHDm6K5lRdJvWhgNtPxZGVxASnZ4IYmReUNyVeen5NKIpIuRi9JSeYLlKoMAhl/UNAkcC04Rg+gc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - check-counter: {} - workunit: clients: all: - suites/blogbench.sh teuthology_branch: main teuthology_sha1: f58709e3fda190343157063e5edb0d7a36a41afc timestamp: 2022-07-05_04:17:03 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1713 2022-07-05T11:38:09.213 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa; will attempt to use it 2022-07-05T11:38:09.214 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa/tasks 2022-07-05T11:38:09.215 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-07-05T11:38:09.218 INFO:teuthology.task.internal:Checking packages... 2022-07-05T11:38:09.242 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '494bbf8c4cff5775f04a6a479335587c213bcf08' 2022-07-05T11:38:09.242 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-07-05T11:38:09.243 INFO:teuthology.packaging:ref: None 2022-07-05T11:38:09.243 INFO:teuthology.packaging:tag: None 2022-07-05T11:38:09.243 INFO:teuthology.packaging:branch: pacific 2022-07-05T11:38:09.244 INFO:teuthology.packaging:sha1: 494bbf8c4cff5775f04a6a479335587c213bcf08 2022-07-05T11:38:09.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2022-07-05T11:38:09.677 INFO:teuthology.task.internal:Found packages for ceph version 16.2.9-404.gc4a8e5d1 2022-07-05T11:38:09.678 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-07-05T11:38:09.685 INFO:teuthology.task.internal:no buildpackages task found 2022-07-05T11:38:09.685 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-07-05T11:38:09.699 INFO:teuthology.task.internal:Saving configuration 2022-07-05T11:38:09.732 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-07-05T11:38:09.750 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-05T11:38:09.812 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi/6913409', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-07-05 11:32:33.387432', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL9suYyxbgdqj3DCWJVX4v/4Ul/nZuwdIMlF2/1m9/KWPnf/v4PHK2CuYbX2eGXzZC/o7yuvAOeenMunHjr+8OE='} 2022-07-05T11:38:09.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi/6913409', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-07-05 11:32:33.386359', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBLfQgCR64LvRcYe6U/r5Ge3Mdsp/HVCQUZMijgKs08Drb75+rwt71yE5suIdAlIctur4J+QNn/vVX8/r8MVh6k='} 2022-07-05T11:38:09.886 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi/6913409', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-07-05 11:32:33.384406', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUz+zVnmbycED92xcj9xpovR24/SJM8asAznfMCiYnoe9f+fQNlGRHIAyXlj7ksYQwtuXz9SpeIaC37X+f4K1w='} 2022-07-05T11:38:09.887 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-07-05T11:38:09.896 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2022-07-05T11:38:09.897 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2022-07-05T11:38:09.898 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2022-07-05T11:38:09.898 INFO:teuthology.run_tasks:Running task console_log... 2022-07-05T11:38:10.080 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f86f7424510>, signals=[15]) 2022-07-05T11:38:10.082 INFO:teuthology.run_tasks:Running task internal.connect... 2022-07-05T11:38:10.095 INFO:teuthology.task.internal:Opening connections... 2022-07-05T11:38:10.098 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2022-07-05T11:38:10.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-05T11:38:10.243 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2022-07-05T11:38:10.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-05T11:38:10.349 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2022-07-05T11:38:10.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-05T11:38:10.439 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-07-05T11:38:10.454 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2022-07-05T11:38:10.482 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2022-07-05T11:38:10.483 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2022-07-05T11:38:10.556 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux" 2022-07-05T11:38:10.557 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.4 (Ootpa)" 2022-07-05T11:38:10.557 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel" 2022-07-05T11:38:10.558 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora" 2022-07-05T11:38:10.559 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.4" 2022-07-05T11:38:10.559 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2022-07-05T11:38:10.560 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-07-05T11:38:10.560 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2022-07-05T11:38:10.561 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-07-05T11:38:10.561 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/" 2022-07-05T11:38:10.561 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-05T11:38:10.562 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-05T11:38:10.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:38:10.563 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-05T11:38:10.563 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-07-05T11:38:10.564 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-05T11:38:10.564 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-07-05T11:38:10.566 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2022-07-05T11:38:10.593 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2022-07-05T11:38:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2022-07-05T11:38:10.612 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2022-07-05T11:38:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2022-07-05T11:38:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2022-07-05T11:38:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2022-07-05T11:38:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2022-07-05T11:38:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2022-07-05T11:38:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2022-07-05T11:38:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-07-05T11:38:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2022-07-05T11:38:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-07-05T11:38:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2022-07-05T11:38:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-05T11:38:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-05T11:38:10.672 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:38:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-05T11:38:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-07-05T11:38:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-05T11:38:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-07-05T11:38:10.674 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2022-07-05T11:38:10.704 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2022-07-05T11:38:10.727 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2022-07-05T11:38:10.728 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2022-07-05T11:38:10.788 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2022-07-05T11:38:10.789 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.4 (Ootpa)" 2022-07-05T11:38:10.789 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2022-07-05T11:38:10.789 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2022-07-05T11:38:10.790 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.4" 2022-07-05T11:38:10.790 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2022-07-05T11:38:10.790 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-07-05T11:38:10.790 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2022-07-05T11:38:10.791 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-07-05T11:38:10.791 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2022-07-05T11:38:10.791 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-05T11:38:10.791 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-05T11:38:10.792 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:38:10.792 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-05T11:38:10.793 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-07-05T11:38:10.793 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-05T11:38:10.793 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-07-05T11:38:10.794 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2022-07-05T11:38:10.816 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-07-05T11:38:10.835 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-07-05T11:38:10.853 INFO:teuthology.task.internal:Checking for old test directory... 2022-07-05T11:38:10.854 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2022-07-05T11:38:10.864 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2022-07-05T11:38:10.871 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2022-07-05T11:38:10.912 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-07-05T11:38:10.941 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-07-05T11:38:10.942 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2022-07-05T11:38:10.952 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2022-07-05T11:38:10.963 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2022-07-05T11:38:10.999 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-07-05T11:38:11.135 INFO:teuthology.run_tasks:Running task kernel... 2022-07-05T11:38:11.188 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2022-07-05T11:38:11.189 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2022-07-05T11:38:11.190 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2022-07-05T11:38:11.191 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2022-07-05T11:38:11.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-05T11:38:11.209 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2022-07-05T11:38:11.266 INFO:teuthology.orchestra.run.smithi090.stdout:4.18.0-305.el8.x86_64 2022-07-05T11:38:11.267 INFO:teuthology.task.kernel:Running kernel on smithi090: 4.18.0-305.el8.x86_64 2022-07-05T11:38:11.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum install -y kernel 2022-07-05T11:38:12.962 INFO:teuthology.orchestra.run.smithi090.stdout:Updating Subscription Management repositories. 2022-07-05T11:38:12.963 INFO:teuthology.orchestra.run.smithi090.stdout:Unable to read consumer identity 2022-07-05T11:38:13.093 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:38:13.094 INFO:teuthology.orchestra.run.smithi090.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-07-05T11:38:13.095 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:38:16.815 INFO:teuthology.orchestra.run.smithi090.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2022-07-05T11:38:18.071 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 12 MB 00:01 2022-07-05T11:38:20.504 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2022-07-05T11:38:21.114 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-4.18.0-305.el8.x86_64 is already installed. 2022-07-05T11:38:21.236 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2022-07-05T11:38:21.237 INFO:teuthology.orchestra.run.smithi090.stdout:Nothing to do. 2022-07-05T11:38:21.237 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2022-07-05T11:38:21.359 DEBUG:teuthology.orchestra.run.smithi090:> echo no | sudo yum reinstall kernel || true 2022-07-05T11:38:21.676 INFO:teuthology.orchestra.run.smithi090.stdout:Updating Subscription Management repositories. 2022-07-05T11:38:21.677 INFO:teuthology.orchestra.run.smithi090.stdout:Unable to read consumer identity 2022-07-05T11:38:21.733 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:38:21.734 INFO:teuthology.orchestra.run.smithi090.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-07-05T11:38:21.735 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:38:21.930 INFO:teuthology.orchestra.run.smithi090.stdout:Last metadata expiration check: 0:00:01 ago on Tue 05 Jul 2022 11:38:20 AM UTC. 2022-07-05T11:38:22.058 INFO:teuthology.orchestra.run.smithi090.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2022-07-05T11:38:22.109 INFO:teuthology.orchestra.run.smithi090.stderr:Error: No packages marked for reinstall. 2022-07-05T11:38:22.152 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum reinstall -y kernel || true 2022-07-05T11:38:22.465 INFO:teuthology.orchestra.run.smithi090.stdout:Updating Subscription Management repositories. 2022-07-05T11:38:22.468 INFO:teuthology.orchestra.run.smithi090.stdout:Unable to read consumer identity 2022-07-05T11:38:22.539 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:38:22.539 INFO:teuthology.orchestra.run.smithi090.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-07-05T11:38:22.540 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:38:22.733 INFO:teuthology.orchestra.run.smithi090.stdout:Last metadata expiration check: 0:00:02 ago on Tue 05 Jul 2022 11:38:20 AM UTC. 2022-07-05T11:38:22.853 INFO:teuthology.orchestra.run.smithi090.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2022-07-05T11:38:22.877 INFO:teuthology.orchestra.run.smithi090.stderr:Error: No packages marked for reinstall. 2022-07-05T11:38:22.924 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel --last | head -n 1 2022-07-05T11:38:23.010 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-4.18.0-305.el8.x86_64 Sun 03 Jul 2022 12:08:04 PM UTC 2022-07-05T11:38:23.011 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.el8.x86_64 2022-07-05T11:38:23.011 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-07-05T11:38:23.012 DEBUG:teuthology.parallel:result is None 2022-07-05T11:38:23.012 INFO:teuthology.run_tasks:Running task internal.base... 2022-07-05T11:38:23.026 INFO:teuthology.task.internal:Creating test directory... 2022-07-05T11:38:23.028 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-07-05T11:38:23.040 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-07-05T11:38:23.048 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-07-05T11:38:23.067 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-07-05T11:38:23.091 INFO:teuthology.run_tasks:Running task internal.archive... 2022-07-05T11:38:23.127 INFO:teuthology.task.internal:Creating archive directory... 2022-07-05T11:38:23.129 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-07-05T11:38:23.144 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-07-05T11:38:23.156 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-07-05T11:38:23.195 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-07-05T11:38:23.207 INFO:teuthology.task.internal:Enabling coredump saving... 2022-07-05T11:38:23.208 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2022-07-05T11:38:23.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-05T11:38:23.248 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2022-07-05T11:38:23.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-05T11:38:23.272 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-07-05T11:38:23.278 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-07-05T11:38:23.308 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-05T11:38:23.308 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-07-05T11:38:23.317 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-05T11:38:23.350 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-05T11:38:23.353 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-05T11:38:23.376 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-05T11:38:23.378 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-05T11:38:23.379 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-07-05T11:38:23.408 INFO:teuthology.task.internal:Configuring sudo... 2022-07-05T11:38:23.409 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-07-05T11:38:23.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-07-05T11:38:23.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-07-05T11:38:23.464 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-07-05T11:38:23.488 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-07-05T11:38:23.489 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-07-05T11:38:23.492 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-07-05T11:38:23.502 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-07-05T11:38:23.525 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-05T11:38:23.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-05T11:38:23.658 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-05T11:38:23.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-05T11:38:23.793 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:38:23.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-07-05T11:38:23.863 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-05T11:38:23.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-05T11:38:23.966 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-05T11:38:24.067 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-05T11:38:24.112 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:38:24.113 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-07-05T11:38:24.179 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-05T11:38:24.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-05T11:38:24.284 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-05T11:38:24.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-05T11:38:24.410 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:38:24.410 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-07-05T11:38:24.476 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2022-07-05T11:38:24.494 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2022-07-05T11:38:24.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2022-07-05T11:38:24.554 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-07-05T11:38:24.555 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-07-05T11:38:24.567 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-07-05T11:38:25.027 INFO:teuthology.run_tasks:Running task internal.timer... 2022-07-05T11:38:25.036 INFO:teuthology.task.internal:Starting timer... 2022-07-05T11:38:25.036 INFO:teuthology.run_tasks:Running task pcp... 2022-07-05T11:38:25.047 INFO:teuthology.run_tasks:Running task selinux... 2022-07-05T11:38:25.071 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2022-07-05T11:38:25.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2022-07-05T11:38:25.138 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: [ OK ] 2022-07-05T11:38:25.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2022-07-05T11:38:25.208 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: [ OK ] 2022-07-05T11:38:25.209 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2022-07-05T11:38:25.271 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: [ OK ] 2022-07-05T11:38:25.273 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-07-05T11:38:25.274 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2022-07-05T11:38:25.303 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2022-07-05T11:38:25.304 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2022-07-05T11:38:25.326 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2022-07-05T11:38:25.327 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2022-07-05T11:38:25.355 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2022-07-05T11:38:25.355 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2022-07-05T11:38:25.356 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-07-05T11:38:25.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-05T11:38:25.382 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-07-05T11:38:25.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-05T11:38:25.410 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-07-05T11:38:25.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-05T11:38:25.444 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-07-05T11:38:25.444 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2022-07-05T11:38:25.470 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2022-07-05T11:38:25.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2022-07-05T11:38:25.532 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-07-05T11:38:25.556 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2022-07-05T11:38:25.557 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-07-05T11:38:25.618 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-07-05T11:38:25.621 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi090.front.sepia.ceph.com,smithi110.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-07-05T11:42:35.147 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2022-07-05T11:42:35.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2022-07-05T11:42:35.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-05T11:42:35.240 DEBUG:teuthology.orchestra.run.smithi090:> true 2022-07-05T11:42:35.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2022-07-05T11:42:35.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-05T11:42:35.395 DEBUG:teuthology.orchestra.run.smithi110:> true 2022-07-05T11:42:35.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2022-07-05T11:42:35.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-05T11:42:35.545 DEBUG:teuthology.orchestra.run.smithi149:> true 2022-07-05T11:42:35.614 INFO:teuthology.run_tasks:Running task clock... 2022-07-05T11:42:35.633 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-07-05T11:42:35.634 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-07-05T11:42:35.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-07-05T11:42:35.640 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-07-05T11:42:35.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-07-05T11:42:35.643 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-07-05T11:42:35.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-07-05T11:42:35.668 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-07-05T11:42:35.670 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-07-05T11:42:35.683 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-07-05T11:42:35.686 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-07-05T11:42:35.687 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-07-05T11:42:35.701 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-07-05T11:42:35.719 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2022-07-05T11:42:35.730 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2022-07-05T11:42:35.730 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2022-07-05T11:42:35.734 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2022-07-05T11:42:35.738 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2022-07-05T11:42:35.744 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-07-05T11:42:35.745 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2022-07-05T11:42:35.752 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-07-05T11:42:35.757 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-07-05T11:42:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-07-05T11:42:35.766 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-07-05T11:42:35.772 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-07-05T11:42:35.822 INFO:teuthology.orchestra.run.smithi110.stderr:bash: ntpq: command not found 2022-07-05T11:42:35.824 INFO:teuthology.orchestra.run.smithi090.stderr:bash: ntpq: command not found 2022-07-05T11:42:35.825 INFO:teuthology.orchestra.run.smithi090.stdout:210 Number of sources = 4 2022-07-05T11:42:35.826 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-07-05T11:42:35.826 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2022-07-05T11:42:35.826 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.826 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.827 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.827 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.828 INFO:teuthology.orchestra.run.smithi110.stdout:210 Number of sources = 4 2022-07-05T11:42:35.828 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-07-05T11:42:35.829 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2022-07-05T11:42:35.829 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.829 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.829 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.830 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.840 INFO:teuthology.orchestra.run.smithi149.stderr:bash: ntpq: command not found 2022-07-05T11:42:35.843 INFO:teuthology.orchestra.run.smithi149.stdout:210 Number of sources = 4 2022-07-05T11:42:35.844 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-07-05T11:42:35.844 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2022-07-05T11:42:35.845 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.845 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.846 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.846 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-07-05T11:42:35.847 INFO:teuthology.run_tasks:Running task install... 2022-07-05T11:42:35.857 DEBUG:teuthology.task.install:project ceph 2022-07-05T11:42:35.858 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08'}} 2022-07-05T11:42:35.858 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08'} 2022-07-05T11:42:35.859 INFO:teuthology.task.install:Using flavor: default 2022-07-05T11:42:35.868 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-07-05T11:42:35.869 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-07-05T11:42:35.870 DEBUG:teuthology.orchestra.run.smithi090:> sudo lsb_release -is 2022-07-05T11:42:35.908 INFO:teuthology.orchestra.run.smithi090.stdout:RedHatEnterprise 2022-07-05T11:42:35.909 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:42:35.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo lsb_release -is 2022-07-05T11:42:35.911 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08', 'tag': None, 'wait_for_package': False} 2022-07-05T11:42:35.911 DEBUG:teuthology.orchestra.run.smithi090:> sudo lsb_release -is 2022-07-05T11:42:35.949 INFO:teuthology.orchestra.run.smithi110.stdout:RedHatEnterprise 2022-07-05T11:42:35.950 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:42:35.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2022-07-05T11:42:35.951 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08', 'tag': None, 'wait_for_package': False} 2022-07-05T11:42:35.952 DEBUG:teuthology.orchestra.run.smithi110:> sudo lsb_release -is 2022-07-05T11:42:35.989 INFO:teuthology.orchestra.run.smithi090.stdout:RedHatEnterprise 2022-07-05T11:42:35.993 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2022-07-05T11:42:35.993 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:42:35.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 2022-07-05T11:42:35.997 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:42:35.998 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08', 'tag': None, 'wait_for_package': False} 2022-07-05T11:42:35.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2022-07-05T11:42:36.069 INFO:teuthology.orchestra.run.smithi110.stdout:RedHatEnterprise 2022-07-05T11:42:36.070 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:42:36.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 2022-07-05T11:42:36.075 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2022-07-05T11:42:36.075 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:42:36.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 2022-07-05T11:42:36.180 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/ 2022-07-05T11:42:36.180 INFO:teuthology.task.install.rpm:Package version is 16.2.9-390.g494bbf8c 2022-07-05T11:42:36.226 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/ 2022-07-05T11:42:36.226 INFO:teuthology.task.install.rpm:Package version is 16.2.9-390.g494bbf8c 2022-07-05T11:42:36.261 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/ 2022-07-05T11:42:36.262 INFO:teuthology.task.install.rpm:Package version is 16.2.9-390.g494bbf8c 2022-07-05T11:42:36.302 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-07-05T11:42:36.303 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:42:36.303 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-07-05T11:42:36.327 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-07-05T11:42:36.328 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/494bbf8c4cff5775f04a6a479335587c213bcf08/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-07-05T11:42:36.343 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-07-05T11:42:36.344 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:42:36.344 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-07-05T11:42:36.369 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-07-05T11:42:36.370 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/494bbf8c4cff5775f04a6a479335587c213bcf08/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-07-05T11:42:36.378 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/pacific/494bbf8c4cff5775f04a6a479335587c213bcf08/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-07-05T11:42:36.378 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:42:36.379 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-07-05T11:42:36.392 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-07-05T11:42:36.404 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-07-05T11:42:36.405 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/494bbf8c4cff5775f04a6a479335587c213bcf08/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-07-05T11:42:36.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-07-05T11:42:36.466 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-07-05T11:42:36.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-07-05T11:42:36.508 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-07-05T11:42:36.530 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2022-07-05T11:42:36.531 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2022-07-05T11:42:36.543 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-07-05T11:42:36.571 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2022-07-05T11:42:36.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2022-07-05T11:42:36.606 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2022-07-05T11:42:36.608 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2022-07-05T11:42:36.885 INFO:teuthology.orchestra.run.smithi090.stdout:Updating Subscription Management repositories. 2022-07-05T11:42:36.925 INFO:teuthology.orchestra.run.smithi110.stdout:Updating Subscription Management repositories. 2022-07-05T11:42:36.963 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2022-07-05T11:42:37.156 INFO:teuthology.orchestra.run.smithi090.stdout:43 files removed 2022-07-05T11:42:37.202 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-07-05T11:42:37.246 INFO:teuthology.orchestra.run.smithi110.stdout:43 files removed 2022-07-05T11:42:37.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-07-05T11:42:37.327 INFO:teuthology.orchestra.run.smithi149.stdout:43 files removed 2022-07-05T11:42:37.372 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-07-05T11:42:37.514 INFO:teuthology.orchestra.run.smithi090.stdout:Updating Subscription Management repositories. 2022-07-05T11:42:37.602 INFO:teuthology.orchestra.run.smithi110.stdout:Updating Subscription Management repositories. 2022-07-05T11:42:37.688 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2022-07-05T11:42:38.077 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 343 kB/s | 76 kB 00:00 2022-07-05T11:42:38.268 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 343 kB/s | 76 kB 00:00 2022-07-05T11:42:38.294 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2022-07-05T11:42:38.484 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2022-07-05T11:42:38.500 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 7.7 kB/s | 1.4 kB 00:00 2022-07-05T11:42:38.692 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 7.7 kB/s | 1.4 kB 00:00 2022-07-05T11:42:39.025 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 332 kB/s | 76 kB 00:00 2022-07-05T11:42:39.245 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 80 kB/s | 15 kB 00:00 2022-07-05T11:42:39.450 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2022-07-05T11:42:40.878 INFO:teuthology.orchestra.run.smithi090.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-07-05T11:42:40.882 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2022-07-05T11:42:41.827 INFO:teuthology.orchestra.run.smithi110.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-07-05T11:42:42.375 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 12 MB 00:01 2022-07-05T11:42:42.823 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 12 MB/s | 12 MB 00:00 2022-07-05T11:42:43.304 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 12 MB 00:02 2022-07-05T11:42:44.819 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2022-07-05T11:42:45.155 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 143 MB/s | 38 MB 00:00 2022-07-05T11:42:45.323 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2022-07-05T11:42:45.644 INFO:teuthology.orchestra.run.smithi110.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 132 MB/s | 33 MB 00:00 2022-07-05T11:42:45.717 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2022-07-05T11:42:46.035 INFO:teuthology.orchestra.run.smithi090.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 130 MB/s | 33 MB 00:00 2022-07-05T11:42:50.579 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 124 MB/s | 33 MB 00:00 2022-07-05T11:42:51.033 INFO:teuthology.orchestra.run.smithi110.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 142 MB/s | 38 MB 00:00 2022-07-05T11:42:51.166 INFO:teuthology.orchestra.run.smithi090.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 142 MB/s | 38 MB 00:00 2022-07-05T11:42:58.560 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-07-05T11:42:58.561 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-07-05T11:42:58.572 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-07-05T11:42:58.572 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-07-05T11:42:58.573 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-07-05T11:42:58.574 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-07-05T11:42:58.576 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-07-05T11:42:58.578 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-07-05T11:42:58.579 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-07-05T11:42:59.054 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2022-07-05T11:42:59.068 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================================================== 2022-07-05T11:42:59.069 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2022-07-05T11:42:59.069 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================================================== 2022-07-05T11:42:59.070 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2022-07-05T11:42:59.070 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-07-05T11:42:59.071 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 6.4 k 2022-07-05T11:42:59.071 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 6.0 M 2022-07-05T11:42:59.072 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 904 k 2022-07-05T11:42:59.072 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 161 k 2022-07-05T11:42:59.073 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 1.6 M 2022-07-05T11:42:59.073 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 113 k 2022-07-05T11:42:59.074 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 2.9 M 2022-07-05T11:42:59.075 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 8.6 M 2022-07-05T11:42:59.075 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 27 k 2022-07-05T11:42:59.076 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 12 M 2022-07-05T11:42:59.076 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 52 M 2022-07-05T11:42:59.076 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 81 k 2022-07-05T11:42:59.077 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 256 k 2022-07-05T11:42:59.077 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 14 k 2022-07-05T11:42:59.078 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-07-05T11:42:59.078 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-07-05T11:42:59.079 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-07-05T11:42:59.079 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 25 k 2022-07-05T11:42:59.080 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 818 k 2022-07-05T11:42:59.080 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 131 k 2022-07-05T11:42:59.081 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-07-05T11:42:59.081 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-07-05T11:42:59.082 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-07-05T11:42:59.082 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 215 k 2022-07-05T11:42:59.083 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 387 k 2022-07-05T11:42:59.083 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 368 k 2022-07-05T11:42:59.084 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 114 k 2022-07-05T11:42:59.084 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 88 k 2022-07-05T11:42:59.085 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.7 M 2022-07-05T11:42:59.085 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 173 k 2022-07-05T11:42:59.085 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-07-05T11:42:59.086 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2022-07-05T11:42:59.086 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-07-05T11:42:59.087 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-07-05T11:42:59.087 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-07-05T11:42:59.088 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-07-05T11:42:59.088 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.7 M 2022-07-05T11:42:59.089 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 4.2 M 2022-07-05T11:42:59.089 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2022-07-05T11:42:59.090 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-07-05T11:42:59.090 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 24 M 2022-07-05T11:42:59.090 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 24 k 2022-07-05T11:42:59.091 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 2.4 M 2022-07-05T11:42:59.092 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 240 k 2022-07-05T11:42:59.092 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 5.0 M 2022-07-05T11:42:59.092 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 18 M 2022-07-05T11:42:59.093 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 15 k 2022-07-05T11:42:59.093 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 26 k 2022-07-05T11:42:59.094 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-07-05T11:42:59.094 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-07-05T11:42:59.094 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-07-05T11:42:59.094 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-07-05T11:42:59.095 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-07-05T11:42:59.095 INFO:teuthology.orchestra.run.smithi149.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-07-05T11:42:59.095 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 173 k 2022-07-05T11:42:59.095 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-07-05T11:42:59.096 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-07-05T11:42:59.096 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-07-05T11:42:59.096 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-07-05T11:42:59.096 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-07-05T11:42:59.097 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 493 k 2022-07-05T11:42:59.097 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-07-05T11:42:59.097 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.8 M 2022-07-05T11:42:59.098 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-07-05T11:42:59.098 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-07-05T11:42:59.098 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-07-05T11:42:59.098 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-07-05T11:42:59.099 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-07-05T11:42:59.099 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-07-05T11:42:59.099 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-07-05T11:42:59.099 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-07-05T11:42:59.100 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-07-05T11:42:59.100 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-07-05T11:42:59.100 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-07-05T11:42:59.100 INFO:teuthology.orchestra.run.smithi149.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-07-05T11:42:59.100 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-07-05T11:42:59.101 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-07-05T11:42:59.101 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-07-05T11:42:59.101 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-07-05T11:42:59.101 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 45 k 2022-07-05T11:42:59.102 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 96 k 2022-07-05T11:42:59.102 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-07-05T11:42:59.102 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-07-05T11:42:59.102 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-07-05T11:42:59.103 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-07-05T11:42:59.103 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-07-05T11:42:59.103 INFO:teuthology.orchestra.run.smithi149.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-07-05T11:42:59.103 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-07-05T11:42:59.104 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-07-05T11:42:59.104 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-07-05T11:42:59.104 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-07-05T11:42:59.104 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-07-05T11:42:59.105 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-07-05T11:42:59.105 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-07-05T11:42:59.105 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-07-05T11:42:59.105 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-07-05T11:42:59.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-07-05T11:42:59.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-07-05T11:42:59.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-07-05T11:42:59.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-07-05T11:42:59.107 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-07-05T11:42:59.107 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-07-05T11:42:59.107 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-07-05T11:42:59.107 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-07-05T11:42:59.107 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-07-05T11:42:59.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-07-05T11:42:59.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-07-05T11:42:59.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-07-05T11:42:59.108 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-07-05T11:42:59.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-07-05T11:42:59.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-07-05T11:42:59.109 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-07-05T11:42:59.110 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-07-05T11:42:59.110 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-07-05T11:42:59.110 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-07-05T11:42:59.110 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-07-05T11:42:59.111 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-07-05T11:42:59.111 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-07-05T11:42:59.111 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-07-05T11:42:59.111 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-07-05T11:42:59.112 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-07-05T11:42:59.112 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-07-05T11:42:59.112 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-07-05T11:42:59.112 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-07-05T11:42:59.112 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-07-05T11:42:59.113 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-07-05T11:42:59.113 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-07-05T11:42:59.113 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-07-05T11:42:59.113 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-07-05T11:42:59.114 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:42:59.114 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2022-07-05T11:42:59.114 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================================================== 2022-07-05T11:42:59.114 INFO:teuthology.orchestra.run.smithi149.stdout:Install 122 Packages 2022-07-05T11:42:59.114 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 6 Packages 2022-07-05T11:42:59.115 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:42:59.115 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 206 M 2022-07-05T11:42:59.116 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2022-07-05T11:42:59.149 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-07-05T11:42:59.150 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-07-05T11:42:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-07-05T11:42:59.161 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-07-05T11:42:59.162 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-07-05T11:42:59.163 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-07-05T11:42:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-07-05T11:42:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-07-05T11:42:59.168 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-07-05T11:42:59.193 INFO:teuthology.orchestra.run.smithi149.stdout:(1/128): ceph-16.2.9-390.g494bbf8c.el8.x86_64.r 60 kB/s | 6.4 kB 00:00 2022-07-05T11:42:59.312 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-07-05T11:42:59.313 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-07-05T11:42:59.324 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-07-05T11:42:59.325 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-07-05T11:42:59.326 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-07-05T11:42:59.326 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-07-05T11:42:59.328 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-07-05T11:42:59.330 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-07-05T11:42:59.331 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-07-05T11:42:59.628 INFO:teuthology.orchestra.run.smithi149.stdout:(2/128): ceph-fuse-16.2.9-390.g494bbf8c.el8.x86 2.0 MB/s | 904 kB 00:00 2022-07-05T11:42:59.635 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2022-07-05T11:42:59.648 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================================================== 2022-07-05T11:42:59.648 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2022-07-05T11:42:59.649 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================================================== 2022-07-05T11:42:59.649 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2022-07-05T11:42:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-07-05T11:42:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 6.4 k 2022-07-05T11:42:59.650 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 6.0 M 2022-07-05T11:42:59.651 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 904 k 2022-07-05T11:42:59.651 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 161 k 2022-07-05T11:42:59.652 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 1.6 M 2022-07-05T11:42:59.652 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 113 k 2022-07-05T11:42:59.653 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 2.9 M 2022-07-05T11:42:59.653 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 8.6 M 2022-07-05T11:42:59.653 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 27 k 2022-07-05T11:42:59.654 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 12 M 2022-07-05T11:42:59.654 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 52 M 2022-07-05T11:42:59.655 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 81 k 2022-07-05T11:42:59.655 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 256 k 2022-07-05T11:42:59.656 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 14 k 2022-07-05T11:42:59.656 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-07-05T11:42:59.656 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-07-05T11:42:59.657 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-07-05T11:42:59.657 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 25 k 2022-07-05T11:42:59.658 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 818 k 2022-07-05T11:42:59.658 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 131 k 2022-07-05T11:42:59.659 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-07-05T11:42:59.659 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-07-05T11:42:59.659 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-07-05T11:42:59.660 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 215 k 2022-07-05T11:42:59.660 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 387 k 2022-07-05T11:42:59.661 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 368 k 2022-07-05T11:42:59.661 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 114 k 2022-07-05T11:42:59.661 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 88 k 2022-07-05T11:42:59.662 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.7 M 2022-07-05T11:42:59.662 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 173 k 2022-07-05T11:42:59.663 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-07-05T11:42:59.663 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2022-07-05T11:42:59.664 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-07-05T11:42:59.664 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-07-05T11:42:59.665 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-07-05T11:42:59.665 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-07-05T11:42:59.665 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.7 M 2022-07-05T11:42:59.666 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 4.2 M 2022-07-05T11:42:59.666 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2022-07-05T11:42:59.667 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-07-05T11:42:59.667 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 24 M 2022-07-05T11:42:59.668 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 24 k 2022-07-05T11:42:59.668 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 2.4 M 2022-07-05T11:42:59.669 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 240 k 2022-07-05T11:42:59.669 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 5.0 M 2022-07-05T11:42:59.669 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 18 M 2022-07-05T11:42:59.670 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 15 k 2022-07-05T11:42:59.670 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 26 k 2022-07-05T11:42:59.671 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-07-05T11:42:59.671 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-07-05T11:42:59.671 INFO:teuthology.orchestra.run.smithi110.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-07-05T11:42:59.672 INFO:teuthology.orchestra.run.smithi110.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-07-05T11:42:59.672 INFO:teuthology.orchestra.run.smithi110.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-07-05T11:42:59.673 INFO:teuthology.orchestra.run.smithi110.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-07-05T11:42:59.673 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 173 k 2022-07-05T11:42:59.673 INFO:teuthology.orchestra.run.smithi110.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-07-05T11:42:59.673 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-07-05T11:42:59.674 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-07-05T11:42:59.674 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-07-05T11:42:59.674 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-07-05T11:42:59.674 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 493 k 2022-07-05T11:42:59.675 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-07-05T11:42:59.675 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.8 M 2022-07-05T11:42:59.675 INFO:teuthology.orchestra.run.smithi110.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-07-05T11:42:59.675 INFO:teuthology.orchestra.run.smithi110.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-07-05T11:42:59.676 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-07-05T11:42:59.676 INFO:teuthology.orchestra.run.smithi110.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-07-05T11:42:59.676 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-07-05T11:42:59.676 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-07-05T11:42:59.677 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-07-05T11:42:59.677 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-07-05T11:42:59.677 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-07-05T11:42:59.678 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-07-05T11:42:59.678 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-07-05T11:42:59.678 INFO:teuthology.orchestra.run.smithi110.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-07-05T11:42:59.679 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-07-05T11:42:59.679 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-07-05T11:42:59.679 INFO:teuthology.orchestra.run.smithi110.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-07-05T11:42:59.679 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-07-05T11:42:59.680 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 45 k 2022-07-05T11:42:59.680 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 96 k 2022-07-05T11:42:59.680 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-07-05T11:42:59.680 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-07-05T11:42:59.680 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-07-05T11:42:59.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-07-05T11:42:59.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-07-05T11:42:59.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-07-05T11:42:59.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-07-05T11:42:59.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-07-05T11:42:59.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-07-05T11:42:59.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-07-05T11:42:59.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-07-05T11:42:59.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-07-05T11:42:59.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-07-05T11:42:59.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-07-05T11:42:59.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-07-05T11:42:59.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-07-05T11:42:59.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-07-05T11:42:59.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-07-05T11:42:59.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-07-05T11:42:59.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-07-05T11:42:59.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-07-05T11:42:59.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-07-05T11:42:59.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-07-05T11:42:59.687 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-07-05T11:42:59.687 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-07-05T11:42:59.687 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-07-05T11:42:59.687 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-07-05T11:42:59.687 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-07-05T11:42:59.688 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-07-05T11:42:59.688 INFO:teuthology.orchestra.run.smithi110.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-07-05T11:42:59.688 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-07-05T11:42:59.688 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-07-05T11:42:59.688 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-07-05T11:42:59.689 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-07-05T11:42:59.689 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-07-05T11:42:59.689 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-07-05T11:42:59.689 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-07-05T11:42:59.690 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-07-05T11:42:59.690 INFO:teuthology.orchestra.run.smithi110.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-07-05T11:42:59.690 INFO:teuthology.orchestra.run.smithi110.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-07-05T11:42:59.690 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-07-05T11:42:59.691 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-07-05T11:42:59.691 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-07-05T11:42:59.691 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-07-05T11:42:59.692 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-07-05T11:42:59.692 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-07-05T11:42:59.692 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-07-05T11:42:59.693 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-07-05T11:42:59.693 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:42:59.693 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2022-07-05T11:42:59.693 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================================================== 2022-07-05T11:42:59.693 INFO:teuthology.orchestra.run.smithi110.stdout:Install 122 Packages 2022-07-05T11:42:59.694 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 6 Packages 2022-07-05T11:42:59.694 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:42:59.695 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 206 M 2022-07-05T11:42:59.695 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2022-07-05T11:42:59.702 INFO:teuthology.orchestra.run.smithi149.stdout:(3/128): ceph-immutable-object-cache-16.2.9-390 2.1 MB/s | 161 kB 00:00 2022-07-05T11:42:59.798 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2022-07-05T11:42:59.812 INFO:teuthology.orchestra.run.smithi090.stdout:====================================================================================================================== 2022-07-05T11:42:59.812 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2022-07-05T11:42:59.813 INFO:teuthology.orchestra.run.smithi090.stdout:====================================================================================================================== 2022-07-05T11:42:59.813 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2022-07-05T11:42:59.814 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-07-05T11:42:59.814 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 6.4 k 2022-07-05T11:42:59.814 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 6.0 M 2022-07-05T11:42:59.815 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 904 k 2022-07-05T11:42:59.815 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 161 k 2022-07-05T11:42:59.816 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 1.6 M 2022-07-05T11:42:59.816 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 113 k 2022-07-05T11:42:59.817 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 2.9 M 2022-07-05T11:42:59.817 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 8.6 M 2022-07-05T11:42:59.817 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 27 k 2022-07-05T11:42:59.818 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 12 M 2022-07-05T11:42:59.818 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 52 M 2022-07-05T11:42:59.819 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 81 k 2022-07-05T11:42:59.819 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 256 k 2022-07-05T11:42:59.820 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 14 k 2022-07-05T11:42:59.820 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-07-05T11:42:59.821 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-07-05T11:42:59.821 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-07-05T11:42:59.821 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 25 k 2022-07-05T11:42:59.823 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 818 k 2022-07-05T11:42:59.824 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 131 k 2022-07-05T11:42:59.824 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-07-05T11:42:59.826 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-07-05T11:42:59.826 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-07-05T11:42:59.828 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 215 k 2022-07-05T11:42:59.828 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 387 k 2022-07-05T11:42:59.829 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 368 k 2022-07-05T11:42:59.829 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 114 k 2022-07-05T11:42:59.829 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 88 k 2022-07-05T11:42:59.829 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.7 M 2022-07-05T11:42:59.830 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 173 k 2022-07-05T11:42:59.830 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-07-05T11:42:59.830 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2022-07-05T11:42:59.830 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-07-05T11:42:59.831 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-07-05T11:42:59.831 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-07-05T11:42:59.831 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-07-05T11:42:59.831 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.7 M 2022-07-05T11:42:59.832 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 4.2 M 2022-07-05T11:42:59.832 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2022-07-05T11:42:59.832 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-07-05T11:42:59.833 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 24 M 2022-07-05T11:42:59.833 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 24 k 2022-07-05T11:42:59.833 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 2.4 M 2022-07-05T11:42:59.833 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 240 k 2022-07-05T11:42:59.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 5.0 M 2022-07-05T11:42:59.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 18 M 2022-07-05T11:42:59.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:16.2.9-390.g494bbf8c.el8 ceph-noarch 15 k 2022-07-05T11:42:59.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 26 k 2022-07-05T11:42:59.835 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-07-05T11:42:59.835 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-07-05T11:42:59.835 INFO:teuthology.orchestra.run.smithi090.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-07-05T11:42:59.836 INFO:teuthology.orchestra.run.smithi090.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-07-05T11:42:59.836 INFO:teuthology.orchestra.run.smithi090.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-07-05T11:42:59.836 INFO:teuthology.orchestra.run.smithi090.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-07-05T11:42:59.836 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 173 k 2022-07-05T11:42:59.836 INFO:teuthology.orchestra.run.smithi090.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-07-05T11:42:59.837 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-07-05T11:42:59.837 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-07-05T11:42:59.837 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-07-05T11:42:59.837 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-07-05T11:42:59.838 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 493 k 2022-07-05T11:42:59.838 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-07-05T11:42:59.838 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 3.8 M 2022-07-05T11:42:59.838 INFO:teuthology.orchestra.run.smithi090.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-07-05T11:42:59.838 INFO:teuthology.orchestra.run.smithi090.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-07-05T11:42:59.839 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-07-05T11:42:59.839 INFO:teuthology.orchestra.run.smithi090.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-07-05T11:42:59.839 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-07-05T11:42:59.839 INFO:teuthology.orchestra.run.smithi090.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-07-05T11:42:59.840 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-07-05T11:42:59.840 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-07-05T11:42:59.840 INFO:teuthology.orchestra.run.smithi090.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-07-05T11:42:59.840 INFO:teuthology.orchestra.run.smithi090.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-07-05T11:42:59.841 INFO:teuthology.orchestra.run.smithi090.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-07-05T11:42:59.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-07-05T11:42:59.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-07-05T11:42:59.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-07-05T11:42:59.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-07-05T11:42:59.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-07-05T11:42:59.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 45 k 2022-07-05T11:42:59.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:16.2.9-390.g494bbf8c.el8 ceph 96 k 2022-07-05T11:42:59.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-07-05T11:42:59.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-07-05T11:42:59.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-07-05T11:42:59.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-07-05T11:42:59.844 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-07-05T11:42:59.844 INFO:teuthology.orchestra.run.smithi090.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-07-05T11:42:59.844 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-07-05T11:42:59.844 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-07-05T11:42:59.845 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-07-05T11:42:59.845 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-07-05T11:42:59.845 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-07-05T11:42:59.845 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-07-05T11:42:59.846 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-07-05T11:42:59.846 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-07-05T11:42:59.846 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-07-05T11:42:59.846 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-07-05T11:42:59.847 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-07-05T11:42:59.847 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-07-05T11:42:59.847 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-07-05T11:42:59.848 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-07-05T11:42:59.848 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-07-05T11:42:59.848 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-07-05T11:42:59.848 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-07-05T11:42:59.848 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-07-05T11:42:59.849 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-07-05T11:42:59.849 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-07-05T11:42:59.849 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-07-05T11:42:59.849 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-07-05T11:42:59.850 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-07-05T11:42:59.850 INFO:teuthology.orchestra.run.smithi090.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-07-05T11:42:59.850 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-07-05T11:42:59.850 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-07-05T11:42:59.851 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-07-05T11:42:59.851 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-07-05T11:42:59.851 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-07-05T11:42:59.851 INFO:teuthology.orchestra.run.smithi090.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-07-05T11:42:59.851 INFO:teuthology.orchestra.run.smithi090.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-07-05T11:42:59.852 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-07-05T11:42:59.852 INFO:teuthology.orchestra.run.smithi090.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-07-05T11:42:59.852 INFO:teuthology.orchestra.run.smithi090.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-07-05T11:42:59.852 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-07-05T11:42:59.852 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-07-05T11:42:59.853 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-07-05T11:42:59.853 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-07-05T11:42:59.853 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-07-05T11:42:59.853 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-07-05T11:42:59.854 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-07-05T11:42:59.854 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-07-05T11:42:59.854 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:42:59.855 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2022-07-05T11:42:59.855 INFO:teuthology.orchestra.run.smithi090.stdout:====================================================================================================================== 2022-07-05T11:42:59.855 INFO:teuthology.orchestra.run.smithi090.stdout:Install 122 Packages 2022-07-05T11:42:59.855 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 6 Packages 2022-07-05T11:42:59.855 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:42:59.856 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 206 M 2022-07-05T11:42:59.856 INFO:teuthology.orchestra.run.smithi110.stdout:(1/128): ceph-16.2.9-390.g494bbf8c.el8.x86_64.r 42 kB/s | 6.4 kB 00:00 2022-07-05T11:42:59.857 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2022-07-05T11:43:00.022 INFO:teuthology.orchestra.run.smithi090.stdout:(1/128): ceph-16.2.9-390.g494bbf8c.el8.x86_64.r 32 kB/s | 6.4 kB 00:00 2022-07-05T11:43:00.082 INFO:teuthology.orchestra.run.smithi149.stdout:(4/128): ceph-base-16.2.9-390.g494bbf8c.el8.x86 6.0 MB/s | 6.0 MB 00:00 2022-07-05T11:43:00.288 INFO:teuthology.orchestra.run.smithi149.stdout:(5/128): ceph-mgr-16.2.9-390.g494bbf8c.el8.x86_ 7.8 MB/s | 1.6 MB 00:00 2022-07-05T11:43:00.436 INFO:teuthology.orchestra.run.smithi110.stdout:(2/128): ceph-fuse-16.2.9-390.g494bbf8c.el8.x86 1.4 MB/s | 904 kB 00:00 2022-07-05T11:43:00.441 INFO:teuthology.orchestra.run.smithi149.stdout:(6/128): ceph-mds-16.2.9-390.g494bbf8c.el8.x86_ 3.3 MB/s | 2.4 MB 00:00 2022-07-05T11:43:00.564 INFO:teuthology.orchestra.run.smithi110.stdout:(3/128): ceph-immutable-object-cache-16.2.9-390 1.2 MB/s | 161 kB 00:00 2022-07-05T11:43:00.778 INFO:teuthology.orchestra.run.smithi090.stdout:(2/128): ceph-fuse-16.2.9-390.g494bbf8c.el8.x86 1.2 MB/s | 904 kB 00:00 2022-07-05T11:43:00.904 INFO:teuthology.orchestra.run.smithi090.stdout:(3/128): ceph-immutable-object-cache-16.2.9-390 1.3 MB/s | 161 kB 00:00 2022-07-05T11:43:00.907 INFO:teuthology.orchestra.run.smithi149.stdout:(7/128): ceph-mon-16.2.9-390.g494bbf8c.el8.x86_ 8.1 MB/s | 5.0 MB 00:00 2022-07-05T11:43:01.766 INFO:teuthology.orchestra.run.smithi110.stdout:(4/128): ceph-mds-16.2.9-390.g494bbf8c.el8.x86_ 2.0 MB/s | 2.4 MB 00:01 2022-07-05T11:43:02.205 INFO:teuthology.orchestra.run.smithi090.stdout:(4/128): ceph-mds-16.2.9-390.g494bbf8c.el8.x86_ 1.9 MB/s | 2.4 MB 00:01 2022-07-05T11:43:02.538 INFO:teuthology.orchestra.run.smithi110.stdout:(5/128): ceph-mgr-16.2.9-390.g494bbf8c.el8.x86_ 2.1 MB/s | 1.6 MB 00:00 2022-07-05T11:43:02.636 INFO:teuthology.orchestra.run.smithi110.stdout:(6/128): ceph-base-16.2.9-390.g494bbf8c.el8.x86 2.0 MB/s | 6.0 MB 00:02 2022-07-05T11:43:03.016 INFO:teuthology.orchestra.run.smithi149.stdout:(8/128): ceph-radosgw-16.2.9-390.g494bbf8c.el8. 5.5 MB/s | 12 MB 00:02 2022-07-05T11:43:03.078 INFO:teuthology.orchestra.run.smithi149.stdout:(9/128): ceph-selinux-16.2.9-390.g494bbf8c.el8. 414 kB/s | 26 kB 00:00 2022-07-05T11:43:03.102 INFO:teuthology.orchestra.run.smithi090.stdout:(5/128): ceph-mgr-16.2.9-390.g494bbf8c.el8.x86_ 1.8 MB/s | 1.6 MB 00:00 2022-07-05T11:43:04.891 INFO:teuthology.orchestra.run.smithi149.stdout:(10/128): ceph-osd-16.2.9-390.g494bbf8c.el8.x86 4.1 MB/s | 18 MB 00:04 2022-07-05T11:43:04.948 INFO:teuthology.orchestra.run.smithi110.stdout:(7/128): ceph-mon-16.2.9-390.g494bbf8c.el8.x86_ 2.1 MB/s | 5.0 MB 00:02 2022-07-05T11:43:04.963 INFO:teuthology.orchestra.run.smithi149.stdout:(11/128): cephfs-mirror-16.2.9-390.g494bbf8c.el 3.4 MB/s | 256 kB 00:00 2022-07-05T11:43:05.031 INFO:teuthology.orchestra.run.smithi149.stdout:(12/128): libcephfs-devel-16.2.9-390.g494bbf8c. 373 kB/s | 25 kB 00:00 2022-07-05T11:43:05.261 INFO:teuthology.orchestra.run.smithi149.stdout:(13/128): libcephfs2-16.2.9-390.g494bbf8c.el8.x 3.5 MB/s | 818 kB 00:00 2022-07-05T11:43:05.333 INFO:teuthology.orchestra.run.smithi149.stdout:(14/128): libcephsqlite-16.2.9-390.g494bbf8c.el 2.4 MB/s | 173 kB 00:00 2022-07-05T11:43:05.372 INFO:teuthology.orchestra.run.smithi090.stdout:(6/128): ceph-mon-16.2.9-390.g494bbf8c.el8.x86_ 2.2 MB/s | 5.0 MB 00:02 2022-07-05T11:43:05.402 INFO:teuthology.orchestra.run.smithi149.stdout:(15/128): librados-devel-16.2.9-390.g494bbf8c.e 1.9 MB/s | 131 kB 00:00 2022-07-05T11:43:05.437 INFO:teuthology.orchestra.run.smithi090.stdout:(7/128): ceph-base-16.2.9-390.g494bbf8c.el8.x86 1.1 MB/s | 6.0 MB 00:05 2022-07-05T11:43:05.553 INFO:teuthology.orchestra.run.smithi149.stdout:(16/128): libradosstriper1-16.2.9-390.g494bbf8c 3.2 MB/s | 493 kB 00:00 2022-07-05T11:43:06.571 INFO:teuthology.orchestra.run.smithi149.stdout:(17/128): librgw2-16.2.9-390.g494bbf8c.el8.x86_ 3.7 MB/s | 3.8 MB 00:01 2022-07-05T11:43:06.640 INFO:teuthology.orchestra.run.smithi149.stdout:(18/128): python3-ceph-argparse-16.2.9-390.g494 661 kB/s | 45 kB 00:00 2022-07-05T11:43:06.710 INFO:teuthology.orchestra.run.smithi149.stdout:(19/128): python3-ceph-common-16.2.9-390.g494bb 1.3 MB/s | 96 kB 00:00 2022-07-05T11:43:06.786 INFO:teuthology.orchestra.run.smithi149.stdout:(20/128): python3-cephfs-16.2.9-390.g494bbf8c.e 2.8 MB/s | 215 kB 00:00 2022-07-05T11:43:06.928 INFO:teuthology.orchestra.run.smithi149.stdout:(21/128): python3-rados-16.2.9-390.g494bbf8c.el 2.7 MB/s | 387 kB 00:00 2022-07-05T11:43:07.064 INFO:teuthology.orchestra.run.smithi149.stdout:(22/128): python3-rbd-16.2.9-390.g494bbf8c.el8. 2.6 MB/s | 368 kB 00:00 2022-07-05T11:43:07.133 INFO:teuthology.orchestra.run.smithi149.stdout:(23/128): python3-rgw-16.2.9-390.g494bbf8c.el8. 1.6 MB/s | 114 kB 00:00 2022-07-05T11:43:07.196 INFO:teuthology.orchestra.run.smithi149.stdout:(24/128): rbd-fuse-16.2.9-390.g494bbf8c.el8.x86 1.4 MB/s | 88 kB 00:00 2022-07-05T11:43:08.103 INFO:teuthology.orchestra.run.smithi149.stdout:(25/128): rbd-mirror-16.2.9-390.g494bbf8c.el8.x 4.0 MB/s | 3.7 MB 00:00 2022-07-05T11:43:08.176 INFO:teuthology.orchestra.run.smithi149.stdout:(26/128): rbd-nbd-16.2.9-390.g494bbf8c.el8.x86_ 2.3 MB/s | 173 kB 00:00 2022-07-05T11:43:08.242 INFO:teuthology.orchestra.run.smithi149.stdout:(27/128): ceph-grafana-dashboards-16.2.9-390.g4 369 kB/s | 24 kB 00:00 2022-07-05T11:43:08.314 INFO:teuthology.orchestra.run.smithi149.stdout:(28/128): ceph-mgr-cephadm-16.2.9-390.g494bbf8c 1.5 MB/s | 113 kB 00:00 2022-07-05T11:43:09.074 INFO:teuthology.orchestra.run.smithi149.stdout:(29/128): ceph-mgr-dashboard-16.2.9-390.g494bbf 3.9 MB/s | 2.9 MB 00:00 2022-07-05T11:43:09.234 INFO:teuthology.orchestra.run.smithi149.stdout:(30/128): ceph-common-16.2.9-390.g494bbf8c.el8. 2.3 MB/s | 24 MB 00:10 2022-07-05T11:43:09.366 INFO:teuthology.orchestra.run.smithi149.stdout:(31/128): ceph-mgr-modules-core-16.2.9-390.g494 1.8 MB/s | 240 kB 00:00 2022-07-05T11:43:09.429 INFO:teuthology.orchestra.run.smithi149.stdout:(32/128): ceph-mgr-rook-16.2.9-390.g494bbf8c.el 439 kB/s | 27 kB 00:00 2022-07-05T11:43:09.491 INFO:teuthology.orchestra.run.smithi149.stdout:(33/128): ceph-prometheus-alerts-16.2.9-390.g49 241 kB/s | 15 kB 00:00 2022-07-05T11:43:09.557 INFO:teuthology.orchestra.run.smithi149.stdout:(34/128): cephadm-16.2.9-390.g494bbf8c.el8.noar 1.2 MB/s | 81 kB 00:00 2022-07-05T11:43:09.620 INFO:teuthology.orchestra.run.smithi149.stdout:(35/128): cephfs-top-16.2.9-390.g494bbf8c.el8.n 230 kB/s | 14 kB 00:00 2022-07-05T11:43:09.839 INFO:teuthology.orchestra.run.smithi149.stdout:(36/128): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2022-07-05T11:43:09.840 INFO:teuthology.orchestra.run.smithi110.stdout:(8/128): ceph-common-16.2.9-390.g494bbf8c.el8.x 2.3 MB/s | 24 MB 00:10 2022-07-05T11:43:09.885 INFO:teuthology.orchestra.run.smithi149.stdout:(37/128): leveldb-1.22-1.el8.x86_64.rpm 3.9 MB/s | 181 kB 00:00 2022-07-05T11:43:09.895 INFO:teuthology.orchestra.run.smithi110.stdout:(9/128): ceph-selinux-16.2.9-390.g494bbf8c.el8. 523 kB/s | 26 kB 00:00 2022-07-05T11:43:09.935 INFO:teuthology.orchestra.run.smithi149.stdout:(38/128): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2022-07-05T11:43:09.965 INFO:teuthology.orchestra.run.smithi110.stdout:(10/128): ceph-radosgw-16.2.9-390.g494bbf8c.el8 2.3 MB/s | 12 MB 00:05 2022-07-05T11:43:09.985 INFO:teuthology.orchestra.run.smithi149.stdout:(39/128): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2022-07-05T11:43:10.007 INFO:teuthology.orchestra.run.smithi090.stdout:(8/128): ceph-common-16.2.9-390.g494bbf8c.el8.x 2.3 MB/s | 24 MB 00:10 2022-07-05T11:43:10.040 INFO:teuthology.orchestra.run.smithi149.stdout:(40/128): python3-apipkg-1.5-6.el8.noarch.rpm 386 kB/s | 21 kB 00:00 2022-07-05T11:43:10.055 INFO:teuthology.orchestra.run.smithi090.stdout:(9/128): ceph-selinux-16.2.9-390.g494bbf8c.el8. 544 kB/s | 26 kB 00:00 2022-07-05T11:43:10.094 INFO:teuthology.orchestra.run.smithi149.stdout:(41/128): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 816 kB/s | 44 kB 00:00 2022-07-05T11:43:10.100 INFO:teuthology.orchestra.run.smithi110.stdout:(11/128): ceph-osd-16.2.9-390.g494bbf8c.el8.x86 2.4 MB/s | 18 MB 00:07 2022-07-05T11:43:10.102 INFO:teuthology.orchestra.run.smithi110.stdout:(12/128): cephfs-mirror-16.2.9-390.g494bbf8c.el 1.8 MB/s | 256 kB 00:00 2022-07-05T11:43:10.150 INFO:teuthology.orchestra.run.smithi149.stdout:(42/128): python3-beautifulsoup4-4.6.3-2.el8.1. 3.3 MB/s | 185 kB 00:00 2022-07-05T11:43:10.153 INFO:teuthology.orchestra.run.smithi110.stdout:(13/128): libcephfs-devel-16.2.9-390.g494bbf8c. 477 kB/s | 25 kB 00:00 2022-07-05T11:43:10.202 INFO:teuthology.orchestra.run.smithi149.stdout:(43/128): python3-cachetools-3.1.1-4.el8.noarch 638 kB/s | 33 kB 00:00 2022-07-05T11:43:10.214 INFO:teuthology.orchestra.run.smithi110.stdout:(14/128): libcephsqlite-16.2.9-390.g494bbf8c.el 2.8 MB/s | 173 kB 00:00 2022-07-05T11:43:10.258 INFO:teuthology.orchestra.run.smithi149.stdout:(44/128): python3-certifi-2018.10.15-7.el8.noar 287 kB/s | 16 kB 00:00 2022-07-05T11:43:10.276 INFO:teuthology.orchestra.run.smithi110.stdout:(15/128): librados-devel-16.2.9-390.g494bbf8c.e 2.1 MB/s | 131 kB 00:00 2022-07-05T11:43:10.319 INFO:teuthology.orchestra.run.smithi149.stdout:(45/128): python3-cheroot-8.5.2-1.el8.noarch.rp 2.8 MB/s | 173 kB 00:00 2022-07-05T11:43:10.399 INFO:teuthology.orchestra.run.smithi110.stdout:(16/128): libcephfs2-16.2.9-390.g494bbf8c.el8.x 2.7 MB/s | 818 kB 00:00 2022-07-05T11:43:10.442 INFO:teuthology.orchestra.run.smithi149.stdout:(46/128): python3-cherrypy-18.4.0-1.el8.noarch. 3.1 MB/s | 384 kB 00:00 2022-07-05T11:43:10.456 INFO:teuthology.orchestra.run.smithi110.stdout:(17/128): libradosstriper1-16.2.9-390.g494bbf8c 2.7 MB/s | 493 kB 00:00 2022-07-05T11:43:10.515 INFO:teuthology.orchestra.run.smithi110.stdout:(18/128): python3-ceph-argparse-16.2.9-390.g494 766 kB/s | 45 kB 00:00 2022-07-05T11:43:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:(47/128): python3-execnet-1.7.1-1.el8.noarch.rp 2.7 MB/s | 355 kB 00:00 2022-07-05T11:43:10.576 INFO:teuthology.orchestra.run.smithi110.stdout:(19/128): python3-ceph-common-16.2.9-390.g494bb 1.5 MB/s | 96 kB 00:00 2022-07-05T11:43:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:(48/128): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2022-07-05T11:43:10.661 INFO:teuthology.orchestra.run.smithi149.stdout:(49/128): python3-jaraco-6.2-6.el8.noarch.rpm 268 kB/s | 11 kB 00:00 2022-07-05T11:43:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:(20/128): python3-cephfs-16.2.9-390.g494bbf8c.e 1.7 MB/s | 215 kB 00:00 2022-07-05T11:43:10.703 INFO:teuthology.orchestra.run.smithi149.stdout:(50/128): ceph-mgr-diskprediction-local-16.2.9- 5.3 MB/s | 8.6 MB 00:01 2022-07-05T11:43:10.703 INFO:teuthology.orchestra.run.smithi149.stdout:(51/128): python3-jaraco-functools-2.0-4.el8.no 417 kB/s | 18 kB 00:00 2022-07-05T11:43:10.745 INFO:teuthology.orchestra.run.smithi149.stdout:(52/128): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2022-07-05T11:43:10.786 INFO:teuthology.orchestra.run.smithi149.stdout:(53/128): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2022-07-05T11:43:10.804 INFO:teuthology.orchestra.run.smithi110.stdout:(21/128): python3-rados-16.2.9-390.g494bbf8c.el 3.6 MB/s | 387 kB 00:00 2022-07-05T11:43:10.871 INFO:teuthology.orchestra.run.smithi149.stdout:(54/128): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2022-07-05T11:43:10.911 INFO:teuthology.orchestra.run.smithi149.stdout:(55/128): python3-portend-2.6-1.el8.noarch.rpm 391 kB/s | 16 kB 00:00 2022-07-05T11:43:10.912 INFO:teuthology.orchestra.run.smithi110.stdout:(22/128): python3-rbd-16.2.9-390.g494bbf8c.el8. 3.3 MB/s | 368 kB 00:00 2022-07-05T11:43:10.955 INFO:teuthology.orchestra.run.smithi149.stdout:(56/128): python3-remoto-1.2.1-1.el8.noarch.rpm 1.1 MB/s | 49 kB 00:00 2022-07-05T11:43:10.964 INFO:teuthology.orchestra.run.smithi110.stdout:(23/128): python3-rgw-16.2.9-390.g494bbf8c.el8. 2.2 MB/s | 114 kB 00:00 2022-07-05T11:43:10.992 INFO:teuthology.orchestra.run.smithi149.stdout:(57/128): python3-repoze-lru-0.7-6.el8.noarch.r 908 kB/s | 34 kB 00:00 2022-07-05T11:43:11.015 INFO:teuthology.orchestra.run.smithi110.stdout:(24/128): rbd-fuse-16.2.9-390.g494bbf8c.el8.x86 1.7 MB/s | 88 kB 00:00 2022-07-05T11:43:11.031 INFO:teuthology.orchestra.run.smithi149.stdout:(58/128): python3-routes-2.4.1-12.el8.noarch.rp 4.9 MB/s | 196 kB 00:00 2022-07-05T11:43:11.071 INFO:teuthology.orchestra.run.smithi149.stdout:(59/128): python3-rsa-4.8-1.el8.noarch.rpm 1.5 MB/s | 61 kB 00:00 2022-07-05T11:43:11.113 INFO:teuthology.orchestra.run.smithi149.stdout:(60/128): python3-simplegeneric-0.8.1-17.el8.no 450 kB/s | 19 kB 00:00 2022-07-05T11:43:11.134 INFO:teuthology.orchestra.run.smithi149.stdout:(61/128): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2022-07-05T11:43:11.152 INFO:teuthology.orchestra.run.smithi149.stdout:(62/128): python3-singledispatch-3.4.0.3-18.el8 616 kB/s | 24 kB 00:00 2022-07-05T11:43:11.181 INFO:teuthology.orchestra.run.smithi149.stdout:(63/128): python3-tempora-1.14.1-5.el8.noarch.r 623 kB/s | 29 kB 00:00 2022-07-05T11:43:11.192 INFO:teuthology.orchestra.run.smithi149.stdout:(64/128): python3-trustme-0.6.0-4.el8.noarch.rp 692 kB/s | 27 kB 00:00 2022-07-05T11:43:11.259 INFO:teuthology.orchestra.run.smithi149.stdout:(65/128): python3-waitress-1.2.1-2.el8.1.noarch 3.0 MB/s | 241 kB 00:00 2022-07-05T11:43:11.269 INFO:teuthology.orchestra.run.smithi149.stdout:(66/128): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2022-07-05T11:43:11.297 INFO:teuthology.orchestra.run.smithi149.stdout:(67/128): python3-websocket-client-0.56.0-5.el8 1.6 MB/s | 61 kB 00:00 2022-07-05T11:43:11.308 INFO:teuthology.orchestra.run.smithi149.stdout:(68/128): python3-webtest-2.0.33-1.el8.noarch.r 2.1 MB/s | 85 kB 00:00 2022-07-05T11:43:11.338 INFO:teuthology.orchestra.run.smithi149.stdout:(69/128): python3-zc-lockfile-2.0-2.el8.noarch. 615 kB/s | 23 kB 00:00 2022-07-05T11:43:11.354 INFO:teuthology.orchestra.run.smithi149.stdout:(70/128): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.5 MB/s | 69 kB 00:00 2022-07-05T11:43:11.385 INFO:teuthology.orchestra.run.smithi149.stdout:(71/128): libgfortran-8.4.1-1.el8.x86_64.rpm 12 MB/s | 639 kB 00:00 2022-07-05T11:43:11.393 INFO:teuthology.orchestra.run.smithi149.stdout:(72/128): python3-requests-oauthlib-1.0.0-1.el8 1.1 MB/s | 43 kB 00:00 2022-07-05T11:43:11.408 INFO:teuthology.orchestra.run.smithi149.stdout:(73/128): pcre2-utf16-10.32-2.el8.x86_64.rpm 10 MB/s | 229 kB 00:00 2022-07-05T11:43:11.422 INFO:teuthology.orchestra.run.smithi149.stdout:(74/128): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.3 MB/s | 70 kB 00:00 2022-07-05T11:43:11.445 INFO:teuthology.orchestra.run.smithi149.stdout:(75/128): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2022-07-05T11:43:11.456 INFO:teuthology.orchestra.run.smithi149.stdout:(76/128): python3-cffi-1.11.5-5.el8.x86_64.rpm 6.9 MB/s | 238 kB 00:00 2022-07-05T11:43:11.457 INFO:teuthology.orchestra.run.smithi110.stdout:(25/128): librgw2-16.2.9-390.g494bbf8c.el8.x86_ 3.6 MB/s | 3.8 MB 00:01 2022-07-05T11:43:11.466 INFO:teuthology.orchestra.run.smithi149.stdout:(77/128): libaio-devel-0.3.112-1.el8.x86_64.rpm 889 kB/s | 19 kB 00:00 2022-07-05T11:43:11.493 INFO:teuthology.orchestra.run.smithi149.stdout:(78/128): libquadmath-8.4.1-1.el8.x86_64.rpm 6.4 MB/s | 169 kB 00:00 2022-07-05T11:43:11.507 INFO:teuthology.orchestra.run.smithi149.stdout:(79/128): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 12 MB/s | 559 kB 00:00 2022-07-05T11:43:11.514 INFO:teuthology.orchestra.run.smithi110.stdout:(26/128): rbd-nbd-16.2.9-390.g494bbf8c.el8.x86_ 3.0 MB/s | 173 kB 00:00 2022-07-05T11:43:11.519 INFO:teuthology.orchestra.run.smithi149.stdout:(80/128): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.7 MB/s | 47 kB 00:00 2022-07-05T11:43:11.535 INFO:teuthology.orchestra.run.smithi149.stdout:(81/128): python3-oauthlib-2.1.0-1.el8.noarch.r 6.3 MB/s | 155 kB 00:00 2022-07-05T11:43:11.550 INFO:teuthology.orchestra.run.smithi149.stdout:(82/128): python3-pycparser-2.14-14.el8.noarch. 3.5 MB/s | 109 kB 00:00 2022-07-05T11:43:11.565 INFO:teuthology.orchestra.run.smithi110.stdout:(27/128): ceph-grafana-dashboards-16.2.9-390.g4 474 kB/s | 24 kB 00:00 2022-07-05T11:43:11.566 INFO:teuthology.orchestra.run.smithi149.stdout:(83/128): elfutils-libelf-devel-0.182-3.el8.x86 1.8 MB/s | 59 kB 00:00 2022-07-05T11:43:11.588 INFO:teuthology.orchestra.run.smithi149.stdout:(84/128): libverto-devel-0.3.0-5.el8.x86_64.rpm 473 kB/s | 18 kB 00:00 2022-07-05T11:43:11.596 INFO:teuthology.orchestra.run.smithi149.stdout:(85/128): libselinux-devel-2.9-5.el8.x86_64.rpm 6.5 MB/s | 200 kB 00:00 2022-07-05T11:43:11.615 INFO:teuthology.orchestra.run.smithi149.stdout:(86/128): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.9 MB/s | 220 kB 00:00 2022-07-05T11:43:11.620 INFO:teuthology.orchestra.run.smithi110.stdout:(28/128): ceph-mgr-cephadm-16.2.9-390.g494bbf8c 2.0 MB/s | 113 kB 00:00 2022-07-05T11:43:11.623 INFO:teuthology.orchestra.run.smithi149.stdout:(87/128): fuse-2.9.7-12.el8.x86_64.rpm 3.1 MB/s | 83 kB 00:00 2022-07-05T11:43:11.639 INFO:teuthology.orchestra.run.smithi149.stdout:(88/128): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.9 MB/s | 48 kB 00:00 2022-07-05T11:43:11.654 INFO:teuthology.orchestra.run.smithi149.stdout:(89/128): python3-cryptography-3.2.1-4.el8.x86_ 18 MB/s | 559 kB 00:00 2022-07-05T11:43:11.675 INFO:teuthology.orchestra.run.smithi149.stdout:(90/128): libcom_err-devel-1.45.6-1.el8.x86_64. 1.8 MB/s | 38 kB 00:00 2022-07-05T11:43:11.702 INFO:teuthology.orchestra.run.smithi149.stdout:(91/128): openssl-devel-1.1.1g-15.el8_3.x86_64. 37 MB/s | 2.3 MB 00:00 2022-07-05T11:43:11.702 INFO:teuthology.orchestra.run.smithi149.stdout:(92/128): libsepol-devel-2.9-2.el8.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2022-07-05T11:43:11.731 INFO:teuthology.orchestra.run.smithi149.stdout:(93/128): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2022-07-05T11:43:11.740 INFO:teuthology.orchestra.run.smithi149.stdout:(94/128): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.5 MB/s | 58 kB 00:00 2022-07-05T11:43:11.754 INFO:teuthology.orchestra.run.smithi149.stdout:(95/128): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.1 MB/s | 97 kB 00:00 2022-07-05T11:43:11.766 INFO:teuthology.orchestra.run.smithi149.stdout:(96/128): python3-pytz-2017.2-9.el8.noarch.rpm 2.0 MB/s | 54 kB 00:00 2022-07-05T11:43:11.786 INFO:teuthology.orchestra.run.smithi149.stdout:(97/128): python3-jinja2-2.10.1-2.el8_0.noarch. 17 MB/s | 538 kB 00:00 2022-07-05T11:43:11.793 INFO:teuthology.orchestra.run.smithi149.stdout:(98/128): python3-jsonpointer-1.10-11.el8.noarc 749 kB/s | 20 kB 00:00 2022-07-05T11:43:11.812 INFO:teuthology.orchestra.run.smithi149.stdout:(99/128): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.7 MB/s | 259 kB 00:00 2022-07-05T11:43:11.837 INFO:teuthology.orchestra.run.smithi090.stdout:(10/128): ceph-osd-16.2.9-390.g494bbf8c.el8.x86 2.8 MB/s | 18 MB 00:06 2022-07-05T11:43:11.838 INFO:teuthology.orchestra.run.smithi149.stdout:(100/128): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.8 MB/s | 126 kB 00:00 2022-07-05T11:43:11.862 INFO:teuthology.orchestra.run.smithi149.stdout:(101/128): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2022-07-05T11:43:11.928 INFO:teuthology.orchestra.run.smithi090.stdout:(11/128): cephfs-mirror-16.2.9-390.g494bbf8c.el 2.8 MB/s | 256 kB 00:00 2022-07-05T11:43:11.953 INFO:teuthology.orchestra.run.smithi110.stdout:(29/128): rbd-mirror-16.2.9-390.g494bbf8c.el8.x 3.9 MB/s | 3.7 MB 00:00 2022-07-05T11:43:11.961 INFO:teuthology.orchestra.run.smithi090.stdout:(12/128): libcephfs-devel-16.2.9-390.g494bbf8c. 775 kB/s | 25 kB 00:00 2022-07-05T11:43:12.095 INFO:teuthology.orchestra.run.smithi090.stdout:(13/128): ceph-radosgw-16.2.9-390.g494bbf8c.el8 1.7 MB/s | 12 MB 00:06 2022-07-05T11:43:12.132 INFO:teuthology.orchestra.run.smithi090.stdout:(14/128): libcephfs2-16.2.9-390.g494bbf8c.el8.x 4.7 MB/s | 818 kB 00:00 2022-07-05T11:43:12.169 INFO:teuthology.orchestra.run.smithi090.stdout:(15/128): libcephsqlite-16.2.9-390.g494bbf8c.el 2.3 MB/s | 173 kB 00:00 2022-07-05T11:43:12.173 INFO:teuthology.orchestra.run.smithi090.stdout:(16/128): librados-devel-16.2.9-390.g494bbf8c.e 3.1 MB/s | 131 kB 00:00 2022-07-05T11:43:12.283 INFO:teuthology.orchestra.run.smithi110.stdout:(30/128): ceph-mgr-dashboard-16.2.9-390.g494bbf 4.4 MB/s | 2.9 MB 00:00 2022-07-05T11:43:12.288 INFO:teuthology.orchestra.run.smithi149.stdout:(102/128): ceph-test-16.2.9-390.g494bbf8c.el8.x 5.6 MB/s | 52 MB 00:09 2022-07-05T11:43:12.308 INFO:teuthology.orchestra.run.smithi149.stdout:(103/128): python3-babel-2.5.1-5.el8.noarch.rpm 9.7 MB/s | 4.8 MB 00:00 2022-07-05T11:43:12.340 INFO:teuthology.orchestra.run.smithi090.stdout:(17/128): libradosstriper1-16.2.9-390.g494bbf8c 2.8 MB/s | 493 kB 00:00 2022-07-05T11:43:12.368 INFO:teuthology.orchestra.run.smithi110.stdout:(31/128): ceph-mgr-modules-core-16.2.9-390.g494 2.8 MB/s | 240 kB 00:00 2022-07-05T11:43:12.371 INFO:teuthology.orchestra.run.smithi149.stdout:(104/128): automake-1.16.1-7.el8.noarch.rpm 1.4 MB/s | 713 kB 00:00 2022-07-05T11:43:12.378 INFO:teuthology.orchestra.run.smithi090.stdout:(18/128): python3-ceph-argparse-16.2.9-390.g494 1.2 MB/s | 45 kB 00:00 2022-07-05T11:43:12.404 INFO:teuthology.orchestra.run.smithi110.stdout:(32/128): ceph-mgr-rook-16.2.9-390.g494bbf8c.el 768 kB/s | 27 kB 00:00 2022-07-05T11:43:12.409 INFO:teuthology.orchestra.run.smithi149.stdout:(105/128): python3-pyasn1-modules-0.3.7-6.el8.n 915 kB/s | 110 kB 00:00 2022-07-05T11:43:12.417 INFO:teuthology.orchestra.run.smithi090.stdout:(19/128): python3-ceph-common-16.2.9-390.g494bb 2.4 MB/s | 96 kB 00:00 2022-07-05T11:43:12.418 INFO:teuthology.orchestra.run.smithi149.stdout:(106/128): jq-1.5-12.el8.x86_64.rpm 1.5 MB/s | 161 kB 00:00 2022-07-05T11:43:12.434 INFO:teuthology.orchestra.run.smithi149.stdout:(107/128): socat-1.7.3.3-2.el8.x86_64.rpm 12 MB/s | 302 kB 00:00 2022-07-05T11:43:12.443 INFO:teuthology.orchestra.run.smithi110.stdout:(33/128): ceph-prometheus-alerts-16.2.9-390.g49 386 kB/s | 15 kB 00:00 2022-07-05T11:43:12.453 INFO:teuthology.orchestra.run.smithi149.stdout:(108/128): openblas-0.3.12-1.el8.x86_64.rpm 57 MB/s | 4.6 MB 00:00 2022-07-05T11:43:12.460 INFO:teuthology.orchestra.run.smithi149.stdout:(109/128): python3-werkzeug-0.12.2-4.el8.noarch 10 MB/s | 457 kB 00:00 2022-07-05T11:43:12.480 INFO:teuthology.orchestra.run.smithi149.stdout:(110/128): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2022-07-05T11:43:12.487 INFO:teuthology.orchestra.run.smithi110.stdout:(34/128): cephadm-16.2.9-390.g494bbf8c.el8.noar 1.8 MB/s | 81 kB 00:00 2022-07-05T11:43:12.495 INFO:teuthology.orchestra.run.smithi149.stdout:(111/128): bison-3.0.4-10.el8.x86_64.rpm 18 MB/s | 688 kB 00:00 2022-07-05T11:43:12.497 INFO:teuthology.orchestra.run.smithi090.stdout:(20/128): python3-cephfs-16.2.9-390.g494bbf8c.e 2.6 MB/s | 215 kB 00:00 2022-07-05T11:43:12.499 INFO:teuthology.orchestra.run.smithi149.stdout:(112/128): python3-markupsafe-0.23-19.el8.x86_6 1.2 MB/s | 39 kB 00:00 2022-07-05T11:43:12.513 INFO:teuthology.orchestra.run.smithi149.stdout:(113/128): python3-numpy-f2py-1.14.3-9.el8.x86_ 6.8 MB/s | 225 kB 00:00 2022-07-05T11:43:12.525 INFO:teuthology.orchestra.run.smithi110.stdout:(35/128): cephfs-top-16.2.9-390.g494bbf8c.el8.n 379 kB/s | 14 kB 00:00 2022-07-05T11:43:12.535 INFO:teuthology.orchestra.run.smithi149.stdout:(114/128): oniguruma-6.8.2-2.el8.x86_64.rpm 5.2 MB/s | 187 kB 00:00 2022-07-05T11:43:12.562 INFO:teuthology.orchestra.run.smithi149.stdout:(115/128): libtool-2.4.6-25.el8.x86_64.rpm 15 MB/s | 709 kB 00:00 2022-07-05T11:43:12.576 INFO:teuthology.orchestra.run.smithi149.stdout:(116/128): openblas-threads-0.3.12-1.el8.x86_64 62 MB/s | 4.7 MB 00:00 2022-07-05T11:43:12.577 INFO:teuthology.orchestra.run.smithi149.stdout:(117/128): python3-mako-1.0.6-13.el8.noarch.rpm 4.1 MB/s | 157 kB 00:00 2022-07-05T11:43:12.608 INFO:teuthology.orchestra.run.smithi149.stdout:(118/128): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.2 MB/s | 103 kB 00:00 2022-07-05T11:43:12.610 INFO:teuthology.orchestra.run.smithi149.stdout:(119/128): librdkafka-0.11.4-1.el8.x86_64.rpm 9.9 MB/s | 353 kB 00:00 2022-07-05T11:43:12.618 INFO:teuthology.orchestra.run.smithi090.stdout:(21/128): python3-rados-16.2.9-390.g494bbf8c.el 3.1 MB/s | 387 kB 00:00 2022-07-05T11:43:12.669 INFO:teuthology.orchestra.run.smithi149.stdout:(120/128): python3-numpy-1.14.3-9.el8.x86_64.rp 41 MB/s | 3.7 MB 00:00 2022-07-05T11:43:12.672 INFO:teuthology.orchestra.run.smithi149.stdout:(121/128): flex-2.6.1-9.el8.x86_64.rpm 4.9 MB/s | 320 kB 00:00 2022-07-05T11:43:12.725 INFO:teuthology.orchestra.run.smithi110.stdout:(36/128): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2022-07-05T11:43:12.741 INFO:teuthology.orchestra.run.smithi090.stdout:(22/128): python3-rbd-16.2.9-390.g494bbf8c.el8. 2.9 MB/s | 368 kB 00:00 2022-07-05T11:43:12.760 INFO:teuthology.orchestra.run.smithi110.stdout:(37/128): leveldb-1.22-1.el8.x86_64.rpm 5.0 MB/s | 181 kB 00:00 2022-07-05T11:43:12.789 INFO:teuthology.orchestra.run.smithi090.stdout:(23/128): librgw2-16.2.9-390.g494bbf8c.el8.x86_ 6.1 MB/s | 3.8 MB 00:00 2022-07-05T11:43:12.790 INFO:teuthology.orchestra.run.smithi090.stdout:(24/128): python3-rgw-16.2.9-390.g494bbf8c.el8. 2.3 MB/s | 114 kB 00:00 2022-07-05T11:43:12.793 INFO:teuthology.orchestra.run.smithi110.stdout:(38/128): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2022-07-05T11:43:12.821 INFO:teuthology.orchestra.run.smithi090.stdout:(25/128): rbd-fuse-16.2.9-390.g494bbf8c.el8.x86 2.7 MB/s | 88 kB 00:00 2022-07-05T11:43:12.826 INFO:teuthology.orchestra.run.smithi149.stdout:(122/128): python3-scipy-1.0.0-20.module+el8.1. 67 MB/s | 15 MB 00:00 2022-07-05T11:43:12.827 INFO:teuthology.orchestra.run.smithi110.stdout:(39/128): libunwind-1.3.1-3.el8.x86_64.rpm 2.2 MB/s | 75 kB 00:00 2022-07-05T11:43:12.852 INFO:teuthology.orchestra.run.smithi149.stdout:(123/128): NetworkManager-tui-1.30.0-13.el8_4.x 12 MB/s | 329 kB 00:00 2022-07-05T11:43:12.861 INFO:teuthology.orchestra.run.smithi110.stdout:(40/128): python3-apipkg-1.5-6.el8.noarch.rpm 636 kB/s | 21 kB 00:00 2022-07-05T11:43:12.870 INFO:teuthology.orchestra.run.smithi090.stdout:(26/128): rbd-nbd-16.2.9-390.g494bbf8c.el8.x86_ 3.5 MB/s | 173 kB 00:00 2022-07-05T11:43:12.877 INFO:teuthology.orchestra.run.smithi149.stdout:(124/128): NetworkManager-team-1.30.0-13.el8_4. 5.8 MB/s | 146 kB 00:00 2022-07-05T11:43:12.896 INFO:teuthology.orchestra.run.smithi110.stdout:(41/128): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.2 MB/s | 44 kB 00:00 2022-07-05T11:43:12.916 INFO:teuthology.orchestra.run.smithi149.stdout:(125/128): NetworkManager-1.30.0-13.el8_4.x86_6 67 MB/s | 2.6 MB 00:00 2022-07-05T11:43:12.922 INFO:teuthology.orchestra.run.smithi090.stdout:(27/128): ceph-grafana-dashboards-16.2.9-390.g4 471 kB/s | 24 kB 00:00 2022-07-05T11:43:12.942 INFO:teuthology.orchestra.run.smithi110.stdout:(42/128): python3-beautifulsoup4-4.6.3-2.el8.1. 3.9 MB/s | 185 kB 00:00 2022-07-05T11:43:12.965 INFO:teuthology.orchestra.run.smithi149.stdout:(126/128): NetworkManager-libnm-1.30.0-13.el8_4 36 MB/s | 1.8 MB 00:00 2022-07-05T11:43:12.976 INFO:teuthology.orchestra.run.smithi110.stdout:(43/128): python3-cachetools-3.1.1-4.el8.noarch 990 kB/s | 33 kB 00:00 2022-07-05T11:43:12.983 INFO:teuthology.orchestra.run.smithi090.stdout:(28/128): ceph-mgr-cephadm-16.2.9-390.g494bbf8c 1.8 MB/s | 113 kB 00:00 2022-07-05T11:43:13.010 INFO:teuthology.orchestra.run.smithi110.stdout:(44/128): python3-certifi-2018.10.15-7.el8.noar 482 kB/s | 16 kB 00:00 2022-07-05T11:43:13.048 INFO:teuthology.orchestra.run.smithi110.stdout:(45/128): python3-cheroot-8.5.2-1.el8.noarch.rp 4.5 MB/s | 173 kB 00:00 2022-07-05T11:43:13.117 INFO:teuthology.orchestra.run.smithi110.stdout:(46/128): python3-cherrypy-18.4.0-1.el8.noarch. 5.4 MB/s | 384 kB 00:00 2022-07-05T11:43:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:(47/128): python3-execnet-1.7.1-1.el8.noarch.rp 4.3 MB/s | 355 kB 00:00 2022-07-05T11:43:13.253 INFO:teuthology.orchestra.run.smithi110.stdout:(48/128): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2022-07-05T11:43:13.306 INFO:teuthology.orchestra.run.smithi110.stdout:(49/128): python3-jaraco-6.2-6.el8.noarch.rpm 211 kB/s | 11 kB 00:00 2022-07-05T11:43:13.354 INFO:teuthology.orchestra.run.smithi110.stdout:(50/128): python3-jaraco-functools-2.0-4.el8.no 375 kB/s | 18 kB 00:00 2022-07-05T11:43:13.550 INFO:teuthology.orchestra.run.smithi149.stdout:(127/128): librbd1-16.2.9-390.g494bbf8c.el8.x86 4.8 MB/s | 4.2 MB 00:00 2022-07-05T11:43:13.631 INFO:teuthology.orchestra.run.smithi110.stdout:(51/128): python3-kubernetes-11.0.0-6.el8.noarc 4.2 MB/s | 1.2 MB 00:00 2022-07-05T11:43:13.639 INFO:teuthology.orchestra.run.smithi149.stdout:(128/128): librados2-16.2.9-390.g494bbf8c.el8.x 3.9 MB/s | 3.7 MB 00:00 2022-07-05T11:43:13.642 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2022-07-05T11:43:13.643 INFO:teuthology.orchestra.run.smithi149.stdout:Total 14 MB/s | 206 MB 00:14 2022-07-05T11:43:13.654 INFO:teuthology.orchestra.run.smithi090.stdout:(29/128): ceph-mgr-dashboard-16.2.9-390.g494bbf 4.4 MB/s | 2.9 MB 00:00 2022-07-05T11:43:13.695 INFO:teuthology.orchestra.run.smithi110.stdout:(52/128): python3-logutils-0.3.5-11.el8.noarch. 760 kB/s | 49 kB 00:00 2022-07-05T11:43:13.698 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2022-07-05T11:43:13.776 INFO:teuthology.orchestra.run.smithi110.stdout:(53/128): ceph-mgr-diskprediction-local-16.2.9- 4.7 MB/s | 8.6 MB 00:01 2022-07-05T11:43:13.777 INFO:teuthology.orchestra.run.smithi110.stdout:(54/128): python3-more-itertools-7.2.0-3.el8.no 715 kB/s | 59 kB 00:00 2022-07-05T11:43:13.811 INFO:teuthology.orchestra.run.smithi110.stdout:(55/128): python3-portend-2.6-1.el8.noarch.rpm 472 kB/s | 16 kB 00:00 2022-07-05T11:43:13.821 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2022-07-05T11:43:13.822 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2022-07-05T11:43:13.845 INFO:teuthology.orchestra.run.smithi110.stdout:(56/128): python3-remoto-1.2.1-1.el8.noarch.rpm 1.4 MB/s | 49 kB 00:00 2022-07-05T11:43:13.878 INFO:teuthology.orchestra.run.smithi110.stdout:(57/128): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2022-07-05T11:43:13.914 INFO:teuthology.orchestra.run.smithi110.stdout:(58/128): python3-routes-2.4.1-12.el8.noarch.rp 5.5 MB/s | 196 kB 00:00 2022-07-05T11:43:13.948 INFO:teuthology.orchestra.run.smithi110.stdout:(59/128): python3-rsa-4.8-1.el8.noarch.rpm 1.8 MB/s | 61 kB 00:00 2022-07-05T11:43:13.953 INFO:teuthology.orchestra.run.smithi090.stdout:(30/128): rbd-mirror-16.2.9-390.g494bbf8c.el8.x 3.2 MB/s | 3.7 MB 00:01 2022-07-05T11:43:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:(60/128): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2022-07-05T11:43:13.980 INFO:teuthology.orchestra.run.smithi110.stdout:(61/128): python3-simplegeneric-0.8.1-17.el8.no 570 kB/s | 19 kB 00:00 2022-07-05T11:43:14.007 INFO:teuthology.orchestra.run.smithi110.stdout:(62/128): python3-singledispatch-3.4.0.3-18.el8 728 kB/s | 24 kB 00:00 2022-07-05T11:43:14.013 INFO:teuthology.orchestra.run.smithi110.stdout:(63/128): python3-tempora-1.14.1-5.el8.noarch.r 892 kB/s | 29 kB 00:00 2022-07-05T11:43:14.032 INFO:teuthology.orchestra.run.smithi090.stdout:(31/128): ceph-mgr-modules-core-16.2.9-390.g494 3.0 MB/s | 240 kB 00:00 2022-07-05T11:43:14.040 INFO:teuthology.orchestra.run.smithi110.stdout:(64/128): python3-trustme-0.6.0-4.el8.noarch.rp 836 kB/s | 27 kB 00:00 2022-07-05T11:43:14.049 INFO:teuthology.orchestra.run.smithi110.stdout:(65/128): python3-waitress-1.2.1-2.el8.1.noarch 6.7 MB/s | 241 kB 00:00 2022-07-05T11:43:14.069 INFO:teuthology.orchestra.run.smithi090.stdout:(32/128): ceph-mgr-rook-16.2.9-390.g494bbf8c.el 745 kB/s | 27 kB 00:00 2022-07-05T11:43:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:(66/128): python3-webob-1.8.5-1.el8.1.noarch.rp 7.0 MB/s | 251 kB 00:00 2022-07-05T11:43:14.082 INFO:teuthology.orchestra.run.smithi110.stdout:(67/128): python3-websocket-client-0.56.0-5.el8 1.8 MB/s | 61 kB 00:00 2022-07-05T11:43:14.106 INFO:teuthology.orchestra.run.smithi090.stdout:(33/128): ceph-prometheus-alerts-16.2.9-390.g49 408 kB/s | 15 kB 00:00 2022-07-05T11:43:14.110 INFO:teuthology.orchestra.run.smithi110.stdout:(68/128): python3-webtest-2.0.33-1.el8.noarch.r 2.4 MB/s | 85 kB 00:00 2022-07-05T11:43:14.115 INFO:teuthology.orchestra.run.smithi110.stdout:(69/128): python3-zc-lockfile-2.0-2.el8.noarch. 698 kB/s | 23 kB 00:00 2022-07-05T11:43:14.145 INFO:teuthology.orchestra.run.smithi090.stdout:(34/128): cephadm-16.2.9-390.g494bbf8c.el8.noar 2.0 MB/s | 81 kB 00:00 2022-07-05T11:43:14.146 INFO:teuthology.orchestra.run.smithi110.stdout:(70/128): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.9 MB/s | 69 kB 00:00 2022-07-05T11:43:14.148 INFO:teuthology.orchestra.run.smithi110.stdout:(71/128): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2022-07-05T11:43:14.183 INFO:teuthology.orchestra.run.smithi090.stdout:(35/128): cephfs-top-16.2.9-390.g494bbf8c.el8.n 387 kB/s | 14 kB 00:00 2022-07-05T11:43:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:(72/128): python3-jsonpointer-1.10-11.el8.noarc 574 kB/s | 20 kB 00:00 2022-07-05T11:43:14.191 INFO:teuthology.orchestra.run.smithi110.stdout:(73/128): python3-jinja2-2.10.1-2.el8_0.noarch. 12 MB/s | 538 kB 00:00 2022-07-05T11:43:14.208 INFO:teuthology.orchestra.run.smithi110.stdout:(74/128): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2022-07-05T11:43:14.220 INFO:teuthology.orchestra.run.smithi110.stdout:(75/128): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.3 MB/s | 126 kB 00:00 2022-07-05T11:43:14.249 INFO:teuthology.orchestra.run.smithi110.stdout:(76/128): python3-jsonpatch-1.21-2.el8.noarch.r 921 kB/s | 27 kB 00:00 2022-07-05T11:43:14.281 INFO:teuthology.orchestra.run.smithi110.stdout:(77/128): python3-babel-2.5.1-5.el8.noarch.rpm 70 MB/s | 4.8 MB 00:00 2022-07-05T11:43:14.290 INFO:teuthology.orchestra.run.smithi110.stdout:(78/128): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2022-07-05T11:43:14.304 INFO:teuthology.orchestra.run.smithi110.stdout:(79/128): python3-pyasn1-modules-0.3.7-6.el8.no 4.6 MB/s | 110 kB 00:00 2022-07-05T11:43:14.322 INFO:teuthology.orchestra.run.smithi110.stdout:(80/128): jq-1.5-12.el8.x86_64.rpm 5.0 MB/s | 161 kB 00:00 2022-07-05T11:43:14.352 INFO:teuthology.orchestra.run.smithi110.stdout:(81/128): socat-1.7.3.3-2.el8.x86_64.rpm 9.8 MB/s | 302 kB 00:00 2022-07-05T11:43:14.365 INFO:teuthology.orchestra.run.smithi110.stdout:(82/128): openblas-0.3.12-1.el8.x86_64.rpm 76 MB/s | 4.6 MB 00:00 2022-07-05T11:43:14.382 INFO:teuthology.orchestra.run.smithi090.stdout:(36/128): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2022-07-05T11:43:14.397 INFO:teuthology.orchestra.run.smithi110.stdout:(83/128): python3-werkzeug-0.12.2-4.el8.noarch. 10 MB/s | 457 kB 00:00 2022-07-05T11:43:14.398 INFO:teuthology.orchestra.run.smithi110.stdout:(84/128): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2022-07-05T11:43:14.418 INFO:teuthology.orchestra.run.smithi090.stdout:(37/128): leveldb-1.22-1.el8.x86_64.rpm 5.1 MB/s | 181 kB 00:00 2022-07-05T11:43:14.425 INFO:teuthology.orchestra.run.smithi110.stdout:(85/128): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2022-07-05T11:43:14.427 INFO:teuthology.orchestra.run.smithi110.stdout:(86/128): python3-markupsafe-0.23-19.el8.x86_64 1.3 MB/s | 39 kB 00:00 2022-07-05T11:43:14.451 INFO:teuthology.orchestra.run.smithi090.stdout:(38/128): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2022-07-05T11:43:14.458 INFO:teuthology.orchestra.run.smithi110.stdout:(87/128): python3-numpy-f2py-1.14.3-9.el8.x86_6 6.7 MB/s | 225 kB 00:00 2022-07-05T11:43:14.487 INFO:teuthology.orchestra.run.smithi090.stdout:(39/128): libunwind-1.3.1-3.el8.x86_64.rpm 2.1 MB/s | 75 kB 00:00 2022-07-05T11:43:14.491 INFO:teuthology.orchestra.run.smithi110.stdout:(88/128): openblas-threads-0.3.12-1.el8.x86_64. 74 MB/s | 4.7 MB 00:00 2022-07-05T11:43:14.511 INFO:teuthology.orchestra.run.smithi110.stdout:(89/128): oniguruma-6.8.2-2.el8.x86_64.rpm 3.5 MB/s | 187 kB 00:00 2022-07-05T11:43:14.521 INFO:teuthology.orchestra.run.smithi110.stdout:(90/128): libtool-2.4.6-25.el8.x86_64.rpm 26 MB/s | 709 kB 00:00 2022-07-05T11:43:14.522 INFO:teuthology.orchestra.run.smithi090.stdout:(40/128): python3-apipkg-1.5-6.el8.noarch.rpm 597 kB/s | 21 kB 00:00 2022-07-05T11:43:14.554 INFO:teuthology.orchestra.run.smithi110.stdout:(91/128): python3-mako-1.0.6-13.el8.noarch.rpm 3.6 MB/s | 157 kB 00:00 2022-07-05T11:43:14.558 INFO:teuthology.orchestra.run.smithi090.stdout:(41/128): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.2 MB/s | 44 kB 00:00 2022-07-05T11:43:14.564 INFO:teuthology.orchestra.run.smithi110.stdout:(92/128): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.6 MB/s | 103 kB 00:00 2022-07-05T11:43:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:(93/128): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2022-07-05T11:43:14.594 INFO:teuthology.orchestra.run.smithi090.stdout:(42/128): python3-beautifulsoup4-4.6.3-2.el8.1. 5.2 MB/s | 185 kB 00:00 2022-07-05T11:43:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:(94/128): python3-numpy-1.14.3-9.el8.x86_64.rpm 66 MB/s | 3.7 MB 00:00 2022-07-05T11:43:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:(95/128): flex-2.6.1-9.el8.x86_64.rpm 8.3 MB/s | 320 kB 00:00 2022-07-05T11:43:14.626 INFO:teuthology.orchestra.run.smithi090.stdout:(43/128): python3-cachetools-3.1.1-4.el8.noarch 1.0 MB/s | 33 kB 00:00 2022-07-05T11:43:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:(96/128): libgfortran-8.4.1-1.el8.x86_64.rpm 20 MB/s | 639 kB 00:00 2022-07-05T11:43:14.659 INFO:teuthology.orchestra.run.smithi090.stdout:(44/128): ceph-mgr-diskprediction-local-16.2.9- 8.5 MB/s | 8.6 MB 00:01 2022-07-05T11:43:14.676 INFO:teuthology.orchestra.run.smithi110.stdout:(97/128): python3-requests-oauthlib-1.0.0-1.el8 2.0 MB/s | 43 kB 00:00 2022-07-05T11:43:14.699 INFO:teuthology.orchestra.run.smithi090.stdout:(45/128): python3-certifi-2018.10.15-7.el8.noar 225 kB/s | 16 kB 00:00 2022-07-05T11:43:14.701 INFO:teuthology.orchestra.run.smithi110.stdout:(98/128): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.8 MB/s | 229 kB 00:00 2022-07-05T11:43:14.723 INFO:teuthology.orchestra.run.smithi110.stdout:(99/128): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.2 MB/s | 70 kB 00:00 2022-07-05T11:43:14.768 INFO:teuthology.orchestra.run.smithi090.stdout:(46/128): python3-cherrypy-18.4.0-1.el8.noarch. 5.5 MB/s | 384 kB 00:00 2022-07-05T11:43:14.836 INFO:teuthology.orchestra.run.smithi090.stdout:(47/128): python3-execnet-1.7.1-1.el8.noarch.rp 5.1 MB/s | 355 kB 00:00 2022-07-05T11:43:14.838 INFO:teuthology.orchestra.run.smithi090.stdout:(48/128): python3-cheroot-8.5.2-1.el8.noarch.rp 966 kB/s | 173 kB 00:00 2022-07-05T11:43:14.847 INFO:teuthology.orchestra.run.smithi110.stdout:(100/128): python3-scipy-1.0.0-20.module+el8.1. 65 MB/s | 15 MB 00:00 2022-07-05T11:43:14.847 INFO:teuthology.orchestra.run.smithi110.stdout:(101/128): python3-jwt-1.6.1-2.el8.noarch.rpm 343 kB/s | 43 kB 00:00 2022-07-05T11:43:14.870 INFO:teuthology.orchestra.run.smithi090.stdout:(49/128): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2022-07-05T11:43:14.872 INFO:teuthology.orchestra.run.smithi090.stdout:(50/128): python3-jaraco-6.2-6.el8.noarch.rpm 328 kB/s | 11 kB 00:00 2022-07-05T11:43:14.880 INFO:teuthology.orchestra.run.smithi110.stdout:(102/128): libaio-devel-0.3.112-1.el8.x86_64.rp 575 kB/s | 19 kB 00:00 2022-07-05T11:43:14.882 INFO:teuthology.orchestra.run.smithi110.stdout:(103/128): python3-cffi-1.11.5-5.el8.x86_64.rpm 6.6 MB/s | 238 kB 00:00 2022-07-05T11:43:14.901 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2022-07-05T11:43:14.903 INFO:teuthology.orchestra.run.smithi090.stdout:(51/128): python3-jaraco-functools-2.0-4.el8.no 531 kB/s | 18 kB 00:00 2022-07-05T11:43:14.905 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2022-07-05T11:43:14.916 INFO:teuthology.orchestra.run.smithi110.stdout:(104/128): libquadmath-8.4.1-1.el8.x86_64.rpm 4.9 MB/s | 169 kB 00:00 2022-07-05T11:43:14.918 INFO:teuthology.orchestra.run.smithi110.stdout:(105/128): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 14 MB/s | 559 kB 00:00 2022-07-05T11:43:14.937 INFO:teuthology.orchestra.run.smithi090.stdout:(52/128): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2022-07-05T11:43:14.943 INFO:teuthology.orchestra.run.smithi110.stdout:(106/128): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.7 MB/s | 47 kB 00:00 2022-07-05T11:43:14.953 INFO:teuthology.orchestra.run.smithi110.stdout:(107/128): python3-oauthlib-2.1.0-1.el8.noarch. 4.5 MB/s | 155 kB 00:00 2022-07-05T11:43:14.966 INFO:teuthology.orchestra.run.smithi110.stdout:(108/128): python3-pycparser-2.14-14.el8.noarch 4.7 MB/s | 109 kB 00:00 2022-07-05T11:43:14.971 INFO:teuthology.orchestra.run.smithi090.stdout:(53/128): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2022-07-05T11:43:14.979 INFO:teuthology.orchestra.run.smithi110.stdout:(109/128): elfutils-libelf-devel-0.182-3.el8.x8 2.2 MB/s | 59 kB 00:00 2022-07-05T11:43:14.996 INFO:teuthology.orchestra.run.smithi110.stdout:(110/128): libverto-devel-0.3.0-5.el8.x86_64.rp 606 kB/s | 18 kB 00:00 2022-07-05T11:43:15.006 INFO:teuthology.orchestra.run.smithi110.stdout:(111/128): libselinux-devel-2.9-5.el8.x86_64.rp 7.2 MB/s | 200 kB 00:00 2022-07-05T11:43:15.027 INFO:teuthology.orchestra.run.smithi110.stdout:(112/128): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.0 MB/s | 220 kB 00:00 2022-07-05T11:43:15.038 INFO:teuthology.orchestra.run.smithi090.stdout:(54/128): python3-pecan-1.3.2-9.el8.noarch.rpm 4.2 MB/s | 283 kB 00:00 2022-07-05T11:43:15.039 INFO:teuthology.orchestra.run.smithi110.stdout:(113/128): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 83 kB 00:00 2022-07-05T11:43:15.049 INFO:teuthology.orchestra.run.smithi090.stdout:(55/128): python3-kubernetes-11.0.0-6.el8.noarc 6.6 MB/s | 1.2 MB 00:00 2022-07-05T11:43:15.057 INFO:teuthology.orchestra.run.smithi110.stdout:(114/128): keyutils-libs-devel-1.5.10-6.el8.x86 1.5 MB/s | 48 kB 00:00 2022-07-05T11:43:15.072 INFO:teuthology.orchestra.run.smithi090.stdout:(56/128): python3-portend-2.6-1.el8.noarch.rpm 475 kB/s | 16 kB 00:00 2022-07-05T11:43:15.083 INFO:teuthology.orchestra.run.smithi090.stdout:(57/128): python3-remoto-1.2.1-1.el8.noarch.rpm 1.4 MB/s | 49 kB 00:00 2022-07-05T11:43:15.094 INFO:teuthology.orchestra.run.smithi110.stdout:(115/128): python3-cryptography-3.2.1-4.el8.x86 9.9 MB/s | 559 kB 00:00 2022-07-05T11:43:15.101 INFO:teuthology.orchestra.run.smithi110.stdout:(116/128): openssl-devel-1.1.1g-15.el8_3.x86_64 54 MB/s | 2.3 MB 00:00 2022-07-05T11:43:15.104 INFO:teuthology.orchestra.run.smithi090.stdout:(58/128): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2022-07-05T11:43:15.119 INFO:teuthology.orchestra.run.smithi090.stdout:(59/128): python3-routes-2.4.1-12.el8.noarch.rp 5.4 MB/s | 196 kB 00:00 2022-07-05T11:43:15.122 INFO:teuthology.orchestra.run.smithi110.stdout:(117/128): libcom_err-devel-1.45.6-1.el8.x86_64 1.3 MB/s | 38 kB 00:00 2022-07-05T11:43:15.130 INFO:teuthology.orchestra.run.smithi110.stdout:(118/128): libsepol-devel-2.9-2.el8.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2022-07-05T11:43:15.138 INFO:teuthology.orchestra.run.smithi090.stdout:(60/128): python3-rsa-4.8-1.el8.noarch.rpm 1.8 MB/s | 61 kB 00:00 2022-07-05T11:43:15.150 INFO:teuthology.orchestra.run.smithi110.stdout:(119/128): pcre2-devel-10.32-2.el8.x86_64.rpm 22 MB/s | 605 kB 00:00 2022-07-05T11:43:15.154 INFO:teuthology.orchestra.run.smithi090.stdout:(61/128): python3-simplegeneric-0.8.1-17.el8.no 540 kB/s | 19 kB 00:00 2022-07-05T11:43:15.159 INFO:teuthology.orchestra.run.smithi110.stdout:(120/128): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.0 MB/s | 58 kB 00:00 2022-07-05T11:43:15.171 INFO:teuthology.orchestra.run.smithi110.stdout:(121/128): libuuid-devel-2.32.1-27.el8.x86_64.r 4.5 MB/s | 97 kB 00:00 2022-07-05T11:43:15.173 INFO:teuthology.orchestra.run.smithi090.stdout:(62/128): python3-singledispatch-3.4.0.3-18.el8 681 kB/s | 24 kB 00:00 2022-07-05T11:43:15.189 INFO:teuthology.orchestra.run.smithi090.stdout:(63/128): python3-tempora-1.14.1-5.el8.noarch.r 842 kB/s | 29 kB 00:00 2022-07-05T11:43:15.208 INFO:teuthology.orchestra.run.smithi090.stdout:(64/128): python3-trustme-0.6.0-4.el8.noarch.rp 798 kB/s | 27 kB 00:00 2022-07-05T11:43:15.226 INFO:teuthology.orchestra.run.smithi090.stdout:(65/128): python3-waitress-1.2.1-2.el8.1.noarch 6.3 MB/s | 241 kB 00:00 2022-07-05T11:43:15.243 INFO:teuthology.orchestra.run.smithi090.stdout:(66/128): python3-webob-1.8.5-1.el8.1.noarch.rp 7.0 MB/s | 251 kB 00:00 2022-07-05T11:43:15.261 INFO:teuthology.orchestra.run.smithi090.stdout:(67/128): python3-websocket-client-0.56.0-5.el8 1.7 MB/s | 61 kB 00:00 2022-07-05T11:43:15.277 INFO:teuthology.orchestra.run.smithi090.stdout:(68/128): python3-webtest-2.0.33-1.el8.noarch.r 2.4 MB/s | 85 kB 00:00 2022-07-05T11:43:15.295 INFO:teuthology.orchestra.run.smithi090.stdout:(69/128): python3-zc-lockfile-2.0-2.el8.noarch. 684 kB/s | 23 kB 00:00 2022-07-05T11:43:15.312 INFO:teuthology.orchestra.run.smithi090.stdout:(70/128): xmlstarlet-1.6.1-11.el8.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2022-07-05T11:43:15.326 INFO:teuthology.orchestra.run.smithi090.stdout:(71/128): python3-pytz-2017.2-9.el8.noarch.rpm 1.7 MB/s | 54 kB 00:00 2022-07-05T11:43:15.357 INFO:teuthology.orchestra.run.smithi090.stdout:(72/128): python3-jinja2-2.10.1-2.el8_0.noarch. 12 MB/s | 538 kB 00:00 2022-07-05T11:43:15.358 INFO:teuthology.orchestra.run.smithi090.stdout:(73/128): python3-jsonpointer-1.10-11.el8.noarc 640 kB/s | 20 kB 00:00 2022-07-05T11:43:15.381 INFO:teuthology.orchestra.run.smithi090.stdout:(74/128): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.3 MB/s | 126 kB 00:00 2022-07-05T11:43:15.389 INFO:teuthology.orchestra.run.smithi090.stdout:(75/128): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.9 MB/s | 259 kB 00:00 2022-07-05T11:43:15.412 INFO:teuthology.orchestra.run.smithi090.stdout:(76/128): python3-jsonpatch-1.21-2.el8.noarch.r 1.1 MB/s | 27 kB 00:00 2022-07-05T11:43:15.443 INFO:teuthology.orchestra.run.smithi090.stdout:(77/128): python3-babel-2.5.1-5.el8.noarch.rpm 77 MB/s | 4.8 MB 00:00 2022-07-05T11:43:15.453 INFO:teuthology.orchestra.run.smithi090.stdout:(78/128): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2022-07-05T11:43:15.470 INFO:teuthology.orchestra.run.smithi090.stdout:(79/128): python3-pyasn1-modules-0.3.7-6.el8.no 4.1 MB/s | 110 kB 00:00 2022-07-05T11:43:15.477 INFO:teuthology.orchestra.run.smithi090.stdout:(80/128): jq-1.5-12.el8.x86_64.rpm 6.5 MB/s | 161 kB 00:00 2022-07-05T11:43:15.507 INFO:teuthology.orchestra.run.smithi090.stdout:(81/128): socat-1.7.3.3-2.el8.x86_64.rpm 9.9 MB/s | 302 kB 00:00 2022-07-05T11:43:15.530 INFO:teuthology.orchestra.run.smithi090.stdout:(82/128): openblas-0.3.12-1.el8.x86_64.rpm 78 MB/s | 4.6 MB 00:00 2022-07-05T11:43:15.546 INFO:teuthology.orchestra.run.smithi090.stdout:(83/128): python3-werkzeug-0.12.2-4.el8.noarch. 12 MB/s | 457 kB 00:00 2022-07-05T11:43:15.560 INFO:teuthology.orchestra.run.smithi090.stdout:(84/128): python3-prettytable-0.7.2-14.el8.noar 1.6 MB/s | 44 kB 00:00 2022-07-05T11:43:15.584 INFO:teuthology.orchestra.run.smithi090.stdout:(85/128): bison-3.0.4-10.el8.x86_64.rpm 20 MB/s | 688 kB 00:00 2022-07-05T11:43:15.585 INFO:teuthology.orchestra.run.smithi090.stdout:(86/128): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2022-07-05T11:43:15.608 INFO:teuthology.orchestra.run.smithi090.stdout:(87/128): python3-numpy-f2py-1.14.3-9.el8.x86_6 9.3 MB/s | 225 kB 00:00 2022-07-05T11:43:15.631 INFO:teuthology.orchestra.run.smithi090.stdout:(88/128): oniguruma-6.8.2-2.el8.x86_64.rpm 8.1 MB/s | 187 kB 00:00 2022-07-05T11:43:15.659 INFO:teuthology.orchestra.run.smithi090.stdout:(89/128): openblas-threads-0.3.12-1.el8.x86_64. 64 MB/s | 4.7 MB 00:00 2022-07-05T11:43:15.668 INFO:teuthology.orchestra.run.smithi090.stdout:(90/128): libtool-2.4.6-25.el8.x86_64.rpm 19 MB/s | 709 kB 00:00 2022-07-05T11:43:15.681 INFO:teuthology.orchestra.run.smithi090.stdout:(91/128): python3-mako-1.0.6-13.el8.noarch.rpm 6.9 MB/s | 157 kB 00:00 2022-07-05T11:43:15.693 INFO:teuthology.orchestra.run.smithi090.stdout:(92/128): python3-pyOpenSSL-19.0.0-1.el8.noarch 4.1 MB/s | 103 kB 00:00 2022-07-05T11:43:15.712 INFO:teuthology.orchestra.run.smithi090.stdout:(93/128): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2022-07-05T11:43:15.735 INFO:teuthology.orchestra.run.smithi090.stdout:(94/128): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2022-07-05T11:43:15.751 INFO:teuthology.orchestra.run.smithi090.stdout:(95/128): python3-numpy-1.14.3-9.el8.x86_64.rpm 64 MB/s | 3.7 MB 00:00 2022-07-05T11:43:15.781 INFO:teuthology.orchestra.run.smithi090.stdout:(96/128): libgfortran-8.4.1-1.el8.x86_64.rpm 21 MB/s | 639 kB 00:00 2022-07-05T11:43:15.800 INFO:teuthology.orchestra.run.smithi090.stdout:(97/128): python3-requests-oauthlib-1.0.0-1.el8 2.2 MB/s | 43 kB 00:00 2022-07-05T11:43:15.824 INFO:teuthology.orchestra.run.smithi090.stdout:(98/128): pcre2-utf16-10.32-2.el8.x86_64.rpm 9.6 MB/s | 229 kB 00:00 2022-07-05T11:43:15.845 INFO:teuthology.orchestra.run.smithi090.stdout:(99/128): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.5 MB/s | 70 kB 00:00 2022-07-05T11:43:15.948 INFO:teuthology.orchestra.run.smithi090.stdout:(100/128): python3-scipy-1.0.0-20.module+el8.1. 68 MB/s | 15 MB 00:00 2022-07-05T11:43:15.949 INFO:teuthology.orchestra.run.smithi090.stdout:(101/128): python3-jwt-1.6.1-2.el8.noarch.rpm 407 kB/s | 43 kB 00:00 2022-07-05T11:43:15.973 INFO:teuthology.orchestra.run.smithi090.stdout:(102/128): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.4 MB/s | 238 kB 00:00 2022-07-05T11:43:15.975 INFO:teuthology.orchestra.run.smithi090.stdout:(103/128): libaio-devel-0.3.112-1.el8.x86_64.rp 708 kB/s | 19 kB 00:00 2022-07-05T11:43:16.000 INFO:teuthology.orchestra.run.smithi090.stdout:(104/128): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 20 MB/s | 559 kB 00:00 2022-07-05T11:43:16.003 INFO:teuthology.orchestra.run.smithi090.stdout:(105/128): libquadmath-8.4.1-1.el8.x86_64.rpm 6.0 MB/s | 169 kB 00:00 2022-07-05T11:43:16.022 INFO:teuthology.orchestra.run.smithi090.stdout:(106/128): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.1 MB/s | 47 kB 00:00 2022-07-05T11:43:16.034 INFO:teuthology.orchestra.run.smithi090.stdout:(107/128): python3-oauthlib-2.1.0-1.el8.noarch. 5.6 MB/s | 155 kB 00:00 2022-07-05T11:43:16.043 INFO:teuthology.orchestra.run.smithi110.stdout:(122/128): librbd1-16.2.9-390.g494bbf8c.el8.x86 4.8 MB/s | 4.2 MB 00:00 2022-07-05T11:43:16.046 INFO:teuthology.orchestra.run.smithi090.stdout:(108/128): python3-pycparser-2.14-14.el8.noarch 4.5 MB/s | 109 kB 00:00 2022-07-05T11:43:16.058 INFO:teuthology.orchestra.run.smithi090.stdout:(109/128): elfutils-libelf-devel-0.182-3.el8.x8 2.4 MB/s | 59 kB 00:00 2022-07-05T11:43:16.066 INFO:teuthology.orchestra.run.smithi110.stdout:(123/128): NetworkManager-tui-1.30.0-13.el8_4.x 14 MB/s | 329 kB 00:00 2022-07-05T11:43:16.069 INFO:teuthology.orchestra.run.smithi090.stdout:(110/128): libverto-devel-0.3.0-5.el8.x86_64.rp 776 kB/s | 18 kB 00:00 2022-07-05T11:43:16.087 INFO:teuthology.orchestra.run.smithi110.stdout:(124/128): NetworkManager-team-1.30.0-13.el8_4. 7.1 MB/s | 146 kB 00:00 2022-07-05T11:43:16.088 INFO:teuthology.orchestra.run.smithi090.stdout:(111/128): libselinux-devel-2.9-5.el8.x86_64.rp 7.6 MB/s | 200 kB 00:00 2022-07-05T11:43:16.097 INFO:teuthology.orchestra.run.smithi090.stdout:(112/128): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.7 MB/s | 220 kB 00:00 2022-07-05T11:43:16.116 INFO:teuthology.orchestra.run.smithi090.stdout:(113/128): fuse-2.9.7-12.el8.x86_64.rpm 2.9 MB/s | 83 kB 00:00 2022-07-05T11:43:16.118 INFO:teuthology.orchestra.run.smithi110.stdout:(125/128): librados2-16.2.9-390.g494bbf8c.el8.x 3.9 MB/s | 3.7 MB 00:00 2022-07-05T11:43:16.123 INFO:teuthology.orchestra.run.smithi090.stdout:(114/128): keyutils-libs-devel-1.5.10-6.el8.x86 1.9 MB/s | 48 kB 00:00 2022-07-05T11:43:16.142 INFO:teuthology.orchestra.run.smithi110.stdout:(126/128): NetworkManager-1.30.0-13.el8_4.x86_6 46 MB/s | 2.6 MB 00:00 2022-07-05T11:43:16.143 INFO:teuthology.orchestra.run.smithi090.stdout:(115/128): python3-cryptography-3.2.1-4.el8.x86 21 MB/s | 559 kB 00:00 2022-07-05T11:43:16.153 INFO:teuthology.orchestra.run.smithi110.stdout:(127/128): NetworkManager-libnm-1.30.0-13.el8_4 52 MB/s | 1.8 MB 00:00 2022-07-05T11:43:16.163 INFO:teuthology.orchestra.run.smithi090.stdout:(116/128): libcom_err-devel-1.45.6-1.el8.x86_64 1.9 MB/s | 38 kB 00:00 2022-07-05T11:43:16.169 INFO:teuthology.orchestra.run.smithi090.stdout:(117/128): openssl-devel-1.1.1g-15.el8_3.x86_64 50 MB/s | 2.3 MB 00:00 2022-07-05T11:43:16.192 INFO:teuthology.orchestra.run.smithi090.stdout:(118/128): libsepol-devel-2.9-2.el8.x86_64.rpm 2.9 MB/s | 86 kB 00:00 2022-07-05T11:43:16.207 INFO:teuthology.orchestra.run.smithi090.stdout:(119/128): pcre2-devel-10.32-2.el8.x86_64.rpm 16 MB/s | 605 kB 00:00 2022-07-05T11:43:16.214 INFO:teuthology.orchestra.run.smithi090.stdout:(120/128): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.6 MB/s | 58 kB 00:00 2022-07-05T11:43:16.226 INFO:teuthology.orchestra.run.smithi090.stdout:(121/128): libuuid-devel-2.32.1-27.el8.x86_64.r 5.1 MB/s | 97 kB 00:00 2022-07-05T11:43:16.727 INFO:teuthology.orchestra.run.smithi090.stdout:(122/128): ceph-test-16.2.9-390.g494bbf8c.el8.x 7.8 MB/s | 52 MB 00:06 2022-07-05T11:43:16.751 INFO:teuthology.orchestra.run.smithi090.stdout:(123/128): NetworkManager-tui-1.30.0-13.el8_4.x 14 MB/s | 329 kB 00:00 2022-07-05T11:43:16.772 INFO:teuthology.orchestra.run.smithi090.stdout:(124/128): NetworkManager-team-1.30.0-13.el8_4. 6.9 MB/s | 146 kB 00:00 2022-07-05T11:43:16.809 INFO:teuthology.orchestra.run.smithi090.stdout:(125/128): NetworkManager-1.30.0-13.el8_4.x86_6 68 MB/s | 2.6 MB 00:00 2022-07-05T11:43:16.842 INFO:teuthology.orchestra.run.smithi090.stdout:(126/128): NetworkManager-libnm-1.30.0-13.el8_4 56 MB/s | 1.8 MB 00:00 2022-07-05T11:43:16.881 INFO:teuthology.orchestra.run.smithi090.stdout:(127/128): librados2-16.2.9-390.g494bbf8c.el8.x 5.6 MB/s | 3.7 MB 00:00 2022-07-05T11:43:17.077 INFO:teuthology.orchestra.run.smithi090.stdout:(128/128): librbd1-16.2.9-390.g494bbf8c.el8.x86 4.9 MB/s | 4.2 MB 00:00 2022-07-05T11:43:17.081 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2022-07-05T11:43:17.081 INFO:teuthology.orchestra.run.smithi090.stdout:Total 12 MB/s | 206 MB 00:17 2022-07-05T11:43:17.138 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2022-07-05T11:43:17.261 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2022-07-05T11:43:17.262 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2022-07-05T11:43:17.283 INFO:teuthology.orchestra.run.smithi110.stdout:(128/128): ceph-test-16.2.9-390.g494bbf8c.el8.x 7.0 MB/s | 52 MB 00:07 2022-07-05T11:43:17.288 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2022-07-05T11:43:17.289 INFO:teuthology.orchestra.run.smithi110.stdout:Total 12 MB/s | 206 MB 00:17 2022-07-05T11:43:17.350 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2022-07-05T11:43:17.475 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2022-07-05T11:43:17.476 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2022-07-05T11:43:18.333 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2022-07-05T11:43:18.337 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2022-07-05T11:43:18.549 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2022-07-05T11:43:18.555 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2022-07-05T11:43:20.197 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2022-07-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-07-05T11:43:20.423 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/134 2022-07-05T11:43:20.671 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/134 2022-07-05T11:43:20.865 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/134 2022-07-05T11:43:20.954 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/134 2022-07-05T11:43:21.230 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2022-07-05T11:43:21.618 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2022-07-05T11:43:21.847 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 5/134 2022-07-05T11:43:22.264 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 5/134 2022-07-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:43:22.597 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:43:22.780 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:43:22.902 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:43:23.111 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:43:23.627 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2022-07-05T11:43:23.690 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2022-07-05T11:43:23.717 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-07-05T11:43:23.967 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2022-07-05T11:43:23.970 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/134 2022-07-05T11:43:23.995 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-07-05T11:43:24.105 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:43:24.198 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/134 2022-07-05T11:43:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/134 2022-07-05T11:43:24.270 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:43:24.452 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/134 2022-07-05T11:43:24.494 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2022-07-05T11:43:24.656 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2022-07-05T11:43:24.704 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2022-07-05T11:43:24.847 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:43:24.863 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/134 2022-07-05T11:43:24.953 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/134 2022-07-05T11:43:24.955 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:43:25.122 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 14/134 2022-07-05T11:43:25.206 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2022-07-05T11:43:25.255 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2022-07-05T11:43:25.392 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 14/134 2022-07-05T11:43:25.477 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/134 2022-07-05T11:43:25.575 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/134 2022-07-05T11:43:25.593 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2022-07-05T11:43:25.663 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-07-05T11:43:25.727 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-07-05T11:43:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:43:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2022-07-05T11:43:25.964 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:26.221 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2022-07-05T11:43:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:43:26.230 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:26.463 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:43:26.481 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:43:26.560 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:43:26.828 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2022-07-05T11:43:26.864 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:43:27.012 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/134 2022-07-05T11:43:27.078 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:43:27.098 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:43:27.160 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 19/134 2022-07-05T11:43:27.208 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:43:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:43:27.393 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 20/134 2022-07-05T11:43:27.403 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:43:27.498 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:43:27.621 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 21/134 2022-07-05T11:43:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 9/134 2022-07-05T11:43:27.771 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 21/134 2022-07-05T11:43:27.931 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:43:27.971 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 22/134 2022-07-05T11:43:27.998 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 9/134 2022-07-05T11:43:28.026 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:43:28.187 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:43:28.252 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2022-07-05T11:43:28.300 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:43:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2022-07-05T11:43:28.487 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 22/134 2022-07-05T11:43:28.524 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2022-07-05T11:43:28.631 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:43:28.701 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2022-07-05T11:43:28.714 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.12-1.el8.x86_64 23/134 2022-07-05T11:43:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:43:28.887 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:43:28.889 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 14/134 2022-07-05T11:43:28.993 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:43:29.128 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 14/134 2022-07-05T11:43:29.139 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 14/134 2022-07-05T11:43:29.248 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 23/134 2022-07-05T11:43:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 14/134 2022-07-05T11:43:29.435 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-07-05T11:43:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-07-05T11:43:29.529 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 24/134 2022-07-05T11:43:29.725 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:29.728 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-07-05T11:43:29.792 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-07-05T11:43:30.039 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:30.054 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:30.242 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 24/134 2022-07-05T11:43:30.368 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:30.532 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 25/134 2022-07-05T11:43:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 17/134 2022-07-05T11:43:30.646 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:30.794 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2022-07-05T11:43:30.836 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 18/134 2022-07-05T11:43:30.957 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-07-05T11:43:30.966 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 18/134 2022-07-05T11:43:31.001 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x 27/134 2022-07-05T11:43:31.172 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8 28/134 2022-07-05T11:43:31.175 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 17/134 2022-07-05T11:43:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 19/134 2022-07-05T11:43:31.395 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 18/134 2022-07-05T11:43:31.406 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 29/134 2022-07-05T11:43:31.565 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 18/134 2022-07-05T11:43:31.629 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/134 2022-07-05T11:43:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 19/134 2022-07-05T11:43:31.769 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 19/134 2022-07-05T11:43:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.12-1.el8.x86_64 20/134 2022-07-05T11:43:32.294 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 19/134 2022-07-05T11:43:32.472 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 20/134 2022-07-05T11:43:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.12-1.el8.x86_64 20/134 2022-07-05T11:43:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/134 2022-07-05T11:43:33.045 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 20/134 2022-07-05T11:43:33.245 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/134 2022-07-05T11:43:33.396 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/134 2022-07-05T11:43:33.633 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/134 2022-07-05T11:43:33.644 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 22/134 2022-07-05T11:43:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2022-07-05T11:43:33.979 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/134 2022-07-05T11:43:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/134 2022-07-05T11:43:34.242 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 22/134 2022-07-05T11:43:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/134 2022-07-05T11:43:34.478 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2022-07-05T11:43:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2022-07-05T11:43:34.711 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/134 2022-07-05T11:43:34.722 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 31/134 2022-07-05T11:43:34.886 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x 27/134 2022-07-05T11:43:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/134 2022-07-05T11:43:35.035 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 32/134 2022-07-05T11:43:35.064 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8 28/134 2022-07-05T11:43:35.226 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2022-07-05T11:43:35.328 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 33/134 2022-07-05T11:43:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x 27/134 2022-07-05T11:43:35.596 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/134 2022-07-05T11:43:35.642 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8 28/134 2022-07-05T11:43:35.842 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/134 2022-07-05T11:43:36.028 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 29/134 2022-07-05T11:43:36.056 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2022-07-05T11:43:36.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 37/134 2022-07-05T11:43:36.404 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/134 2022-07-05T11:43:36.508 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 38/134 2022-07-05T11:43:36.586 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 29/134 2022-07-05T11:43:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/134 2022-07-05T11:43:36.681 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 39/134 2022-07-05T11:43:36.870 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/134 2022-07-05T11:43:36.928 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/134 2022-07-05T11:43:36.947 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/134 2022-07-05T11:43:36.988 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/134 2022-07-05T11:43:37.120 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.5-12.el8.x86_64 41/134 2022-07-05T11:43:37.144 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/134 2022-07-05T11:43:37.222 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/134 2022-07-05T11:43:37.332 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 42/134 2022-07-05T11:43:37.455 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/134 2022-07-05T11:43:37.606 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 43/134 2022-07-05T11:43:37.711 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/134 2022-07-05T11:43:37.835 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.1-7.el8.noarch 44/134 2022-07-05T11:43:38.002 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 45/134 2022-07-05T11:43:38.186 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 46/134 2022-07-05T11:43:38.354 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 47/134 2022-07-05T11:43:38.546 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 48/134 2022-07-05T11:43:38.745 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 49/134 2022-07-05T11:43:38.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 50/134 2022-07-05T11:43:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/134 2022-07-05T11:43:39.234 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/134 2022-07-05T11:43:39.305 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/134 2022-07-05T11:43:39.491 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 53/134 2022-07-05T11:43:39.576 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 34/134 2022-07-05T11:43:39.715 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 54/134 2022-07-05T11:43:39.720 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/134 2022-07-05T11:43:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/134 2022-07-05T11:43:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2022-07-05T11:43:40.093 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 34/134 2022-07-05T11:43:40.149 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 55/134 2022-07-05T11:43:40.288 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 37/134 2022-07-05T11:43:40.354 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/134 2022-07-05T11:43:40.465 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 56/134 2022-07-05T11:43:40.467 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 38/134 2022-07-05T11:43:40.539 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2022-07-05T11:43:40.657 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 57/134 2022-07-05T11:43:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 39/134 2022-07-05T11:43:40.804 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 37/134 2022-07-05T11:43:40.870 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 40/134 2022-07-05T11:43:40.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/134 2022-07-05T11:43:40.983 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 38/134 2022-07-05T11:43:41.042 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 41/134 2022-07-05T11:43:41.159 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/134 2022-07-05T11:43:41.170 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 39/134 2022-07-05T11:43:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 42/134 2022-07-05T11:43:41.332 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 40/134 2022-07-05T11:43:41.386 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/134 2022-07-05T11:43:41.448 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 43/134 2022-07-05T11:43:41.483 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 41/134 2022-07-05T11:43:41.571 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/134 2022-07-05T11:43:41.666 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/134 2022-07-05T11:43:41.712 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 42/134 2022-07-05T11:43:41.814 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 62/134 2022-07-05T11:43:41.815 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 45/134 2022-07-05T11:43:41.881 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 43/134 2022-07-05T11:43:41.999 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/134 2022-07-05T11:43:42.086 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 63/134 2022-07-05T11:43:42.107 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/134 2022-07-05T11:43:42.214 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 47/134 2022-07-05T11:43:42.280 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 45/134 2022-07-05T11:43:42.376 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2022-07-05T11:43:42.449 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/134 2022-07-05T11:43:42.588 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 48/134 2022-07-05T11:43:42.661 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2022-07-05T11:43:42.691 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 47/134 2022-07-05T11:43:42.862 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 66/134 2022-07-05T11:43:42.883 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 49/134 2022-07-05T11:43:43.069 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 67/134 2022-07-05T11:43:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 50/134 2022-07-05T11:43:43.130 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 48/134 2022-07-05T11:43:43.265 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2022-07-05T11:43:43.338 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/134 2022-07-05T11:43:43.416 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 49/134 2022-07-05T11:43:43.563 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2022-07-05T11:43:43.616 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 50/134 2022-07-05T11:43:43.660 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 52/134 2022-07-05T11:43:43.759 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2022-07-05T11:43:43.854 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 53/134 2022-07-05T11:43:43.897 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/134 2022-07-05T11:43:43.957 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2022-07-05T11:43:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 54/134 2022-07-05T11:43:44.117 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2022-07-05T11:43:44.184 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 52/134 2022-07-05T11:43:44.299 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 55/134 2022-07-05T11:43:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2022-07-05T11:43:44.395 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 53/134 2022-07-05T11:43:44.564 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2022-07-05T11:43:44.571 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 54/134 2022-07-05T11:43:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 56/134 2022-07-05T11:43:44.780 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 75/134 2022-07-05T11:43:44.814 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 55/134 2022-07-05T11:43:44.918 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 57/134 2022-07-05T11:43:44.948 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 76/134 2022-07-05T11:43:45.086 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 56/134 2022-07-05T11:43:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/134 2022-07-05T11:43:45.243 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 77/134 2022-07-05T11:43:45.385 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 57/134 2022-07-05T11:43:45.415 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 59/134 2022-07-05T11:43:45.439 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 78/134 2022-07-05T11:43:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 60/134 2022-07-05T11:43:45.652 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/134 2022-07-05T11:43:45.667 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 79/134 2022-07-05T11:43:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 60/134 2022-07-05T11:43:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 59/134 2022-07-05T11:43:45.890 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jq-1.5-12.el8.x86_64 61/134 2022-07-05T11:43:45.935 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-2.6-1.el8.noarch 80/134 2022-07-05T11:43:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2022-07-05T11:43:46.069 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 60/134 2022-07-05T11:43:46.143 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 60/134 2022-07-05T11:43:46.193 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/134 2022-07-05T11:43:46.328 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jq-1.5-12.el8.x86_64 61/134 2022-07-05T11:43:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 63/134 2022-07-05T11:43:46.377 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 82/134 2022-07-05T11:43:46.540 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2022-07-05T11:43:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.1-7.el8.noarch 64/134 2022-07-05T11:43:46.614 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 83/134 2022-07-05T11:43:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 65/134 2022-07-05T11:43:46.805 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 63/134 2022-07-05T11:43:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 66/134 2022-07-05T11:43:47.018 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.1-7.el8.noarch 64/134 2022-07-05T11:43:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 67/134 2022-07-05T11:43:47.202 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 65/134 2022-07-05T11:43:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2022-07-05T11:43:47.405 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 66/134 2022-07-05T11:43:47.578 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 67/134 2022-07-05T11:43:47.656 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2022-07-05T11:43:47.740 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 84/134 2022-07-05T11:43:47.809 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2022-07-05T11:43:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2022-07-05T11:43:48.024 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/134 2022-07-05T11:43:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2022-07-05T11:43:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2022-07-05T11:43:48.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2022-07-05T11:43:48.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 86/134 2022-07-05T11:43:48.335 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2022-07-05T11:43:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2022-07-05T11:43:48.499 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2022-07-05T11:43:48.632 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 87/134 2022-07-05T11:43:48.723 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2022-07-05T11:43:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2022-07-05T11:43:48.932 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 75/134 2022-07-05T11:43:48.948 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2022-07-05T11:43:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/134 2022-07-05T11:43:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 76/134 2022-07-05T11:43:49.225 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2022-07-05T11:43:49.252 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 89/134 2022-07-05T11:43:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 77/134 2022-07-05T11:43:49.406 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 75/134 2022-07-05T11:43:49.541 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 78/134 2022-07-05T11:43:49.550 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 90/134 2022-07-05T11:43:49.612 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 76/134 2022-07-05T11:43:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 79/134 2022-07-05T11:43:49.777 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 91/134 2022-07-05T11:43:49.857 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 77/134 2022-07-05T11:43:49.993 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2022-07-05T11:43:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-2.6-1.el8.noarch 80/134 2022-07-05T11:43:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 78/134 2022-07-05T11:43:50.168 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2022-07-05T11:43:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 79/134 2022-07-05T11:43:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/134 2022-07-05T11:43:50.556 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 82/134 2022-07-05T11:43:50.603 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-2.6-1.el8.noarch 80/134 2022-07-05T11:43:50.753 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 83/134 2022-07-05T11:43:50.937 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/134 2022-07-05T11:43:51.148 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 82/134 2022-07-05T11:43:51.411 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 83/134 2022-07-05T11:43:51.908 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 84/134 2022-07-05T11:43:52.201 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/134 2022-07-05T11:43:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 86/134 2022-07-05T11:43:52.524 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 84/134 2022-07-05T11:43:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 87/134 2022-07-05T11:43:52.826 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/134 2022-07-05T11:43:53.078 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/134 2022-07-05T11:43:53.080 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 86/134 2022-07-05T11:43:53.339 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 89/134 2022-07-05T11:43:53.428 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 87/134 2022-07-05T11:43:53.589 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 90/134 2022-07-05T11:43:53.676 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/134 2022-07-05T11:43:53.820 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 91/134 2022-07-05T11:43:53.986 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 89/134 2022-07-05T11:43:54.029 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2022-07-05T11:43:54.228 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2022-07-05T11:43:54.234 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 90/134 2022-07-05T11:43:54.470 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 91/134 2022-07-05T11:43:54.477 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:43:54.652 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2022-07-05T11:43:54.718 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:43:54.836 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2022-07-05T11:43:55.411 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:43:56.569 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 95/134 2022-07-05T11:43:56.646 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 95/134 2022-07-05T11:43:56.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 96/134 2022-07-05T11:43:58.585 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:43:58.819 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:43:59.509 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:43:59.851 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 95/134 2022-07-05T11:43:59.956 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 95/134 2022-07-05T11:44:00.084 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 96/134 2022-07-05T11:44:00.359 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:44:00.560 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:44:01.246 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 94/134 2022-07-05T11:44:01.528 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 95/134 2022-07-05T11:44:01.633 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 95/134 2022-07-05T11:44:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 96/134 2022-07-05T11:44:14.543 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 96/134 2022-07-05T11:44:14.543 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2022-07-05T11:44:14.544 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2022-07-05T11:44:14.544 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2022-07-05T11:44:14.544 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /run 2022-07-05T11:44:14.544 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2022-07-05T11:44:14.544 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2022-07-05T11:44:14.545 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2022-07-05T11:44:14.545 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2022-07-05T11:44:14.545 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2022-07-05T11:44:14.545 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:14.956 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 97/134 2022-07-05T11:44:15.381 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 97/134 2022-07-05T11:44:15.547 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 98/134 2022-07-05T11:44:17.027 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 98/134 2022-07-05T11:44:17.222 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 99/134 2022-07-05T11:44:17.244 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 99/134 2022-07-05T11:44:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 96/134 2022-07-05T11:44:17.903 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2022-07-05T11:44:17.903 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2022-07-05T11:44:17.903 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /dev 2022-07-05T11:44:17.904 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /run 2022-07-05T11:44:17.904 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2022-07-05T11:44:17.904 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2022-07-05T11:44:17.904 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2022-07-05T11:44:17.905 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2022-07-05T11:44:17.905 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /dev 2022-07-05T11:44:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:18.300 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 97/134 2022-07-05T11:44:18.725 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 97/134 2022-07-05T11:44:18.891 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 98/134 2022-07-05T11:44:19.552 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 100/134 2022-07-05T11:44:19.762 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 100/134 2022-07-05T11:44:19.886 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el 101/134 2022-07-05T11:44:19.901 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 96/134 2022-07-05T11:44:19.902 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2022-07-05T11:44:19.902 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2022-07-05T11:44:19.902 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /dev 2022-07-05T11:44:19.902 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /run 2022-07-05T11:44:19.903 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2022-07-05T11:44:19.903 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2022-07-05T11:44:19.903 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2022-07-05T11:44:19.903 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2022-07-05T11:44:19.904 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /dev 2022-07-05T11:44:19.904 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:20.074 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.e 102/134 2022-07-05T11:44:20.238 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 103/134 2022-07-05T11:44:20.310 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 97/134 2022-07-05T11:44:20.369 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 98/134 2022-07-05T11:44:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 99/134 2022-07-05T11:44:20.622 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 99/134 2022-07-05T11:44:20.735 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 97/134 2022-07-05T11:44:20.909 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 98/134 2022-07-05T11:44:21.132 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 103/134 2022-07-05T11:44:21.410 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 104/134 2022-07-05T11:44:22.383 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 98/134 2022-07-05T11:44:22.455 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 104/134 2022-07-05T11:44:22.585 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 99/134 2022-07-05T11:44:22.607 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 99/134 2022-07-05T11:44:22.646 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 105/134 2022-07-05T11:44:22.742 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 105/134 2022-07-05T11:44:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 100/134 2022-07-05T11:44:23.111 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8 106/134 2022-07-05T11:44:23.310 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 107/134 2022-07-05T11:44:23.339 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 107/134 2022-07-05T11:44:23.343 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 100/134 2022-07-05T11:44:23.455 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el 101/134 2022-07-05T11:44:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 108/134 2022-07-05T11:44:23.516 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 108/134 2022-07-05T11:44:23.644 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.e 102/134 2022-07-05T11:44:23.832 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 103/134 2022-07-05T11:44:24.557 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 109/134 2022-07-05T11:44:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 103/134 2022-07-05T11:44:24.777 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 110/134 2022-07-05T11:44:24.865 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 110/134 2022-07-05T11:44:25.004 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:16.2.9-390.g494bbf 111/134 2022-07-05T11:44:25.014 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 100/134 2022-07-05T11:44:25.030 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 104/134 2022-07-05T11:44:25.047 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.9-390.g494bbf 111/134 2022-07-05T11:44:25.229 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 112/134 2022-07-05T11:44:25.255 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 100/134 2022-07-05T11:44:25.407 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el 101/134 2022-07-05T11:44:25.569 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.e 102/134 2022-07-05T11:44:25.574 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 112/134 2022-07-05T11:44:25.768 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 103/134 2022-07-05T11:44:25.779 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 113/134 2022-07-05T11:44:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 104/134 2022-07-05T11:44:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 105/134 2022-07-05T11:44:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 105/134 2022-07-05T11:44:26.672 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 103/134 2022-07-05T11:44:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8 106/134 2022-07-05T11:44:26.935 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 104/134 2022-07-05T11:44:26.947 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 107/134 2022-07-05T11:44:26.975 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 107/134 2022-07-05T11:44:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 108/134 2022-07-05T11:44:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 108/134 2022-07-05T11:44:27.974 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 104/134 2022-07-05T11:44:28.151 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 105/134 2022-07-05T11:44:28.215 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 109/134 2022-07-05T11:44:28.249 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 105/134 2022-07-05T11:44:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 110/134 2022-07-05T11:44:28.546 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 110/134 2022-07-05T11:44:28.643 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8 106/134 2022-07-05T11:44:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:16.2.9-390.g494bbf 111/134 2022-07-05T11:44:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.9-390.g494bbf 111/134 2022-07-05T11:44:28.877 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 107/134 2022-07-05T11:44:28.904 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 107/134 2022-07-05T11:44:28.973 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 112/134 2022-07-05T11:44:29.059 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 108/134 2022-07-05T11:44:29.070 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 108/134 2022-07-05T11:44:29.318 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 112/134 2022-07-05T11:44:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 113/134 2022-07-05T11:44:30.285 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 113/134 2022-07-05T11:44:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 109/134 2022-07-05T11:44:30.627 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 110/134 2022-07-05T11:44:30.719 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 110/134 2022-07-05T11:44:30.867 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:16.2.9-390.g494bbf 111/134 2022-07-05T11:44:30.911 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.9-390.g494bbf 111/134 2022-07-05T11:44:31.109 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 112/134 2022-07-05T11:44:31.258 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 114/134 2022-07-05T11:44:31.453 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 112/134 2022-07-05T11:44:31.617 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 113/134 2022-07-05T11:44:31.618 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 115/134 2022-07-05T11:44:31.815 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 116/134 2022-07-05T11:44:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 117/134 2022-07-05T11:44:32.261 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-25.el8.x86_64 118/134 2022-07-05T11:44:32.273 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 118/134 2022-07-05T11:44:32.441 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_6 119/134 2022-07-05T11:44:32.657 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 120/134 2022-07-05T11:44:32.831 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/134 2022-07-05T11:44:32.991 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 122/134 2022-07-05T11:44:33.202 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 123/134 2022-07-05T11:44:33.377 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 124/134 2022-07-05T11:44:33.611 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 125/134 2022-07-05T11:44:33.819 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/134 2022-07-05T11:44:33.905 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/134 2022-07-05T11:44:33.989 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 113/134 2022-07-05T11:44:34.119 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.0.4-10.el8.x86_64 127/134 2022-07-05T11:44:34.133 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 127/134 2022-07-05T11:44:34.280 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 128/134 2022-07-05T11:44:34.318 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 114/134 2022-07-05T11:44:34.430 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 129/134 2022-07-05T11:44:34.430 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-07-05T11:44:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/134 2022-07-05T11:44:34.638 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-07-05T11:44:34.790 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 131/134 2022-07-05T11:44:34.800 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:34.800 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:35.173 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/134 2022-07-05T11:44:35.290 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:35.290 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-07-05T11:44:35.513 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 116/134 2022-07-05T11:44:35.531 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-07-05T11:44:35.531 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/134 2022-07-05T11:44:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 117/134 2022-07-05T11:44:35.861 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 118/134 2022-07-05T11:44:36.051 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_6 119/134 2022-07-05T11:44:36.111 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 113/134 2022-07-05T11:44:36.209 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 120/134 2022-07-05T11:44:36.394 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/134 2022-07-05T11:44:36.395 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 1/134 2022-07-05T11:44:36.395 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 2/134 2022-07-05T11:44:36.395 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 3/134 2022-07-05T11:44:36.396 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 4/134 2022-07-05T11:44:36.396 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:16.2.9-390.g494bbf 5/134 2022-07-05T11:44:36.396 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:44:36.396 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:44:36.397 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:44:36.397 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 9/134 2022-07-05T11:44:36.397 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:44:36.397 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 11/134 2022-07-05T11:44:36.397 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 12/134 2022-07-05T11:44:36.398 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:44:36.398 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_6 14/134 2022-07-05T11:44:36.398 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 15/134 2022-07-05T11:44:36.398 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 16/134 2022-07-05T11:44:36.399 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 17/134 2022-07-05T11:44:36.399 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 18/134 2022-07-05T11:44:36.399 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 19/134 2022-07-05T11:44:36.399 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8 20/134 2022-07-05T11:44:36.399 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x 21/134 2022-07-05T11:44:36.400 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 22/134 2022-07-05T11:44:36.400 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 23/134 2022-07-05T11:44:36.400 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 24/134 2022-07-05T11:44:36.401 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 25/134 2022-07-05T11:44:36.401 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 26/134 2022-07-05T11:44:36.401 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 27/134 2022-07-05T11:44:36.401 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 28/134 2022-07-05T11:44:36.402 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.e 29/134 2022-07-05T11:44:36.402 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 30/134 2022-07-05T11:44:36.414 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 31/134 2022-07-05T11:44:36.414 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 32/134 2022-07-05T11:44:36.415 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8 33/134 2022-07-05T11:44:36.415 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 34/134 2022-07-05T11:44:36.415 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el 35/134 2022-07-05T11:44:36.415 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 36/134 2022-07-05T11:44:36.416 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 37/134 2022-07-05T11:44:36.416 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/134 2022-07-05T11:44:36.416 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/134 2022-07-05T11:44:36.416 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2022-07-05T11:44:36.416 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2022-07-05T11:44:36.417 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/134 2022-07-05T11:44:36.417 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2022-07-05T11:44:36.417 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2022-07-05T11:44:36.418 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2022-07-05T11:44:36.418 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2022-07-05T11:44:36.418 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2022-07-05T11:44:36.418 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2022-07-05T11:44:36.419 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/134 2022-07-05T11:44:36.419 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/134 2022-07-05T11:44:36.419 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/134 2022-07-05T11:44:36.419 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/134 2022-07-05T11:44:36.420 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/134 2022-07-05T11:44:36.420 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/134 2022-07-05T11:44:36.421 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/134 2022-07-05T11:44:36.421 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2022-07-05T11:44:36.421 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2022-07-05T11:44:36.422 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/134 2022-07-05T11:44:36.422 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/134 2022-07-05T11:44:36.422 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/134 2022-07-05T11:44:36.423 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/134 2022-07-05T11:44:36.423 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/134 2022-07-05T11:44:36.423 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/134 2022-07-05T11:44:36.423 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/134 2022-07-05T11:44:36.424 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/134 2022-07-05T11:44:36.424 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/134 2022-07-05T11:44:36.424 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/134 2022-07-05T11:44:36.424 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/134 2022-07-05T11:44:36.424 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/134 2022-07-05T11:44:36.425 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2022-07-05T11:44:36.425 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 71/134 2022-07-05T11:44:36.425 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 72/134 2022-07-05T11:44:36.425 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/134 2022-07-05T11:44:36.426 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 74/134 2022-07-05T11:44:36.426 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 75/134 2022-07-05T11:44:36.426 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 76/134 2022-07-05T11:44:36.426 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 77/134 2022-07-05T11:44:36.427 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/134 2022-07-05T11:44:36.427 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 79/134 2022-07-05T11:44:36.427 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 80/134 2022-07-05T11:44:36.427 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 81/134 2022-07-05T11:44:36.428 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/134 2022-07-05T11:44:36.428 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 83/134 2022-07-05T11:44:36.428 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 84/134 2022-07-05T11:44:36.429 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2022-07-05T11:44:36.429 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 86/134 2022-07-05T11:44:36.429 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 87/134 2022-07-05T11:44:36.429 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 88/134 2022-07-05T11:44:36.430 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 89/134 2022-07-05T11:44:36.430 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 90/134 2022-07-05T11:44:36.430 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 91/134 2022-07-05T11:44:36.430 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 92/134 2022-07-05T11:44:36.431 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 93/134 2022-07-05T11:44:36.431 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 94/134 2022-07-05T11:44:36.431 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 95/134 2022-07-05T11:44:36.432 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 96/134 2022-07-05T11:44:36.432 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/134 2022-07-05T11:44:36.432 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 98/134 2022-07-05T11:44:36.432 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/134 2022-07-05T11:44:36.433 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 100/134 2022-07-05T11:44:36.433 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 101/134 2022-07-05T11:44:36.433 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 102/134 2022-07-05T11:44:36.433 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/134 2022-07-05T11:44:36.434 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.1-7.el8.noarch 104/134 2022-07-05T11:44:36.434 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 105/134 2022-07-05T11:44:36.434 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.5-12.el8.x86_64 106/134 2022-07-05T11:44:36.434 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 107/134 2022-07-05T11:44:36.435 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 108/134 2022-07-05T11:44:36.435 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 109/134 2022-07-05T11:44:36.435 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 110/134 2022-07-05T11:44:36.435 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.0.4-10.el8.x86_64 111/134 2022-07-05T11:44:36.436 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 112/134 2022-07-05T11:44:36.436 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 113/134 2022-07-05T11:44:36.436 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 114/134 2022-07-05T11:44:36.437 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 115/134 2022-07-05T11:44:36.437 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/134 2022-07-05T11:44:36.437 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 117/134 2022-07-05T11:44:36.437 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 118/134 2022-07-05T11:44:36.438 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 119/134 2022-07-05T11:44:36.438 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 120/134 2022-07-05T11:44:36.438 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.1-9.el8.x86_64 121/134 2022-07-05T11:44:36.438 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 122/134 2022-07-05T11:44:36.439 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 123/134 2022-07-05T11:44:36.439 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/134 2022-07-05T11:44:36.439 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 125/134 2022-07-05T11:44:36.439 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/134 2022-07-05T11:44:36.440 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 127/134 2022-07-05T11:44:36.440 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/134 2022-07-05T11:44:36.440 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 129/134 2022-07-05T11:44:36.440 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 130/134 2022-07-05T11:44:36.441 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 131/134 2022-07-05T11:44:36.441 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:36.441 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 133/134 2022-07-05T11:44:36.442 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 114/134 2022-07-05T11:44:36.443 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/134 2022-07-05T11:44:36.610 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 122/134 2022-07-05T11:44:36.625 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/134 2022-07-05T11:44:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 123/134 2022-07-05T11:44:36.964 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 124/134 2022-07-05T11:44:37.132 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 125/134 2022-07-05T11:44:37.339 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 126/134 2022-07-05T11:44:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/134 2022-07-05T11:44:37.572 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.1-9.el8.x86_64 127/134 2022-07-05T11:44:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 127/134 2022-07-05T11:44:37.666 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 116/134 2022-07-05T11:44:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 117/134 2022-07-05T11:44:37.881 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.0.4-10.el8.x86_64 128/134 2022-07-05T11:44:37.894 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 128/134 2022-07-05T11:44:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 129/134 2022-07-05T11:44:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-07-05T11:44:38.056 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 118/134 2022-07-05T11:44:38.205 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_6 119/134 2022-07-05T11:44:38.282 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-07-05T11:44:38.412 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 120/134 2022-07-05T11:44:38.449 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 131/134 2022-07-05T11:44:38.459 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:38.460 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:38.596 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/134 2022-07-05T11:44:38.599 INFO:teuthology.orchestra.run.smithi149.stderr:Errors during downloading metadata for repository 'rhel-8-for-x86_64-baseos-rpms': 2022-07-05T11:44:38.600 INFO:teuthology.orchestra.run.smithi149.stderr: - Status code: 404 for https://satellite.front.sepia.ceph.com/pulp/repos/Ceph/Library/content/dist/rhel8/8/x86_64/baseos/os/repodata/repomd.xml (IP: 172.21.0.42) 2022-07-05T11:44:38.773 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 122/134 2022-07-05T11:44:38.867 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:38.868 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-07-05T11:44:38.942 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 123/134 2022-07-05T11:44:39.109 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 124/134 2022-07-05T11:44:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-07-05T11:44:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/134 2022-07-05T11:44:39.310 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 125/134 2022-07-05T11:44:39.446 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 134/134 2022-07-05T11:44:39.447 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2022-07-05T11:44:39.467 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 126/134 2022-07-05T11:44:39.580 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:39.581 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2022-07-05T11:44:39.582 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:39.582 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:39.583 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:39.584 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.585 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.586 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2022-07-05T11:44:39.586 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.1-7.el8.noarch 2022-07-05T11:44:39.587 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.0.4-10.el8.x86_64 2022-07-05T11:44:39.588 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.588 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.589 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.590 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.591 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.595 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.596 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.597 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.598 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.599 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:39.600 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-07-05T11:44:39.601 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.1-9.el8.x86_64 2022-07-05T11:44:39.601 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.7-12.el8.x86_64 2022-07-05T11:44:39.602 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-07-05T11:44:39.602 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.5-12.el8.x86_64 2022-07-05T11:44:39.603 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-07-05T11:44:39.603 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-07-05T11:44:39.605 INFO:teuthology.orchestra.run.smithi149.stdout: leveldb-1.22-1.el8.x86_64 2022-07-05T11:44:39.605 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-07-05T11:44:39.606 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.606 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.607 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.607 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-07-05T11:44:39.608 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-07-05T11:44:39.609 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.2-3.el8.x86_64 2022-07-05T11:44:39.610 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-07-05T11:44:39.610 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-07-05T11:44:39.611 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.611 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.612 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-07-05T11:44:39.612 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.612 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-07-05T11:44:39.613 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-07-05T11:44:39.613 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-25.el8.x86_64 2022-07-05T11:44:39.614 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.3.1-3.el8.x86_64 2022-07-05T11:44:39.615 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-07-05T11:44:39.616 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-07-05T11:44:39.616 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-07-05T11:44:39.617 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-07-05T11:44:39.618 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.12-1.el8.x86_64 2022-07-05T11:44:39.618 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-07-05T11:44:39.619 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-07-05T11:44:39.619 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-07-05T11:44:39.620 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-07-05T11:44:39.620 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-07-05T11:44:39.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-apipkg-1.5-6.el8.noarch 2022-07-05T11:44:39.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.5.1-5.el8.noarch 2022-07-05T11:44:39.621 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-07-05T11:44:39.621 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-07-05T11:44:39.621 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-07-05T11:44:39.621 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.621 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.622 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.622 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-07-05T11:44:39.622 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-07-05T11:44:39.623 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-07-05T11:44:39.623 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-07-05T11:44:39.623 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-07-05T11:44:39.623 INFO:teuthology.orchestra.run.smithi149.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-07-05T11:44:39.624 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-07-05T11:44:39.624 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-6.2-6.el8.noarch 2022-07-05T11:44:39.625 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-07-05T11:44:39.625 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-07-05T11:44:39.626 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-07-05T11:44:39.626 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-07-05T11:44:39.626 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-07-05T11:44:39.626 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-07-05T11:44:39.627 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-07-05T11:44:39.627 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.0.6-13.el8.noarch 2022-07-05T11:44:39.627 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-07-05T11:44:39.627 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-07-05T11:44:39.628 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-07-05T11:44:39.628 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-07-05T11:44:39.628 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-07-05T11:44:39.628 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-07-05T11:44:39.629 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-2.6-1.el8.noarch 2022-07-05T11:44:39.629 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-07-05T11:44:39.629 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-07-05T11:44:39.629 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-07-05T11:44:39.629 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-07-05T11:44:39.630 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.14-14.el8.noarch 2022-07-05T11:44:39.630 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2017.2-9.el8.noarch 2022-07-05T11:44:39.630 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.630 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.631 INFO:teuthology.orchestra.run.smithi149.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-07-05T11:44:39.631 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-07-05T11:44:39.631 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-07-05T11:44:39.631 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.632 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.4.1-12.el8.noarch 2022-07-05T11:44:39.632 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.8-1.el8.noarch 2022-07-05T11:44:39.632 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-07-05T11:44:39.632 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-07-05T11:44:39.632 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-07-05T11:44:39.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-07-05T11:44:39.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-07-05T11:44:39.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-07-05T11:44:39.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-07-05T11:44:39.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-07-05T11:44:39.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-07-05T11:44:39.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-07-05T11:44:39.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-07-05T11:44:39.635 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.635 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.635 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:39.635 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.3.3-2.el8.x86_64 2022-07-05T11:44:39.636 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-07-05T11:44:39.636 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-07-05T11:44:39.637 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-07-05T11:44:39.637 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:39.638 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2022-07-05T11:44:39.726 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.1-9.el8.x86_64 127/134 2022-07-05T11:44:39.747 DEBUG:teuthology.parallel:result is None 2022-07-05T11:44:39.811 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 127/134 2022-07-05T11:44:40.017 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.0.4-10.el8.x86_64 128/134 2022-07-05T11:44:40.030 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 128/134 2022-07-05T11:44:40.049 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/134 2022-07-05T11:44:40.050 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 1/134 2022-07-05T11:44:40.050 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 2/134 2022-07-05T11:44:40.050 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 3/134 2022-07-05T11:44:40.051 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 4/134 2022-07-05T11:44:40.051 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:16.2.9-390.g494bbf 5/134 2022-07-05T11:44:40.051 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:44:40.051 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:44:40.052 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:44:40.052 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 9/134 2022-07-05T11:44:40.052 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:44:40.052 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 11/134 2022-07-05T11:44:40.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 12/134 2022-07-05T11:44:40.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:44:40.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_6 14/134 2022-07-05T11:44:40.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 15/134 2022-07-05T11:44:40.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 16/134 2022-07-05T11:44:40.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 17/134 2022-07-05T11:44:40.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 18/134 2022-07-05T11:44:40.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 19/134 2022-07-05T11:44:40.055 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8 20/134 2022-07-05T11:44:40.055 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x 21/134 2022-07-05T11:44:40.055 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 22/134 2022-07-05T11:44:40.055 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 23/134 2022-07-05T11:44:40.056 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 24/134 2022-07-05T11:44:40.056 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 25/134 2022-07-05T11:44:40.056 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 26/134 2022-07-05T11:44:40.057 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 27/134 2022-07-05T11:44:40.057 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 28/134 2022-07-05T11:44:40.057 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.e 29/134 2022-07-05T11:44:40.057 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 30/134 2022-07-05T11:44:40.058 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 31/134 2022-07-05T11:44:40.058 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 32/134 2022-07-05T11:44:40.058 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8 33/134 2022-07-05T11:44:40.059 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 34/134 2022-07-05T11:44:40.059 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el 35/134 2022-07-05T11:44:40.059 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 36/134 2022-07-05T11:44:40.059 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 37/134 2022-07-05T11:44:40.060 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/134 2022-07-05T11:44:40.060 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/134 2022-07-05T11:44:40.060 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2022-07-05T11:44:40.060 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2022-07-05T11:44:40.061 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/134 2022-07-05T11:44:40.061 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2022-07-05T11:44:40.061 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2022-07-05T11:44:40.061 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2022-07-05T11:44:40.062 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2022-07-05T11:44:40.062 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2022-07-05T11:44:40.062 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2022-07-05T11:44:40.063 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/134 2022-07-05T11:44:40.063 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/134 2022-07-05T11:44:40.063 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/134 2022-07-05T11:44:40.063 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/134 2022-07-05T11:44:40.064 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/134 2022-07-05T11:44:40.064 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/134 2022-07-05T11:44:40.064 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/134 2022-07-05T11:44:40.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2022-07-05T11:44:40.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2022-07-05T11:44:40.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/134 2022-07-05T11:44:40.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/134 2022-07-05T11:44:40.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/134 2022-07-05T11:44:40.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/134 2022-07-05T11:44:40.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/134 2022-07-05T11:44:40.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/134 2022-07-05T11:44:40.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/134 2022-07-05T11:44:40.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/134 2022-07-05T11:44:40.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/134 2022-07-05T11:44:40.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/134 2022-07-05T11:44:40.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/134 2022-07-05T11:44:40.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/134 2022-07-05T11:44:40.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2022-07-05T11:44:40.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 71/134 2022-07-05T11:44:40.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/134 2022-07-05T11:44:40.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 73/134 2022-07-05T11:44:40.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 74/134 2022-07-05T11:44:40.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2022-07-05T11:44:40.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/134 2022-07-05T11:44:40.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 77/134 2022-07-05T11:44:40.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/134 2022-07-05T11:44:40.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.1-7.el8.noarch 79/134 2022-07-05T11:44:40.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 80/134 2022-07-05T11:44:40.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jq-1.5-12.el8.x86_64 81/134 2022-07-05T11:44:40.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 82/134 2022-07-05T11:44:40.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 83/134 2022-07-05T11:44:40.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 84/134 2022-07-05T11:44:40.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 85/134 2022-07-05T11:44:40.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.0.4-10.el8.x86_64 86/134 2022-07-05T11:44:40.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 87/134 2022-07-05T11:44:40.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 88/134 2022-07-05T11:44:40.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 89/134 2022-07-05T11:44:40.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 90/134 2022-07-05T11:44:40.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/134 2022-07-05T11:44:40.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 92/134 2022-07-05T11:44:40.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2022-07-05T11:44:40.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 94/134 2022-07-05T11:44:40.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/134 2022-07-05T11:44:40.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.1-9.el8.x86_64 96/134 2022-07-05T11:44:40.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 97/134 2022-07-05T11:44:40.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 98/134 2022-07-05T11:44:40.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 99/134 2022-07-05T11:44:40.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 100/134 2022-07-05T11:44:40.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 101/134 2022-07-05T11:44:40.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 102/134 2022-07-05T11:44:40.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 103/134 2022-07-05T11:44:40.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 104/134 2022-07-05T11:44:40.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 105/134 2022-07-05T11:44:40.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 106/134 2022-07-05T11:44:40.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 107/134 2022-07-05T11:44:40.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/134 2022-07-05T11:44:40.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 109/134 2022-07-05T11:44:40.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 110/134 2022-07-05T11:44:40.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 111/134 2022-07-05T11:44:40.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 112/134 2022-07-05T11:44:40.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/134 2022-07-05T11:44:40.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 114/134 2022-07-05T11:44:40.080 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 115/134 2022-07-05T11:44:40.080 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 116/134 2022-07-05T11:44:40.080 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 117/134 2022-07-05T11:44:40.081 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 118/134 2022-07-05T11:44:40.081 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 119/134 2022-07-05T11:44:40.081 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 120/134 2022-07-05T11:44:40.081 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 121/134 2022-07-05T11:44:40.081 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 122/134 2022-07-05T11:44:40.082 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 123/134 2022-07-05T11:44:40.082 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/134 2022-07-05T11:44:40.082 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 125/134 2022-07-05T11:44:40.083 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/134 2022-07-05T11:44:40.083 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 127/134 2022-07-05T11:44:40.083 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/134 2022-07-05T11:44:40.083 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 129/134 2022-07-05T11:44:40.084 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 130/134 2022-07-05T11:44:40.084 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 131/134 2022-07-05T11:44:40.084 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:40.084 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 133/134 2022-07-05T11:44:40.202 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 129/134 2022-07-05T11:44:40.203 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-07-05T11:44:40.428 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-07-05T11:44:40.594 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 131/134 2022-07-05T11:44:40.603 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:40.604 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:41.062 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:41.063 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-07-05T11:44:41.304 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-07-05T11:44:41.305 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/134 2022-07-05T11:44:42.149 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/134 2022-07-05T11:44:42.150 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 1/134 2022-07-05T11:44:42.150 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 2/134 2022-07-05T11:44:42.150 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 3/134 2022-07-05T11:44:42.151 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 4/134 2022-07-05T11:44:42.152 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:16.2.9-390.g494bbf 5/134 2022-07-05T11:44:42.152 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 6/134 2022-07-05T11:44:42.153 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 7/134 2022-07-05T11:44:42.154 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 8/134 2022-07-05T11:44:42.154 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 9/134 2022-07-05T11:44:42.155 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 10/134 2022-07-05T11:44:42.155 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 11/134 2022-07-05T11:44:42.155 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 12/134 2022-07-05T11:44:42.156 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 13/134 2022-07-05T11:44:42.156 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_6 14/134 2022-07-05T11:44:42.156 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 15/134 2022-07-05T11:44:42.156 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 16/134 2022-07-05T11:44:42.156 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 17/134 2022-07-05T11:44:42.157 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_ 18/134 2022-07-05T11:44:42.157 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 19/134 2022-07-05T11:44:42.157 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8 20/134 2022-07-05T11:44:42.157 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x 21/134 2022-07-05T11:44:42.158 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 22/134 2022-07-05T11:44:42.158 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 23/134 2022-07-05T11:44:42.158 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 24/134 2022-07-05T11:44:42.158 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 25/134 2022-07-05T11:44:42.159 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 26/134 2022-07-05T11:44:42.159 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 27/134 2022-07-05T11:44:42.159 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 28/134 2022-07-05T11:44:42.159 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.e 29/134 2022-07-05T11:44:42.160 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noar 30/134 2022-07-05T11:44:42.160 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.no 31/134 2022-07-05T11:44:42.160 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.9-390.g494b 32/134 2022-07-05T11:44:42.160 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8 33/134 2022-07-05T11:44:42.160 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 34/134 2022-07-05T11:44:42.161 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el 35/134 2022-07-05T11:44:42.161 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 36/134 2022-07-05T11:44:42.161 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 37/134 2022-07-05T11:44:42.161 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/134 2022-07-05T11:44:42.162 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/134 2022-07-05T11:44:42.162 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2022-07-05T11:44:42.162 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2022-07-05T11:44:42.162 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/134 2022-07-05T11:44:42.162 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2022-07-05T11:44:42.163 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2022-07-05T11:44:42.163 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2022-07-05T11:44:42.163 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2022-07-05T11:44:42.163 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2022-07-05T11:44:42.164 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2022-07-05T11:44:42.164 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/134 2022-07-05T11:44:42.164 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/134 2022-07-05T11:44:42.165 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/134 2022-07-05T11:44:42.165 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/134 2022-07-05T11:44:42.166 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/134 2022-07-05T11:44:42.166 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/134 2022-07-05T11:44:42.166 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/134 2022-07-05T11:44:42.166 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2022-07-05T11:44:42.166 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2022-07-05T11:44:42.167 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/134 2022-07-05T11:44:42.167 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/134 2022-07-05T11:44:42.167 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/134 2022-07-05T11:44:42.167 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/134 2022-07-05T11:44:42.168 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/134 2022-07-05T11:44:42.168 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/134 2022-07-05T11:44:42.169 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/134 2022-07-05T11:44:42.169 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/134 2022-07-05T11:44:42.169 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/134 2022-07-05T11:44:42.169 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/134 2022-07-05T11:44:42.170 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/134 2022-07-05T11:44:42.170 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/134 2022-07-05T11:44:42.170 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2022-07-05T11:44:42.170 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 71/134 2022-07-05T11:44:42.171 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/134 2022-07-05T11:44:42.171 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 73/134 2022-07-05T11:44:42.171 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 74/134 2022-07-05T11:44:42.171 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2022-07-05T11:44:42.172 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/134 2022-07-05T11:44:42.172 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 77/134 2022-07-05T11:44:42.172 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/134 2022-07-05T11:44:42.172 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.1-7.el8.noarch 79/134 2022-07-05T11:44:42.173 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 80/134 2022-07-05T11:44:42.173 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jq-1.5-12.el8.x86_64 81/134 2022-07-05T11:44:42.173 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 82/134 2022-07-05T11:44:42.174 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 83/134 2022-07-05T11:44:42.174 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 84/134 2022-07-05T11:44:42.174 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 85/134 2022-07-05T11:44:42.187 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.0.4-10.el8.x86_64 86/134 2022-07-05T11:44:42.188 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 87/134 2022-07-05T11:44:42.188 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 88/134 2022-07-05T11:44:42.188 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 89/134 2022-07-05T11:44:42.188 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 90/134 2022-07-05T11:44:42.188 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/134 2022-07-05T11:44:42.189 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 92/134 2022-07-05T11:44:42.189 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2022-07-05T11:44:42.189 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 94/134 2022-07-05T11:44:42.189 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/134 2022-07-05T11:44:42.190 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.1-9.el8.x86_64 96/134 2022-07-05T11:44:42.190 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 97/134 2022-07-05T11:44:42.190 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 98/134 2022-07-05T11:44:42.190 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 99/134 2022-07-05T11:44:42.191 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 100/134 2022-07-05T11:44:42.191 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 101/134 2022-07-05T11:44:42.191 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 102/134 2022-07-05T11:44:42.191 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 103/134 2022-07-05T11:44:42.191 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 104/134 2022-07-05T11:44:42.192 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 105/134 2022-07-05T11:44:42.192 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 106/134 2022-07-05T11:44:42.192 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 107/134 2022-07-05T11:44:42.192 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/134 2022-07-05T11:44:42.193 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 109/134 2022-07-05T11:44:42.193 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 110/134 2022-07-05T11:44:42.193 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 111/134 2022-07-05T11:44:42.193 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 112/134 2022-07-05T11:44:42.194 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/134 2022-07-05T11:44:42.194 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 114/134 2022-07-05T11:44:42.194 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 115/134 2022-07-05T11:44:42.195 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 116/134 2022-07-05T11:44:42.195 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 117/134 2022-07-05T11:44:42.195 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 118/134 2022-07-05T11:44:42.195 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 119/134 2022-07-05T11:44:42.195 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 120/134 2022-07-05T11:44:42.196 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 121/134 2022-07-05T11:44:42.196 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 122/134 2022-07-05T11:44:42.196 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 123/134 2022-07-05T11:44:42.196 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/134 2022-07-05T11:44:42.197 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 125/134 2022-07-05T11:44:42.197 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/134 2022-07-05T11:44:42.197 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 127/134 2022-07-05T11:44:42.197 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/134 2022-07-05T11:44:42.197 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 129/134 2022-07-05T11:44:42.198 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 130/134 2022-07-05T11:44:42.198 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 131/134 2022-07-05T11:44:42.198 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-07-05T11:44:42.198 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 133/134 2022-07-05T11:44:42.289 INFO:teuthology.orchestra.run.smithi110.stderr:Errors during downloading metadata for repository 'rhel-8-for-x86_64-appstream-rpms': 2022-07-05T11:44:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - Status code: 404 for https://satellite.front.sepia.ceph.com/pulp/repos/Ceph/Library/content/dist/rhel8/8/x86_64/appstream/os/repodata/repomd.xml (IP: 172.21.0.42) 2022-07-05T11:44:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 134/134 2022-07-05T11:44:43.056 INFO:teuthology.orchestra.run.smithi110.stdout:Installed products updated. 2022-07-05T11:44:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:43.185 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2022-07-05T11:44:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.188 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2022-07-05T11:44:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.1-7.el8.noarch 2022-07-05T11:44:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.0.4-10.el8.x86_64 2022-07-05T11:44:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-07-05T11:44:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.1-9.el8.x86_64 2022-07-05T11:44:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.7-12.el8.x86_64 2022-07-05T11:44:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-07-05T11:44:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: jq-1.5-12.el8.x86_64 2022-07-05T11:44:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-07-05T11:44:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-07-05T11:44:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: leveldb-1.22-1.el8.x86_64 2022-07-05T11:44:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-07-05T11:44:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-07-05T11:44:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-07-05T11:44:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.2-3.el8.x86_64 2022-07-05T11:44:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-07-05T11:44:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-07-05T11:44:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-07-05T11:44:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-07-05T11:44:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-07-05T11:44:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-25.el8.x86_64 2022-07-05T11:44:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.3.1-3.el8.x86_64 2022-07-05T11:44:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-07-05T11:44:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-07-05T11:44:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-07-05T11:44:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-07-05T11:44:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.12-1.el8.x86_64 2022-07-05T11:44:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-07-05T11:44:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-07-05T11:44:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-07-05T11:44:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-07-05T11:44:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-07-05T11:44:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-apipkg-1.5-6.el8.noarch 2022-07-05T11:44:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.5.1-5.el8.noarch 2022-07-05T11:44:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-07-05T11:44:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-07-05T11:44:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-07-05T11:44:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-07-05T11:44:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-07-05T11:44:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-07-05T11:44:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-07-05T11:44:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-07-05T11:44:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-07-05T11:44:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-07-05T11:44:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-6.2-6.el8.noarch 2022-07-05T11:44:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-07-05T11:44:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-07-05T11:44:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-07-05T11:44:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-07-05T11:44:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-07-05T11:44:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-07-05T11:44:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-07-05T11:44:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.0.6-13.el8.noarch 2022-07-05T11:44:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-07-05T11:44:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-07-05T11:44:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-07-05T11:44:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-07-05T11:44:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-07-05T11:44:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-07-05T11:44:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-2.6-1.el8.noarch 2022-07-05T11:44:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-07-05T11:44:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-07-05T11:44:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-07-05T11:44:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-07-05T11:44:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.14-14.el8.noarch 2022-07-05T11:44:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2017.2-9.el8.noarch 2022-07-05T11:44:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-07-05T11:44:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-07-05T11:44:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-07-05T11:44:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.4.1-12.el8.noarch 2022-07-05T11:44:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.8-1.el8.noarch 2022-07-05T11:44:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-07-05T11:44:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-07-05T11:44:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-07-05T11:44:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-07-05T11:44:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-07-05T11:44:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-07-05T11:44:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-07-05T11:44:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-07-05T11:44:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-07-05T11:44:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-07-05T11:44:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-07-05T11:44:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.3.3-2.el8.x86_64 2022-07-05T11:44:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-07-05T11:44:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-07-05T11:44:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-07-05T11:44:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:43.228 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2022-07-05T11:44:43.375 DEBUG:teuthology.parallel:result is None 2022-07-05T11:44:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:Errors during downloading metadata for repository 'rhel-8-for-x86_64-appstream-rpms': 2022-07-05T11:44:44.378 INFO:teuthology.orchestra.run.smithi090.stderr: - Status code: 404 for https://satellite.front.sepia.ceph.com/pulp/repos/Ceph/Library/content/dist/rhel8/8/x86_64/appstream/os/repodata/repomd.xml (IP: 172.21.0.42) 2022-07-05T11:44:45.204 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 134/134 2022-07-05T11:44:45.205 INFO:teuthology.orchestra.run.smithi090.stdout:Installed products updated. 2022-07-05T11:44:45.346 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:45.346 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2022-07-05T11:44:45.347 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:45.347 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:45.347 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:45.348 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-07-05T11:44:45.348 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.349 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.349 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2022-07-05T11:44:45.349 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.1-7.el8.noarch 2022-07-05T11:44:45.350 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.0.4-10.el8.x86_64 2022-07-05T11:44:45.350 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.351 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.351 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.352 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.352 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.353 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.353 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.354 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.354 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.355 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.355 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.355 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.356 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.356 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.357 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.357 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.358 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.358 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.359 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.359 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.359 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.360 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:16.2.9-390.g494bbf8c.el8.noarch 2022-07-05T11:44:45.360 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-07-05T11:44:45.361 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.1-9.el8.x86_64 2022-07-05T11:44:45.361 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.7-12.el8.x86_64 2022-07-05T11:44:45.363 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-07-05T11:44:45.364 INFO:teuthology.orchestra.run.smithi090.stdout: jq-1.5-12.el8.x86_64 2022-07-05T11:44:45.364 INFO:teuthology.orchestra.run.smithi090.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-07-05T11:44:45.364 INFO:teuthology.orchestra.run.smithi090.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-07-05T11:44:45.364 INFO:teuthology.orchestra.run.smithi090.stdout: leveldb-1.22-1.el8.x86_64 2022-07-05T11:44:45.365 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-07-05T11:44:45.365 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.365 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.365 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.366 INFO:teuthology.orchestra.run.smithi090.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-07-05T11:44:45.366 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-07-05T11:44:45.366 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.2-3.el8.x86_64 2022-07-05T11:44:45.367 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-07-05T11:44:45.367 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-07-05T11:44:45.368 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.368 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.368 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-07-05T11:44:45.369 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.369 INFO:teuthology.orchestra.run.smithi090.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-07-05T11:44:45.370 INFO:teuthology.orchestra.run.smithi090.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-07-05T11:44:45.370 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-25.el8.x86_64 2022-07-05T11:44:45.370 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.3.1-3.el8.x86_64 2022-07-05T11:44:45.371 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-07-05T11:44:45.371 INFO:teuthology.orchestra.run.smithi090.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-07-05T11:44:45.371 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-07-05T11:44:45.372 INFO:teuthology.orchestra.run.smithi090.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-07-05T11:44:45.372 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.12-1.el8.x86_64 2022-07-05T11:44:45.373 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-07-05T11:44:45.373 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-07-05T11:44:45.373 INFO:teuthology.orchestra.run.smithi090.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-07-05T11:44:45.374 INFO:teuthology.orchestra.run.smithi090.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-07-05T11:44:45.374 INFO:teuthology.orchestra.run.smithi090.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-07-05T11:44:45.374 INFO:teuthology.orchestra.run.smithi090.stdout: python3-apipkg-1.5-6.el8.noarch 2022-07-05T11:44:45.375 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.5.1-5.el8.noarch 2022-07-05T11:44:45.375 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-07-05T11:44:45.375 INFO:teuthology.orchestra.run.smithi090.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-07-05T11:44:45.376 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-07-05T11:44:45.377 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.377 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.378 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.378 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-07-05T11:44:45.378 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-07-05T11:44:45.378 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-07-05T11:44:45.379 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-07-05T11:44:45.379 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-07-05T11:44:45.379 INFO:teuthology.orchestra.run.smithi090.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-07-05T11:44:45.379 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-07-05T11:44:45.380 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-6.2-6.el8.noarch 2022-07-05T11:44:45.380 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-07-05T11:44:45.380 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-07-05T11:44:45.381 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-07-05T11:44:45.381 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-07-05T11:44:45.381 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-07-05T11:44:45.382 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-07-05T11:44:45.392 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-07-05T11:44:45.392 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.0.6-13.el8.noarch 2022-07-05T11:44:45.393 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-07-05T11:44:45.395 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-07-05T11:44:45.396 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-07-05T11:44:45.396 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-07-05T11:44:45.397 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-07-05T11:44:45.397 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-07-05T11:44:45.398 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-2.6-1.el8.noarch 2022-07-05T11:44:45.398 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-07-05T11:44:45.399 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-07-05T11:44:45.399 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-07-05T11:44:45.400 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-07-05T11:44:45.400 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.14-14.el8.noarch 2022-07-05T11:44:45.401 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2017.2-9.el8.noarch 2022-07-05T11:44:45.401 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.402 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.402 INFO:teuthology.orchestra.run.smithi090.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-07-05T11:44:45.402 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-07-05T11:44:45.403 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-07-05T11:44:45.403 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.404 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.4.1-12.el8.noarch 2022-07-05T11:44:45.404 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.8-1.el8.noarch 2022-07-05T11:44:45.405 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-07-05T11:44:45.406 INFO:teuthology.orchestra.run.smithi090.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-07-05T11:44:45.407 INFO:teuthology.orchestra.run.smithi090.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-07-05T11:44:45.407 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-07-05T11:44:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-07-05T11:44:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-07-05T11:44:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-07-05T11:44:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-07-05T11:44:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-07-05T11:44:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-07-05T11:44:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-07-05T11:44:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:16.2.9-390.g494bbf8c.el8.x86_64 2022-07-05T11:44:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.3.3-2.el8.x86_64 2022-07-05T11:44:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-07-05T11:44:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-07-05T11:44:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-07-05T11:44:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:45.416 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2022-07-05T11:44:45.528 DEBUG:teuthology.parallel:result is None 2022-07-05T11:44:45.528 DEBUG:teuthology.orchestra.run.smithi090:> sudo lsb_release -is 2022-07-05T11:44:45.579 INFO:teuthology.orchestra.run.smithi090.stdout:RedHatEnterprise 2022-07-05T11:44:45.581 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:44:45.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 2022-07-05T11:44:45.746 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-07-05T11:44:45.768 INFO:teuthology.orchestra.run.smithi090.stdout:16.2.9-390.g494bbf8c.el8 2022-07-05T11:44:45.769 INFO:teuthology.packaging:The installed version of ceph is 16.2.9-390.g494bbf8c.el8 2022-07-05T11:44:45.770 INFO:teuthology.task.install:The correct ceph version 16.2.9-390.g494bbf8c is installed. 2022-07-05T11:44:45.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo lsb_release -is 2022-07-05T11:44:45.835 INFO:teuthology.orchestra.run.smithi110.stdout:RedHatEnterprise 2022-07-05T11:44:45.837 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:44:45.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 2022-07-05T11:44:45.989 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-07-05T11:44:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:16.2.9-390.g494bbf8c.el8 2022-07-05T11:44:46.068 INFO:teuthology.packaging:The installed version of ceph is 16.2.9-390.g494bbf8c.el8 2022-07-05T11:44:46.069 INFO:teuthology.task.install:The correct ceph version 16.2.9-390.g494bbf8c is installed. 2022-07-05T11:44:46.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2022-07-05T11:44:46.130 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2022-07-05T11:44:46.133 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-07-05T11:44:46.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 2022-07-05T11:44:46.298 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-07-05T11:44:46.321 INFO:teuthology.orchestra.run.smithi149.stdout:16.2.9-390.g494bbf8c.el8 2022-07-05T11:44:46.322 INFO:teuthology.packaging:The installed version of ceph is 16.2.9-390.g494bbf8c.el8 2022-07-05T11:44:46.323 INFO:teuthology.task.install:The correct ceph version 16.2.9-390.g494bbf8c is installed. 2022-07-05T11:44:46.324 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-07-05T11:44:46.324 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:46.325 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-07-05T11:44:46.352 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:44:46.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-07-05T11:44:46.383 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:44:46.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-07-05T11:44:46.413 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-07-05T11:44:46.414 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:46.414 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2022-07-05T11:44:46.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-07-05T11:44:46.504 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:44:46.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2022-07-05T11:44:46.533 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-07-05T11:44:46.601 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:44:46.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2022-07-05T11:44:46.632 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-07-05T11:44:46.701 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-07-05T11:44:46.702 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:46.702 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2022-07-05T11:44:46.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-07-05T11:44:46.798 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:44:46.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2022-07-05T11:44:46.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-07-05T11:44:46.898 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:44:46.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2022-07-05T11:44:46.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-07-05T11:44:46.997 INFO:teuthology.run_tasks:Running task ceph... 2022-07-05T11:44:47.086 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-07-05T11:44:47.087 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2022-07-05T11:44:47.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2022-07-05T11:44:47.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2022-07-05T11:44:47.121 INFO:tasks.ceph:Disabling ceph logrotate... 2022-07-05T11:44:47.122 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2022-07-05T11:44:47.157 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2022-07-05T11:44:47.164 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2022-07-05T11:44:47.193 INFO:tasks.ceph:Creating extra log directories... 2022-07-05T11:44:47.193 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-07-05T11:44:47.223 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-07-05T11:44:47.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-07-05T11:44:47.274 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-07-05T11:44:47.275 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-07-05T11:44:47.275 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-07-05T11:44:47.276 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:47.277 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-07-05T11:44:47.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-07-05T11:44:47.446 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-07-05T11:44:47.586 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:44:47.586 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-07-05T11:44:47.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-07-05T11:44:47.744 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-07-05T11:44:47.772 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:44:47.773 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-07-05T11:44:47.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-07-05T11:44:47.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-07-05T11:44:47.998 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-07-05T11:44:48.000 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-07-05T11:44:48.000 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi/6913409', 'branch': 'pacific', 'description': 'fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6913409', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2022-07-05_04:17:03-fs-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'pacific'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported', 'mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08'}}, 'kclient': {'mntopts': ['nowsync']}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pacific', 'sha1': 'c4a8e5d15163d588b25b033c25ae416600cffaa5'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 500, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'pacific', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': 'c4a8e5d15163d588b25b033c25ae416600cffaa5', 'targets': {'smithi090.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5QKMzL/K4geGCPmMUeRI+Bweq0opcMMOqXsc7sr8TBC33EWU3e/LjYcyUzsq64O6ceEQg7abi3VGkhGghBuo5kMkA6eR+YZduWYjhwOnTmaPE7Ru5dkKKJRgGfB3O5K1jBlKoiXows2WvSRb3evEKs0zQqW+4+m/ipxWVm/1uZyUQ5jN0BBkK7oOFOKi2+iY/s9l0J1XTdhk4pjxp6OvsAUMA9SLUAikPe04csgZCVCKjROzG/R9mK30g2ao7f/jJiN7l/KIMAr2Df+Dkq73do2aD1uNnMzukuJbf4BKuwRtO0bYrXWi135VMiDyHch5KYXypIR0dPlv4llqEKdwzrYdtO51GpH60b7FXpOwzWzib9v2jVbbmrlbp5DjKXcOUi31WnV68c3XXyremRRsV4BQDduWAvSIrqVK6zAo1Ex5nVoDe0otY8TCRLDWD+PJAd7/7iJGljMnQEyQV77eV4VJKxlO/+RqGNW0HHqzxrN632em3z07VhWyvFBC01/c=', 'smithi110.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEGGOe18JIExJcyKbevpJQYx9Qmwz2lWAWbnNIzNGtCkiXZI8RHg9waVmAw7hMtcEfUEM/5NRpWb2eB/D22BXpPTMtYllwvSU6JPIm4PlC3ByOu7qx6xIS58EGGp6M01pLEECYDaiiEodVuoVZZZOANiOkfgU0yZnneaqYUo2hbYbh4H+QKAf6IUtLSvLMPNcszaqB6yv05pB48VP4pD6Sds78we2H7ySoE+EityJIkv2GQDC26btg9/sSx4htVWDeVCiDQdiwwFe7tVTmD6ZM9pON4I39VhwQBRKPS7BCD+smd8X9/D2jU+BUztfa/DhVOqppsEDnt5yLjXKgPXO/3lULQ5kiuBYNXFEl3AUcx7o/n9IFSv5t/cCstjpf5iG2ipkGxbEZTpX32HvwJGObkgMjIbKk2OS+AzOZAe6t1vXwU/cInB9l5RiB9vXZIBbvcjP1Nq9Ir1fn9pmug2hyeDqqHXWcgM9SCUW+P0tJKaLzGjQdvRnQoTSNJ300bVc=', 'smithi149.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXRDhbFglBe9/XINsM1a9zMPHV8owLxx8mVaoqDmcjxx6Ysp4eezQ8MW0WQ6NJ233a0gw64nxP6BbfnsXmYbI30Q3zg7HzEzvbDpNZYfuppJ9n1u+ZhnwF8kyWuAIUebAjh9M8PGQ7NLBPj4e7aj2BsdFp8Q3JOUdaC13xPomTldhe+zyQYSlvfgyxaa7OGo1PhGp0cy29XBf1XjNIX5w+4lSIPv5k8HxMcuM5p+F2xkDXedt2k9TFF7lcjD33KIPIF4SS2KFI9LqWdb7GgpyM60ZlGO/i7xYar0kG11CBHn2qNxnc7bITWnRb7CUYHpE+9uBrBV/PzJHjrn0Wc/xADa/dpwjC+8yP8j4qKyxyDjj8w7gqBtm/aOpWPgp4pId4Jk3jnlZEi8RefOpKveVbdZ7YursSjw0zqjgiI2GTnr+9sEw55C4UHDm6K5lRdJvWhgNtPxZGVxASnZ4IYmReUNyVeen5NKIpIuRi9JSeYLlKoMAhl/UNAkcC04Rg+gc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '494bbf8c4cff5775f04a6a479335587c213bcf08'}}, {'ceph': None}, {'kclient': None}, {'fwd_scrub': {'scrub_timeout': 900, 'sleep_between_iterations': 1}}, {'check-counter': {}}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology_branch': 'main', 'teuthology_sha1': 'f58709e3fda190343157063e5edb0d7a36a41afc', 'timestamp': '2022-07-05_04:17:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1713'} 2022-07-05T11:44:48.001 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-07-05T11:44:48.008 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-07-05T11:44:48.014 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-07-05T11:44:48.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2022-07-05T11:44:48.062 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2022-07-05T11:44:48.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2022-07-05T11:44:48.109 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:48.110 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2022-07-05T11:44:48.144 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-07-05T11:44:48.145 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-07-05T11:44:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-07-05T11:44:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.205 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 79110 Links: 1 2022-07-05T11:44:48.205 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.205 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.205 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2022-07-05 11:44:41.758710987 +0000 2022-07-05T11:44:48.206 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2022-07-05 11:41:49.156913889 +0000 2022-07-05T11:44:48.206 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2022-07-05 11:41:49.156913889 +0000 2022-07-05T11:44:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2022-07-05T11:44:48.228 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2022-07-05T11:44:48.228 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2022-07-05T11:44:48.228 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000286673 s, 1.8 MB/s 2022-07-05T11:44:48.229 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-07-05T11:44:48.286 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-07-05T11:44:48.287 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.287 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 74721 Links: 1 2022-07-05T11:44:48.287 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.287 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.288 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2022-07-05 11:44:41.758710987 +0000 2022-07-05T11:44:48.288 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2022-07-05 11:41:49.726904753 +0000 2022-07-05T11:44:48.288 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2022-07-05 11:41:49.726904753 +0000 2022-07-05T11:44:48.290 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2022-07-05T11:44:48.296 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2022-07-05T11:44:48.296 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2022-07-05T11:44:48.297 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.00021932 s, 2.3 MB/s 2022-07-05T11:44:48.299 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-07-05T11:44:48.353 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-07-05T11:44:48.354 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.354 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 72652 Links: 1 2022-07-05T11:44:48.355 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.355 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.355 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2022-07-05 11:44:41.758710987 +0000 2022-07-05T11:44:48.356 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2022-07-05 11:41:50.326895136 +0000 2022-07-05T11:44:48.356 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2022-07-05 11:41:50.326895136 +0000 2022-07-05T11:44:48.357 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2022-07-05T11:44:48.363 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2022-07-05T11:44:48.363 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2022-07-05T11:44:48.364 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000190471 s, 2.7 MB/s 2022-07-05T11:44:48.366 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-07-05T11:44:48.423 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-07-05T11:44:48.423 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.423 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 76464 Links: 1 2022-07-05T11:44:48.424 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.424 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.424 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2022-07-05 11:44:41.758710987 +0000 2022-07-05T11:44:48.424 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2022-07-05 11:41:50.937885343 +0000 2022-07-05T11:44:48.425 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2022-07-05 11:41:50.937885343 +0000 2022-07-05T11:44:48.425 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2022-07-05T11:44:48.433 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2022-07-05T11:44:48.433 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2022-07-05T11:44:48.433 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000230049 s, 2.2 MB/s 2022-07-05T11:44:48.434 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-07-05T11:44:48.434 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:44:48.435 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2022-07-05T11:44:48.454 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-07-05T11:44:48.455 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-07-05T11:44:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-07-05T11:44:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.512 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 76413 Links: 1 2022-07-05T11:44:48.513 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.513 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.513 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2022-07-05 11:44:39.609942089 +0000 2022-07-05T11:44:48.513 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2022-07-05 11:41:56.048605093 +0000 2022-07-05T11:44:48.514 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2022-07-05 11:41:56.048605093 +0000 2022-07-05T11:44:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2022-07-05T11:44:48.524 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2022-07-05T11:44:48.525 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2022-07-05T11:44:48.526 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000141907 s, 3.6 MB/s 2022-07-05T11:44:48.537 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-07-05T11:44:48.593 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-07-05T11:44:48.593 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.594 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 79935 Links: 1 2022-07-05T11:44:48.594 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.594 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.595 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2022-07-05 11:44:39.609942089 +0000 2022-07-05T11:44:48.596 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2022-07-05 11:41:56.649594453 +0000 2022-07-05T11:44:48.596 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2022-07-05 11:41:56.649594453 +0000 2022-07-05T11:44:48.596 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2022-07-05T11:44:48.604 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2022-07-05T11:44:48.605 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2022-07-05T11:44:48.605 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000124775 s, 4.1 MB/s 2022-07-05T11:44:48.608 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-07-05T11:44:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-07-05T11:44:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.675 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 76587 Links: 1 2022-07-05T11:44:48.676 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.676 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.677 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2022-07-05 11:44:39.609942089 +0000 2022-07-05T11:44:48.677 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2022-07-05 11:41:57.220584345 +0000 2022-07-05T11:44:48.677 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2022-07-05 11:41:57.220584345 +0000 2022-07-05T11:44:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2022-07-05T11:44:48.690 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2022-07-05T11:44:48.691 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2022-07-05T11:44:48.691 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000110536 s, 4.6 MB/s 2022-07-05T11:44:48.692 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-07-05T11:44:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-07-05T11:44:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.776 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 75412 Links: 1 2022-07-05T11:44:48.776 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.776 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.776 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2022-07-05 11:44:39.609942089 +0000 2022-07-05T11:44:48.777 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2022-07-05 11:41:57.812573864 +0000 2022-07-05T11:44:48.777 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2022-07-05 11:41:57.812573864 +0000 2022-07-05T11:44:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2022-07-05T11:44:48.781 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2022-07-05T11:44:48.781 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2022-07-05T11:44:48.781 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000124922 s, 4.1 MB/s 2022-07-05T11:44:48.782 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-07-05T11:44:48.782 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:44:48.783 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2022-07-05T11:44:48.813 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-07-05T11:44:48.814 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-07-05T11:44:48.881 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-07-05T11:44:48.882 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.882 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 75398 Links: 1 2022-07-05T11:44:48.883 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.883 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.884 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2022-07-05 11:44:35.999900571 +0000 2022-07-05T11:44:48.884 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2022-07-05 11:41:58.542227382 +0000 2022-07-05T11:44:48.884 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2022-07-05 11:41:58.542227382 +0000 2022-07-05T11:44:48.885 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2022-07-05T11:44:48.885 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2022-07-05T11:44:48.886 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2022-07-05T11:44:48.886 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000264294 s, 1.9 MB/s 2022-07-05T11:44:48.889 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-07-05T11:44:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-07-05T11:44:48.947 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:48.948 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 68580 Links: 1 2022-07-05T11:44:48.948 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:48.949 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:48.949 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2022-07-05 11:44:35.999900571 +0000 2022-07-05T11:44:48.949 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2022-07-05 11:41:59.182214935 +0000 2022-07-05T11:44:48.950 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2022-07-05 11:41:59.182214935 +0000 2022-07-05T11:44:48.950 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2022-07-05T11:44:48.958 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2022-07-05T11:44:48.958 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2022-07-05T11:44:48.959 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000291413 s, 1.8 MB/s 2022-07-05T11:44:48.962 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-07-05T11:44:49.017 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-07-05T11:44:49.018 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:49.019 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 79907 Links: 1 2022-07-05T11:44:49.019 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:49.020 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:49.020 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2022-07-05 11:44:35.999900571 +0000 2022-07-05T11:44:49.021 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2022-07-05 11:41:59.787203168 +0000 2022-07-05T11:44:49.021 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2022-07-05 11:41:59.787203168 +0000 2022-07-05T11:44:49.021 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2022-07-05T11:44:49.027 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2022-07-05T11:44:49.028 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2022-07-05T11:44:49.028 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000226607 s, 2.3 MB/s 2022-07-05T11:44:49.030 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-07-05T11:44:49.095 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-07-05T11:44:49.096 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-07-05T11:44:49.096 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 80037 Links: 1 2022-07-05T11:44:49.096 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:44:49.097 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2022-07-05T11:44:49.097 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2022-07-05 11:44:35.999900571 +0000 2022-07-05T11:44:49.097 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2022-07-05 11:42:00.345192315 +0000 2022-07-05T11:44:49.097 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2022-07-05 11:42:00.345192315 +0000 2022-07-05T11:44:49.098 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2022-07-05T11:44:49.111 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2022-07-05T11:44:49.112 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2022-07-05T11:44:49.112 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000229091 s, 2.2 MB/s 2022-07-05T11:44:49.112 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-07-05T11:44:49.113 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2022-07-05T11:44:49.113 INFO:tasks.ceph:Generating config... 2022-07-05T11:44:49.115 INFO:tasks.ceph:[client] client mount timeout = 600 2022-07-05T11:44:49.116 INFO:tasks.ceph:[client] debug client = 20 2022-07-05T11:44:49.116 INFO:tasks.ceph:[client] debug ms = 1 2022-07-05T11:44:49.117 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-07-05T11:44:49.117 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-07-05T11:44:49.117 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-07-05T11:44:49.118 INFO:tasks.ceph:[mds] debug mds = 20 2022-07-05T11:44:49.118 INFO:tasks.ceph:[mds] debug ms = 1 2022-07-05T11:44:49.118 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2022-07-05T11:44:49.119 INFO:tasks.ceph:[mds] mds bal merge size = 5 2022-07-05T11:44:49.119 INFO:tasks.ceph:[mds] mds bal split bits = 3 2022-07-05T11:44:49.120 INFO:tasks.ceph:[mds] mds bal split size = 100 2022-07-05T11:44:49.120 INFO:tasks.ceph:[mds] mds debug frag = True 2022-07-05T11:44:49.120 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-07-05T11:44:49.121 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-07-05T11:44:49.121 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-07-05T11:44:49.121 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-07-05T11:44:49.122 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-07-05T11:44:49.122 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-07-05T11:44:49.122 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-07-05T11:44:49.123 INFO:tasks.ceph:[mgr] debug ms = 1 2022-07-05T11:44:49.123 INFO:tasks.ceph:[mon] debug mon = 20 2022-07-05T11:44:49.123 INFO:tasks.ceph:[mon] debug ms = 1 2022-07-05T11:44:49.124 INFO:tasks.ceph:[mon] debug paxos = 20 2022-07-05T11:44:49.124 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-07-05T11:44:49.124 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-07-05T11:44:49.125 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2022-07-05T11:44:49.125 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-07-05T11:44:49.125 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-07-05T11:44:49.126 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-07-05T11:44:49.126 INFO:tasks.ceph:[osd] debug ms = 1 2022-07-05T11:44:49.127 INFO:tasks.ceph:[osd] debug osd = 20 2022-07-05T11:44:49.127 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-07-05T11:44:49.127 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-07-05T11:44:49.128 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-07-05T11:44:49.128 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-07-05T11:44:49.128 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-07-05T11:44:49.129 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-07-05T11:44:49.129 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-07-05T11:44:49.130 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2022-07-05T11:44:49.130 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2022-07-05T11:44:49.131 INFO:tasks.ceph:Setting up mon.a... 2022-07-05T11:44:49.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-07-05T11:44:49.191 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.keyring 2022-07-05T11:44:49.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-07-05T11:44:49.236 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-07-05T11:44:49.305 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.90'), ('mon.b', '172.21.15.110'), ('mon.c', '172.21.15.149')] 2022-07-05T11:44:49.307 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.90,172.21.15.110,172.21.15.149', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.d': {}, 'mds.g': {}, 'mds.j': {}, 'mds.b': {}, 'mds.e': {}, 'mds.h': {}, 'mds.k': {}, 'mds.c': {}, 'mds.f': {}, 'mds.i': {}, 'mds.l': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-07-05T11:44:49.308 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:49.309 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-07-05T11:44:49.361 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.90 --add b 172.21.15.110 --add c 172.21.15.149 --print /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:44:49.441 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:44:49.441 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: generated fsid fc926128-a7e6-49db-b76e-e89bbf4193cc 2022-07-05T11:44:49.442 INFO:teuthology.orchestra.run.smithi090.stdout:epoch 0 2022-07-05T11:44:49.442 INFO:teuthology.orchestra.run.smithi090.stdout:fsid fc926128-a7e6-49db-b76e-e89bbf4193cc 2022-07-05T11:44:49.442 INFO:teuthology.orchestra.run.smithi090.stdout:last_changed 2022-07-05T11:44:49.440498+0000 2022-07-05T11:44:49.443 INFO:teuthology.orchestra.run.smithi090.stdout:created 2022-07-05T11:44:49.440498+0000 2022-07-05T11:44:49.443 INFO:teuthology.orchestra.run.smithi090.stdout:min_mon_release 0 (unknown) 2022-07-05T11:44:49.443 INFO:teuthology.orchestra.run.smithi090.stdout:election_strategy: 1 2022-07-05T11:44:49.443 INFO:teuthology.orchestra.run.smithi090.stdout:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2022-07-05T11:44:49.444 INFO:teuthology.orchestra.run.smithi090.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2022-07-05T11:44:49.444 INFO:teuthology.orchestra.run.smithi090.stdout:2: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2022-07-05T11:44:49.444 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-07-05T11:44:49.446 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-07-05T11:44:49.511 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fc926128-a7e6-49db-b76e-e89bbf4193cc... 2022-07-05T11:44:49.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-07-05T11:44:49.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-07-05T11:44:49.558 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-07-05T11:44:49.592 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2022-07-05T11:44:49.593 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2022-07-05T11:44:49.593 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-07-05T11:44:49.593 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2022-07-05T11:44:49.594 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.594 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2022-07-05T11:44:49.594 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.594 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2022-07-05T11:44:49.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.595 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2022-07-05T11:44:49.595 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2022-07-05T11:44:49.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.596 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2022-07-05T11:44:49.596 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2022-07-05T11:44:49.596 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.596 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2022-07-05T11:44:49.597 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2022-07-05T11:44:49.597 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.597 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2022-07-05T11:44:49.597 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2022-07-05T11:44:49.598 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.598 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2022-07-05T11:44:49.598 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.598 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2022-07-05T11:44:49.599 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2022-07-05T11:44:49.599 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2022-07-05T11:44:49.599 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2022-07-05T11:44:49.599 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2022-07-05T11:44:49.599 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2022-07-05T11:44:49.600 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2022-07-05T11:44:49.600 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-07-05T11:44:49.600 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2022-07-05T11:44:49.600 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2022-07-05T11:44:49.601 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.601 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-07-05T11:44:49.601 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.601 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2022-07-05T11:44:49.602 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.602 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2022-07-05T11:44:49.602 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.603 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2022-07-05T11:44:49.603 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2022-07-05T11:44:49.603 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2022-07-05T11:44:49.603 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.110,172.21.15.149" 2022-07-05T11:44:49.604 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2022-07-05T11:44:49.604 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = fc926128-a7e6-49db-b76e-e89bbf4193cc 2022-07-05T11:44:49.604 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.604 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2022-07-05T11:44:49.605 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2022-07-05T11:44:49.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.605 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2022-07-05T11:44:49.605 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2022-07-05T11:44:49.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.606 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2022-07-05T11:44:49.606 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2022-07-05T11:44:49.606 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.606 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2022-07-05T11:44:49.607 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2022-07-05T11:44:49.607 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2022-07-05T11:44:49.607 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.607 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2022-07-05T11:44:49.607 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2022-07-05T11:44:49.608 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.608 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2022-07-05T11:44:49.608 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.608 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2022-07-05T11:44:49.609 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.609 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2022-07-05T11:44:49.609 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.609 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2022-07-05T11:44:49.610 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2022-07-05T11:44:49.610 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.610 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2022-07-05T11:44:49.610 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2022-07-05T11:44:49.610 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2022-07-05T11:44:49.611 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore compression mode = aggressive 2022-07-05T11:44:49.611 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2022-07-05T11:44:49.611 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 20 2022-07-05T11:44:49.611 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2022-07-05T11:44:49.612 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2022-07-05T11:44:49.612 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2022-07-05T11:44:49.612 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 10 2022-07-05T11:44:49.612 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2022-07-05T11:44:49.613 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2022-07-05T11:44:49.613 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2022-07-05T11:44:49.613 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2022-07-05T11:44:49.613 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2022-07-05T11:44:49.613 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2022-07-05T11:44:49.614 INFO:teuthology.orchestra.run.smithi090.stdout: osd shutdown pgref assert = True 2022-07-05T11:44:49.614 INFO:teuthology.orchestra.run.smithi090.stdout: osd_max_omap_entries_per_request = 10000 2022-07-05T11:44:49.614 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.614 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2022-07-05T11:44:49.615 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2022-07-05T11:44:49.615 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2022-07-05T11:44:49.615 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2022-07-05T11:44:49.615 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2022-07-05T11:44:49.616 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2022-07-05T11:44:49.616 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2022-07-05T11:44:49.616 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2022-07-05T11:44:49.616 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.617 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2022-07-05T11:44:49.617 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2022-07-05T11:44:49.617 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2022-07-05T11:44:49.617 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2022-07-05T11:44:49.617 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2022-07-05T11:44:49.618 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2022-07-05T11:44:49.618 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2022-07-05T11:44:49.618 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2022-07-05T11:44:49.618 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2022-07-05T11:44:49.619 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2022-07-05T11:44:49.619 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2022-07-05T11:44:49.619 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.619 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-07-05T11:44:49.620 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2022-07-05T11:44:49.620 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2022-07-05T11:44:49.620 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.620 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2022-07-05T11:44:49.621 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-07-05T11:44:49.621 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-07-05T11:44:49.621 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2022-07-05T11:44:49.621 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:44:49.622 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2022-07-05T11:44:49.622 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2022-07-05T11:44:49.622 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2022-07-05T11:44:49.622 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2022-07-05T11:44:49.623 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-07-05T11:44:49.623 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-07-05T11:44:49.623 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2022-07-05T11:44:49.623 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2022-07-05T11:44:49.624 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2022-07-05T11:44:49.624 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2022-07-05T11:44:49.624 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2022-07-05T11:44:49.624 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2022-07-05T11:44:49.624 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2022-07-05T11:44:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2022-07-05T11:44:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2022-07-05T11:44:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2022-07-05T11:44:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.g] 2022-07-05T11:44:49.626 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.j] 2022-07-05T11:44:49.626 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2022-07-05T11:44:49.626 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.e] 2022-07-05T11:44:49.626 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.h] 2022-07-05T11:44:49.627 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.k] 2022-07-05T11:44:49.627 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2022-07-05T11:44:49.627 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.f] 2022-07-05T11:44:49.627 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.i] 2022-07-05T11:44:49.627 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.l] 2022-07-05T11:44:49.628 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2022-07-05T11:44:49.628 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2022-07-05T11:44:49.628 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2022-07-05T11:44:49.628 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal fragment size max = 10000 2022-07-05T11:44:49.629 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal merge size = 5 2022-07-05T11:44:49.629 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split bits = 3 2022-07-05T11:44:49.629 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split size = 100 2022-07-05T11:44:49.629 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2022-07-05T11:44:49.630 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2022-07-05T11:44:49.630 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2022-07-05T11:44:49.630 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2022-07-05T11:44:49.630 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2022-07-05T11:44:49.631 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2022-07-05T11:44:49.631 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2022-07-05T11:44:49.634 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2022-07-05T11:44:49.634 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2022-07-05T11:44:49.634 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-07-05T11:44:49.635 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2022-07-05T11:44:49.635 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.635 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2022-07-05T11:44:49.635 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.636 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2022-07-05T11:44:49.636 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.636 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2022-07-05T11:44:49.636 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2022-07-05T11:44:49.637 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.637 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2022-07-05T11:44:49.637 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2022-07-05T11:44:49.637 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.638 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2022-07-05T11:44:49.638 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2022-07-05T11:44:49.638 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.638 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2022-07-05T11:44:49.639 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2022-07-05T11:44:49.639 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.639 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2022-07-05T11:44:49.639 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.640 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2022-07-05T11:44:49.640 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2022-07-05T11:44:49.640 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2022-07-05T11:44:49.641 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2022-07-05T11:44:49.642 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2022-07-05T11:44:49.642 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2022-07-05T11:44:49.642 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2022-07-05T11:44:49.642 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-07-05T11:44:49.643 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2022-07-05T11:44:49.643 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2022-07-05T11:44:49.643 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.643 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-07-05T11:44:49.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.644 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2022-07-05T11:44:49.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.644 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2022-07-05T11:44:49.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2022-07-05T11:44:49.645 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2022-07-05T11:44:49.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2022-07-05T11:44:49.645 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.90,172.21.15.110,172.21.15.149" 2022-07-05T11:44:49.646 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2022-07-05T11:44:49.646 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = fc926128-a7e6-49db-b76e-e89bbf4193cc 2022-07-05T11:44:49.646 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.647 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2022-07-05T11:44:49.647 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2022-07-05T11:44:49.647 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.647 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2022-07-05T11:44:49.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2022-07-05T11:44:49.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2022-07-05T11:44:49.648 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2022-07-05T11:44:49.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.649 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2022-07-05T11:44:49.649 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2022-07-05T11:44:49.649 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2022-07-05T11:44:49.649 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2022-07-05T11:44:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2022-07-05T11:44:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.650 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2022-07-05T11:44:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2022-07-05T11:44:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2022-07-05T11:44:49.651 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.652 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2022-07-05T11:44:49.652 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2022-07-05T11:44:49.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.652 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2022-07-05T11:44:49.653 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2022-07-05T11:44:49.653 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2022-07-05T11:44:49.653 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore compression mode = aggressive 2022-07-05T11:44:49.653 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2022-07-05T11:44:49.653 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2022-07-05T11:44:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2022-07-05T11:44:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2022-07-05T11:44:49.654 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2022-07-05T11:44:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2022-07-05T11:44:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2022-07-05T11:44:49.655 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2022-07-05T11:44:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2022-07-05T11:44:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2022-07-05T11:44:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2022-07-05T11:44:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2022-07-05T11:44:49.656 INFO:teuthology.orchestra.run.smithi149.stdout: osd shutdown pgref assert = True 2022-07-05T11:44:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: osd_max_omap_entries_per_request = 10000 2022-07-05T11:44:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.657 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2022-07-05T11:44:49.657 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2022-07-05T11:44:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2022-07-05T11:44:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2022-07-05T11:44:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2022-07-05T11:44:49.658 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2022-07-05T11:44:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2022-07-05T11:44:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2022-07-05T11:44:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.659 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2022-07-05T11:44:49.659 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2022-07-05T11:44:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2022-07-05T11:44:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2022-07-05T11:44:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2022-07-05T11:44:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2022-07-05T11:44:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2022-07-05T11:44:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2022-07-05T11:44:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2022-07-05T11:44:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2022-07-05T11:44:49.661 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2022-07-05T11:44:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-07-05T11:44:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2022-07-05T11:44:49.662 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2022-07-05T11:44:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2022-07-05T11:44:49.663 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-07-05T11:44:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-07-05T11:44:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2022-07-05T11:44:49.664 INFO:teuthology.orchestra.run.smithi149.stdout: 2022-07-05T11:44:49.664 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2022-07-05T11:44:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2022-07-05T11:44:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2022-07-05T11:44:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2022-07-05T11:44:49.665 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-07-05T11:44:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-07-05T11:44:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2022-07-05T11:44:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2022-07-05T11:44:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2022-07-05T11:44:49.666 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2022-07-05T11:44:49.667 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2022-07-05T11:44:49.667 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2022-07-05T11:44:49.667 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2022-07-05T11:44:49.667 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2022-07-05T11:44:49.668 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2022-07-05T11:44:49.668 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2022-07-05T11:44:49.668 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.g] 2022-07-05T11:44:49.668 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.j] 2022-07-05T11:44:49.668 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2022-07-05T11:44:49.669 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.e] 2022-07-05T11:44:49.669 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.h] 2022-07-05T11:44:49.669 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.k] 2022-07-05T11:44:49.669 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2022-07-05T11:44:49.670 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.f] 2022-07-05T11:44:49.670 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.i] 2022-07-05T11:44:49.670 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.l] 2022-07-05T11:44:49.671 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2022-07-05T11:44:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2022-07-05T11:44:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2022-07-05T11:44:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal fragment size max = 10000 2022-07-05T11:44:49.671 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal merge size = 5 2022-07-05T11:44:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal split bits = 3 2022-07-05T11:44:49.672 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal split size = 100 2022-07-05T11:44:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2022-07-05T11:44:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2022-07-05T11:44:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2022-07-05T11:44:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2022-07-05T11:44:49.673 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2022-07-05T11:44:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2022-07-05T11:44:49.674 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2022-07-05T11:44:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2022-07-05T11:44:49.675 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2022-07-05T11:44:49.675 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-07-05T11:44:49.675 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2022-07-05T11:44:49.676 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.676 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2022-07-05T11:44:49.676 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.676 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2022-07-05T11:44:49.677 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.677 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2022-07-05T11:44:49.677 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2022-07-05T11:44:49.677 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.677 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2022-07-05T11:44:49.678 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2022-07-05T11:44:49.678 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.678 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2022-07-05T11:44:49.678 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2022-07-05T11:44:49.679 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.679 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2022-07-05T11:44:49.679 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2022-07-05T11:44:49.679 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.680 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2022-07-05T11:44:49.680 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.680 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2022-07-05T11:44:49.680 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2022-07-05T11:44:49.680 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2022-07-05T11:44:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2022-07-05T11:44:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2022-07-05T11:44:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2022-07-05T11:44:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2022-07-05T11:44:49.682 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-07-05T11:44:49.682 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2022-07-05T11:44:49.683 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2022-07-05T11:44:49.683 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.684 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-07-05T11:44:49.684 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.684 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2022-07-05T11:44:49.685 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.685 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2022-07-05T11:44:49.685 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.685 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2022-07-05T11:44:49.686 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2022-07-05T11:44:49.686 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2022-07-05T11:44:49.686 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.90,172.21.15.110,172.21.15.149" 2022-07-05T11:44:49.686 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2022-07-05T11:44:49.687 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = fc926128-a7e6-49db-b76e-e89bbf4193cc 2022-07-05T11:44:49.687 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2022-07-05T11:44:49.687 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2022-07-05T11:44:49.688 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.688 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2022-07-05T11:44:49.688 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2022-07-05T11:44:49.688 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.689 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2022-07-05T11:44:49.689 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2022-07-05T11:44:49.689 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.689 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2022-07-05T11:44:49.689 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2022-07-05T11:44:49.690 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2022-07-05T11:44:49.690 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.690 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2022-07-05T11:44:49.690 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2022-07-05T11:44:49.691 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.691 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2022-07-05T11:44:49.691 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.691 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2022-07-05T11:44:49.692 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.692 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2022-07-05T11:44:49.693 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.693 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2022-07-05T11:44:49.693 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2022-07-05T11:44:49.693 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.694 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2022-07-05T11:44:49.694 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2022-07-05T11:44:49.694 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2022-07-05T11:44:49.694 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression mode = aggressive 2022-07-05T11:44:49.695 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2022-07-05T11:44:49.695 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2022-07-05T11:44:49.695 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2022-07-05T11:44:49.695 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2022-07-05T11:44:49.696 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2022-07-05T11:44:49.696 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2022-07-05T11:44:49.696 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2022-07-05T11:44:49.696 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2022-07-05T11:44:49.697 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2022-07-05T11:44:49.697 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2022-07-05T11:44:49.697 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2022-07-05T11:44:49.697 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2022-07-05T11:44:49.697 INFO:teuthology.orchestra.run.smithi110.stdout: osd shutdown pgref assert = True 2022-07-05T11:44:49.698 INFO:teuthology.orchestra.run.smithi110.stdout: osd_max_omap_entries_per_request = 10000 2022-07-05T11:44:49.698 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2022-07-05T11:44:49.698 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2022-07-05T11:44:49.699 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2022-07-05T11:44:49.699 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2022-07-05T11:44:49.699 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2022-07-05T11:44:49.699 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2022-07-05T11:44:49.699 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2022-07-05T11:44:49.700 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2022-07-05T11:44:49.700 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.700 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2022-07-05T11:44:49.701 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2022-07-05T11:44:49.701 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2022-07-05T11:44:49.701 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2022-07-05T11:44:49.701 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2022-07-05T11:44:49.702 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2022-07-05T11:44:49.702 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2022-07-05T11:44:49.703 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2022-07-05T11:44:49.703 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2022-07-05T11:44:49.703 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2022-07-05T11:44:49.703 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2022-07-05T11:44:49.704 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.704 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-07-05T11:44:49.704 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2022-07-05T11:44:49.704 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2022-07-05T11:44:49.705 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.705 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2022-07-05T11:44:49.705 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-07-05T11:44:49.705 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-07-05T11:44:49.705 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2022-07-05T11:44:49.706 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-07-05T11:44:49.706 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2022-07-05T11:44:49.706 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2022-07-05T11:44:49.707 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2022-07-05T11:44:49.707 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2022-07-05T11:44:49.707 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-07-05T11:44:49.707 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-07-05T11:44:49.707 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2022-07-05T11:44:49.708 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2022-07-05T11:44:49.708 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2022-07-05T11:44:49.708 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2022-07-05T11:44:49.708 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2022-07-05T11:44:49.709 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2022-07-05T11:44:49.709 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2022-07-05T11:44:49.709 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2022-07-05T11:44:49.709 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2022-07-05T11:44:49.709 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2022-07-05T11:44:49.710 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.g] 2022-07-05T11:44:49.710 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.j] 2022-07-05T11:44:49.710 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2022-07-05T11:44:49.711 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2022-07-05T11:44:49.711 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.h] 2022-07-05T11:44:49.711 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.k] 2022-07-05T11:44:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2022-07-05T11:44:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2022-07-05T11:44:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.i] 2022-07-05T11:44:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.l] 2022-07-05T11:44:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2022-07-05T11:44:49.713 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2022-07-05T11:44:49.713 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2022-07-05T11:44:49.713 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal fragment size max = 10000 2022-07-05T11:44:49.713 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal merge size = 5 2022-07-05T11:44:49.714 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split bits = 3 2022-07-05T11:44:49.714 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split size = 100 2022-07-05T11:44:49.714 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2022-07-05T11:44:49.714 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2022-07-05T11:44:49.715 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2022-07-05T11:44:49.715 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2022-07-05T11:44:49.715 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2022-07-05T11:44:49.716 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2022-07-05T11:44:49.716 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2022-07-05T11:44:49.716 INFO:tasks.ceph:Creating admin key on mon.a... 2022-07-05T11:44:49.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-07-05T11:44:49.766 INFO:tasks.ceph:Copying monmap to all nodes... 2022-07-05T11:44:49.766 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:49.767 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-07-05T11:44:49.794 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:49.795 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-07-05T11:44:49.852 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2022-07-05T11:44:49.853 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:49.853 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2022-07-05T11:44:49.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-07-05T11:44:49.928 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:44:49.928 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:44:50.000 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2022-07-05T11:44:50.001 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:44:50.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2022-07-05T11:44:50.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-07-05T11:44:50.060 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:44:50.061 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:44:50.204 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2022-07-05T11:44:50.205 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:44:50.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2022-07-05T11:44:50.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-07-05T11:44:50.276 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:44:50.277 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:44:50.392 INFO:tasks.ceph:Setting up mon nodes... 2022-07-05T11:44:50.393 INFO:tasks.ceph:Setting up mgr nodes... 2022-07-05T11:44:50.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-07-05T11:44:50.447 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-07-05T11:44:50.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-07-05T11:44:50.521 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-07-05T11:44:50.524 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2022-07-05T11:44:50.605 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2022-07-05T11:44:50.609 INFO:tasks.ceph:Setting up mds nodes... 2022-07-05T11:44:50.610 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-07-05T11:44:50.676 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-07-05T11:44:50.677 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-07-05T11:44:50.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-07-05T11:44:50.854 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-07-05T11:44:50.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-07-05T11:44:50.930 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-g && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.g /var/lib/ceph/mds/ceph-g/keyring 2022-07-05T11:44:51.028 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-g/keyring 2022-07-05T11:44:51.031 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-g 2022-07-05T11:44:51.075 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-j && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.j /var/lib/ceph/mds/ceph-j/keyring 2022-07-05T11:44:51.176 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-j/keyring 2022-07-05T11:44:51.178 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-j 2022-07-05T11:44:51.217 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-07-05T11:44:51.274 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-07-05T11:44:51.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-07-05T11:44:51.311 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2022-07-05T11:44:51.424 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2022-07-05T11:44:51.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2022-07-05T11:44:51.450 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-h && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.h /var/lib/ceph/mds/ceph-h/keyring 2022-07-05T11:44:51.555 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-h/keyring 2022-07-05T11:44:51.556 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-h 2022-07-05T11:44:51.631 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-k && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.k /var/lib/ceph/mds/ceph-k/keyring 2022-07-05T11:44:51.722 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-k/keyring 2022-07-05T11:44:51.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-k 2022-07-05T11:44:51.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-07-05T11:44:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-07-05T11:44:51.824 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-07-05T11:44:51.858 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2022-07-05T11:44:51.955 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2022-07-05T11:44:51.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2022-07-05T11:44:51.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-i && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.i /var/lib/ceph/mds/ceph-i/keyring 2022-07-05T11:44:52.087 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-i/keyring 2022-07-05T11:44:52.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-i 2022-07-05T11:44:52.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-l && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.l /var/lib/ceph/mds/ceph-l/keyring 2022-07-05T11:44:52.211 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-l/keyring 2022-07-05T11:44:52.214 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-l 2022-07-05T11:44:52.283 INFO:tasks.ceph_client:Setting up client nodes... 2022-07-05T11:44:52.284 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-07-05T11:44:52.330 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-07-05T11:44:52.345 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-07-05T11:44:52.365 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2022-07-05T11:44:52.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-07-05T11:44:52.428 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-07-05T11:44:52.429 INFO:tasks.ceph:role: osd.0 2022-07-05T11:44:52.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2022-07-05T11:44:52.431 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-07-05T11:44:52.509 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:44:52.510 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:44:52.511 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:44:52.511 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2022-07-05T11:44:52.512 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:44:52.512 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:44:52.513 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:44:52.513 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:44:52.514 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:44:52.514 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:44:52.874 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2022-07-05T11:44:52.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2022-07-05T11:44:52.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-07-05T11:44:53.005 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-07-05T11:44:53.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-07-05T11:44:53.112 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-07-05T11:44:53.112 INFO:tasks.ceph:role: osd.3 2022-07-05T11:44:53.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2022-07-05T11:44:53.113 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-07-05T11:44:53.186 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:44:53.187 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:44:53.187 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:44:53.187 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2022-07-05T11:44:53.188 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:44:53.188 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:44:53.188 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:44:53.188 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:44:53.189 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:44:53.189 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:44:53.550 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2022-07-05T11:44:53.553 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2022-07-05T11:44:53.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2022-07-05T11:44:53.647 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-07-05T11:44:53.682 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-07-05T11:44:53.749 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-07-05T11:44:53.750 INFO:tasks.ceph:role: osd.6 2022-07-05T11:44:53.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2022-07-05T11:44:53.751 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-07-05T11:44:53.824 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:44:53.825 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:44:53.825 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:44:53.825 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2022-07-05T11:44:53.825 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:44:53.826 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:44:53.826 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:44:53.826 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:44:53.827 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:44:53.827 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:44:54.187 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2022-07-05T11:44:54.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2022-07-05T11:44:54.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-07-05T11:44:54.298 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-07-05T11:44:54.329 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2022-07-05T11:44:54.410 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-07-05T11:44:54.411 INFO:tasks.ceph:role: osd.9 2022-07-05T11:44:54.411 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2022-07-05T11:44:54.411 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-07-05T11:44:54.489 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:44:54.489 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:44:54.490 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:44:54.491 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2022-07-05T11:44:54.491 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:44:54.491 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:44:54.492 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:44:54.493 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:44:54.493 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:44:54.494 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:44:54.863 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2022-07-05T11:44:54.864 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2022-07-05T11:44:54.865 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2022-07-05T11:44:55.015 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2022-07-05T11:44:55.045 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:44:55.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:55.137+0000 7fd252881200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-07-05T11:44:55.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:55.137+0000 7fd252881200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-07-05T11:44:55.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:55.137+0000 7fd252881200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-07-05T11:44:55.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:55.137+0000 7fd252881200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-07-05T11:44:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:55.137+0000 7fd252881200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-07-05T11:44:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:55.146+0000 7fd252881200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-07-05T11:44:57.999 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-07-05T11:44:58.030 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:44:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:58.116+0000 7f5f4e1fa200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-07-05T11:44:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:58.116+0000 7f5f4e1fa200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-07-05T11:44:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:58.116+0000 7f5f4e1fa200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-07-05T11:44:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:58.116+0000 7f5f4e1fa200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-07-05T11:44:58.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:58.116+0000 7f5f4e1fa200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-07-05T11:44:58.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:44:58.116+0000 7f5f4e1fa200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-07-05T11:45:00.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-07-05T11:45:01.063 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:01.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:01.166+0000 7fe112428200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-07-05T11:45:01.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:01.166+0000 7fe112428200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-07-05T11:45:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:01.166+0000 7fe112428200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-07-05T11:45:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:01.166+0000 7fe112428200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-07-05T11:45:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:01.166+0000 7fe112428200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-07-05T11:45:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:01.167+0000 7fe112428200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-07-05T11:45:04.027 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-07-05T11:45:04.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:04.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:04.191+0000 7f1041f4f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2022-07-05T11:45:04.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:04.192+0000 7f1041f4f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2022-07-05T11:45:04.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:04.192+0000 7f1041f4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2022-07-05T11:45:04.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:04.192+0000 7f1041f4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2022-07-05T11:45:04.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:04.192+0000 7f1041f4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2022-07-05T11:45:04.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:04.192+0000 7f1041f4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2022-07-05T11:45:07.044 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2022-07-05T11:45:07.073 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-07-05T11:45:07.106 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:07.106 INFO:tasks.ceph:role: osd.1 2022-07-05T11:45:07.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2022-07-05T11:45:07.107 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-07-05T11:45:07.178 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:07.178 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:07.178 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:07.179 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2022-07-05T11:45:07.179 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:07.179 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:07.179 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:07.184 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:07.184 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:07.185 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:07.200 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2022-07-05T11:45:07.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2022-07-05T11:45:07.202 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2022-07-05T11:45:07.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-07-05T11:45:07.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-07-05T11:45:07.419 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:07.421 INFO:tasks.ceph:role: osd.4 2022-07-05T11:45:07.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2022-07-05T11:45:07.422 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-07-05T11:45:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:07.483 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:07.483 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:07.484 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2022-07-05T11:45:07.484 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:07.485 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:07.486 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:07.487 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:07.487 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:07.487 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:07.505 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2022-07-05T11:45:07.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2022-07-05T11:45:07.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2022-07-05T11:45:07.588 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-07-05T11:45:07.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-07-05T11:45:07.737 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:07.737 INFO:tasks.ceph:role: osd.7 2022-07-05T11:45:07.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2022-07-05T11:45:07.738 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-07-05T11:45:07.810 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:07.811 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:07.811 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:07.812 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2022-07-05T11:45:07.812 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:07.812 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:07.813 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:07.813 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:07.814 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:07.814 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:07.832 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2022-07-05T11:45:07.834 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2022-07-05T11:45:07.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2022-07-05T11:45:07.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-07-05T11:45:07.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2022-07-05T11:45:08.046 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:08.047 INFO:tasks.ceph:role: osd.10 2022-07-05T11:45:08.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2022-07-05T11:45:08.049 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-07-05T11:45:08.110 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2022-07-05T11:45:08.112 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:08.113 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:08.113 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:08.114 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:08.135 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2022-07-05T11:45:08.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2022-07-05T11:45:08.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2022-07-05T11:45:08.214 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2022-07-05T11:45:08.292 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:08.378 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:08.370+0000 7f2bc0bd7200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-07-05T11:45:08.379 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:08.370+0000 7f2bc0bd7200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-07-05T11:45:08.379 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:08.370+0000 7f2bc0bd7200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-07-05T11:45:08.380 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:08.370+0000 7f2bc0bd7200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-07-05T11:45:08.380 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:08.370+0000 7f2bc0bd7200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-07-05T11:45:08.380 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:08.370+0000 7f2bc0bd7200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-07-05T11:45:11.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-07-05T11:45:11.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:11.378 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:11.376+0000 7ff0e9045200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-07-05T11:45:11.378 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:11.376+0000 7ff0e9045200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-07-05T11:45:11.379 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:11.376+0000 7ff0e9045200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-07-05T11:45:11.379 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:11.376+0000 7ff0e9045200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-07-05T11:45:11.379 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:11.376+0000 7ff0e9045200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-07-05T11:45:11.379 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:11.377+0000 7ff0e9045200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-07-05T11:45:14.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-07-05T11:45:14.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:14.384 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:14.382+0000 7fbe5a284200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-07-05T11:45:14.384 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:14.382+0000 7fbe5a284200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-07-05T11:45:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:14.382+0000 7fbe5a284200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-07-05T11:45:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:14.382+0000 7fbe5a284200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-07-05T11:45:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:14.382+0000 7fbe5a284200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-07-05T11:45:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:14.382+0000 7fbe5a284200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-07-05T11:45:17.244 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-07-05T11:45:17.273 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:17.358 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:17.356+0000 7f5249262200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2022-07-05T11:45:17.358 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:17.356+0000 7f5249262200 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2022-07-05T11:45:17.359 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:17.356+0000 7f5249262200 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2022-07-05T11:45:17.359 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:17.356+0000 7f5249262200 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2022-07-05T11:45:17.359 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:17.356+0000 7f5249262200 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2022-07-05T11:45:17.359 INFO:teuthology.orchestra.run.smithi110.stderr:2022-07-05T11:45:17.356+0000 7f5249262200 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2022-07-05T11:45:18.003 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:45:18.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:45:18.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:45:20.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2022-07-05T11:45:20.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-07-05T11:45:20.272 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:20.272 INFO:tasks.ceph:role: osd.2 2022-07-05T11:45:20.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2022-07-05T11:45:20.274 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-07-05T11:45:20.351 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:20.352 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2022-07-05T11:45:20.353 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:20.353 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:20.354 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:20.354 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:20.355 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:20.723 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2022-07-05T11:45:20.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2022-07-05T11:45:20.725 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2022-07-05T11:45:20.856 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-07-05T11:45:20.889 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-07-05T11:45:20.955 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:20.956 INFO:tasks.ceph:role: osd.5 2022-07-05T11:45:20.956 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2022-07-05T11:45:20.957 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-07-05T11:45:21.028 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:21.029 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:21.029 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:21.030 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2022-07-05T11:45:21.030 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:21.031 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:21.031 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:21.032 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:21.032 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:21.032 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:21.390 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2022-07-05T11:45:21.394 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2022-07-05T11:45:21.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-07-05T11:45:21.458 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-07-05T11:45:21.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2022-07-05T11:45:21.582 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:21.582 INFO:tasks.ceph:role: osd.8 2022-07-05T11:45:21.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2022-07-05T11:45:21.584 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-07-05T11:45:21.674 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:21.675 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:21.675 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:21.676 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2022-07-05T11:45:21.676 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:21.676 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:21.677 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:21.677 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:21.677 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:21.678 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:22.035 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2022-07-05T11:45:22.038 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2022-07-05T11:45:22.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2022-07-05T11:45:22.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2022-07-05T11:45:22.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2022-07-05T11:45:22.245 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-07-05T11:45:22.245 INFO:tasks.ceph:role: osd.11 2022-07-05T11:45:22.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2022-07-05T11:45:22.246 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-07-05T11:45:22.321 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-07-05T11:45:22.322 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2022-07-05T11:45:22.322 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-07-05T11:45:22.322 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2022-07-05T11:45:22.322 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-07-05T11:45:22.323 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2022-07-05T11:45:22.323 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-07-05T11:45:22.323 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-07-05T11:45:22.324 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-07-05T11:45:22.324 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-07-05T11:45:22.690 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2022-07-05T11:45:22.691 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2022-07-05T11:45:22.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2022-07-05T11:45:22.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2022-07-05T11:45:22.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:22.939 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:22.938+0000 7f698798a200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-07-05T11:45:22.941 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:22.939+0000 7f698798a200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-07-05T11:45:22.941 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:22.939+0000 7f698798a200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-07-05T11:45:22.942 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:22.939+0000 7f698798a200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-07-05T11:45:22.942 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:22.939+0000 7f698798a200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-07-05T11:45:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:22.948+0000 7f698798a200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-07-05T11:45:25.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-07-05T11:45:25.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:25.950 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:25.948+0000 7f4fa53ef200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-07-05T11:45:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:25.948+0000 7f4fa53ef200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-07-05T11:45:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:25.948+0000 7f4fa53ef200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-07-05T11:45:25.951 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:25.948+0000 7f4fa53ef200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-07-05T11:45:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:25.948+0000 7f4fa53ef200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-07-05T11:45:25.952 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:25.948+0000 7f4fa53ef200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-07-05T11:45:28.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-07-05T11:45:28.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:28.949 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:28.947+0000 7f5ae2adc200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2022-07-05T11:45:28.949 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:28.947+0000 7f5ae2adc200 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2022-07-05T11:45:28.949 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:28.947+0000 7f5ae2adc200 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2022-07-05T11:45:28.949 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:28.947+0000 7f5ae2adc200 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2022-07-05T11:45:28.950 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:28.947+0000 7f5ae2adc200 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2022-07-05T11:45:28.950 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:28.947+0000 7f5ae2adc200 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2022-07-05T11:45:31.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2022-07-05T11:45:31.871 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:31.955 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:31.953+0000 7f210398b200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2022-07-05T11:45:31.956 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:31.954+0000 7f210398b200 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2022-07-05T11:45:31.957 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:31.954+0000 7f210398b200 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2022-07-05T11:45:31.957 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:31.954+0000 7f210398b200 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2022-07-05T11:45:31.958 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:31.954+0000 7f210398b200 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2022-07-05T11:45:31.958 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:31.954+0000 7f210398b200 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2022-07-05T11:45:34.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2022-07-05T11:45:34.870 INFO:tasks.ceph:Reading keys from all nodes... 2022-07-05T11:45:34.871 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:34.871 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-07-05T11:45:34.901 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:34.902 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-07-05T11:45:34.967 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:34.968 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-07-05T11:45:35.033 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:35.034 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-g/keyring of=/dev/stdout 2022-07-05T11:45:35.103 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:35.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-j/keyring of=/dev/stdout 2022-07-05T11:45:35.170 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:35.171 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-07-05T11:45:35.236 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:35.237 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-07-05T11:45:35.302 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:35.302 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-07-05T11:45:35.367 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:35.368 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2022-07-05T11:45:35.431 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-07-05T11:45:35.466 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.467 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-07-05T11:45:35.534 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.535 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2022-07-05T11:45:35.603 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.604 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-h/keyring of=/dev/stdout 2022-07-05T11:45:35.669 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.670 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-k/keyring of=/dev/stdout 2022-07-05T11:45:35.737 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.737 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-07-05T11:45:35.805 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.806 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-07-05T11:45:35.870 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-07-05T11:45:35.934 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:35.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2022-07-05T11:45:35.999 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.000 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2022-07-05T11:45:36.030 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-07-05T11:45:36.098 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2022-07-05T11:45:36.167 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.168 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-i/keyring of=/dev/stdout 2022-07-05T11:45:36.233 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-l/keyring of=/dev/stdout 2022-07-05T11:45:36.301 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.301 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-07-05T11:45:36.368 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-07-05T11:45:36.434 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2022-07-05T11:45:36.500 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:36.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2022-07-05T11:45:36.567 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:36.567 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-07-05T11:45:36.588 INFO:tasks.ceph:Adding keys to all mons... 2022-07-05T11:45:36.589 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2022-07-05T11:45:36.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2022-07-05T11:45:36.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2022-07-05T11:45:36.657 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2022-07-05T11:45:36.658 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAyJMRijCNoGhAAj4Gp5kHtumwRmrJPgB+E8w== 2022-07-05T11:45:36.658 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2022-07-05T11:45:36.658 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAyJMRiMkLhJxAA3ynlsy3tvD0VmGGNgYruIw== 2022-07-05T11:45:36.659 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2022-07-05T11:45:36.659 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAyJMRiblftMhAAXdkWjOMA19midUioDKDSMQ== 2022-07-05T11:45:36.659 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.g] 2022-07-05T11:45:36.659 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRihiWaARAAdo0g2iexkhYGdcFfkLdAtQ== 2022-07-05T11:45:36.660 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.j] 2022-07-05T11:45:36.660 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRidl9uChAAULErSyqzAvn/TpbID1HvCg== 2022-07-05T11:45:36.660 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2022-07-05T11:45:36.660 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQA3JMRi+slECBAAST6B0UjgWmjPIVypFjR1yQ== 2022-07-05T11:45:36.661 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2022-07-05T11:45:36.661 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQA6JMRiijQBBxAAvc4FLdx79un36fI9cLGgfQ== 2022-07-05T11:45:36.661 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2022-07-05T11:45:36.661 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQA9JMRiTsAFChAA9VDkp6WVkzm6ItOCmaViXA== 2022-07-05T11:45:36.661 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.9] 2022-07-05T11:45:36.662 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBAJMRiTQZ4CxAA60gfwkVmqTuJaTktLY4PeQ== 2022-07-05T11:45:36.662 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2022-07-05T11:45:36.662 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAyJMRitqQCHxAAFbXZjA/fGiTE7ge2Nif9Ug== 2022-07-05T11:45:36.662 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2022-07-05T11:45:36.663 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRiAac5EBAA7x4lRurFuSK0AF/L2vLKIg== 2022-07-05T11:45:36.663 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.e] 2022-07-05T11:45:36.663 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRix0bqGBAAV4l2Iudyjf0le8uvRx0sYQ== 2022-07-05T11:45:36.663 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.h] 2022-07-05T11:45:36.664 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRiUYp1IBAATAbrHJkxTTH5uU2qA6LNQg== 2022-07-05T11:45:36.664 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.k] 2022-07-05T11:45:36.664 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRi/Fv9KhAA8fooUYT2HPnhTOPhKyU86A== 2022-07-05T11:45:36.665 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2022-07-05T11:45:36.665 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBEJMRijlcdFhAAyR5XBWWib5kBEMh2w39ELQ== 2022-07-05T11:45:36.665 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2022-07-05T11:45:36.665 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBHJMRimPN6FhAAzCsRLqktF9GNhgvz1PIJRw== 2022-07-05T11:45:36.666 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2022-07-05T11:45:36.666 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBKJMRi0ZrTFhAA6a1cQeVA3ICKuGmRsNSYsg== 2022-07-05T11:45:36.666 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.10] 2022-07-05T11:45:36.667 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBNJMRihSlEFRAAIvIT/y/FOI4I1xulIO7Q/w== 2022-07-05T11:45:36.667 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.z] 2022-07-05T11:45:36.667 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAyJMRiNFkSJBAANRM/6jr4FXSgUycWZJtqog== 2022-07-05T11:45:36.667 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2022-07-05T11:45:36.667 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRiD23sMBAAlghqUP7ZoYUbrRQJE2xUeA== 2022-07-05T11:45:36.668 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.f] 2022-07-05T11:45:36.668 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAzJMRiWCbTOBAAnrFtP1+qiJR6wEvTzRtJWQ== 2022-07-05T11:45:36.668 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.i] 2022-07-05T11:45:36.668 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQA0JMRieGkFBRAAVGKVbsMbApXjjC0nruCgHg== 2022-07-05T11:45:36.669 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.l] 2022-07-05T11:45:36.669 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQA0JMRiB4aIDBAAJF9F95I2n0u8XPGAfXDa5A== 2022-07-05T11:45:36.669 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2022-07-05T11:45:36.669 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBSJMRifzj8NxAA2j26TNerbdjKzhxRHIV9HA== 2022-07-05T11:45:36.670 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2022-07-05T11:45:36.670 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBVJMRiF+SLOBAAFFGqcrlEPuuQlUx21XSQtg== 2022-07-05T11:45:36.670 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.8] 2022-07-05T11:45:36.670 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBYJMRiQUF7OBAAPcG3+FDx5lhGvY7yQV+BEw== 2022-07-05T11:45:36.671 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.11] 2022-07-05T11:45:36.671 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBbJMRivJvjOBAAlCt/oFQgNSsu2JC5wDMsyQ== 2022-07-05T11:45:36.671 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2022-07-05T11:45:36.671 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQA0JMRiZdWuExAAjd9vnfS8yOLiF9ap7eLEUg== 2022-07-05T11:45:36.675 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2022-07-05T11:45:36.675 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAyJMRijCNoGhAAj4Gp5kHtumwRmrJPgB+E8w== 2022-07-05T11:45:36.675 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2022-07-05T11:45:36.676 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAyJMRiMkLhJxAA3ynlsy3tvD0VmGGNgYruIw== 2022-07-05T11:45:36.676 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2022-07-05T11:45:36.676 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAyJMRiblftMhAAXdkWjOMA19midUioDKDSMQ== 2022-07-05T11:45:36.676 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.g] 2022-07-05T11:45:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRihiWaARAAdo0g2iexkhYGdcFfkLdAtQ== 2022-07-05T11:45:36.677 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.j] 2022-07-05T11:45:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRidl9uChAAULErSyqzAvn/TpbID1HvCg== 2022-07-05T11:45:36.678 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2022-07-05T11:45:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA3JMRi+slECBAAST6B0UjgWmjPIVypFjR1yQ== 2022-07-05T11:45:36.678 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2022-07-05T11:45:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA6JMRiijQBBxAAvc4FLdx79un36fI9cLGgfQ== 2022-07-05T11:45:36.679 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2022-07-05T11:45:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA9JMRiTsAFChAA9VDkp6WVkzm6ItOCmaViXA== 2022-07-05T11:45:36.679 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.9] 2022-07-05T11:45:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBAJMRiTQZ4CxAA60gfwkVmqTuJaTktLY4PeQ== 2022-07-05T11:45:36.680 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2022-07-05T11:45:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAyJMRitqQCHxAAFbXZjA/fGiTE7ge2Nif9Ug== 2022-07-05T11:45:36.680 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2022-07-05T11:45:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRiAac5EBAA7x4lRurFuSK0AF/L2vLKIg== 2022-07-05T11:45:36.681 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2022-07-05T11:45:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRix0bqGBAAV4l2Iudyjf0le8uvRx0sYQ== 2022-07-05T11:45:36.681 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.h] 2022-07-05T11:45:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRiUYp1IBAATAbrHJkxTTH5uU2qA6LNQg== 2022-07-05T11:45:36.682 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.k] 2022-07-05T11:45:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRi/Fv9KhAA8fooUYT2HPnhTOPhKyU86A== 2022-07-05T11:45:36.682 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2022-07-05T11:45:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBEJMRijlcdFhAAyR5XBWWib5kBEMh2w39ELQ== 2022-07-05T11:45:36.683 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2022-07-05T11:45:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBHJMRimPN6FhAAzCsRLqktF9GNhgvz1PIJRw== 2022-07-05T11:45:36.683 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2022-07-05T11:45:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBKJMRi0ZrTFhAA6a1cQeVA3ICKuGmRsNSYsg== 2022-07-05T11:45:36.684 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.10] 2022-07-05T11:45:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBNJMRihSlEFRAAIvIT/y/FOI4I1xulIO7Q/w== 2022-07-05T11:45:36.684 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.z] 2022-07-05T11:45:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAyJMRiNFkSJBAANRM/6jr4FXSgUycWZJtqog== 2022-07-05T11:45:36.684 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2022-07-05T11:45:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRiD23sMBAAlghqUP7ZoYUbrRQJE2xUeA== 2022-07-05T11:45:36.685 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2022-07-05T11:45:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAzJMRiWCbTOBAAnrFtP1+qiJR6wEvTzRtJWQ== 2022-07-05T11:45:36.685 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.i] 2022-07-05T11:45:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA0JMRieGkFBRAAVGKVbsMbApXjjC0nruCgHg== 2022-07-05T11:45:36.686 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.l] 2022-07-05T11:45:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA0JMRiB4aIDBAAJF9F95I2n0u8XPGAfXDa5A== 2022-07-05T11:45:36.686 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2022-07-05T11:45:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBSJMRifzj8NxAA2j26TNerbdjKzhxRHIV9HA== 2022-07-05T11:45:36.687 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2022-07-05T11:45:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBVJMRiF+SLOBAAFFGqcrlEPuuQlUx21XSQtg== 2022-07-05T11:45:36.687 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.8] 2022-07-05T11:45:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBYJMRiQUF7OBAAPcG3+FDx5lhGvY7yQV+BEw== 2022-07-05T11:45:36.688 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.11] 2022-07-05T11:45:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBbJMRivJvjOBAAlCt/oFQgNSsu2JC5wDMsyQ== 2022-07-05T11:45:36.688 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2022-07-05T11:45:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA0JMRiZdWuExAAjd9vnfS8yOLiF9ap7eLEUg== 2022-07-05T11:45:36.689 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2022-07-05T11:45:36.689 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAyJMRijCNoGhAAj4Gp5kHtumwRmrJPgB+E8w== 2022-07-05T11:45:36.689 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2022-07-05T11:45:36.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAyJMRiMkLhJxAA3ynlsy3tvD0VmGGNgYruIw== 2022-07-05T11:45:36.690 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2022-07-05T11:45:36.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAyJMRiblftMhAAXdkWjOMA19midUioDKDSMQ== 2022-07-05T11:45:36.690 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.g] 2022-07-05T11:45:36.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRihiWaARAAdo0g2iexkhYGdcFfkLdAtQ== 2022-07-05T11:45:36.691 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.j] 2022-07-05T11:45:36.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRidl9uChAAULErSyqzAvn/TpbID1HvCg== 2022-07-05T11:45:36.691 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2022-07-05T11:45:36.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA3JMRi+slECBAAST6B0UjgWmjPIVypFjR1yQ== 2022-07-05T11:45:36.692 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2022-07-05T11:45:36.692 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA6JMRiijQBBxAAvc4FLdx79un36fI9cLGgfQ== 2022-07-05T11:45:36.692 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2022-07-05T11:45:36.692 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA9JMRiTsAFChAA9VDkp6WVkzm6ItOCmaViXA== 2022-07-05T11:45:36.693 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.9] 2022-07-05T11:45:36.693 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBAJMRiTQZ4CxAA60gfwkVmqTuJaTktLY4PeQ== 2022-07-05T11:45:36.693 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2022-07-05T11:45:36.693 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAyJMRitqQCHxAAFbXZjA/fGiTE7ge2Nif9Ug== 2022-07-05T11:45:36.693 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2022-07-05T11:45:36.694 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRiAac5EBAA7x4lRurFuSK0AF/L2vLKIg== 2022-07-05T11:45:36.694 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.e] 2022-07-05T11:45:36.694 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRix0bqGBAAV4l2Iudyjf0le8uvRx0sYQ== 2022-07-05T11:45:36.694 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.h] 2022-07-05T11:45:36.695 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRiUYp1IBAATAbrHJkxTTH5uU2qA6LNQg== 2022-07-05T11:45:36.695 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.k] 2022-07-05T11:45:36.695 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRi/Fv9KhAA8fooUYT2HPnhTOPhKyU86A== 2022-07-05T11:45:36.695 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2022-07-05T11:45:36.696 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBEJMRijlcdFhAAyR5XBWWib5kBEMh2w39ELQ== 2022-07-05T11:45:36.696 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2022-07-05T11:45:36.696 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBHJMRimPN6FhAAzCsRLqktF9GNhgvz1PIJRw== 2022-07-05T11:45:36.696 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2022-07-05T11:45:36.696 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBKJMRi0ZrTFhAA6a1cQeVA3ICKuGmRsNSYsg== 2022-07-05T11:45:36.697 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.10] 2022-07-05T11:45:36.697 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBNJMRihSlEFRAAIvIT/y/FOI4I1xulIO7Q/w== 2022-07-05T11:45:36.697 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.z] 2022-07-05T11:45:36.697 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAyJMRiNFkSJBAANRM/6jr4FXSgUycWZJtqog== 2022-07-05T11:45:36.698 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2022-07-05T11:45:36.698 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRiD23sMBAAlghqUP7ZoYUbrRQJE2xUeA== 2022-07-05T11:45:36.698 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.f] 2022-07-05T11:45:36.698 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAzJMRiWCbTOBAAnrFtP1+qiJR6wEvTzRtJWQ== 2022-07-05T11:45:36.699 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.i] 2022-07-05T11:45:36.699 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA0JMRieGkFBRAAVGKVbsMbApXjjC0nruCgHg== 2022-07-05T11:45:36.699 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.l] 2022-07-05T11:45:36.699 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA0JMRiB4aIDBAAJF9F95I2n0u8XPGAfXDa5A== 2022-07-05T11:45:36.699 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2022-07-05T11:45:36.700 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBSJMRifzj8NxAA2j26TNerbdjKzhxRHIV9HA== 2022-07-05T11:45:36.700 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2022-07-05T11:45:36.700 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBVJMRiF+SLOBAAFFGqcrlEPuuQlUx21XSQtg== 2022-07-05T11:45:36.700 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.8] 2022-07-05T11:45:36.701 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBYJMRiQUF7OBAAPcG3+FDx5lhGvY7yQV+BEw== 2022-07-05T11:45:36.701 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.11] 2022-07-05T11:45:36.701 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBbJMRivJvjOBAAlCt/oFQgNSsu2JC5wDMsyQ== 2022-07-05T11:45:36.701 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2022-07-05T11:45:36.702 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA0JMRiZdWuExAAjd9vnfS8yOLiF9ap7eLEUg== 2022-07-05T11:45:36.702 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:36.716 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:36.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:36.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.775 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.861 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.869 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.918 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.920 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.923 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.974 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:36.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.033 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.121 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.213 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.217 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.303 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:37.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:37.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:37.466 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.481 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.558 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.620 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.629 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.679 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.682 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:37.734 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.736 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.739 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.790 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.876 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.966 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:37.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.045 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:38.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:38.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-07-05T11:45:38.103 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.193 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.196 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.200 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.250 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.254 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.311 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-07-05T11:45:38.363 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.389 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.436 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.466 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.607 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.613 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-07-05T11:45:38.663 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-07-05T11:45:38.702 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-07-05T11:45:38.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-07-05T11:45:38.755 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-07-05T11:45:38.756 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-07-05T11:45:38.783 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-07-05T11:45:38.873 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-07-05T11:45:38.899 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-07-05T11:45:38.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-07-05T11:45:39.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-07-05T11:45:39.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-07-05T11:45:39.076 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-07-05T11:45:39.168 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-07-05T11:45:39.192 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:39.195 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:39.197 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-07-05T11:45:39.247 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-07-05T11:45:39.247 INFO:tasks.ceph.mon.a:Restarting daemon 2022-07-05T11:45:39.248 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-07-05T11:45:39.251 INFO:tasks.ceph.mon.a:Started 2022-07-05T11:45:39.251 INFO:tasks.ceph.mon.b:Restarting daemon 2022-07-05T11:45:39.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-07-05T11:45:39.254 INFO:tasks.ceph.mon.b:Started 2022-07-05T11:45:39.254 INFO:tasks.ceph.mon.c:Restarting daemon 2022-07-05T11:45:39.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-07-05T11:45:39.288 INFO:tasks.ceph.mon.c:Started 2022-07-05T11:45:39.289 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-07-05T11:45:39.289 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-07-05T11:45:39.290 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-07-05T11:45:39.292 INFO:tasks.ceph.mgr.x:Started 2022-07-05T11:45:39.293 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-07-05T11:45:39.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-07-05T11:45:39.295 INFO:tasks.ceph.mgr.y:Started 2022-07-05T11:45:39.296 INFO:tasks.ceph.mgr.z:Restarting daemon 2022-07-05T11:45:39.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2022-07-05T11:45:39.299 INFO:tasks.ceph.mgr.z:Started 2022-07-05T11:45:39.300 INFO:tasks.ceph:Setting crush tunables to default 2022-07-05T11:45:39.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd crush tunables default 2022-07-05T11:45:39.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:39.414+0000 7f89f854c700 1 Processor -- start 2022-07-05T11:45:39.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:39.414+0000 7f89f854c700 1 -- start start 2022-07-05T11:45:39.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:39.415+0000 7f89f854c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0068da0 con 0x7f89f00e6110 2022-07-05T11:45:39.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:39.415+0000 7f89f854c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0069080 con 0x7f89f017dda0 2022-07-05T11:45:39.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:39.415+0000 7f89f854c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0069360 con 0x7f89f017e180 2022-07-05T11:45:39.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:39.415+0000 7f89f5ae7700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f89f00e6110 0x7f89f0181bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48546/0 (socket says 172.21.15.90:48546) 2022-07-05T11:45:39.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:39.416+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 learned_addr learned my addr 172.21.15.90:0/3957548716 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:45:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 >> v1:172.21.15.149:6789/0 conn(0x7f89f017e180 legacy=0x7f89f0182300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 >> v1:172.21.15.110:6789/0 conn(0x7f89f017dda0 legacy=0x7f89f0083570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 >> v1:172.21.15.90:6789/0 conn(0x7f89f00e6110 legacy=0x7f89f0181bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:42.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:42.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d000b730 con 0x7f89d0008ba0 2022-07-05T11:45:42.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d000b8f0 con 0x7f89d0006040 2022-07-05T11:45:42.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d000bab0 con 0x7f89d0003610 2022-07-05T11:45:42.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:42.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:42.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-07-05T11:45:42.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:42.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:42.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-07-05T11:45:42.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:42.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-07-05T11:45:42.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:42.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:42.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-07-05T11:45:42.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-07-05T11:45:42.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:42.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:42.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.415+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-07-05T11:45:42.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:42.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-07-05T11:45:42.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:42.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:42.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-07-05T11:45:42.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-07-05T11:45:42.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:42.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:42.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-07-05T11:45:42.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:42.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-07-05T11:45:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:42.616+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-07-05T11:45:43.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:43.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-07-05T11:45:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-07-05T11:45:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-07-05T11:45:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-07-05T11:45:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-07-05T11:45:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:43.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.017+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-07-05T11:45:43.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:43.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-07-05T11:45:43.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:43.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:43.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-07-05T11:45:43.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:43.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:43.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-07-05T11:45:43.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f62e8700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:43.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:43.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f62e8700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-07-05T11:45:43.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-07-05T11:45:43.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f5ae7700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-07-05T11:45:43.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-07-05T11:45:43.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:43.818+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-07-05T11:45:44.734 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:44.733+0000 7f64e46eb680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-07-05T11:45:44.748 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:44.746+0000 7fe316f96680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-07-05T11:45:44.756 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:44.755+0000 7f4c64b84680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-07-05T11:45:44.802 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:44.800+0000 7f64e46eb680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-07-05T11:45:44.816 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:44.814+0000 7fe316f96680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-07-05T11:45:44.825 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:44.823+0000 7f4c64b84680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-07-05T11:45:45.227 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:45.224+0000 7f64e46eb680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-07-05T11:45:45.258 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:45.256+0000 7fe316f96680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-07-05T11:45:45.274 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:45.272+0000 7f4c64b84680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-07-05T11:45:45.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 msgr2=0x7f89d0005a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:45:45.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.149:3300/0 conn(0x7f89d0003610 0x7f89d0005a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 msgr2=0x7f89d0008500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:45:45.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.110:3300/0 conn(0x7f89d0006040 0x7f89d0008500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 msgr2=0x7f89d000b040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:45:45.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0008ba0 0x7f89d000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 reap_dead start 2022-07-05T11:45:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 reap_dead start 2022-07-05T11:45:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0003a50 0x7f89d00064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0069640 con 0x7f89f00e6110 2022-07-05T11:45:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d0007ab0 con 0x7f89f017e180 2022-07-05T11:45:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89effff700 1 -- 172.21.15.90:0/3957548716 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d000b730 con 0x7f89d0003a50 2022-07-05T11:45:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> v2:172.21.15.90:3300/0 conn(0x7f89d0003a50 0x7f89d00064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v1:172.21.15.149:6789/0 conn(0x7f89f017e180 legacy=0x7f89d000df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 >> v1:172.21.15.90:6789/0 conn(0x7f89f00e6110 legacy=0x7f89d0011670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f6ae9700 1 -- 172.21.15.90:0/3957548716 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0007c40 con 0x7f89d0003a50 2022-07-05T11:45:45.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f52e6700 1 -- 172.21.15.90:0/3957548716 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160329101 0 0) 0x7f89f0069640 con 0x7f89f00e6110 2022-07-05T11:45:45.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.415+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/3957548716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89d0003a50 0x7f89d00064f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f89f00f0520 tx=0x7f89e8009040).ready entity=mon.0 client_cookie=4daa0e587880c558 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:45.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f52e6700 1 -- 172.21.15.90:0/3957548716 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8017460 con 0x7f89d0003a50 2022-07-05T11:45:45.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f52e6700 1 -- 172.21.15.90:0/3957548716 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e80175c0 con 0x7f89d0003a50 2022-07-05T11:45:45.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f52e6700 1 -- 172.21.15.90:0/3957548716 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8017940 con 0x7f89d0003a50 2022-07-05T11:45:45.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f854c700 1 -- 172.21.15.90:0/3957548716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89d0003a50 msgr2=0x7f89d00064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:45.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f854c700 1 --2- 172.21.15.90:0/3957548716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89d0003a50 0x7f89d00064f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f89f00f0520 tx=0x7f89e8009040).stop 2022-07-05T11:45:45.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f854c700 1 -- 172.21.15.90:0/3957548716 shutdown_connections 2022-07-05T11:45:45.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f854c700 1 --2- 172.21.15.90:0/3957548716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89d0003a50 0x7f89d00064f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f854c700 1 -- 172.21.15.90:0/3957548716 >> 172.21.15.90:0/3957548716 conn(0x7f89f00f0030 msgr2=0x7f89f0061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:45.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f854c700 1 -- 172.21.15.90:0/3957548716 shutdown_connections 2022-07-05T11:45:45.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.416+0000 7f89f854c700 1 -- 172.21.15.90:0/3957548716 wait complete. 2022-07-05T11:45:45.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.418+0000 7f89f854c700 1 Processor -- start 2022-07-05T11:45:45.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.418+0000 7f89f854c700 1 -- start start 2022-07-05T11:45:45.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d0003a50 0x7f89f0084c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:45.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f00e6110 0x7f89f0085130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f017e180 0x7f89f00ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00847b0 con 0x7f89f017e180 2022-07-05T11:45:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0083bc0 con 0x7f89d0003a50 2022-07-05T11:45:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f017d1f0 con 0x7f89f00e6110 2022-07-05T11:45:45.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f017e180 0x7f89f00ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:45.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f017e180 0x7f89f00ebf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55680/0 (socket says 172.21.15.90:55680) 2022-07-05T11:45:45.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 -- 172.21.15.90:0/835165160 learned_addr learned my addr 172.21.15.90:0/835165160 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:45.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f5ae7700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f00e6110 0x7f89f0085130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:45.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f62e8700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d0003a50 0x7f89f0084c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:45.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 -- 172.21.15.90:0/835165160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f00e6110 msgr2=0x7f89f0085130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:45.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f00e6110 0x7f89f0085130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 -- 172.21.15.90:0/835165160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d0003a50 msgr2=0x7f89f0084c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:45.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d0003a50 0x7f89f0084c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 -- 172.21.15.90:0/835165160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e800f040 con 0x7f89f017e180 2022-07-05T11:45:45.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f6ae9700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f017e180 0x7f89f00ebf90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f89d000b670 tx=0x7f89e8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:45.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89ee7fc700 1 -- 172.21.15.90:0/835165160 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8003da0 con 0x7f89f017e180 2022-07-05T11:45:45.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89ee7fc700 1 -- 172.21.15.90:0/835165160 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8017730 con 0x7f89f017e180 2022-07-05T11:45:45.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f0083e80 con 0x7f89f017e180 2022-07-05T11:45:45.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89ee7fc700 1 -- 172.21.15.90:0/835165160 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8024670 con 0x7f89f017e180 2022-07-05T11:45:45.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.419+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0084440 con 0x7f89f017e180 2022-07-05T11:45:45.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.420+0000 7f89ee7fc700 1 -- 172.21.15.90:0/835165160 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f89e8013040 con 0x7f89f017e180 2022-07-05T11:45:45.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.420+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0084920 con 0x7f89f017e180 2022-07-05T11:45:45.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.420+0000 7f89ee7fc700 1 -- 172.21.15.90:0/835165160 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f89e8021430 con 0x7f89f017e180 2022-07-05T11:45:45.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.424+0000 7f89ee7fc700 1 -- 172.21.15.90:0/835165160 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f89e8021670 con 0x7f89f017e180 2022-07-05T11:45:45.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.496+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f89f006b1e0 con 0x7f89f017e180 2022-07-05T11:45:45.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.501+0000 7f89ee7fc700 1 -- 172.21.15.90:0/835165160 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f89e8021810 con 0x7f89f017e180 2022-07-05T11:45:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f017e180 msgr2=0x7f89f00ebf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f017e180 0x7f89f00ebf90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f89d000b670 tx=0x7f89e8009040).stop 2022-07-05T11:45:45.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 shutdown_connections 2022-07-05T11:45:45.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f017e180 0x7f89f00ebf90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d0003a50 0x7f89f0084c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 --2- 172.21.15.90:0/835165160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f00e6110 0x7f89f0085130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:45.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 >> 172.21.15.90:0/835165160 conn(0x7f89f00f0030 msgr2=0x7f89f00e9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:45.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 shutdown_connections 2022-07-05T11:45:45.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:45.502+0000 7f89f854c700 1 -- 172.21.15.90:0/835165160 wait complete. 2022-07-05T11:45:45.510 INFO:teuthology.orchestra.run.smithi090.stderr:adjusted tunables profile to default 2022-07-05T11:45:45.516 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-07-05T11:45:45.517 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:45.518 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-07-05T11:45:45.541 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:45.542 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-07-05T11:45:45.605 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:45.605 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-07-05T11:45:45.669 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:45:45.670 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2022-07-05T11:45:45.733 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:45.734 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-07-05T11:45:45.759 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:45.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-07-05T11:45:45.824 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:45.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-07-05T11:45:45.895 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2022-07-05T11:45:45.896 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2022-07-05T11:45:45.959 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:45.958+0000 7f64e46eb680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-07-05T11:45:45.971 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:45.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-07-05T11:45:45.978 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:45.976+0000 7f4c64b84680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-07-05T11:45:45.988 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:45.986+0000 7fe316f96680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-07-05T11:45:45.998 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:45.998 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-07-05T11:45:46.027 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:46.026+0000 7f64e46eb680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-07-05T11:45:46.047 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:46.045+0000 7f4c64b84680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-07-05T11:45:46.053 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:46.051+0000 7fe316f96680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-07-05T11:45:46.062 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:46.062 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2022-07-05T11:45:46.127 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2022-07-05T11:45:46.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2022-07-05T11:45:46.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new e594880d-164a-4adc-8b41-18c6f1737dda 0 2022-07-05T11:45:46.210 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:46.208+0000 7f64e46eb680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-07-05T11:45:46.235 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:46.233+0000 7fe316f96680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-07-05T11:45:46.244 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:46.242+0000 7f4c64b84680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-07-05T11:45:46.346 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.344+0000 7fdc7bb3b700 1 Processor -- start 2022-07-05T11:45:46.347 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.344+0000 7fdc7bb3b700 1 -- start start 2022-07-05T11:45:46.350 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7bb3b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdc7417bb10 0x7fdc740643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7bb3b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdc740ca610 0x7fdc7417feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7bb3b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdc741803a0 0x7fdc741807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7bb3b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740c9f20 con 0x7fdc7417bb10 2022-07-05T11:45:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7bb3b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740caac0 con 0x7fdc740ca610 2022-07-05T11:45:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7bb3b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740cad50 con 0x7fdc741803a0 2022-07-05T11:45:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdc741803a0 0x7fdc741807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdc741803a0 0x7fdc741807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58714/0 (socket says 172.21.15.149:58714) 2022-07-05T11:45:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/217477246 learned_addr learned my addr 172.21.15.149:0/217477246 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc798d7700 1 --2- 172.21.15.149:0/217477246 >> v2:172.21.15.90:3300/0 conn(0x7fdc7417bb10 0x7fdc740643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc790d6700 1 --2- 172.21.15.149:0/217477246 >> v2:172.21.15.110:3300/0 conn(0x7fdc740ca610 0x7fdc7417feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/217477246 >> v2:172.21.15.110:3300/0 conn(0x7fdc740ca610 msgr2=0x7fdc7417feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:46.354 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 --2- 172.21.15.149:0/217477246 >> v2:172.21.15.110:3300/0 conn(0x7fdc740ca610 0x7fdc7417feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.354 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/217477246 >> v2:172.21.15.90:3300/0 conn(0x7fdc7417bb10 msgr2=0x7fdc740643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:46.354 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 --2- 172.21.15.149:0/217477246 >> v2:172.21.15.90:3300/0 conn(0x7fdc7417bb10 0x7fdc740643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.354 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/217477246 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc740cb030 con 0x7fdc741803a0 2022-07-05T11:45:46.355 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc7a0d8700 1 --2- 172.21.15.149:0/217477246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc741807c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fdc7405e0a0 tx=0x7fdc6c009840).ready entity=mon.2 client_cookie=78182b8095411813 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:46.355 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc788d5700 1 -- 172.21.15.149:0/217477246 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00e070 con 0x7fdc741803a0 2022-07-05T11:45:46.355 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc788d5700 1 -- 172.21.15.149:0/217477246 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c00b940 con 0x7fdc741803a0 2022-07-05T11:45:46.355 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.346+0000 7fdc788d5700 1 -- 172.21.15.149:0/217477246 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00bcc0 con 0x7fdc741803a0 2022-07-05T11:45:46.356 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/217477246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 msgr2=0x7fdc741807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.356 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/217477246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc741807c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fdc7405e0a0 tx=0x7fdc6c009840).stop 2022-07-05T11:45:46.356 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/217477246 shutdown_connections 2022-07-05T11:45:46.356 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/217477246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc741807c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.356 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/217477246 >> v2:172.21.15.90:3300/0 conn(0x7fdc7417bb10 0x7fdc740643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.357 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/217477246 >> v2:172.21.15.110:3300/0 conn(0x7fdc740ca610 0x7fdc7417feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.357 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/217477246 >> 172.21.15.149:0/217477246 conn(0x7fdc740f1680 msgr2=0x7fdc740f1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:46.357 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/217477246 shutdown_connections 2022-07-05T11:45:46.358 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.347+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/217477246 wait complete. 2022-07-05T11:45:46.358 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.348+0000 7fdc7bb3b700 1 Processor -- start 2022-07-05T11:45:46.359 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.348+0000 7fdc7bb3b700 1 -- start start 2022-07-05T11:45:46.363 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7bb3b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc740ca610 0x7fdc74158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.363 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7bb3b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc7417bb10 0x7fdc7417bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.363 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7bb3b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc7417c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.363 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7bb3b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74063480 con 0x7fdc740ca610 2022-07-05T11:45:46.364 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7bb3b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74062870 con 0x7fdc7417bb10 2022-07-05T11:45:46.364 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7bb3b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74062b50 con 0x7fdc741803a0 2022-07-05T11:45:46.365 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7a0d8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc7417c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.365 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7a0d8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc7417c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58720/0 (socket says 172.21.15.149:58720) 2022-07-05T11:45:46.366 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.349+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/3818898478 learned_addr learned my addr 172.21.15.149:0/3818898478 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:46.366 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc798d7700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc740ca610 0x7fdc74158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.367 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc790d6700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc7417bb10 0x7fdc7417bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.367 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/3818898478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc7417bb10 msgr2=0x7fdc7417bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.367 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7a0d8700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc7417bb10 0x7fdc7417bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.367 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/3818898478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc740ca610 msgr2=0x7fdc74158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.368 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7a0d8700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc740ca610 0x7fdc74158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.369 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7a0d8700 1 -- 172.21.15.149:0/3818898478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009ae0 con 0x7fdc741803a0 2022-07-05T11:45:46.369 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc798d7700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc740ca610 0x7fdc74158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:45:46.370 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7a0d8700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc7417c4e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fdc740f4b80 tx=0x7fdc6c009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:46.370 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc61ffb700 1 -- 172.21.15.149:0/3818898478 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00beb0 con 0x7fdc741803a0 2022-07-05T11:45:46.371 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc61ffb700 1 -- 172.21.15.149:0/3818898478 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c00bcc0 con 0x7fdc741803a0 2022-07-05T11:45:46.371 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc74062e30 con 0x7fdc741803a0 2022-07-05T11:45:46.372 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc61ffb700 1 -- 172.21.15.149:0/3818898478 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c01d6b0 con 0x7fdc741803a0 2022-07-05T11:45:46.372 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.350+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc74159230 con 0x7fdc741803a0 2022-07-05T11:45:46.372 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.351+0000 7fdc61ffb700 1 -- 172.21.15.149:0/3818898478 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fdc6c024030 con 0x7fdc741803a0 2022-07-05T11:45:46.373 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.351+0000 7fdc61ffb700 1 -- 172.21.15.149:0/3818898478 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fdc6c027440 con 0x7fdc741803a0 2022-07-05T11:45:46.373 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.351+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc740635f0 con 0x7fdc741803a0 2022-07-05T11:45:46.374 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.355+0000 7fdc61ffb700 1 -- 172.21.15.149:0/3818898478 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7fdc6c02c060 con 0x7fdc741803a0 2022-07-05T11:45:46.437 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.435+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e594880d-164a-4adc-8b41-18c6f1737dda", "id": 0} v 0) v1 -- 0x7fdc740cb310 con 0x7fdc741803a0 2022-07-05T11:45:46.443 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.441+0000 7fdc61ffb700 1 -- 172.21.15.149:0/3818898478 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e594880d-164a-4adc-8b41-18c6f1737dda", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc6c0350b0 con 0x7fdc741803a0 2022-07-05T11:45:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:0 2022-07-05T11:45:46.444 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.442+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 msgr2=0x7fdc7417c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.445 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.442+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc7417c4e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fdc740f4b80 tx=0x7fdc6c009840).stop 2022-07-05T11:45:46.445 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.443+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 shutdown_connections 2022-07-05T11:45:46.445 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.443+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc741803a0 0x7fdc7417c4e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.445 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.443+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc740ca610 0x7fdc74158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.446 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.443+0000 7fdc7bb3b700 1 --2- 172.21.15.149:0/3818898478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc7417bb10 0x7fdc7417bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.446 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.443+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 >> 172.21.15.149:0/3818898478 conn(0x7fdc740f1680 msgr2=0x7fdc740efe30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:46.446 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.443+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 shutdown_connections 2022-07-05T11:45:46.447 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.443+0000 7fdc7bb3b700 1 -- 172.21.15.149:0/3818898478 wait complete. 2022-07-05T11:45:46.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new cd1bca41-12c0-411b-aff7-cabdd7a16b07 1 2022-07-05T11:45:46.612 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.610+0000 7fbf09588700 1 Processor -- start 2022-07-05T11:45:46.613 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.610+0000 7fbf09588700 1 -- start start 2022-07-05T11:45:46.623 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.611+0000 7fbf09588700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf04178730 0x7fbf040ee840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.623 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.611+0000 7fbf09588700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbf04067e70 0x7fbf04068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.624 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.611+0000 7fbf09588700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf04068810 0x7fbf04181d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.624 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.611+0000 7fbf09588700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0417d6b0 con 0x7fbf04067e70 2022-07-05T11:45:46.625 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.611+0000 7fbf09588700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0417d990 con 0x7fbf04178730 2022-07-05T11:45:46.625 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.611+0000 7fbf09588700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0417dc70 con 0x7fbf04068810 2022-07-05T11:45:46.626 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf04068810 0x7fbf04181d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.626 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf04068810 0x7fbf04181d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58722/0 (socket says 172.21.15.149:58722) 2022-07-05T11:45:46.626 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 -- 172.21.15.149:0/3278618038 learned_addr learned my addr 172.21.15.149:0/3278618038 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:46.627 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf027fc700 1 --2- 172.21.15.149:0/3278618038 >> v2:172.21.15.90:3300/0 conn(0x7fbf04067e70 0x7fbf04068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.627 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf02ffd700 1 --2- 172.21.15.149:0/3278618038 >> v2:172.21.15.110:3300/0 conn(0x7fbf04178730 0x7fbf040ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.628 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 -- 172.21.15.149:0/3278618038 >> v2:172.21.15.110:3300/0 conn(0x7fbf04178730 msgr2=0x7fbf040ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:46.629 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 --2- 172.21.15.149:0/3278618038 >> v2:172.21.15.110:3300/0 conn(0x7fbf04178730 0x7fbf040ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.629 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 -- 172.21.15.149:0/3278618038 >> v2:172.21.15.90:3300/0 conn(0x7fbf04067e70 msgr2=0x7fbf04068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:46.630 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 --2- 172.21.15.149:0/3278618038 >> v2:172.21.15.90:3300/0 conn(0x7fbf04067e70 0x7fbf04068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.630 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 -- 172.21.15.149:0/3278618038 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0417df50 con 0x7fbf04068810 2022-07-05T11:45:46.631 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf037fe700 1 --2- 172.21.15.149:0/3278618038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04068810 0x7fbf04181d40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fbf040870d0 tx=0x7fbefc009840).ready entity=mon.2 client_cookie=2eb7744c618b76d5 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:46.631 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf01ffb700 1 -- 172.21.15.149:0/3278618038 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00e070 con 0x7fbf04068810 2022-07-05T11:45:46.632 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf01ffb700 1 -- 172.21.15.149:0/3278618038 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc00b940 con 0x7fbf04068810 2022-07-05T11:45:46.632 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.612+0000 7fbf01ffb700 1 -- 172.21.15.149:0/3278618038 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00bcc0 con 0x7fbf04068810 2022-07-05T11:45:46.632 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 -- 172.21.15.149:0/3278618038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04068810 msgr2=0x7fbf04181d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.633 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 --2- 172.21.15.149:0/3278618038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04068810 0x7fbf04181d40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fbf040870d0 tx=0x7fbefc009840).stop 2022-07-05T11:45:46.633 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 -- 172.21.15.149:0/3278618038 shutdown_connections 2022-07-05T11:45:46.634 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 --2- 172.21.15.149:0/3278618038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04068810 0x7fbf04181d40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.634 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 --2- 172.21.15.149:0/3278618038 >> v2:172.21.15.110:3300/0 conn(0x7fbf04178730 0x7fbf040ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.635 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 --2- 172.21.15.149:0/3278618038 >> v2:172.21.15.90:3300/0 conn(0x7fbf04067e70 0x7fbf04068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.635 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 -- 172.21.15.149:0/3278618038 >> 172.21.15.149:0/3278618038 conn(0x7fbf040effc0 msgr2=0x7fbf04061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:46.636 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 -- 172.21.15.149:0/3278618038 shutdown_connections 2022-07-05T11:45:46.636 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.613+0000 7fbf09588700 1 -- 172.21.15.149:0/3278618038 wait complete. 2022-07-05T11:45:46.636 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.614+0000 7fbf09588700 1 Processor -- start 2022-07-05T11:45:46.637 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.614+0000 7fbf09588700 1 -- start start 2022-07-05T11:45:46.637 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf09588700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04067e70 0x7fbf04171c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.638 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf09588700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04068810 0x7fbf04083a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.638 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf09588700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf04178730 0x7fbf04083f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.639 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf09588700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04179bf0 con 0x7fbf04178730 2022-07-05T11:45:46.639 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf09588700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04179ed0 con 0x7fbf04068810 2022-07-05T11:45:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf09588700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0417a1b0 con 0x7fbf04067e70 2022-07-05T11:45:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04067e70 0x7fbf04171c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.640 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04067e70 0x7fbf04171c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58724/0 (socket says 172.21.15.149:58724) 2022-07-05T11:45:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf02ffd700 1 -- 172.21.15.149:0/4155416095 learned_addr learned my addr 172.21.15.149:0/4155416095 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf027fc700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04068810 0x7fbf04083a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.615+0000 7fbf037fe700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf04178730 0x7fbf04083f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf02ffd700 1 -- 172.21.15.149:0/4155416095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04068810 msgr2=0x7fbf04083a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf02ffd700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04068810 0x7fbf04083a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf02ffd700 1 -- 172.21.15.149:0/4155416095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf04178730 msgr2=0x7fbf04083f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf02ffd700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf04178730 0x7fbf04083f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.644 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf02ffd700 1 -- 172.21.15.149:0/4155416095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc009ae0 con 0x7fbf04067e70 2022-07-05T11:45:46.644 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf02ffd700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04067e70 0x7fbf04171c50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fbeec00e950 tx=0x7fbeec009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:46.645 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbefaffd700 1 -- 172.21.15.149:0/4155416095 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec009530 con 0x7fbf04067e70 2022-07-05T11:45:46.645 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbefaffd700 1 -- 172.21.15.149:0/4155416095 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec012600 con 0x7fbf04067e70 2022-07-05T11:45:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0417a490 con 0x7fbf04067e70 2022-07-05T11:45:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbefaffd700 1 -- 172.21.15.149:0/4155416095 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec012980 con 0x7fbf04067e70 2022-07-05T11:45:46.646 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf04083570 con 0x7fbf04067e70 2022-07-05T11:45:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbefaffd700 1 -- 172.21.15.149:0/4155416095 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fbeec022070 con 0x7fbf04067e70 2022-07-05T11:45:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.616+0000 7fbefaffd700 1 -- 172.21.15.149:0/4155416095 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fbeec01bbe0 con 0x7fbf04067e70 2022-07-05T11:45:46.647 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.617+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf040ee680 con 0x7fbf04067e70 2022-07-05T11:45:46.648 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:46.636+0000 7f64e46eb680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-07-05T11:45:46.648 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.621+0000 7fbefaffd700 1 -- 172.21.15.149:0/4155416095 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7fbeec03ade0 con 0x7fbf04067e70 2022-07-05T11:45:46.663 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:46.661+0000 7fe316f96680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-07-05T11:45:46.707 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.699+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd1bca41-12c0-411b-aff7-cabdd7a16b07", "id": 1} v 0) v1 -- 0x7fbf04083790 con 0x7fbf04067e70 2022-07-05T11:45:46.707 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:46.702+0000 7f4c64b84680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-07-05T11:45:46.711 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.707+0000 7fbefaffd700 1 -- 172.21.15.149:0/4155416095 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd1bca41-12c0-411b-aff7-cabdd7a16b07", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbeec029030 con 0x7fbf04067e70 2022-07-05T11:45:46.712 INFO:teuthology.orchestra.run.smithi149.stdout:1 2022-07-05T11:45:46.716 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04067e70 msgr2=0x7fbf04171c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.716 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04067e70 0x7fbf04171c50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fbeec00e950 tx=0x7fbeec009060).stop 2022-07-05T11:45:46.716 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 shutdown_connections 2022-07-05T11:45:46.717 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf04178730 0x7fbf04083f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.717 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf04067e70 0x7fbf04171c50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.717 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 --2- 172.21.15.149:0/4155416095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04068810 0x7fbf04083a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.717 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 >> 172.21.15.149:0/4155416095 conn(0x7fbf040effc0 msgr2=0x7fbf04172b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:46.718 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 shutdown_connections 2022-07-05T11:45:46.718 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.708+0000 7fbf09588700 1 -- 172.21.15.149:0/4155416095 wait complete. 2022-07-05T11:45:46.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 42d0ffc3-80f3-408d-903d-59b721062ae9 2 2022-07-05T11:45:46.738 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:46.737+0000 7f64e46eb680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-07-05T11:45:46.763 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:46.761+0000 7fe316f96680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-07-05T11:45:46.814 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:46.813+0000 7f4c64b84680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-07-05T11:45:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.838+0000 7f0d1b5c5700 1 Processor -- start 2022-07-05T11:45:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.838+0000 7f0d1b5c5700 1 -- start start 2022-07-05T11:45:46.852 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.839+0000 7f0d1b5c5700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d14178610 0x7f0d141789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.853 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.839+0000 7f0d1b5c5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d1417e100 0x7f0d14063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.853 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.839+0000 7f0d1b5c5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1417d560 con 0x7f0d1417f3b0 2022-07-05T11:45:46.853 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.839+0000 7f0d1b5c5700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1417f830 con 0x7f0d14178610 2022-07-05T11:45:46.854 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.839+0000 7f0d1b5c5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1417c670 con 0x7f0d1417e100 2022-07-05T11:45:46.854 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.839+0000 7f0d19b62700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d1417e100 0x7f0d14063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.854 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19b62700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d1417e100 0x7f0d14063bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58734/0 (socket says 172.21.15.149:58734) 2022-07-05T11:45:46.855 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19b62700 1 -- 172.21.15.149:0/1091045570 learned_addr learned my addr 172.21.15.149:0/1091045570 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:46.855 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d18b60700 1 --1- 172.21.15.149:0/1091045570 >> v1:172.21.15.149:6789/0 conn(0x7f0d1417f3b0 0x7f0d1417d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60606/0 (socket says 172.21.15.149:60606) 2022-07-05T11:45:46.855 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19361700 1 --2- 172.21.15.149:0/1091045570 >> v2:172.21.15.90:3300/0 conn(0x7f0d14178610 0x7f0d141789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.855 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19b62700 1 -- 172.21.15.149:0/1091045570 >> v2:172.21.15.90:3300/0 conn(0x7f0d14178610 msgr2=0x7f0d141789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:46.855 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19b62700 1 --2- 172.21.15.149:0/1091045570 >> v2:172.21.15.90:3300/0 conn(0x7f0d14178610 0x7f0d141789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.856 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19b62700 1 -- 172.21.15.149:0/1091045570 >> v1:172.21.15.149:6789/0 conn(0x7f0d1417f3b0 legacy=0x7f0d1417d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.856 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d03fff700 1 -- 172.21.15.149:0/1091045570 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102399153 0 0) 0x7f0d1417d560 con 0x7f0d1417f3b0 2022-07-05T11:45:46.856 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19b62700 1 -- 172.21.15.149:0/1091045570 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1417c950 con 0x7f0d1417e100 2022-07-05T11:45:46.857 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19361700 1 --2- 172.21.15.149:0/1091045570 >> v2:172.21.15.90:3300/0 conn(0x7f0d14178610 0x7f0d141789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:45:46.857 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d19b62700 1 --2- 172.21.15.149:0/1091045570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417e100 0x7f0d14063bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0d1417c480 tx=0x7f0d0c009840).ready entity=mon.2 client_cookie=41861d5291c8c6c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:46.857 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d03fff700 1 -- 172.21.15.149:0/1091045570 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00e070 con 0x7f0d1417e100 2022-07-05T11:45:46.857 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d03fff700 1 -- 172.21.15.149:0/1091045570 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c00ba50 con 0x7f0d1417e100 2022-07-05T11:45:46.857 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.840+0000 7f0d03fff700 1 -- 172.21.15.149:0/1091045570 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00bdd0 con 0x7f0d1417e100 2022-07-05T11:45:46.858 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/1091045570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417e100 msgr2=0x7f0d14063bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.858 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 --2- 172.21.15.149:0/1091045570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417e100 0x7f0d14063bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0d1417c480 tx=0x7f0d0c009840).stop 2022-07-05T11:45:46.858 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/1091045570 shutdown_connections 2022-07-05T11:45:46.858 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 --2- 172.21.15.149:0/1091045570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417e100 0x7f0d14063bc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.859 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 --2- 172.21.15.149:0/1091045570 >> v2:172.21.15.90:3300/0 conn(0x7f0d14178610 0x7f0d141789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.859 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/1091045570 >> 172.21.15.149:0/1091045570 conn(0x7f0d140f2210 msgr2=0x7f0d14069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:46.859 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/1091045570 shutdown_connections 2022-07-05T11:45:46.860 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.841+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/1091045570 wait complete. 2022-07-05T11:45:46.860 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.842+0000 7f0d1b5c5700 1 Processor -- start 2022-07-05T11:45:46.860 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.842+0000 7f0d1b5c5700 1 -- start start 2022-07-05T11:45:46.860 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d1b5c5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d14178610 0x7f0d141686b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.861 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d1b5c5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d1417e100 0x7f0d1417b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.861 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d1b5c5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417f3b0 0x7f0d141703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:46.861 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d1b5c5700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14177f20 con 0x7f0d1417e100 2022-07-05T11:45:46.861 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d1b5c5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1416ff50 con 0x7f0d14178610 2022-07-05T11:45:46.862 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d1b5c5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1416f970 con 0x7f0d1417f3b0 2022-07-05T11:45:46.862 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d19b62700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417f3b0 0x7f0d141703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.862 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d19b62700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417f3b0 0x7f0d141703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58738/0 (socket says 172.21.15.149:58738) 2022-07-05T11:45:46.862 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.843+0000 7f0d19b62700 1 -- 172.21.15.149:0/3589061650 learned_addr learned my addr 172.21.15.149:0/3589061650 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:46.863 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d18b60700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d1417e100 0x7f0d1417b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.863 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19361700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d14178610 0x7f0d141686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:46.863 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19b62700 1 -- 172.21.15.149:0/3589061650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d14178610 msgr2=0x7f0d141686b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.863 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19b62700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d14178610 0x7f0d141686b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.864 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19b62700 1 -- 172.21.15.149:0/3589061650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d1417e100 msgr2=0x7f0d1417b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.864 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19b62700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d1417e100 0x7f0d1417b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.865 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19b62700 1 -- 172.21.15.149:0/3589061650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c009ae0 con 0x7f0d1417f3b0 2022-07-05T11:45:46.865 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19361700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d14178610 0x7f0d141686b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:45:46.866 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d19b62700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417f3b0 0x7f0d141703e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d0c013f50 tx=0x7f0d1417d4d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:46.866 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d017fa700 1 -- 172.21.15.149:0/3589061650 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00bdd0 con 0x7f0d1417f3b0 2022-07-05T11:45:46.866 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d017fa700 1 -- 172.21.15.149:0/3589061650 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c003340 con 0x7f0d1417f3b0 2022-07-05T11:45:46.867 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1417a5e0 con 0x7f0d1417f3b0 2022-07-05T11:45:46.867 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d017fa700 1 -- 172.21.15.149:0/3589061650 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c01d6b0 con 0x7f0d1417f3b0 2022-07-05T11:45:46.867 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1416fbe0 con 0x7f0d1417f3b0 2022-07-05T11:45:46.867 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d017fa700 1 -- 172.21.15.149:0/3589061650 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f0d0c024030 con 0x7f0d1417f3b0 2022-07-05T11:45:46.868 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.844+0000 7f0d017fa700 1 -- 172.21.15.149:0/3589061650 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f0d0c012810 con 0x7f0d1417f3b0 2022-07-05T11:45:46.868 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.845+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1406b1e0 con 0x7f0d1417f3b0 2022-07-05T11:45:46.868 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.847+0000 7f0d017fa700 1 -- 172.21.15.149:0/3589061650 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f0d0c022070 con 0x7f0d1417f3b0 2022-07-05T11:45:46.888 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:46.887+0000 7f64e46eb680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-07-05T11:45:46.913 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:46.912+0000 7fe316f96680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-07-05T11:45:46.928 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.926+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42d0ffc3-80f3-408d-903d-59b721062ae9", "id": 2} v 0) v1 -- 0x7f0d1417cc30 con 0x7f0d1417f3b0 2022-07-05T11:45:46.936 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.934+0000 7f0d017fa700 1 -- 172.21.15.149:0/3589061650 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42d0ffc3-80f3-408d-903d-59b721062ae9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d0c0123c0 con 0x7f0d1417f3b0 2022-07-05T11:45:46.937 INFO:teuthology.orchestra.run.smithi149.stdout:2 2022-07-05T11:45:46.940 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417f3b0 msgr2=0x7f0d141703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:46.940 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417f3b0 0x7f0d141703e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d0c013f50 tx=0x7f0d1417d4d0).stop 2022-07-05T11:45:46.941 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 shutdown_connections 2022-07-05T11:45:46.941 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d1417f3b0 0x7f0d141703e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.941 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d14178610 0x7f0d141686b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.942 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 --2- 172.21.15.149:0/3589061650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d1417e100 0x7f0d1417b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:46.943 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 >> 172.21.15.149:0/3589061650 conn(0x7f0d140f2210 msgr2=0x7f0d14062030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:46.943 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 shutdown_connections 2022-07-05T11:45:46.944 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:46.935+0000 7f0d1b5c5700 1 -- 172.21.15.149:0/3589061650 wait complete. 2022-07-05T11:45:46.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new f5f6a0c1-08c3-4f62-a4bf-a510e124cff7 3 2022-07-05T11:45:46.963 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:46.962+0000 7f64e46eb680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-07-05T11:45:46.981 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:46.979+0000 7f4c64b84680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-07-05T11:45:46.988 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:46.987+0000 7fe316f96680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-07-05T11:45:47.030 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:47.029+0000 7f64e46eb680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-07-05T11:45:47.055 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:47.054+0000 7fe316f96680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-07-05T11:45:47.060 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:47.059+0000 7f4c64b84680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-07-05T11:45:47.066 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.064+0000 7f803908d700 1 Processor -- start 2022-07-05T11:45:47.066 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.064+0000 7f803908d700 1 -- start start 2022-07-05T11:45:47.079 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f803908d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80340efa50 0x7f80340efee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.079 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f803908d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8034061f10 con 0x7f803417dcd0 2022-07-05T11:45:47.080 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f803908d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8034062d70 con 0x7f8034063910 2022-07-05T11:45:47.080 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f803908d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8034062160 con 0x7f80340efa50 2022-07-05T11:45:47.081 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f803888c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80340efa50 0x7f80340efee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.081 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f8033fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f803417dcd0 0x7f8034063200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.149:53744/0 (socket says 172.21.15.149:53744) 2022-07-05T11:45:47.082 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f8033fff700 1 -- 172.21.15.149:0/863547581 learned_addr learned my addr 172.21.15.149:0/863547581 (peer_addr_for_me v1:172.21.15.149:0/0) 2022-07-05T11:45:47.082 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.065+0000 7f80337fe700 1 --1- 172.21.15.149:0/863547581 >> v1:172.21.15.110:6789/0 conn(0x7f8034063910 0x7f80340ef340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.149:34872/0 (socket says 172.21.15.149:34872) 2022-07-05T11:45:47.083 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f8032ffd700 1 -- 172.21.15.149:0/863547581 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456574696 0 0) 0x7f8034061f10 con 0x7f803417dcd0 2022-07-05T11:45:47.083 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f803888c700 1 -- 172.21.15.149:0/863547581 >> v1:172.21.15.110:6789/0 conn(0x7f8034063910 legacy=0x7f80340ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.084 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f803888c700 1 -- 172.21.15.149:0/863547581 >> v1:172.21.15.90:6789/0 conn(0x7f803417dcd0 legacy=0x7f8034063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.084 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f803888c700 1 -- 172.21.15.149:0/863547581 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8034062440 con 0x7f80340efa50 2022-07-05T11:45:47.084 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f803888c700 1 --2- 172.21.15.149:0/863547581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340efa50 0x7f80340efee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f802c009de0 tx=0x7f802c009780).ready entity=mon.1 client_cookie=f498d10267247f41 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.084 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f8032ffd700 1 -- 172.21.15.149:0/863547581 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c00e070 con 0x7f80340efa50 2022-07-05T11:45:47.085 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f8032ffd700 1 -- 172.21.15.149:0/863547581 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c00bae0 con 0x7f80340efa50 2022-07-05T11:45:47.085 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f8032ffd700 1 -- 172.21.15.149:0/863547581 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c00be60 con 0x7f80340efa50 2022-07-05T11:45:47.085 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f803908d700 1 -- 172.21.15.149:0/863547581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340efa50 msgr2=0x7f80340efee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.085 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.066+0000 7f803908d700 1 --2- 172.21.15.149:0/863547581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340efa50 0x7f80340efee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f802c009de0 tx=0x7f802c009780).stop 2022-07-05T11:45:47.085 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.067+0000 7f803908d700 1 -- 172.21.15.149:0/863547581 shutdown_connections 2022-07-05T11:45:47.086 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.067+0000 7f803908d700 1 --2- 172.21.15.149:0/863547581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340efa50 0x7f80340efee0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.086 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.067+0000 7f803908d700 1 -- 172.21.15.149:0/863547581 >> 172.21.15.149:0/863547581 conn(0x7f80340f5470 msgr2=0x7f80340f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.086 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.067+0000 7f803908d700 1 -- 172.21.15.149:0/863547581 shutdown_connections 2022-07-05T11:45:47.086 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.067+0000 7f803908d700 1 -- 172.21.15.149:0/863547581 wait complete. 2022-07-05T11:45:47.087 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.068+0000 7f803908d700 1 Processor -- start 2022-07-05T11:45:47.087 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.068+0000 7f803908d700 1 -- start start 2022-07-05T11:45:47.087 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f803908d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8034063910 0x7f8034171c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.087 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f803908d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80340efa50 0x7f8034177660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.088 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f803908d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f803417dcd0 0x7f80340cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.088 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f803908d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340cb6b0 con 0x7f8034063910 2022-07-05T11:45:47.088 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f803908d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340ca7c0 con 0x7f803417dcd0 2022-07-05T11:45:47.088 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f803908d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340caaa0 con 0x7f80340efa50 2022-07-05T11:45:47.088 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f80337fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80340efa50 0x7f8034177660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.089 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f80337fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80340efa50 0x7f8034177660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58746/0 (socket says 172.21.15.149:58746) 2022-07-05T11:45:47.089 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f8033fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8034063910 0x7f8034171c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.089 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f80337fe700 1 -- 172.21.15.149:0/1275115765 learned_addr learned my addr 172.21.15.149:0/1275115765 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:47.089 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.069+0000 7f803888c700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f803417dcd0 0x7f80340cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.090 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f8033fff700 1 -- 172.21.15.149:0/1275115765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80340efa50 msgr2=0x7f8034177660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.090 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f8033fff700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80340efa50 0x7f8034177660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.090 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f8033fff700 1 -- 172.21.15.149:0/1275115765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f803417dcd0 msgr2=0x7f80340cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.091 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f8033fff700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f803417dcd0 0x7f80340cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.091 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f8033fff700 1 -- 172.21.15.149:0/1275115765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c009a20 con 0x7f8034063910 2022-07-05T11:45:47.091 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f80337fe700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80340efa50 0x7f8034177660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:45:47.091 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f803888c700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f803417dcd0 0x7f80340cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:45:47.092 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f8033fff700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8034063910 0x7f8034171c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8028001eb0 tx=0x7f8028007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.092 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f801bfff700 1 -- 172.21.15.149:0/1275115765 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280070d0 con 0x7f8034063910 2022-07-05T11:45:47.092 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f801bfff700 1 -- 172.21.15.149:0/1275115765 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028007230 con 0x7f8034063910 2022-07-05T11:45:47.093 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80340cad80 con 0x7f8034063910 2022-07-05T11:45:47.093 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f801bfff700 1 -- 172.21.15.149:0/1275115765 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280075d0 con 0x7f8034063910 2022-07-05T11:45:47.093 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80340cb340 con 0x7f8034063910 2022-07-05T11:45:47.094 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f801bfff700 1 -- 172.21.15.149:0/1275115765 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f802801a060 con 0x7f8034063910 2022-07-05T11:45:47.094 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.070+0000 7f801bfff700 1 -- 172.21.15.149:0/1275115765 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f8028013af0 con 0x7f8034063910 2022-07-05T11:45:47.094 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.071+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8034046db0 con 0x7f8034063910 2022-07-05T11:45:47.094 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.073+0000 7f801bfff700 1 -- 172.21.15.149:0/1275115765 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f8028018070 con 0x7f8034063910 2022-07-05T11:45:47.132 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:47.131+0000 7f4c64b84680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-07-05T11:45:47.154 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.153+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f5f6a0c1-08c3-4f62-a4bf-a510e124cff7", "id": 3} v 0) v1 -- 0x7f8034062720 con 0x7f8034063910 2022-07-05T11:45:47.161 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.160+0000 7f801bfff700 1 -- 172.21.15.149:0/1275115765 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5f6a0c1-08c3-4f62-a4bf-a510e124cff7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8028005df0 con 0x7f8034063910 2022-07-05T11:45:47.162 INFO:teuthology.orchestra.run.smithi149.stdout:3 2022-07-05T11:45:47.163 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8034063910 msgr2=0x7f8034171c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8034063910 0x7f8034171c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8028001eb0 tx=0x7f8028007bb0).stop 2022-07-05T11:45:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 shutdown_connections 2022-07-05T11:45:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f803417dcd0 0x7f80340cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8034063910 0x7f8034171c60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.165 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 --2- 172.21.15.149:0/1275115765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80340efa50 0x7f8034177660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.165 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 >> 172.21.15.149:0/1275115765 conn(0x7f80340f5470 msgr2=0x7f8034063200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.165 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 shutdown_connections 2022-07-05T11:45:47.165 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.161+0000 7f803908d700 1 -- 172.21.15.149:0/1275115765 wait complete. 2022-07-05T11:45:47.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 1edda2e9-dd13-4bcc-bd89-682ddd1622cc 4 2022-07-05T11:45:47.287 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:47.286+0000 7f64e46eb680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-07-05T11:45:47.313 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:47.311+0000 7fe316f96680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-07-05T11:45:47.342 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.328+0000 7ff5d6f4b700 1 Processor -- start 2022-07-05T11:45:47.342 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.328+0000 7ff5d6f4b700 1 -- start start 2022-07-05T11:45:47.343 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5d6f4b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5d00643a0 0x7ff5d00ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.343 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5d6f4b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00cab00 con 0x7ff5d017bb10 2022-07-05T11:45:47.344 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5d6f4b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00cad50 con 0x7ff5d01805c0 2022-07-05T11:45:47.344 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5d6f4b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d017f5e0 con 0x7ff5d00643a0 2022-07-05T11:45:47.345 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5d54e8700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff5d01805c0 0x7ff5d0181bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60628/0 (socket says 172.21.15.149:60628) 2022-07-05T11:45:47.345 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5d54e8700 1 -- 172.21.15.149:0/868753455 learned_addr learned my addr 172.21.15.149:0/868753455 (peer_addr_for_me v1:172.21.15.149:0/0) 2022-07-05T11:45:47.346 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cffff700 1 --2- 172.21.15.149:0/868753455 >> v2:172.21.15.110:3300/0 conn(0x7ff5d00643a0 0x7ff5d00ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.346 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cf7fe700 1 -- 172.21.15.149:0/868753455 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307134487 0 0) 0x7ff5d00cad50 con 0x7ff5d01805c0 2022-07-05T11:45:47.347 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cf7fe700 1 -- 172.21.15.149:0/868753455 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b40033f0 con 0x7ff5d01805c0 2022-07-05T11:45:47.347 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cf7fe700 1 -- 172.21.15.149:0/868753455 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071409353 0 0) 0x7ff5d00cab00 con 0x7ff5d017bb10 2022-07-05T11:45:47.348 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cf7fe700 1 -- 172.21.15.149:0/868753455 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d00cad50 con 0x7ff5d017bb10 2022-07-05T11:45:47.348 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cffff700 1 -- 172.21.15.149:0/868753455 >> v1:172.21.15.149:6789/0 conn(0x7ff5d01805c0 legacy=0x7ff5d0181bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.349 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cffff700 1 -- 172.21.15.149:0/868753455 >> v1:172.21.15.90:6789/0 conn(0x7ff5d017bb10 legacy=0x7ff5d017feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.349 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.329+0000 7ff5cffff700 1 -- 172.21.15.149:0/868753455 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00cb030 con 0x7ff5d00643a0 2022-07-05T11:45:47.349 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5cffff700 1 --2- 172.21.15.149:0/868753455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 0x7ff5d00ca610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff5bc009760 tx=0x7ff5bc009060).ready entity=mon.1 client_cookie=a1037fd5d56fe690 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.350 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5cf7fe700 1 -- 172.21.15.149:0/868753455 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00d4a0 con 0x7ff5d00643a0 2022-07-05T11:45:47.350 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5cf7fe700 1 -- 172.21.15.149:0/868753455 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00d600 con 0x7ff5d00643a0 2022-07-05T11:45:47.351 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5cf7fe700 1 -- 172.21.15.149:0/868753455 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00d980 con 0x7ff5d00643a0 2022-07-05T11:45:47.351 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/868753455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 msgr2=0x7ff5d00ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.352 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5d6f4b700 1 --2- 172.21.15.149:0/868753455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 0x7ff5d00ca610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff5bc009760 tx=0x7ff5bc009060).stop 2022-07-05T11:45:47.352 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/868753455 shutdown_connections 2022-07-05T11:45:47.353 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5d6f4b700 1 --2- 172.21.15.149:0/868753455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 0x7ff5d00ca610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.353 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/868753455 >> 172.21.15.149:0/868753455 conn(0x7ff5d00f1680 msgr2=0x7ff5d00f1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.354 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/868753455 shutdown_connections 2022-07-05T11:45:47.354 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.330+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/868753455 wait complete. 2022-07-05T11:45:47.355 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.332+0000 7ff5d6f4b700 1 Processor -- start 2022-07-05T11:45:47.355 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.332+0000 7ff5d6f4b700 1 -- start start 2022-07-05T11:45:47.356 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d6f4b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 0x7ff5d00f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.356 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d6f4b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d017bb10 0x7ff5d018ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.357 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d6f4b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d01805c0 0x7ff5d015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.357 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d6f4b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0192070 con 0x7ff5d01805c0 2022-07-05T11:45:47.357 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d6f4b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0192350 con 0x7ff5d00643a0 2022-07-05T11:45:47.358 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d6f4b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0192630 con 0x7ff5d017bb10 2022-07-05T11:45:47.358 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d017bb10 0x7ff5d018ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.359 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d017bb10 0x7ff5d018ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58758/0 (socket says 172.21.15.149:58758) 2022-07-05T11:45:47.359 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 -- 172.21.15.149:0/34410958 learned_addr learned my addr 172.21.15.149:0/34410958 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:47.360 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d4ce7700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 0x7ff5d00f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.360 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5d54e8700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d01805c0 0x7ff5d015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.361 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 -- 172.21.15.149:0/34410958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 msgr2=0x7ff5d00f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.361 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 0x7ff5d00f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.362 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 -- 172.21.15.149:0/34410958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d01805c0 msgr2=0x7ff5d015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.362 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d01805c0 0x7ff5d015cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.363 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.333+0000 7ff5cffff700 1 -- 172.21.15.149:0/34410958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0092a0 con 0x7ff5d017bb10 2022-07-05T11:45:47.363 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5cffff700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d017bb10 0x7ff5d018ee80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff5d0088f60 tx=0x7ff5bc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.363 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5ccff9700 1 -- 172.21.15.149:0/34410958 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00dcf0 con 0x7ff5d017bb10 2022-07-05T11:45:47.364 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5ccff9700 1 -- 172.21.15.149:0/34410958 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00de50 con 0x7ff5d017bb10 2022-07-05T11:45:47.364 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d0192910 con 0x7ff5d017bb10 2022-07-05T11:45:47.365 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5ccff9700 1 -- 172.21.15.149:0/34410958 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00d980 con 0x7ff5d017bb10 2022-07-05T11:45:47.365 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d018e640 con 0x7ff5d017bb10 2022-07-05T11:45:47.366 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5ccff9700 1 -- 172.21.15.149:0/34410958 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7ff5bc00f070 con 0x7ff5d017bb10 2022-07-05T11:45:47.366 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.334+0000 7ff5ccff9700 1 -- 172.21.15.149:0/34410958 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7ff5bc027460 con 0x7ff5d017bb10 2022-07-05T11:45:47.367 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.335+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d018eb80 con 0x7ff5d017bb10 2022-07-05T11:45:47.367 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.338+0000 7ff5ccff9700 1 -- 172.21.15.149:0/34410958 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7ff5bc016070 con 0x7ff5d017bb10 2022-07-05T11:45:47.407 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:47.405+0000 7f4c64b84680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-07-05T11:45:47.418 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.417+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1edda2e9-dd13-4bcc-bd89-682ddd1622cc", "id": 4} v 0) v1 -- 0x7ff5d006be40 con 0x7ff5d017bb10 2022-07-05T11:45:47.426 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.422+0000 7ff5ccff9700 1 -- 172.21.15.149:0/34410958 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1edda2e9-dd13-4bcc-bd89-682ddd1622cc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff5bc01d640 con 0x7ff5d017bb10 2022-07-05T11:45:47.427 INFO:teuthology.orchestra.run.smithi149.stdout:4 2022-07-05T11:45:47.429 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.423+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d017bb10 msgr2=0x7ff5d018ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.429 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.423+0000 7ff5d6f4b700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d017bb10 0x7ff5d018ee80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff5d0088f60 tx=0x7ff5bc016000).stop 2022-07-05T11:45:47.430 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.423+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 shutdown_connections 2022-07-05T11:45:47.430 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.423+0000 7ff5d6f4b700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d01805c0 0x7ff5d015cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.431 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.423+0000 7ff5d6f4b700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d00643a0 0x7ff5d00f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.431 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.423+0000 7ff5d6f4b700 1 --2- 172.21.15.149:0/34410958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d017bb10 0x7ff5d018ee80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.432 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.423+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 >> 172.21.15.149:0/34410958 conn(0x7ff5d00f1680 msgr2=0x7ff5d017feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.432 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.424+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 shutdown_connections 2022-07-05T11:45:47.432 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.424+0000 7ff5d6f4b700 1 -- 172.21.15.149:0/34410958 wait complete. 2022-07-05T11:45:47.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new c0888e0d-d7f2-42ed-a663-b4ba75aaa317 5 2022-07-05T11:45:47.479 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:47.478+0000 7f64e46eb680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-07-05T11:45:47.505 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:47.503+0000 7fe316f96680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-07-05T11:45:47.559 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.557+0000 7facbf3a5700 1 Processor -- start 2022-07-05T11:45:47.560 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.557+0000 7facbf3a5700 1 -- start start 2022-07-05T11:45:47.573 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbf3a5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7facb80c9980 0x7facb817be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.574 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbf3a5700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7facb8179c40 0x7facb817c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.574 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbf3a5700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb817a140 con 0x7facb8179860 2022-07-05T11:45:47.575 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbf3a5700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb817c310 con 0x7facb8179c40 2022-07-05T11:45:47.575 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbf3a5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb817b280 con 0x7facb80c9980 2022-07-05T11:45:47.576 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbc940700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7facb80c9980 0x7facb817be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.577 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbc940700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7facb80c9980 0x7facb817be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58762/0 (socket says 172.21.15.149:58762) 2022-07-05T11:45:47.578 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbc940700 1 -- 172.21.15.149:0/2114319590 learned_addr learned my addr 172.21.15.149:0/2114319590 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:47.579 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.558+0000 7facbd942700 1 --2- 172.21.15.149:0/2114319590 >> v2:172.21.15.90:3300/0 conn(0x7facb8179c40 0x7facb817c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.580 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7facbc940700 1 -- 172.21.15.149:0/2114319590 >> v2:172.21.15.90:3300/0 conn(0x7facb8179c40 msgr2=0x7facb817c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:47.580 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7facbc940700 1 --2- 172.21.15.149:0/2114319590 >> v2:172.21.15.90:3300/0 conn(0x7facb8179c40 0x7facb817c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.581 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7facbc940700 1 -- 172.21.15.149:0/2114319590 >> v1:172.21.15.90:6789/0 conn(0x7facb8179860 legacy=0x7facb817b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.581 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7facbc940700 1 -- 172.21.15.149:0/2114319590 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb817a390 con 0x7facb80c9980 2022-07-05T11:45:47.582 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7facbc940700 1 --2- 172.21.15.149:0/2114319590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb817be20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7facb80c6850 tx=0x7facb40090f0).ready entity=mon.2 client_cookie=728cd8f4afbd91eb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.583 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7faca7fff700 1 -- 172.21.15.149:0/2114319590 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400b520 con 0x7facb80c9980 2022-07-05T11:45:47.583 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7faca7fff700 1 -- 172.21.15.149:0/2114319590 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb400b680 con 0x7facb80c9980 2022-07-05T11:45:47.584 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.559+0000 7faca7fff700 1 -- 172.21.15.149:0/2114319590 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400ba00 con 0x7facb80c9980 2022-07-05T11:45:47.584 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 -- 172.21.15.149:0/2114319590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 msgr2=0x7facb817be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.585 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 --2- 172.21.15.149:0/2114319590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb817be20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7facb80c6850 tx=0x7facb40090f0).stop 2022-07-05T11:45:47.585 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 -- 172.21.15.149:0/2114319590 shutdown_connections 2022-07-05T11:45:47.586 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 --2- 172.21.15.149:0/2114319590 >> v2:172.21.15.90:3300/0 conn(0x7facb8179c40 0x7facb817c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.586 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 --2- 172.21.15.149:0/2114319590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb817be20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.587 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 -- 172.21.15.149:0/2114319590 >> 172.21.15.149:0/2114319590 conn(0x7facb8083570 msgr2=0x7facb8083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.588 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 -- 172.21.15.149:0/2114319590 shutdown_connections 2022-07-05T11:45:47.589 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.560+0000 7facbf3a5700 1 -- 172.21.15.149:0/2114319590 wait complete. 2022-07-05T11:45:47.589 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.561+0000 7facbf3a5700 1 Processor -- start 2022-07-05T11:45:47.590 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.561+0000 7facbf3a5700 1 -- start start 2022-07-05T11:45:47.590 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.562+0000 7facbf3a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb8190750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.590 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.562+0000 7facbf3a5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facb8179860 0x7facb81920f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.591 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.562+0000 7facbf3a5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8179c40 0x7facb8171a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.591 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.562+0000 7facbf3a5700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8191c60 con 0x7facb8179860 2022-07-05T11:45:47.592 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.562+0000 7facbf3a5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81925e0 con 0x7facb8179c40 2022-07-05T11:45:47.592 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.562+0000 7facbf3a5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8190d70 con 0x7facb80c9980 2022-07-05T11:45:47.593 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.562+0000 7facbd141700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb8190750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.593 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb8190750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58766/0 (socket says 172.21.15.149:58766) 2022-07-05T11:45:47.593 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 -- 172.21.15.149:0/3794152170 learned_addr learned my addr 172.21.15.149:0/3794152170 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:47.594 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbc940700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facb8179860 0x7facb81920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.594 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd942700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8179c40 0x7facb8171a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.594 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 -- 172.21.15.149:0/3794152170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8179c40 msgr2=0x7facb8171a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.594 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8179c40 0x7facb8171a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.595 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 -- 172.21.15.149:0/3794152170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facb8179860 msgr2=0x7facb81920f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.595 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facb8179860 0x7facb81920f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.596 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 -- 172.21.15.149:0/3794152170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009370 con 0x7facb80c9980 2022-07-05T11:45:47.596 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbc940700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facb8179860 0x7facb81920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:45:47.596 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbd141700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb8190750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7faca800c470 tx=0x7faca8007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.596 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7faca57fa700 1 -- 172.21.15.149:0/3794152170 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8012400 con 0x7facb80c9980 2022-07-05T11:45:47.597 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7faca57fa700 1 -- 172.21.15.149:0/3794152170 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8012580 con 0x7facb80c9980 2022-07-05T11:45:47.597 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb8191050 con 0x7facb80c9980 2022-07-05T11:45:47.597 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7faca57fa700 1 -- 172.21.15.149:0/3794152170 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8012940 con 0x7facb80c9980 2022-07-05T11:45:47.598 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb8191610 con 0x7facb80c9980 2022-07-05T11:45:47.598 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7faca57fa700 1 -- 172.21.15.149:0/3794152170 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7faca8019030 con 0x7facb80c9980 2022-07-05T11:45:47.599 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.563+0000 7faca57fa700 1 -- 172.21.15.149:0/3794152170 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7faca8007e30 con 0x7facb80c9980 2022-07-05T11:45:47.600 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.564+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb806b1e0 con 0x7facb80c9980 2022-07-05T11:45:47.600 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.566+0000 7faca57fa700 1 -- 172.21.15.149:0/3794152170 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7faca8021060 con 0x7facb80c9980 2022-07-05T11:45:47.618 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:47.616+0000 7f4c64b84680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-07-05T11:45:47.648 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.646+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0888e0d-d7f2-42ed-a663-b4ba75aaa317", "id": 5} v 0) v1 -- 0x7facb806be40 con 0x7facb80c9980 2022-07-05T11:45:47.651 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.650+0000 7faca57fa700 1 -- 172.21.15.149:0/3794152170 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0888e0d-d7f2-42ed-a663-b4ba75aaa317", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faca8017070 con 0x7facb80c9980 2022-07-05T11:45:47.652 INFO:teuthology.orchestra.run.smithi149.stdout:5 2022-07-05T11:45:47.655 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.650+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 msgr2=0x7facb8190750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.655 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.650+0000 7facbf3a5700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb8190750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7faca800c470 tx=0x7faca8007dc0).stop 2022-07-05T11:45:47.655 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.651+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 shutdown_connections 2022-07-05T11:45:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.651+0000 7facbf3a5700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8179c40 0x7facb8171a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.651+0000 7facbf3a5700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb80c9980 0x7facb8190750 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.651+0000 7facbf3a5700 1 --2- 172.21.15.149:0/3794152170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facb8179860 0x7facb81920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.651+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 >> 172.21.15.149:0/3794152170 conn(0x7facb8083570 msgr2=0x7facb80f0850 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.651+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 shutdown_connections 2022-07-05T11:45:47.657 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.651+0000 7facbf3a5700 1 -- 172.21.15.149:0/3794152170 wait complete. 2022-07-05T11:45:47.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 1f2f25f7-edcb-4d89-8da2-50fccda7e3d7 6 2022-07-05T11:45:47.780 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.778+0000 7efff4485700 1 Processor -- start 2022-07-05T11:45:47.780 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.778+0000 7efff4485700 1 -- start start 2022-07-05T11:45:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff4485700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec17d560 con 0x7effec178610 2022-07-05T11:45:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff4485700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec17c670 con 0x7effec1789f0 2022-07-05T11:45:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff4485700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec17c950 con 0x7effec062f20 2022-07-05T11:45:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff2a22700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7effec062f20 0x7effec0642d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60650/0 (socket says 172.21.15.149:60650) 2022-07-05T11:45:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff2a22700 1 -- 172.21.15.149:0/1437413395 learned_addr learned my addr 172.21.15.149:0/1437413395 (peer_addr_for_me v1:172.21.15.149:0/0) 2022-07-05T11:45:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374424214 0 0) 0x7effec17c950 con 0x7effec062f20 2022-07-05T11:45:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd40033f0 con 0x7effec062f20 2022-07-05T11:45:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460011322 0 0) 0x7effec17c670 con 0x7effec1789f0 2022-07-05T11:45:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec17c950 con 0x7effec1789f0 2022-07-05T11:45:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775348436 0 0) 0x7effec17d560 con 0x7effec178610 2022-07-05T11:45:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec17c670 con 0x7effec178610 2022-07-05T11:45:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.2 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4163138825 0 0) 0x7effd40033f0 con 0x7effec062f20 2022-07-05T11:45:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 >> v1:172.21.15.110:6789/0 conn(0x7effec1789f0 legacy=0x7effec063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 >> v1:172.21.15.90:6789/0 conn(0x7effec178610 legacy=0x7effec17d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.793 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec17cc30 con 0x7effec062f20 2022-07-05T11:45:47.793 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.2 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7effe40017c0 con 0x7effec062f20 2022-07-05T11:45:47.793 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 >> v1:172.21.15.149:6789/0 conn(0x7effec062f20 legacy=0x7effec0642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd4003cf0 0x7effd40040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd4004750 0x7effd4004bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd40051f0 0x7effd400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd400c140 con 0x7effd4003cf0 2022-07-05T11:45:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd400c2b0 con 0x7effd4004750 2022-07-05T11:45:47.795 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd400c470 con 0x7effd40051f0 2022-07-05T11:45:47.795 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff2a22700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd40051f0 0x7effd400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.795 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff2221700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd4003cf0 0x7effd40040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.795 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.780+0000 7efff1a20700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd4004750 0x7effd4004bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.796 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2a22700 1 -- 172.21.15.149:0/1437413395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd4004750 msgr2=0x7effd4004bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:47.796 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2a22700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd4004750 0x7effd4004bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.796 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2a22700 1 -- 172.21.15.149:0/1437413395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd4003cf0 msgr2=0x7effd40040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:47.796 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2a22700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd4003cf0 0x7effd40040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.797 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2a22700 1 -- 172.21.15.149:0/1437413395 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40033f0 con 0x7effd40051f0 2022-07-05T11:45:47.797 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2221700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd4003cf0 0x7effd40040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:45:47.797 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2a22700 1 -- 172.21.15.149:0/1437413395 reap_dead start 2022-07-05T11:45:47.797 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff2a22700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd40051f0 0x7effd400b8e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7effe400c3c0 tx=0x7effec17d4d0).ready entity=mon.2 client_cookie=c5f4a18967632824 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.797 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400cc90 con 0x7effd40051f0 2022-07-05T11:45:47.798 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe400cdf0 con 0x7effd40051f0 2022-07-05T11:45:47.798 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff121f700 1 -- 172.21.15.149:0/1437413395 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4005dc0 con 0x7effd40051f0 2022-07-05T11:45:47.798 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff4485700 1 -- 172.21.15.149:0/1437413395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd40051f0 msgr2=0x7effd400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.798 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.781+0000 7efff4485700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd40051f0 0x7effd400b8e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7effe400c3c0 tx=0x7effec17d4d0).stop 2022-07-05T11:45:47.799 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.782+0000 7efff4485700 1 -- 172.21.15.149:0/1437413395 shutdown_connections 2022-07-05T11:45:47.799 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.782+0000 7efff4485700 1 --2- 172.21.15.149:0/1437413395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd40051f0 0x7effd400b8e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.799 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.782+0000 7efff4485700 1 -- 172.21.15.149:0/1437413395 >> 172.21.15.149:0/1437413395 conn(0x7effec0f2210 msgr2=0x7effec069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.799 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.782+0000 7efff4485700 1 -- 172.21.15.149:0/1437413395 shutdown_connections 2022-07-05T11:45:47.800 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.782+0000 7efff4485700 1 -- 172.21.15.149:0/1437413395 wait complete. 2022-07-05T11:45:47.800 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.783+0000 7efff4485700 1 Processor -- start 2022-07-05T11:45:47.800 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.783+0000 7efff4485700 1 -- start start 2022-07-05T11:45:47.800 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff4485700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd40051f0 0x7effec155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.800 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff4485700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec1925a0 0x7effec192a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.801 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff4485700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effec15a0d0 0x7effec15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:47.801 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff4485700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec177a00 con 0x7effd40051f0 2022-07-05T11:45:47.801 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff4485700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec176b10 con 0x7effec15a0d0 2022-07-05T11:45:47.801 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff4485700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec176df0 con 0x7effec1925a0 2022-07-05T11:45:47.802 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec1925a0 0x7effec192a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.802 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec1925a0 0x7effec192a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58784/0 (socket says 172.21.15.149:58784) 2022-07-05T11:45:47.802 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 -- 172.21.15.149:0/1933547779 learned_addr learned my addr 172.21.15.149:0/1933547779 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:47.803 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff2221700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd40051f0 0x7effec155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.803 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff2a22700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effec15a0d0 0x7effec15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:47.803 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 -- 172.21.15.149:0/1933547779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effec15a0d0 msgr2=0x7effec15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.803 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effec15a0d0 0x7effec15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.804 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 -- 172.21.15.149:0/1933547779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd40051f0 msgr2=0x7effec155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.804 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd40051f0 0x7effec155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.804 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 -- 172.21.15.149:0/1933547779 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec1770d0 con 0x7effec1925a0 2022-07-05T11:45:47.804 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff2a22700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effec15a0d0 0x7effec15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:45:47.805 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.784+0000 7efff1a20700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec1925a0 0x7effec192a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7effe8002a80 tx=0x7effe8007b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:47.805 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.785+0000 7effda7fc700 1 -- 172.21.15.149:0/1933547779 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8002e40 con 0x7effec1925a0 2022-07-05T11:45:47.805 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.785+0000 7effda7fc700 1 -- 172.21.15.149:0/1933547779 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe800f8d0 con 0x7effec1925a0 2022-07-05T11:45:47.805 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.785+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec1773b0 con 0x7effec1925a0 2022-07-05T11:45:47.806 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.785+0000 7effda7fc700 1 -- 172.21.15.149:0/1933547779 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe800fc50 con 0x7effec1925a0 2022-07-05T11:45:47.806 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.785+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec1562c0 con 0x7effec1925a0 2022-07-05T11:45:47.806 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.785+0000 7effda7fc700 1 -- 172.21.15.149:0/1933547779 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7effe801b030 con 0x7effec1925a0 2022-07-05T11:45:47.806 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.785+0000 7effda7fc700 1 -- 172.21.15.149:0/1933547779 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7effe801ea60 con 0x7effec1925a0 2022-07-05T11:45:47.807 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.786+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec177850 con 0x7effec1925a0 2022-07-05T11:45:47.807 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.788+0000 7effda7fc700 1 -- 172.21.15.149:0/1933547779 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7effe8023060 con 0x7effec1925a0 2022-07-05T11:45:47.880 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.877+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f2f25f7-edcb-4d89-8da2-50fccda7e3d7", "id": 6} v 0) v1 -- 0x7effec06b1e0 con 0x7effec1925a0 2022-07-05T11:45:47.883 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.880+0000 7effda7fc700 1 -- 172.21.15.149:0/1933547779 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f2f25f7-edcb-4d89-8da2-50fccda7e3d7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7effe8019070 con 0x7effec1925a0 2022-07-05T11:45:47.883 INFO:teuthology.orchestra.run.smithi149.stdout:6 2022-07-05T11:45:47.885 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec1925a0 msgr2=0x7effec192a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:47.886 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec1925a0 0x7effec192a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7effe8002a80 tx=0x7effe8007b70).stop 2022-07-05T11:45:47.886 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 shutdown_connections 2022-07-05T11:45:47.886 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effec15a0d0 0x7effec15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.887 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effd40051f0 0x7effec155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.887 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 --2- 172.21.15.149:0/1933547779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec1925a0 0x7effec192a20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:47.888 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 >> 172.21.15.149:0/1933547779 conn(0x7effec0f2210 msgr2=0x7effec0633f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:47.888 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 shutdown_connections 2022-07-05T11:45:47.888 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:47.881+0000 7efff4485700 1 -- 172.21.15.149:0/1933547779 wait complete. 2022-07-05T11:45:47.895 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new fc77b6e9-acfd-43fd-8c29-0eb5beccee23 7 2022-07-05T11:45:48.010 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.009+0000 7f141f49b700 1 Processor -- start 2022-07-05T11:45:48.011 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.009+0000 7f141f49b700 1 -- start start 2022-07-05T11:45:48.015 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141f49b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f141817e230 0x7f1418064200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.015 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141f49b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180c9850 con 0x7f14180ca6c0 2022-07-05T11:45:48.015 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141f49b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180c8960 con 0x7f14180c9ce0 2022-07-05T11:45:48.015 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141f49b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14180c8c40 con 0x7f141817e230 2022-07-05T11:45:48.016 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141d237700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f141817e230 0x7f1418064200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.016 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141ca36700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f14180ca6c0 0x7f14180c8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.149:53792/0 (socket says 172.21.15.149:53792) 2022-07-05T11:45:48.016 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141ca36700 1 -- 172.21.15.149:0/3726100452 learned_addr learned my addr 172.21.15.149:0/3726100452 (peer_addr_for_me v1:172.21.15.149:0/0) 2022-07-05T11:45:48.016 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.010+0000 7f141da38700 1 --1- 172.21.15.149:0/3726100452 >> v1:172.21.15.110:6789/0 conn(0x7f14180c9ce0 0x7f1418061f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.149:34922/0 (socket says 172.21.15.149:34922) 2022-07-05T11:45:48.017 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141d237700 1 -- 172.21.15.149:0/3726100452 >> v1:172.21.15.110:6789/0 conn(0x7f14180c9ce0 legacy=0x7f1418061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.017 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f1407fff700 1 -- 172.21.15.149:0/3726100452 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811087613 0 0) 0x7f14180c8960 con 0x7f14180c9ce0 2022-07-05T11:45:48.017 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141d237700 1 -- 172.21.15.149:0/3726100452 >> v1:172.21.15.90:6789/0 conn(0x7f14180ca6c0 legacy=0x7f14180c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.017 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141d237700 1 -- 172.21.15.149:0/3726100452 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180c8f20 con 0x7f141817e230 2022-07-05T11:45:48.018 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141d237700 1 --2- 172.21.15.149:0/3726100452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f141817e230 0x7f1418064200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1414009760 tx=0x7f1414009060).ready entity=mon.0 client_cookie=c5b66057fa083cbb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.018 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f1407fff700 1 -- 172.21.15.149:0/3726100452 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140090d0 con 0x7f141817e230 2022-07-05T11:45:48.018 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f1407fff700 1 -- 172.21.15.149:0/3726100452 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141400f510 con 0x7f141817e230 2022-07-05T11:45:48.018 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f1407fff700 1 -- 172.21.15.149:0/3726100452 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141400f890 con 0x7f141817e230 2022-07-05T11:45:48.018 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141f49b700 1 -- 172.21.15.149:0/3726100452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f141817e230 msgr2=0x7f1418064200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.019 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141f49b700 1 --2- 172.21.15.149:0/3726100452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f141817e230 0x7f1418064200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1414009760 tx=0x7f1414009060).stop 2022-07-05T11:45:48.019 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141f49b700 1 -- 172.21.15.149:0/3726100452 shutdown_connections 2022-07-05T11:45:48.019 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141f49b700 1 --2- 172.21.15.149:0/3726100452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f141817e230 0x7f1418064200 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.020 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.011+0000 7f141f49b700 1 -- 172.21.15.149:0/3726100452 >> 172.21.15.149:0/3726100452 conn(0x7f14180f5760 msgr2=0x7f14180f1730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.020 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.012+0000 7f141f49b700 1 -- 172.21.15.149:0/3726100452 shutdown_connections 2022-07-05T11:45:48.020 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.012+0000 7f141f49b700 1 -- 172.21.15.149:0/3726100452 wait complete. 2022-07-05T11:45:48.020 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.013+0000 7f141f49b700 1 Processor -- start 2022-07-05T11:45:48.021 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.013+0000 7f141f49b700 1 -- start start 2022-07-05T11:45:48.024 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141f49b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14180c9ce0 0x7f141816e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.025 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141f49b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14180ca6c0 0x7f141816bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.025 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141f49b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f141817e230 0x7f141816c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.025 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141f49b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141816e6a0 con 0x7f14180c9ce0 2022-07-05T11:45:48.025 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141f49b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14181707c0 con 0x7f14180ca6c0 2022-07-05T11:45:48.026 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141f49b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418171320 con 0x7f141817e230 2022-07-05T11:45:48.026 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141da38700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f141817e230 0x7f141816c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.026 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141ca36700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14180ca6c0 0x7f141816bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.026 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141da38700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f141817e230 0x7f141816c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58796/0 (socket says 172.21.15.149:58796) 2022-07-05T11:45:48.027 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141da38700 1 -- 172.21.15.149:0/1067847148 learned_addr learned my addr 172.21.15.149:0/1067847148 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:48.027 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.014+0000 7f141d237700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14180c9ce0 0x7f141816e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.027 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141d237700 1 -- 172.21.15.149:0/1067847148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f141817e230 msgr2=0x7f141816c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.028 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141d237700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f141817e230 0x7f141816c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.028 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141d237700 1 -- 172.21.15.149:0/1067847148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14180ca6c0 msgr2=0x7f141816bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.028 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141d237700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14180ca6c0 0x7f141816bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.028 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141d237700 1 -- 172.21.15.149:0/1067847148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14140092a0 con 0x7f14180c9ce0 2022-07-05T11:45:48.029 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141d237700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14180c9ce0 0x7f141816e9c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f141805e970 tx=0x7f1414017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.029 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f14057fa700 1 -- 172.21.15.149:0/1067847148 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414011ac0 con 0x7f14180c9ce0 2022-07-05T11:45:48.029 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f14057fa700 1 -- 172.21.15.149:0/1067847148 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414011c20 con 0x7f14180c9ce0 2022-07-05T11:45:48.029 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f14057fa700 1 -- 172.21.15.149:0/1067847148 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141401c420 con 0x7f14180c9ce0 2022-07-05T11:45:48.029 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141816e3c0 con 0x7f14180c9ce0 2022-07-05T11:45:48.030 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1418170cd0 con 0x7f14180c9ce0 2022-07-05T11:45:48.030 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f14057fa700 1 -- 172.21.15.149:0/1067847148 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f141402c070 con 0x7f14180c9ce0 2022-07-05T11:45:48.030 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.015+0000 7f14057fa700 1 -- 172.21.15.149:0/1067847148 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f141401ca30 con 0x7f14180c9ce0 2022-07-05T11:45:48.031 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.016+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141806b1e0 con 0x7f14180c9ce0 2022-07-05T11:45:48.031 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.018+0000 7f14057fa700 1 -- 172.21.15.149:0/1067847148 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f141402a060 con 0x7f14180c9ce0 2022-07-05T11:45:48.099 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.097+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc77b6e9-acfd-43fd-8c29-0eb5beccee23", "id": 7} v 0) v1 -- 0x7f141806be40 con 0x7f14180c9ce0 2022-07-05T11:45:48.100 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:45:48.102 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.100+0000 7f14057fa700 1 -- 172.21.15.149:0/1067847148 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc77b6e9-acfd-43fd-8c29-0eb5beccee23", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1414020070 con 0x7f14180c9ce0 2022-07-05T11:45:48.103 INFO:teuthology.orchestra.run.smithi149.stdout:7 2022-07-05T11:45:48.105 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14180c9ce0 msgr2=0x7f141816e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.106 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14180c9ce0 0x7f141816e9c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f141805e970 tx=0x7f1414017000).stop 2022-07-05T11:45:48.106 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 shutdown_connections 2022-07-05T11:45:48.106 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f141817e230 0x7f141816c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14180c9ce0 0x7f141816e9c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 --2- 172.21.15.149:0/1067847148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14180ca6c0 0x7f141816bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.107 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 >> 172.21.15.149:0/1067847148 conn(0x7f14180f5760 msgr2=0x7f14181785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.108 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 shutdown_connections 2022-07-05T11:45:48.108 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.101+0000 7f141f49b700 1 -- 172.21.15.149:0/1067847148 wait complete. 2022-07-05T11:45:48.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:45:48.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:45:48.114 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new e7cdf0c2-efcd-4675-ad9c-a09056aad4bd 8 2022-07-05T11:45:48.134 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:48.131+0000 7f64e46eb680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-07-05T11:45:48.168 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:48.166+0000 7fe316f96680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-07-05T11:45:48.202 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:48.201+0000 7f64e46eb680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-07-05T11:45:48.235 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:48.234+0000 7fe316f96680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-07-05T11:45:48.276 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.274+0000 7f7964a56700 1 Processor -- start 2022-07-05T11:45:48.276 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.274+0000 7f7964a56700 1 -- start start 2022-07-05T11:45:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.275+0000 7f7964a56700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796017d560 con 0x7f7960062f20 2022-07-05T11:45:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.275+0000 7f7964a56700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796017c670 con 0x7f7960178610 2022-07-05T11:45:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.275+0000 7f7964a56700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796017c950 con 0x7f79601789f0 2022-07-05T11:45:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795dd9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f79601789f0 0x7f7960063bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60674/0 (socket says 172.21.15.149:60674) 2022-07-05T11:45:48.282 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795dd9b700 1 -- 172.21.15.149:0/2443679646 learned_addr learned my addr 172.21.15.149:0/2443679646 (peer_addr_for_me v1:172.21.15.149:0/0) 2022-07-05T11:45:48.282 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895359932 0 0) 0x7f796017c950 con 0x7f79601789f0 2022-07-05T11:45:48.282 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79400033f0 con 0x7f79601789f0 2022-07-05T11:45:48.282 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341888104 0 0) 0x7f796017d560 con 0x7f7960062f20 2022-07-05T11:45:48.283 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f796017c950 con 0x7f7960062f20 2022-07-05T11:45:48.283 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902565413 0 0) 0x7f796017c670 con 0x7f7960178610 2022-07-05T11:45:48.283 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f796017d560 con 0x7f7960178610 2022-07-05T11:45:48.284 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.2 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3066448422 0 0) 0x7f79400033f0 con 0x7f79601789f0 2022-07-05T11:45:48.284 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 >> v1:172.21.15.110:6789/0 conn(0x7f7960178610 legacy=0x7f796017d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.284 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 >> v1:172.21.15.90:6789/0 conn(0x7f7960062f20 legacy=0x7f79600642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.284 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796017cc30 con 0x7f79601789f0 2022-07-05T11:45:48.285 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.2 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f7950001470 con 0x7f79601789f0 2022-07-05T11:45:48.285 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 >> v1:172.21.15.149:6789/0 conn(0x7f79601789f0 legacy=0x7f7960063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.285 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7940003c50 0x7f7940004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.285 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400046e0 0x7f7940004b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.286 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f794000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.286 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794000c0a0 con 0x7f7940003c50 2022-07-05T11:45:48.286 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794000c210 con 0x7f79400046e0 2022-07-05T11:45:48.286 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794000c3d0 con 0x7f7940005140 2022-07-05T11:45:48.286 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795ed9d700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f794000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.287 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795e59c700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7940003c50 0x7f7940004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.287 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.276+0000 7f795dd9b700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400046e0 0x7f7940004b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.287 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795ed9d700 1 -- 172.21.15.149:0/2443679646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400046e0 msgr2=0x7f7940004b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:48.287 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795ed9d700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400046e0 0x7f7940004b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.288 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795ed9d700 1 -- 172.21.15.149:0/2443679646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7940003c50 msgr2=0x7f7940004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:48.288 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795ed9d700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7940003c50 0x7f7940004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.288 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795ed9d700 1 -- 172.21.15.149:0/2443679646 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79400033f0 con 0x7f7940005140 2022-07-05T11:45:48.288 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795ed9d700 1 -- 172.21.15.149:0/2443679646 reap_dead start 2022-07-05T11:45:48.288 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795ed9d700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f794000b8e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7958001fa0 tx=0x7f7958007f60).ready entity=mon.2 client_cookie=7e1a3079da623adc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.289 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795800c700 con 0x7f7940005140 2022-07-05T11:45:48.289 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795800c860 con 0x7f7940005140 2022-07-05T11:45:48.289 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f795d59a700 1 -- 172.21.15.149:0/2443679646 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795800cc00 con 0x7f7940005140 2022-07-05T11:45:48.289 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f7964a56700 1 -- 172.21.15.149:0/2443679646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 msgr2=0x7f794000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.290 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.277+0000 7f7964a56700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f794000b8e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7958001fa0 tx=0x7f7958007f60).stop 2022-07-05T11:45:48.290 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.278+0000 7f7964a56700 1 -- 172.21.15.149:0/2443679646 shutdown_connections 2022-07-05T11:45:48.290 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.278+0000 7f7964a56700 1 --2- 172.21.15.149:0/2443679646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f794000b8e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.290 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.278+0000 7f7964a56700 1 -- 172.21.15.149:0/2443679646 >> 172.21.15.149:0/2443679646 conn(0x7f79600f2210 msgr2=0x7f7960069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.290 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.278+0000 7f7964a56700 1 -- 172.21.15.149:0/2443679646 shutdown_connections 2022-07-05T11:45:48.291 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.278+0000 7f7964a56700 1 -- 172.21.15.149:0/2443679646 wait complete. 2022-07-05T11:45:48.292 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:48.279+0000 7f64e46eb680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-07-05T11:45:48.294 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.280+0000 7f7964a56700 1 Processor -- start 2022-07-05T11:45:48.295 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.280+0000 7f7964a56700 1 -- start start 2022-07-05T11:45:48.295 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f7960172920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.295 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960177ba0 0x7f79601712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.295 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79600ec5b0 0x7f796018ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.296 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960172e10 con 0x7f79600ec5b0 2022-07-05T11:45:48.296 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960192ed0 con 0x7f7960177ba0 2022-07-05T11:45:48.296 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796018f9d0 con 0x7f7940005140 2022-07-05T11:45:48.296 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f7960172920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.296 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f7960172920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58808/0 (socket says 172.21.15.149:58808) 2022-07-05T11:45:48.297 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 -- 172.21.15.149:0/2704386355 learned_addr learned my addr 172.21.15.149:0/2704386355 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:48.297 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795dd9b700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960177ba0 0x7f79601712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.297 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795ed9d700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79600ec5b0 0x7f796018ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.297 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 -- 172.21.15.149:0/2704386355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960177ba0 msgr2=0x7f79601712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.298 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960177ba0 0x7f79601712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.298 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 -- 172.21.15.149:0/2704386355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79600ec5b0 msgr2=0x7f796018ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.298 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79600ec5b0 0x7f796018ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.298 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 -- 172.21.15.149:0/2704386355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960192150 con 0x7f7940005140 2022-07-05T11:45:48.298 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f795e59c700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f7960172920 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7948002a20 tx=0x7f7948007bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.299 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f79567fc700 1 -- 172.21.15.149:0/2704386355 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948002e00 con 0x7f7940005140 2022-07-05T11:45:48.299 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f79567fc700 1 -- 172.21.15.149:0/2704386355 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800f8d0 con 0x7f7940005140 2022-07-05T11:45:48.299 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796018f6f0 con 0x7f7940005140 2022-07-05T11:45:48.299 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f79567fc700 1 -- 172.21.15.149:0/2704386355 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800fc50 con 0x7f7940005140 2022-07-05T11:45:48.299 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79601926d0 con 0x7f7940005140 2022-07-05T11:45:48.300 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.283+0000 7f79567fc700 1 -- 172.21.15.149:0/2704386355 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f794801b030 con 0x7f7940005140 2022-07-05T11:45:48.300 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.284+0000 7f79567fc700 1 -- 172.21.15.149:0/2704386355 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f794801eb40 con 0x7f7940005140 2022-07-05T11:45:48.300 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.285+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796006b1e0 con 0x7f7940005140 2022-07-05T11:45:48.300 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.287+0000 7f79567fc700 1 -- 172.21.15.149:0/2704386355 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f7948023060 con 0x7f7940005140 2022-07-05T11:45:48.312 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:48.310+0000 7fe316f96680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-07-05T11:45:48.335 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:48.333+0000 7f4c64b84680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-07-05T11:45:48.376 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.375+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7cdf0c2-efcd-4675-ad9c-a09056aad4bd", "id": 8} v 0) v1 -- 0x7f796006be40 con 0x7f7940005140 2022-07-05T11:45:48.379 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.378+0000 7f79567fc700 1 -- 172.21.15.149:0/2704386355 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7cdf0c2-efcd-4675-ad9c-a09056aad4bd", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7948019070 con 0x7f7940005140 2022-07-05T11:45:48.380 INFO:teuthology.orchestra.run.smithi149.stdout:8 2022-07-05T11:45:48.381 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 msgr2=0x7f7960172920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.382 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f7960172920 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7948002a20 tx=0x7f7948007bb0).stop 2022-07-05T11:45:48.382 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 shutdown_connections 2022-07-05T11:45:48.382 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79600ec5b0 0x7f796018ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.382 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7940005140 0x7f7960172920 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.383 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 --2- 172.21.15.149:0/2704386355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7960177ba0 0x7f79601712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.383 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 >> 172.21.15.149:0/2704386355 conn(0x7f79600f2210 msgr2=0x7f79600633f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.383 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 shutdown_connections 2022-07-05T11:45:48.383 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.379+0000 7f7964a56700 1 -- 172.21.15.149:0/2704386355 wait complete. 2022-07-05T11:45:48.393 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd 9 2022-07-05T11:45:48.408 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:48.406+0000 7f4c64b84680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-07-05T11:45:48.424 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:48.423+0000 7f64e46eb680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-07-05T11:45:48.455 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:48.454+0000 7fe316f96680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-07-05T11:45:48.491 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:48.489+0000 7f4c64b84680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-07-05T11:45:48.493 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:48.492+0000 7f64e46eb680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-07-05T11:45:48.507 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.506+0000 7f396578c700 1 Processor -- start 2022-07-05T11:45:48.508 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.506+0000 7f396578c700 1 -- start start 2022-07-05T11:45:48.511 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f396578c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f396017bb10 0x7f39600643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.511 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f396578c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f39601805c0 0x7f3960181bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.512 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f396578c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600caac0 con 0x7f39600ca610 2022-07-05T11:45:48.512 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f396578c700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396017f5e0 con 0x7f39601805c0 2022-07-05T11:45:48.512 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f396578c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600c9f20 con 0x7f396017bb10 2022-07-05T11:45:48.512 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f396017bb10 0x7f39600643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.513 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f396017bb10 0x7f39600643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58814/0 (socket says 172.21.15.149:58814) 2022-07-05T11:45:48.513 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 -- 172.21.15.149:0/3910692197 learned_addr learned my addr 172.21.15.149:0/3910692197 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:48.513 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395f7fe700 1 --2- 172.21.15.149:0/3910692197 >> v2:172.21.15.110:3300/0 conn(0x7f39601805c0 0x7f3960181bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.513 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 -- 172.21.15.149:0/3910692197 >> v2:172.21.15.110:3300/0 conn(0x7f39601805c0 msgr2=0x7f3960181bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:48.514 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 --2- 172.21.15.149:0/3910692197 >> v2:172.21.15.110:3300/0 conn(0x7f39601805c0 0x7f3960181bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.514 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 -- 172.21.15.149:0/3910692197 >> v1:172.21.15.110:6789/0 conn(0x7f39600ca610 legacy=0x7f396017feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.514 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 -- 172.21.15.149:0/3910692197 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600cad50 con 0x7f396017bb10 2022-07-05T11:45:48.514 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395effd700 1 --2- 172.21.15.149:0/3910692197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f396017bb10 0x7f39600643a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f396005ff20 tx=0x7f39500090f0).ready entity=mon.2 client_cookie=6737e13dee6b880b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.514 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.507+0000 7f395dffb700 1 -- 172.21.15.149:0/3910692197 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395000b600 con 0x7f396017bb10 2022-07-05T11:45:48.515 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f395dffb700 1 -- 172.21.15.149:0/3910692197 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395000b760 con 0x7f396017bb10 2022-07-05T11:45:48.515 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f395dffb700 1 -- 172.21.15.149:0/3910692197 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395000bae0 con 0x7f396017bb10 2022-07-05T11:45:48.515 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 -- 172.21.15.149:0/3910692197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f396017bb10 msgr2=0x7f39600643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.515 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 --2- 172.21.15.149:0/3910692197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f396017bb10 0x7f39600643a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f396005ff20 tx=0x7f39500090f0).stop 2022-07-05T11:45:48.516 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 -- 172.21.15.149:0/3910692197 shutdown_connections 2022-07-05T11:45:48.516 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 --2- 172.21.15.149:0/3910692197 >> v2:172.21.15.110:3300/0 conn(0x7f39601805c0 0x7f3960181bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.516 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 --2- 172.21.15.149:0/3910692197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f396017bb10 0x7f39600643a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.516 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 -- 172.21.15.149:0/3910692197 >> 172.21.15.149:0/3910692197 conn(0x7f39600f1680 msgr2=0x7f39600f1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.517 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 -- 172.21.15.149:0/3910692197 shutdown_connections 2022-07-05T11:45:48.517 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.508+0000 7f396578c700 1 -- 172.21.15.149:0/3910692197 wait complete. 2022-07-05T11:45:48.517 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.510+0000 7f396578c700 1 Processor -- start 2022-07-05T11:45:48.517 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.510+0000 7f396578c700 1 -- start start 2022-07-05T11:45:48.521 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39600ca610 0x7f39600c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.521 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396017bb10 0x7f39600f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.521 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601805c0 0x7f396017e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.521 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600f36c0 con 0x7f396017bb10 2022-07-05T11:45:48.522 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396017d560 con 0x7f39600ca610 2022-07-05T11:45:48.522 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396017d840 con 0x7f39601805c0 2022-07-05T11:45:48.522 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601805c0 0x7f396017e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.522 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601805c0 0x7f396017e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58824/0 (socket says 172.21.15.149:58824) 2022-07-05T11:45:48.523 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 -- 172.21.15.149:0/2220385780 learned_addr learned my addr 172.21.15.149:0/2220385780 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:48.523 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395effd700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39600ca610 0x7f39600c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.523 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395e7fc700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396017bb10 0x7f39600f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.523 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 -- 172.21.15.149:0/2220385780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39600ca610 msgr2=0x7f39600c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.524 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39600ca610 0x7f39600c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.524 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 -- 172.21.15.149:0/2220385780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396017bb10 msgr2=0x7f39600f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.524 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396017bb10 0x7f39600f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.524 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 -- 172.21.15.149:0/2220385780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950009370 con 0x7f39601805c0 2022-07-05T11:45:48.525 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f395f7fe700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601805c0 0x7f396017e8e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3958007f50 tx=0x7f3958009860).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.525 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f3946ffd700 1 -- 172.21.15.149:0/2220385780 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800ec20 con 0x7f39601805c0 2022-07-05T11:45:48.525 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f3946ffd700 1 -- 172.21.15.149:0/2220385780 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800ed80 con 0x7f39601805c0 2022-07-05T11:45:48.525 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396017db20 con 0x7f39601805c0 2022-07-05T11:45:48.525 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f3946ffd700 1 -- 172.21.15.149:0/2220385780 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958014630 con 0x7f39601805c0 2022-07-05T11:45:48.526 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.511+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396017e0e0 con 0x7f39601805c0 2022-07-05T11:45:48.526 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.512+0000 7f3946ffd700 1 -- 172.21.15.149:0/2220385780 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f395801b030 con 0x7f39601805c0 2022-07-05T11:45:48.526 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.512+0000 7f3946ffd700 1 -- 172.21.15.149:0/2220385780 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7f395801db20 con 0x7f39601805c0 2022-07-05T11:45:48.526 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.512+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396006be40 con 0x7f39601805c0 2022-07-05T11:45:48.527 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.514+0000 7f3946ffd700 1 -- 172.21.15.149:0/2220385780 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f3958019070 con 0x7f39601805c0 2022-07-05T11:45:48.527 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:48.523+0000 7fe316f96680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-07-05T11:45:48.595 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.593+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd", "id": 9} v 0) v1 -- 0x7f39600cb030 con 0x7f39601805c0 2022-07-05T11:45:48.598 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.596+0000 7f3946ffd700 1 -- 172.21.15.149:0/2220385780 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7f39580098f0 con 0x7f39601805c0 2022-07-05T11:45:48.598 INFO:teuthology.orchestra.run.smithi149.stdout:9 2022-07-05T11:45:48.599 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601805c0 msgr2=0x7f396017e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.600 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601805c0 0x7f396017e8e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3958007f50 tx=0x7f3958009860).stop 2022-07-05T11:45:48.600 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 shutdown_connections 2022-07-05T11:45:48.600 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601805c0 0x7f396017e8e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.600 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39600ca610 0x7f39600c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 --2- 172.21.15.149:0/2220385780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396017bb10 0x7f39600f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 >> 172.21.15.149:0/2220385780 conn(0x7f39600f1680 msgr2=0x7f396017feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 shutdown_connections 2022-07-05T11:45:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.597+0000 7f396578c700 1 -- 172.21.15.149:0/2220385780 wait complete. 2022-07-05T11:45:48.608 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:48.607+0000 7f64e46eb680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-07-05T11:45:48.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 9dd57505-dedd-4a00-a0e0-8f300c1ed971 10 2022-07-05T11:45:48.637 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:48.635+0000 7fe316f96680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-07-05T11:45:48.645 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:48.643+0000 7f4c64b84680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-07-05T11:45:48.713 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:48.712+0000 7f64e46eb680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-07-05T11:45:48.720 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:48.718+0000 7f4c64b84680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-07-05T11:45:48.741 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:48.739+0000 7fe316f96680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-07-05T11:45:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.756+0000 7f208ea8b700 1 Processor -- start 2022-07-05T11:45:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.756+0000 7f208ea8b700 1 -- start start 2022-07-05T11:45:48.762 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f208ea8b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f20881817d0 0x7f20881788f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.762 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f208ea8b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f20880c8de0 0x7f20880c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.763 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f208ea8b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208817fd40 con 0x7f2088178510 2022-07-05T11:45:48.763 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f208ea8b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2088180020 con 0x7f20880c8de0 2022-07-05T11:45:48.763 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f208ea8b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2088180300 con 0x7f20881817d0 2022-07-05T11:45:48.763 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f2087fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f20881817d0 0x7f20881788f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.764 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f2087fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f20881817d0 0x7f20881788f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58830/0 (socket says 172.21.15.149:58830) 2022-07-05T11:45:48.764 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f2087fff700 1 -- 172.21.15.149:0/2152487844 learned_addr learned my addr 172.21.15.149:0/2152487844 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:48.764 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f208d028700 1 --2- 172.21.15.149:0/2152487844 >> v2:172.21.15.90:3300/0 conn(0x7f20880c8de0 0x7f20880c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.765 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.757+0000 7f208c827700 1 --1- 172.21.15.149:0/2152487844 >> v1:172.21.15.90:6789/0 conn(0x7f2088178510 0x7f20881810c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.149:53830/0 (socket says 172.21.15.149:53830) 2022-07-05T11:45:48.765 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f2087fff700 1 -- 172.21.15.149:0/2152487844 >> v2:172.21.15.90:3300/0 conn(0x7f20880c8de0 msgr2=0x7f20880c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:48.765 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f20877fe700 1 -- 172.21.15.149:0/2152487844 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444162477 0 0) 0x7f208817fd40 con 0x7f2088178510 2022-07-05T11:45:48.765 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f2087fff700 1 --2- 172.21.15.149:0/2152487844 >> v2:172.21.15.90:3300/0 conn(0x7f20880c8de0 0x7f20880c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.766 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f2087fff700 1 -- 172.21.15.149:0/2152487844 >> v1:172.21.15.90:6789/0 conn(0x7f2088178510 legacy=0x7f20881810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.766 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f2087fff700 1 -- 172.21.15.149:0/2152487844 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20881805e0 con 0x7f20881817d0 2022-07-05T11:45:48.766 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f2087fff700 1 --2- 172.21.15.149:0/2152487844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20881817d0 0x7f20881788f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f20880ebf50 tx=0x7f20740090f0).ready entity=mon.2 client_cookie=a5fa6c8b9ff17a44 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.766 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f20877fe700 1 -- 172.21.15.149:0/2152487844 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400b520 con 0x7f20881817d0 2022-07-05T11:45:48.767 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f20877fe700 1 -- 172.21.15.149:0/2152487844 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207400b680 con 0x7f20881817d0 2022-07-05T11:45:48.767 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.758+0000 7f20877fe700 1 -- 172.21.15.149:0/2152487844 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400ba20 con 0x7f20881817d0 2022-07-05T11:45:48.767 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 -- 172.21.15.149:0/2152487844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20881817d0 msgr2=0x7f20881788f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.767 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 --2- 172.21.15.149:0/2152487844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20881817d0 0x7f20881788f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f20880ebf50 tx=0x7f20740090f0).stop 2022-07-05T11:45:48.767 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 -- 172.21.15.149:0/2152487844 shutdown_connections 2022-07-05T11:45:48.768 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 --2- 172.21.15.149:0/2152487844 >> v2:172.21.15.90:3300/0 conn(0x7f20880c8de0 0x7f20880c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.768 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 --2- 172.21.15.149:0/2152487844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20881817d0 0x7f20881788f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.768 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 -- 172.21.15.149:0/2152487844 >> 172.21.15.149:0/2152487844 conn(0x7f208805d9a0 msgr2=0x7f208805ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.768 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 -- 172.21.15.149:0/2152487844 shutdown_connections 2022-07-05T11:45:48.769 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.759+0000 7f208ea8b700 1 -- 172.21.15.149:0/2152487844 wait complete. 2022-07-05T11:45:48.772 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.761+0000 7f208ea8b700 1 Processor -- start 2022-07-05T11:45:48.772 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.761+0000 7f208ea8b700 1 -- start start 2022-07-05T11:45:48.773 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208ea8b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20880c8de0 0x7f2088176c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.773 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208ea8b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088178510 0x7f2088083570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.773 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208ea8b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20881817d0 0x7f2088196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.773 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208ea8b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881767c0 con 0x7f20881817d0 2022-07-05T11:45:48.774 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208ea8b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2088177140 con 0x7f20880c8de0 2022-07-05T11:45:48.774 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208ea8b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2088175bd0 con 0x7f2088178510 2022-07-05T11:45:48.774 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088178510 0x7f2088083570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.774 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088178510 0x7f2088083570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58834/0 (socket says 172.21.15.149:58834) 2022-07-05T11:45:48.775 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 -- 172.21.15.149:0/2619173510 learned_addr learned my addr 172.21.15.149:0/2619173510 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:48.775 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208d028700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20881817d0 0x7f2088196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.775 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f208c827700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20880c8de0 0x7f2088176c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.775 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 -- 172.21.15.149:0/2619173510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20880c8de0 msgr2=0x7f2088176c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.776 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20880c8de0 0x7f2088176c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.776 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 -- 172.21.15.149:0/2619173510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20881817d0 msgr2=0x7f2088196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.776 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20881817d0 0x7f2088196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.776 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.763+0000 7f2087fff700 1 -- 172.21.15.149:0/2619173510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2074009370 con 0x7f2088178510 2022-07-05T11:45:48.776 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.764+0000 7f2087fff700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088178510 0x7f2088083570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f20880f1840 tx=0x7f2074017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.777 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.764+0000 7f2084ff9700 1 -- 172.21.15.149:0/2619173510 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400b520 con 0x7f2088178510 2022-07-05T11:45:48.777 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.764+0000 7f2084ff9700 1 -- 172.21.15.149:0/2619173510 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074006970 con 0x7f2088178510 2022-07-05T11:45:48.777 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.764+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2088182e60 con 0x7f2088178510 2022-07-05T11:45:48.777 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.764+0000 7f2084ff9700 1 -- 172.21.15.149:0/2619173510 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400b7f0 con 0x7f2088178510 2022-07-05T11:45:48.778 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.764+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2088176170 con 0x7f2088178510 2022-07-05T11:45:48.778 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.765+0000 7f2084ff9700 1 -- 172.21.15.149:0/2619173510 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f207402d070 con 0x7f2088178510 2022-07-05T11:45:48.778 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.765+0000 7f2084ff9700 1 -- 172.21.15.149:0/2619173510 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1904+0+0 (secure 0 0 0) 0x7f207400b950 con 0x7f2088178510 2022-07-05T11:45:48.778 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.765+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2088176970 con 0x7f2088178510 2022-07-05T11:45:48.779 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.767+0000 7f2084ff9700 1 -- 172.21.15.149:0/2619173510 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f2074045de0 con 0x7f2088178510 2022-07-05T11:45:48.841 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:48.840+0000 7f4c64b84680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-07-05T11:45:48.847 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.845+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9dd57505-dedd-4a00-a0e0-8f300c1ed971", "id": 10} v 0) v1 -- 0x7f20881808c0 con 0x7f2088178510 2022-07-05T11:45:48.851 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.849+0000 7f2084ff9700 1 -- 172.21.15.149:0/2619173510 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9dd57505-dedd-4a00-a0e0-8f300c1ed971", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7f2074034030 con 0x7f2088178510 2022-07-05T11:45:48.851 INFO:teuthology.orchestra.run.smithi149.stdout:10 2022-07-05T11:45:48.852 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088178510 msgr2=0x7f2088083570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.853 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088178510 0x7f2088083570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f20880f1840 tx=0x7f2074017000).stop 2022-07-05T11:45:48.853 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 shutdown_connections 2022-07-05T11:45:48.853 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20881817d0 0x7f2088196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.853 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20880c8de0 0x7f2088176c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.854 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 --2- 172.21.15.149:0/2619173510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088178510 0x7f2088083570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.854 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 >> 172.21.15.149:0/2619173510 conn(0x7f208805d9a0 msgr2=0x7f20880657a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.854 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 shutdown_connections 2022-07-05T11:45:48.855 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.850+0000 7f208ea8b700 1 -- 172.21.15.149:0/2619173510 wait complete. 2022-07-05T11:45:48.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new ca9c1921-128a-4639-9879-9494fcbec477 11 2022-07-05T11:45:48.955 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:48.953+0000 7f4c64b84680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-07-05T11:45:48.977 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.975+0000 7f8c0e9f1700 1 Processor -- start 2022-07-05T11:45:48.977 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.975+0000 7f8c0e9f1700 1 -- start start 2022-07-05T11:45:48.980 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c0e9f1700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8c080ee840 0x7f8c08068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c0e9f1700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8c0817c3e0 0x7f8c0817c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c0e9f1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0817d6b0 con 0x7f8c08178730 2022-07-05T11:45:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c0e9f1700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0817d990 con 0x7f8c0817c3e0 2022-07-05T11:45:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c0e9f1700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0817dc70 con 0x7f8c080ee840 2022-07-05T11:45:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c07fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8c08178730 0x7f8c08067e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60714/0 (socket says 172.21.15.149:60714) 2022-07-05T11:45:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c07fff700 1 -- 172.21.15.149:0/1489647001 learned_addr learned my addr 172.21.15.149:0/1489647001 (peer_addr_for_me v1:172.21.15.149:0/0) 2022-07-05T11:45:48.983 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c077fe700 1 --2- 172.21.15.149:0/1489647001 >> v2:172.21.15.110:3300/0 conn(0x7f8c080ee840 0x7f8c08068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.984 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c0cf8e700 1 --2- 172.21.15.149:0/1489647001 >> v2:172.21.15.90:3300/0 conn(0x7f8c0817c3e0 0x7f8c0817c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.984 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c06ffd700 1 -- 172.21.15.149:0/1489647001 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206892364 0 0) 0x7f8c0817d6b0 con 0x7f8c08178730 2022-07-05T11:45:48.985 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c06ffd700 1 -- 172.21.15.149:0/1489647001 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf40033f0 con 0x7f8c08178730 2022-07-05T11:45:48.985 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c06ffd700 1 -- 172.21.15.149:0/1489647001 <== mon.2 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174443305 0 0) 0x7f8bf40033f0 con 0x7f8c08178730 2022-07-05T11:45:48.985 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c077fe700 1 -- 172.21.15.149:0/1489647001 >> v2:172.21.15.90:3300/0 conn(0x7f8c0817c3e0 msgr2=0x7f8c0817c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:48.985 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c077fe700 1 --2- 172.21.15.149:0/1489647001 >> v2:172.21.15.90:3300/0 conn(0x7f8c0817c3e0 0x7f8c0817c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.986 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c077fe700 1 -- 172.21.15.149:0/1489647001 >> v1:172.21.15.149:6789/0 conn(0x7f8c08178730 legacy=0x7f8c08067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.986 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c077fe700 1 -- 172.21.15.149:0/1489647001 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0817df50 con 0x7f8c080ee840 2022-07-05T11:45:48.986 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.976+0000 7f8c077fe700 1 --2- 172.21.15.149:0/1489647001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c08068580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8c080672d0 tx=0x7f8bf8009060).ready entity=mon.1 client_cookie=aee5dabf2d63b8cd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:48.987 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c06ffd700 1 -- 172.21.15.149:0/1489647001 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc001470 con 0x7f8c080ee840 2022-07-05T11:45:48.987 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c06ffd700 1 -- 172.21.15.149:0/1489647001 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8011400 con 0x7f8c080ee840 2022-07-05T11:45:48.987 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c06ffd700 1 -- 172.21.15.149:0/1489647001 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011780 con 0x7f8c080ee840 2022-07-05T11:45:48.987 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1489647001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 msgr2=0x7f8c08068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.988 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 --2- 172.21.15.149:0/1489647001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c08068580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8c080672d0 tx=0x7f8bf8009060).stop 2022-07-05T11:45:48.988 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1489647001 shutdown_connections 2022-07-05T11:45:48.988 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 --2- 172.21.15.149:0/1489647001 >> v2:172.21.15.90:3300/0 conn(0x7f8c0817c3e0 0x7f8c0817c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.988 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 --2- 172.21.15.149:0/1489647001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c08068580 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.989 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1489647001 >> 172.21.15.149:0/1489647001 conn(0x7f8c080effc0 msgr2=0x7f8c08061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:48.989 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1489647001 shutdown_connections 2022-07-05T11:45:48.989 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.977+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1489647001 wait complete. 2022-07-05T11:45:48.989 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.979+0000 7f8c0e9f1700 1 Processor -- start 2022-07-05T11:45:48.989 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.979+0000 7f8c0e9f1700 1 -- start start 2022-07-05T11:45:48.993 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0e9f1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c080c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.993 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0e9f1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c08178730 0x7f8c080c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.994 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0e9f1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c0817c3e0 0x7f8c080c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:48.994 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0e9f1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080c5940 con 0x7f8c0817c3e0 2022-07-05T11:45:48.995 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0e9f1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080c5c20 con 0x7f8c080ee840 2022-07-05T11:45:48.995 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0e9f1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080c5f00 con 0x7f8c08178730 2022-07-05T11:45:48.995 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c077fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c08178730 0x7f8c080c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.996 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c077fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c08178730 0x7f8c080c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58846/0 (socket says 172.21.15.149:58846) 2022-07-05T11:45:48.996 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c077fe700 1 -- 172.21.15.149:0/1221908485 learned_addr learned my addr 172.21.15.149:0/1221908485 (peer_addr_for_me v2:172.21.15.149:0/0) 2022-07-05T11:45:48.997 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c07fff700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c080c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.997 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0cf8e700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c0817c3e0 0x7f8c080c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:48.998 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c07fff700 1 -- 172.21.15.149:0/1221908485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c08178730 msgr2=0x7f8c080c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.998 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c07fff700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c08178730 0x7f8c080c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:48.999 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c07fff700 1 -- 172.21.15.149:0/1221908485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c0817c3e0 msgr2=0x7f8c080c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:48.999 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c07fff700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c0817c3e0 0x7f8c080c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.000 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c07fff700 1 -- 172.21.15.149:0/1221908485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80092a0 con 0x7f8c080ee840 2022-07-05T11:45:49.000 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c07fff700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c080c4f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8bfc00c810 tx=0x7f8bfc001a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:49.000 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8beffff700 1 -- 172.21.15.149:0/1221908485 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc007170 con 0x7f8c080ee840 2022-07-05T11:45:49.001 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8beffff700 1 -- 172.21.15.149:0/1221908485 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0072f0 con 0x7f8c080ee840 2022-07-05T11:45:49.001 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.980+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c080c61e0 con 0x7f8c080ee840 2022-07-05T11:45:49.002 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.981+0000 7f8beffff700 1 -- 172.21.15.149:0/1221908485 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0048c0 con 0x7f8c080ee840 2022-07-05T11:45:49.002 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.981+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c080c9120 con 0x7f8c080ee840 2022-07-05T11:45:49.003 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.981+0000 7f8beffff700 1 -- 172.21.15.149:0/1221908485 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f8bfc014410 con 0x7f8c080ee840 2022-07-05T11:45:49.003 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.981+0000 7f8beffff700 1 -- 172.21.15.149:0/1221908485 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2019+0+0 (secure 0 0 0) 0x7f8bfc01dc50 con 0x7f8c080ee840 2022-07-05T11:45:49.004 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.981+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c080c8590 con 0x7f8c080ee840 2022-07-05T11:45:49.004 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:48.984+0000 7f8beffff700 1 -- 172.21.15.149:0/1221908485 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f8bfc034de0 con 0x7f8c080ee840 2022-07-05T11:45:49.023 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:49.021+0000 7f64e46eb680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-07-05T11:45:49.050 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:49.048+0000 7fe316f96680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-07-05T11:45:49.063 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.062+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca9c1921-128a-4639-9879-9494fcbec477", "id": 11} v 0) v1 -- 0x7f8c0806be40 con 0x7f8c080ee840 2022-07-05T11:45:49.067 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.065+0000 7f8beffff700 1 -- 172.21.15.149:0/1221908485 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca9c1921-128a-4639-9879-9494fcbec477", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f8bfc023030 con 0x7f8c080ee840 2022-07-05T11:45:49.069 INFO:teuthology.orchestra.run.smithi149.stdout:11 2022-07-05T11:45:49.070 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.066+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 msgr2=0x7f8c080c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:49.070 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.066+0000 7f8c0e9f1700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c080c4f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8bfc00c810 tx=0x7f8bfc001a10).stop 2022-07-05T11:45:49.071 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.066+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 shutdown_connections 2022-07-05T11:45:49.071 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.066+0000 7f8c0e9f1700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c0817c3e0 0x7f8c080c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.071 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.066+0000 7f8c0e9f1700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c080ee840 0x7f8c080c4f00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.071 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.066+0000 7f8c0e9f1700 1 --2- 172.21.15.149:0/1221908485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c08178730 0x7f8c080c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.066+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 >> 172.21.15.149:0/1221908485 conn(0x7f8c080effc0 msgr2=0x7f8c080680b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.067+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 shutdown_connections 2022-07-05T11:45:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2022-07-05T11:45:49.067+0000 7f8c0e9f1700 1 -- 172.21.15.149:0/1221908485 wait complete. 2022-07-05T11:45:49.081 INFO:tasks.ceph.osd.0:Restarting daemon 2022-07-05T11:45:49.082 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-07-05T11:45:49.085 INFO:tasks.ceph.osd.0:Started 2022-07-05T11:45:49.085 INFO:tasks.ceph.osd.3:Restarting daemon 2022-07-05T11:45:49.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-07-05T11:45:49.090 INFO:tasks.ceph.osd.3:Started 2022-07-05T11:45:49.090 INFO:tasks.ceph.osd.6:Restarting daemon 2022-07-05T11:45:49.091 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-07-05T11:45:49.093 INFO:tasks.ceph.osd.6:Started 2022-07-05T11:45:49.097 INFO:tasks.ceph.osd.9:Restarting daemon 2022-07-05T11:45:49.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2022-07-05T11:45:49.099 INFO:tasks.ceph.mgr.y.smithi110.stderr:2022-07-05T11:45:49.090+0000 7f64e46eb680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-07-05T11:45:49.109 INFO:tasks.ceph.osd.9:Started 2022-07-05T11:45:49.110 INFO:tasks.ceph.osd.1:Restarting daemon 2022-07-05T11:45:49.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-07-05T11:45:49.113 INFO:tasks.ceph.osd.1:Started 2022-07-05T11:45:49.114 INFO:tasks.ceph.osd.4:Restarting daemon 2022-07-05T11:45:49.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-07-05T11:45:49.117 INFO:tasks.ceph.osd.4:Started 2022-07-05T11:45:49.117 INFO:tasks.ceph.osd.7:Restarting daemon 2022-07-05T11:45:49.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-07-05T11:45:49.120 INFO:tasks.ceph.osd.7:Started 2022-07-05T11:45:49.121 INFO:tasks.ceph.osd.10:Restarting daemon 2022-07-05T11:45:49.122 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2022-07-05T11:45:49.124 INFO:tasks.ceph.osd.10:Started 2022-07-05T11:45:49.125 INFO:tasks.ceph.osd.2:Restarting daemon 2022-07-05T11:45:49.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-07-05T11:45:49.127 INFO:tasks.ceph.mgr.x.smithi090.stderr:2022-07-05T11:45:49.125+0000 7fe316f96680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-07-05T11:45:49.127 INFO:tasks.ceph.osd.2:Started 2022-07-05T11:45:49.128 INFO:tasks.ceph.osd.5:Restarting daemon 2022-07-05T11:45:49.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-07-05T11:45:49.131 INFO:tasks.ceph.osd.5:Started 2022-07-05T11:45:49.131 INFO:tasks.ceph.osd.8:Restarting daemon 2022-07-05T11:45:49.132 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2022-07-05T11:45:49.134 INFO:tasks.ceph.osd.8:Started 2022-07-05T11:45:49.135 INFO:tasks.ceph.osd.11:Restarting daemon 2022-07-05T11:45:49.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2022-07-05T11:45:49.138 INFO:tasks.ceph.osd.11:Started 2022-07-05T11:45:49.138 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:45:49.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.257+0000 7f313e140700 1 Processor -- start 2022-07-05T11:45:49.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.257+0000 7f313e140700 1 -- start start 2022-07-05T11:45:49.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f313e140700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f31380c7d00 0x7f313817de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:49.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f313e140700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31380c9520 0x7f31380c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:49.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f313e140700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31380c9090 con 0x7f313817da60 2022-07-05T11:45:49.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f313e140700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31380c81a0 con 0x7f31380c9520 2022-07-05T11:45:49.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f313e140700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31380c8480 con 0x7f31380c7d00 2022-07-05T11:45:49.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f3137fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31380c9520 0x7f31380c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:49.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f3137fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31380c9520 0x7f31380c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55710/0 (socket says 172.21.15.90:55710) 2022-07-05T11:45:49.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f3137fff700 1 -- 172.21.15.90:0/1658265014 learned_addr learned my addr 172.21.15.90:0/1658265014 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:49.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.258+0000 7f3136ffd700 1 --2- 172.21.15.90:0/1658265014 >> v2:172.21.15.110:3300/0 conn(0x7f31380c7d00 0x7f313817de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:49.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f3137fff700 1 -- 172.21.15.90:0/1658265014 >> v2:172.21.15.110:3300/0 conn(0x7f31380c7d00 msgr2=0x7f313817de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:49.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f3137fff700 1 --2- 172.21.15.90:0/1658265014 >> v2:172.21.15.110:3300/0 conn(0x7f31380c7d00 0x7f313817de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f3137fff700 1 -- 172.21.15.90:0/1658265014 >> v1:172.21.15.110:6789/0 conn(0x7f313817da60 legacy=0x7f313817eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:49.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f3137fff700 1 -- 172.21.15.90:0/1658265014 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31380c8760 con 0x7f31380c9520 2022-07-05T11:45:49.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f3137fff700 1 --2- 172.21.15.90:0/1658265014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31380c9520 0x7f31380c99b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f31380c7890 tx=0x7f31300090f0).ready entity=mon.0 client_cookie=62010f47df21adf0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:49.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f31367fc700 1 -- 172.21.15.90:0/1658265014 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000b520 con 0x7f31380c9520 2022-07-05T11:45:49.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f31367fc700 1 -- 172.21.15.90:0/1658265014 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000b680 con 0x7f31380c9520 2022-07-05T11:45:49.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f31367fc700 1 -- 172.21.15.90:0/1658265014 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000ba00 con 0x7f31380c9520 2022-07-05T11:45:49.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 -- 172.21.15.90:0/1658265014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31380c9520 msgr2=0x7f31380c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:49.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 --2- 172.21.15.90:0/1658265014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31380c9520 0x7f31380c99b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f31380c7890 tx=0x7f31300090f0).stop 2022-07-05T11:45:49.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 -- 172.21.15.90:0/1658265014 shutdown_connections 2022-07-05T11:45:49.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 --2- 172.21.15.90:0/1658265014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31380c9520 0x7f31380c99b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 --2- 172.21.15.90:0/1658265014 >> v2:172.21.15.110:3300/0 conn(0x7f31380c7d00 0x7f313817de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 -- 172.21.15.90:0/1658265014 >> 172.21.15.90:0/1658265014 conn(0x7f31380f4b70 msgr2=0x7f31380f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:49.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 -- 172.21.15.90:0/1658265014 shutdown_connections 2022-07-05T11:45:49.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.259+0000 7f313e140700 1 -- 172.21.15.90:0/1658265014 wait complete. 2022-07-05T11:45:49.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.261+0000 7f313e140700 1 Processor -- start 2022-07-05T11:45:49.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.261+0000 7f313e140700 1 -- start start 2022-07-05T11:45:49.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f313e140700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31380c7d00 0x7f31381764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:49.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f313e140700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31380c9520 0x7f3138179da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:49.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f313e140700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f313817da60 0x7f313818ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:49.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f313e140700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3138176990 con 0x7f313817da60 2022-07-05T11:45:49.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f313e140700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3138190ce0 con 0x7f31380c9520 2022-07-05T11:45:49.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f313e140700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3138190fc0 con 0x7f31380c7d00 2022-07-05T11:45:49.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f313817da60 0x7f313818ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:49.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f313817da60 0x7f313818ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55716/0 (socket says 172.21.15.90:55716) 2022-07-05T11:45:49.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 -- 172.21.15.90:0/1453869293 learned_addr learned my addr 172.21.15.90:0/1453869293 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:49.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3136ffd700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31380c9520 0x7f3138179da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:49.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f31377fe700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31380c7d00 0x7f31381764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:49.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 -- 172.21.15.90:0/1453869293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31380c7d00 msgr2=0x7f31381764a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:49.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31380c7d00 0x7f31381764a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 -- 172.21.15.90:0/1453869293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31380c9520 msgr2=0x7f3138179da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:49.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31380c9520 0x7f3138179da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 -- 172.21.15.90:0/1453869293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130009370 con 0x7f313817da60 2022-07-05T11:45:49.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.262+0000 7f3137fff700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f313817da60 0x7f313818ca10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3138088b30 tx=0x7f3130017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:49.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f311f7fe700 1 -- 172.21.15.90:0/1453869293 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000b7f0 con 0x7f313817da60 2022-07-05T11:45:49.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f311f7fe700 1 -- 172.21.15.90:0/1453869293 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000b950 con 0x7f313817da60 2022-07-05T11:45:49.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31381912a0 con 0x7f313817da60 2022-07-05T11:45:49.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f311f7fe700 1 -- 172.21.15.90:0/1453869293 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313001b640 con 0x7f313817da60 2022-07-05T11:45:49.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3138191860 con 0x7f313817da60 2022-07-05T11:45:49.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f311f7fe700 1 -- 172.21.15.90:0/1453869293 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 2) v1 ==== 37381+0+0 (secure 0 0 0) 0x7f313002b070 con 0x7f313817da60 2022-07-05T11:45:49.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f311f7fe700 1 -- 172.21.15.90:0/1453869293 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2134+0+0 (secure 0 0 0) 0x7f3130042e10 con 0x7f313817da60 2022-07-05T11:45:49.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.263+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3138191a20 con 0x7f313817da60 2022-07-05T11:45:49.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.266+0000 7f311f7fe700 1 -- 172.21.15.90:0/1453869293 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f313001f020 con 0x7f313817da60 2022-07-05T11:45:49.306 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:49.304+0000 7f4c64b84680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-07-05T11:45:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.329+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f313818c730 con 0x7f313817da60 2022-07-05T11:45:49.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f311f7fe700 1 -- 172.21.15.90:0/1453869293 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9954 (secure 0 0 0) 0x7f313818c730 con 0x7f313817da60 2022-07-05T11:45:49.332 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:45:49.332 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:45:49.064611+0000","last_up_change":"0.000000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:45:49.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f313817da60 msgr2=0x7f313818ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:49.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f313817da60 0x7f313818ca10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3138088b30 tx=0x7f3130017000).stop 2022-07-05T11:45:49.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 shutdown_connections 2022-07-05T11:45:49.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f313817da60 0x7f313818ca10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31380c7d00 0x7f31381764a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 --2- 172.21.15.90:0/1453869293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31380c9520 0x7f3138179da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:49.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 >> 172.21.15.90:0/1453869293 conn(0x7f31380f4b70 msgr2=0x7f3138177410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:49.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 shutdown_connections 2022-07-05T11:45:49.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:49.330+0000 7f313e140700 1 -- 172.21.15.90:0/1453869293 wait complete. 2022-07-05T11:45:49.344 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-07-05T11:45:49.345 INFO:tasks.ceph:Waiting for OSDs to come up 2022-07-05T11:45:49.376 INFO:tasks.ceph.mgr.z.smithi149.stderr:2022-07-05T11:45:49.374+0000 7f4c64b84680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-07-05T11:45:49.685 INFO:tasks.ceph.osd.3.smithi090.stderr:2022-07-05T11:45:49.683+0000 7f7d9228c200 -1 Falling back to public interface 2022-07-05T11:45:49.694 INFO:tasks.ceph.osd.0.smithi090.stderr:2022-07-05T11:45:49.692+0000 7f291fe49200 -1 Falling back to public interface 2022-07-05T11:45:49.700 INFO:tasks.ceph.osd.6.smithi090.stderr:2022-07-05T11:45:49.698+0000 7fa26917a200 -1 Falling back to public interface 2022-07-05T11:45:49.701 INFO:tasks.ceph.osd.9.smithi090.stderr:2022-07-05T11:45:49.699+0000 7f697de4e200 -1 Falling back to public interface 2022-07-05T11:45:49.714 INFO:tasks.ceph.osd.4.smithi110.stderr:2022-07-05T11:45:49.713+0000 7f2456df3200 -1 Falling back to public interface 2022-07-05T11:45:49.715 INFO:tasks.ceph.osd.1.smithi110.stderr:2022-07-05T11:45:49.714+0000 7f1d7acbd200 -1 Falling back to public interface 2022-07-05T11:45:49.722 INFO:tasks.ceph.osd.10.smithi110.stderr:2022-07-05T11:45:49.721+0000 7f6f446e4200 -1 Falling back to public interface 2022-07-05T11:45:49.725 INFO:tasks.ceph.osd.7.smithi110.stderr:2022-07-05T11:45:49.722+0000 7fe157a97200 -1 Falling back to public interface 2022-07-05T11:45:49.732 INFO:tasks.ceph.osd.2.smithi149.stderr:2022-07-05T11:45:49.730+0000 7f24526ad200 -1 Falling back to public interface 2022-07-05T11:45:49.733 INFO:tasks.ceph.osd.8.smithi149.stderr:2022-07-05T11:45:49.730+0000 7f8f7ec01200 -1 Falling back to public interface 2022-07-05T11:45:49.734 INFO:tasks.ceph.osd.5.smithi149.stderr:2022-07-05T11:45:49.730+0000 7f8f49473200 -1 Falling back to public interface 2022-07-05T11:45:49.735 INFO:tasks.ceph.osd.2.smithi149.stderr:2022-07-05T11:45:49.731+0000 7f244c873700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2022-07-05T11:45:49.736 INFO:tasks.ceph.osd.5.smithi149.stderr:2022-07-05T11:45:49.731+0000 7f8f43639700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2022-07-05T11:45:49.737 INFO:tasks.ceph.osd.2.smithi149.stderr:2022-07-05T11:45:49.731+0000 7f244c873700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6814/0: (98) Address already in use 2022-07-05T11:45:49.737 INFO:tasks.ceph.osd.8.smithi149.stderr:2022-07-05T11:45:49.732+0000 7f8f78dc7700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6817/0: (98) Address already in use 2022-07-05T11:45:49.752 INFO:tasks.ceph.osd.11.smithi149.stderr:2022-07-05T11:45:49.747+0000 7f20a7a1b200 -1 Falling back to public interface 2022-07-05T11:45:50.554 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-07-05T11:45:50.666 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.664+0000 7f8bb3baf700 1 Processor -- start 2022-07-05T11:45:50.667 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.665+0000 7f8bb3baf700 1 -- start start 2022-07-05T11:45:50.675 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb3baf700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8bac067c50 0x7f8bac0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.676 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb3baf700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac068fd0 con 0x7f8bac176140 2022-07-05T11:45:50.676 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb3baf700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac0692b0 con 0x7f8bac17e4d0 2022-07-05T11:45:50.677 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb3baf700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac17d710 con 0x7f8bac067c50 2022-07-05T11:45:50.677 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb194b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8bac176140 0x7f8bac0c4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48662/0 (socket says 172.21.15.90:48662) 2022-07-05T11:45:50.677 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb194b700 1 -- 172.21.15.90:0/2696153399 learned_addr learned my addr 172.21.15.90:0/2696153399 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:45:50.677 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb214c700 1 --2- 172.21.15.90:0/2696153399 >> v2:172.21.15.110:3300/0 conn(0x7f8bac067c50 0x7f8bac0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.677 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155979606 0 0) 0x7f8bac068fd0 con 0x7f8bac176140 2022-07-05T11:45:50.678 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b980033f0 con 0x7f8bac176140 2022-07-05T11:45:50.678 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2957932468 0 0) 0x7f8b980033f0 con 0x7f8bac176140 2022-07-05T11:45:50.678 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 >> v2:172.21.15.110:3300/0 conn(0x7f8bac067c50 msgr2=0x7f8bac0680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:50.679 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb0949700 1 --2- 172.21.15.90:0/2696153399 >> v2:172.21.15.110:3300/0 conn(0x7f8bac067c50 0x7f8bac0680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.679 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 >> v1:172.21.15.110:6789/0 conn(0x7f8bac17e4d0 legacy=0x7f8bac17e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:50.679 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.666+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac17d9f0 con 0x7f8bac176140 2022-07-05T11:45:50.679 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f8ba4001470 con 0x7f8bac176140 2022-07-05T11:45:50.679 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 >> v1:172.21.15.90:6789/0 conn(0x7f8bac176140 legacy=0x7f8bac0c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:50.680 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b980038e0 0x7f8b98003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.680 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.680 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98005000 0x7f8b9800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.680 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac17d710 con 0x7f8b98004690 2022-07-05T11:45:50.681 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9800bee0 con 0x7f8b980038e0 2022-07-05T11:45:50.681 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9800c0a0 con 0x7f8b98005000 2022-07-05T11:45:50.681 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb114a700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.681 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb194b700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b980038e0 0x7f8b98003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.682 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb214c700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98005000 0x7f8b9800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.682 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb114a700 1 -- 172.21.15.90:0/2696153399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98005000 msgr2=0x7f8b9800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:50.682 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb114a700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98005000 0x7f8b9800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.682 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb114a700 1 -- 172.21.15.90:0/2696153399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b980038e0 msgr2=0x7f8b98003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:50.683 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb114a700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b980038e0 0x7f8b98003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.683 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb114a700 1 -- 172.21.15.90:0/2696153399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980033f0 con 0x7f8b98004690 2022-07-05T11:45:50.683 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb214c700 1 -- 172.21.15.90:0/2696153399 reap_dead start 2022-07-05T11:45:50.683 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb194b700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b980038e0 0x7f8b98003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:45:50.684 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb114a700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b98004690 0x7f8b98004b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8ba0001820 tx=0x7f8ba0007b90).ready entity=mon.0 client_cookie=d7eb70bee4c3c22e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:50.684 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0007ea0 con 0x7f8b98004690 2022-07-05T11:45:50.684 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba0012400 con 0x7f8b98004690 2022-07-05T11:45:50.684 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.667+0000 7f8bb0949700 1 -- 172.21.15.90:0/2696153399 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00127a0 con 0x7f8b98004690 2022-07-05T11:45:50.685 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.668+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2696153399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b98004690 msgr2=0x7f8b98004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:50.685 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.668+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b98004690 0x7f8b98004b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8ba0001820 tx=0x7f8ba0007b90).stop 2022-07-05T11:45:50.685 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.668+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2696153399 shutdown_connections 2022-07-05T11:45:50.686 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.668+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2696153399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.686 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.668+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2696153399 >> 172.21.15.90:0/2696153399 conn(0x7f8bac0f2980 msgr2=0x7f8bac0f2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:50.686 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.668+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2696153399 shutdown_connections 2022-07-05T11:45:50.687 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.668+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2696153399 wait complete. 2022-07-05T11:45:50.687 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.669+0000 7f8bb3baf700 1 Processor -- start 2022-07-05T11:45:50.687 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.669+0000 7f8bb3baf700 1 -- start start 2022-07-05T11:45:50.687 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb3baf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98004690 0x7f8bac15f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.688 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb3baf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bac15fe00 0x7f8bac0844b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.688 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb3baf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bac0849a0 0x7f8bac1711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.688 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb3baf700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0f0580 con 0x7f8bac15fe00 2022-07-05T11:45:50.689 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb3baf700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0f0860 con 0x7f8bac0849a0 2022-07-05T11:45:50.689 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb3baf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0f0b40 con 0x7f8b98004690 2022-07-05T11:45:50.689 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb114a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bac15fe00 0x7f8bac0844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.689 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb114a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bac15fe00 0x7f8bac0844b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55736/0 (socket says 172.21.15.90:55736) 2022-07-05T11:45:50.690 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.670+0000 7f8bb114a700 1 -- 172.21.15.90:0/2491412759 learned_addr learned my addr 172.21.15.90:0/2491412759 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:50.690 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb214c700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bac0849a0 0x7f8bac1711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.690 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb194b700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98004690 0x7f8bac15f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.691 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb114a700 1 -- 172.21.15.90:0/2491412759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98004690 msgr2=0x7f8bac15f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:50.691 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb114a700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98004690 0x7f8bac15f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.691 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb114a700 1 -- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bac0849a0 msgr2=0x7f8bac1711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:50.691 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb114a700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bac0849a0 0x7f8bac1711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.691 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb114a700 1 -- 172.21.15.90:0/2491412759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0f0e20 con 0x7f8bac15fe00 2022-07-05T11:45:50.692 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb114a700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bac15fe00 0x7f8bac0844b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ba0001e10 tx=0x7f8ba0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:50.692 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8ba9ffb700 1 -- 172.21.15.90:0/2491412759 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0007ea0 con 0x7f8bac15fe00 2022-07-05T11:45:50.692 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8ba9ffb700 1 -- 172.21.15.90:0/2491412759 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba00116e0 con 0x7f8bac15fe00 2022-07-05T11:45:50.692 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8ba9ffb700 1 -- 172.21.15.90:0/2491412759 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0011aa0 con 0x7f8bac15fe00 2022-07-05T11:45:50.693 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac0f1100 con 0x7f8bac15fe00 2022-07-05T11:45:50.693 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.671+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac0f1900 con 0x7f8bac15fe00 2022-07-05T11:45:50.693 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.672+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac0f1750 con 0x7f8bac15fe00 2022-07-05T11:45:50.693 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.673+0000 7f8ba9ffb700 1 -- 172.21.15.90:0/2491412759 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 3) v1 ==== 112117+0+0 (secure 0 0 0) 0x7f8ba001b040 con 0x7f8bac15fe00 2022-07-05T11:45:50.693 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.673+0000 7f8ba9ffb700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8b8c08b9a0 0x7f8b8c08de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:50.694 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.673+0000 7f8ba9ffb700 1 -- 172.21.15.90:0/2491412759 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2134+0+0 (secure 0 0 0) 0x7f8ba00af9d0 con 0x7f8bac15fe00 2022-07-05T11:45:50.694 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.673+0000 7f8bb194b700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8b8c08b9a0 0x7f8b8c08de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:50.694 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.674+0000 7f8bb194b700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8b8c08b9a0 0x7f8b8c08de60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8ba4001d00 tx=0x7f8ba4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:50.695 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.677+0000 7f8ba9ffb700 1 -- 172.21.15.90:0/2491412759 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f8ba0082190 con 0x7f8bac15fe00 2022-07-05T11:45:50.845 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.843+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bac06be40 con 0x7f8bac15fe00 2022-07-05T11:45:50.846 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.844+0000 7f8ba9ffb700 1 -- 172.21.15.90:0/2491412759 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9954 (secure 0 0 0) 0x7f8ba00857b0 con 0x7f8bac15fe00 2022-07-05T11:45:50.846 INFO:teuthology.misc.health.smithi090.stdout: 2022-07-05T11:45:50.846 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":14,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:45:49.064611+0000","last_up_change":"0.000000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:45:50.848 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8b8c08b9a0 msgr2=0x7f8b8c08de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:50.848 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8b8c08b9a0 0x7f8b8c08de60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8ba4001d00 tx=0x7f8ba4009040).stop 2022-07-05T11:45:50.848 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bac15fe00 msgr2=0x7f8bac0844b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:50.849 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bac15fe00 0x7f8bac0844b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ba0001e10 tx=0x7f8ba0016000).stop 2022-07-05T11:45:50.849 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 shutdown_connections 2022-07-05T11:45:50.849 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8b8c08b9a0 0x7f8b8c08de60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.849 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bac0849a0 0x7f8bac1711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.849 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b98004690 0x7f8bac15f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.850 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 --2- 172.21.15.90:0/2491412759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bac15fe00 0x7f8bac0844b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:50.850 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 >> 172.21.15.90:0/2491412759 conn(0x7f8bac0f2980 msgr2=0x7f8bac067000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:50.850 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 shutdown_connections 2022-07-05T11:45:50.850 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:50.846+0000 7f8bb3baf700 1 -- 172.21.15.90:0/2491412759 wait complete. 2022-07-05T11:45:50.858 DEBUG:teuthology.misc:0 of 12 OSDs are up 2022-07-05T11:45:53.141 INFO:tasks.ceph.osd.3.smithi090.stderr:2022-07-05T11:45:53.139+0000 7f7d9228c200 -1 osd.3 0 log_to_monitors {default=true} 2022-07-05T11:45:53.178 INFO:tasks.ceph.osd.8.smithi149.stderr:2022-07-05T11:45:53.177+0000 7f8f7ec01200 -1 osd.8 0 log_to_monitors {default=true} 2022-07-05T11:45:53.201 INFO:tasks.ceph.osd.0.smithi090.stderr:2022-07-05T11:45:53.199+0000 7f291fe49200 -1 osd.0 0 log_to_monitors {default=true} 2022-07-05T11:45:53.207 INFO:tasks.ceph.osd.4.smithi110.stderr:2022-07-05T11:45:53.206+0000 7f2456df3200 -1 osd.4 0 log_to_monitors {default=true} 2022-07-05T11:45:53.223 INFO:tasks.ceph.osd.9.smithi090.stderr:2022-07-05T11:45:53.221+0000 7f697de4e200 -1 osd.9 0 log_to_monitors {default=true} 2022-07-05T11:45:53.230 INFO:tasks.ceph.osd.6.smithi090.stderr:2022-07-05T11:45:53.229+0000 7fa26917a200 -1 osd.6 0 log_to_monitors {default=true} 2022-07-05T11:45:53.236 INFO:tasks.ceph.osd.10.smithi110.stderr:2022-07-05T11:45:53.235+0000 7f6f446e4200 -1 osd.10 0 log_to_monitors {default=true} 2022-07-05T11:45:53.245 INFO:tasks.ceph.osd.1.smithi110.stderr:2022-07-05T11:45:53.244+0000 7f1d7acbd200 -1 osd.1 0 log_to_monitors {default=true} 2022-07-05T11:45:53.266 INFO:tasks.ceph.osd.7.smithi110.stderr:2022-07-05T11:45:53.265+0000 7fe157a97200 -1 osd.7 0 log_to_monitors {default=true} 2022-07-05T11:45:53.481 INFO:tasks.ceph.osd.5.smithi149.stderr:2022-07-05T11:45:53.479+0000 7f8f49473200 -1 osd.5 0 log_to_monitors {default=true} 2022-07-05T11:45:53.489 INFO:tasks.ceph.osd.11.smithi149.stderr:2022-07-05T11:45:53.487+0000 7f20a7a1b200 -1 osd.11 0 log_to_monitors {default=true} 2022-07-05T11:45:53.502 INFO:tasks.ceph.osd.2.smithi149.stderr:2022-07-05T11:45:53.500+0000 7f24526ad200 -1 osd.2 0 log_to_monitors {default=true} 2022-07-05T11:45:55.137 INFO:tasks.ceph.osd.8.smithi149.stderr:2022-07-05T11:45:55.135+0000 7f8f755c0700 -1 osd.8 0 waiting for initial osdmap 2022-07-05T11:45:55.138 INFO:tasks.ceph.osd.2.smithi149.stderr:2022-07-05T11:45:55.135+0000 7f244906c700 -1 osd.2 0 waiting for initial osdmap 2022-07-05T11:45:55.139 INFO:tasks.ceph.osd.5.smithi149.stderr:2022-07-05T11:45:55.135+0000 7f8f3fe32700 -1 osd.5 0 waiting for initial osdmap 2022-07-05T11:45:55.139 INFO:tasks.ceph.osd.11.smithi149.stderr:2022-07-05T11:45:55.136+0000 7f209fbdd700 -1 osd.11 0 waiting for initial osdmap 2022-07-05T11:45:55.140 INFO:tasks.ceph.osd.3.smithi090.stderr:2022-07-05T11:45:55.137+0000 7f7d88c4b700 -1 osd.3 0 waiting for initial osdmap 2022-07-05T11:45:55.141 INFO:tasks.ceph.osd.7.smithi110.stderr:2022-07-05T11:45:55.136+0000 7fe14e456700 -1 osd.7 0 waiting for initial osdmap 2022-07-05T11:45:55.142 INFO:tasks.ceph.osd.0.smithi090.stderr:2022-07-05T11:45:55.137+0000 7f2916808700 -1 osd.0 0 waiting for initial osdmap 2022-07-05T11:45:55.143 INFO:tasks.ceph.osd.1.smithi110.stderr:2022-07-05T11:45:55.136+0000 7f1d7167c700 -1 osd.1 0 waiting for initial osdmap 2022-07-05T11:45:55.143 INFO:tasks.ceph.osd.9.smithi090.stderr:2022-07-05T11:45:55.137+0000 7f697480d700 -1 osd.9 0 waiting for initial osdmap 2022-07-05T11:45:55.144 INFO:tasks.ceph.osd.4.smithi110.stderr:2022-07-05T11:45:55.136+0000 7f244d7b2700 -1 osd.4 0 waiting for initial osdmap 2022-07-05T11:45:55.145 INFO:tasks.ceph.osd.6.smithi090.stderr:2022-07-05T11:45:55.137+0000 7fa25fb39700 -1 osd.6 0 waiting for initial osdmap 2022-07-05T11:45:55.146 INFO:tasks.ceph.osd.10.smithi110.stderr:2022-07-05T11:45:55.141+0000 7f6f3b0a3700 -1 osd.10 0 waiting for initial osdmap 2022-07-05T11:45:55.147 INFO:tasks.ceph.osd.3.smithi090.stderr:2022-07-05T11:45:55.142+0000 7f7d853c7700 -1 osd.3 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.147 INFO:tasks.ceph.osd.7.smithi110.stderr:2022-07-05T11:45:55.143+0000 7fe14abd2700 -1 osd.7 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.148 INFO:tasks.ceph.osd.0.smithi090.stderr:2022-07-05T11:45:55.144+0000 7f2912f84700 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.149 INFO:tasks.ceph.osd.1.smithi110.stderr:2022-07-05T11:45:55.143+0000 7f1d6ddf8700 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.149 INFO:tasks.ceph.osd.6.smithi090.stderr:2022-07-05T11:45:55.145+0000 7fa25c2b5700 -1 osd.6 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.150 INFO:tasks.ceph.osd.4.smithi110.stderr:2022-07-05T11:45:55.143+0000 7f2449f2e700 -1 osd.4 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.150 INFO:tasks.ceph.osd.9.smithi090.stderr:2022-07-05T11:45:55.145+0000 7f6970f89700 -1 osd.9 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.151 INFO:tasks.ceph.osd.8.smithi149.stderr:2022-07-05T11:45:55.145+0000 7f8f71d3c700 -1 osd.8 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.152 INFO:tasks.ceph.osd.10.smithi110.stderr:2022-07-05T11:45:55.148+0000 7f6f3781f700 -1 osd.10 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.153 INFO:tasks.ceph.osd.2.smithi149.stderr:2022-07-05T11:45:55.145+0000 7f24457e8700 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.153 INFO:tasks.ceph.osd.5.smithi149.stderr:2022-07-05T11:45:55.145+0000 7f8f3c5ae700 -1 osd.5 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:55.154 INFO:tasks.ceph.osd.11.smithi149.stderr:2022-07-05T11:45:55.146+0000 7f209ab56700 -1 osd.11 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-07-05T11:45:58.070 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-07-05T11:45:58.187 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.184+0000 7f2243cf1700 1 Processor -- start 2022-07-05T11:45:58.187 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.185+0000 7f2243cf1700 1 -- start start 2022-07-05T11:45:58.193 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f2243cf1700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f223c174ea0 0x7f223c0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.193 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f2243cf1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f223c0c4ca0 0x7f223c181a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.194 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f2243cf1700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0c4100 con 0x7f223c0c69b0 2022-07-05T11:45:58.194 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f2243cf1700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c063250 con 0x7f223c174ea0 2022-07-05T11:45:58.194 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f2243cf1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c063530 con 0x7f223c0c4ca0 2022-07-05T11:45:58.194 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f224228e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f223c0c4ca0 0x7f223c181a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.195 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f224228e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f223c0c4ca0 0x7f223c181a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37436/0 (socket says 172.21.15.90:37436) 2022-07-05T11:45:58.195 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f224228e700 1 -- 172.21.15.90:0/263659951 learned_addr learned my addr 172.21.15.90:0/263659951 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:58.195 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f2241a8d700 1 --2- 172.21.15.90:0/263659951 >> v2:172.21.15.110:3300/0 conn(0x7f223c174ea0 0x7f223c0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.195 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f224228e700 1 -- 172.21.15.90:0/263659951 >> v2:172.21.15.110:3300/0 conn(0x7f223c174ea0 msgr2=0x7f223c0c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:58.195 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f224228e700 1 --2- 172.21.15.90:0/263659951 >> v2:172.21.15.110:3300/0 conn(0x7f223c174ea0 0x7f223c0c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.196 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f224228e700 1 -- 172.21.15.90:0/263659951 >> v1:172.21.15.110:6789/0 conn(0x7f223c0c69b0 legacy=0x7f223c0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.196 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.186+0000 7f224228e700 1 -- 172.21.15.90:0/263659951 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c063810 con 0x7f223c0c4ca0 2022-07-05T11:45:58.196 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f224228e700 1 --2- 172.21.15.90:0/263659951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c0c4ca0 0x7f223c181a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f223c06c0f0 tx=0x7f22380090f0).ready entity=mon.2 client_cookie=adc866aec87bb963 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:58.196 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2240a8b700 1 -- 172.21.15.90:0/263659951 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223800b600 con 0x7f223c0c4ca0 2022-07-05T11:45:58.197 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2240a8b700 1 -- 172.21.15.90:0/263659951 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223800b760 con 0x7f223c0c4ca0 2022-07-05T11:45:58.197 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2240a8b700 1 -- 172.21.15.90:0/263659951 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223800bae0 con 0x7f223c0c4ca0 2022-07-05T11:45:58.197 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 -- 172.21.15.90:0/263659951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c0c4ca0 msgr2=0x7f223c181a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.197 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 --2- 172.21.15.90:0/263659951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c0c4ca0 0x7f223c181a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f223c06c0f0 tx=0x7f22380090f0).stop 2022-07-05T11:45:58.197 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 -- 172.21.15.90:0/263659951 shutdown_connections 2022-07-05T11:45:58.198 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 --2- 172.21.15.90:0/263659951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c0c4ca0 0x7f223c181a20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.198 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 --2- 172.21.15.90:0/263659951 >> v2:172.21.15.110:3300/0 conn(0x7f223c174ea0 0x7f223c0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.198 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 -- 172.21.15.90:0/263659951 >> 172.21.15.90:0/263659951 conn(0x7f223c0f4b30 msgr2=0x7f223c0f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:58.198 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 -- 172.21.15.90:0/263659951 shutdown_connections 2022-07-05T11:45:58.199 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.187+0000 7f2243cf1700 1 -- 172.21.15.90:0/263659951 wait complete. 2022-07-05T11:45:58.199 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.189+0000 7f2243cf1700 1 Processor -- start 2022-07-05T11:45:58.199 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.189+0000 7f2243cf1700 1 -- start start 2022-07-05T11:45:58.199 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2243cf1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f223c0c4ca0 0x7f223c16cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.199 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2243cf1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c0c69b0 0x7f223c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.200 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2243cf1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c174ea0 0x7f223c176290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.200 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2243cf1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c175280 con 0x7f223c0c69b0 2022-07-05T11:45:58.200 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2243cf1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c16d2b0 con 0x7f223c0c4ca0 2022-07-05T11:45:58.200 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2243cf1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0c91b0 con 0x7f223c174ea0 2022-07-05T11:45:58.201 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c0c69b0 0x7f223c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.201 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c0c69b0 0x7f223c0cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56046/0 (socket says 172.21.15.90:56046) 2022-07-05T11:45:58.201 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 -- 172.21.15.90:0/1437157157 learned_addr learned my addr 172.21.15.90:0/1437157157 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:58.201 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2241a8d700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f223c0c4ca0 0x7f223c16cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.201 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224228e700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c174ea0 0x7f223c176290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.202 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 -- 172.21.15.90:0/1437157157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c174ea0 msgr2=0x7f223c176290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.202 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c174ea0 0x7f223c176290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.202 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 -- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f223c0c4ca0 msgr2=0x7f223c16cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.202 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f223c0c4ca0 0x7f223c16cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.203 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 -- 172.21.15.90:0/1437157157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2238009370 con 0x7f223c0c69b0 2022-07-05T11:45:58.203 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f224128c700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c0c69b0 0x7f223c0cc210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f222c00c4c0 tx=0x7f222c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:58.203 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2229ffb700 1 -- 172.21.15.90:0/1437157157 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00ce70 con 0x7f223c0c69b0 2022-07-05T11:45:58.203 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2229ffb700 1 -- 172.21.15.90:0/1437157157 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c001e90 con 0x7f223c0c69b0 2022-07-05T11:45:58.203 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2229ffb700 1 -- 172.21.15.90:0/1437157157 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c007270 con 0x7f223c0c69b0 2022-07-05T11:45:58.204 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.190+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c1754d0 con 0x7f223c0c69b0 2022-07-05T11:45:58.204 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.191+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c175a90 con 0x7f223c0c69b0 2022-07-05T11:45:58.204 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.191+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c1760e0 con 0x7f223c0c69b0 2022-07-05T11:45:58.205 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.192+0000 7f2229ffb700 1 -- 172.21.15.90:0/1437157157 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f222c010070 con 0x7f223c0c69b0 2022-07-05T11:45:58.206 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.193+0000 7f2229ffb700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f221c08ba40 0x7f221c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.206 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.193+0000 7f2229ffb700 1 -- 172.21.15.90:0/1437157157 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6756+0+0 (secure 0 0 0) 0x7f222c0af7b0 con 0x7f223c0c69b0 2022-07-05T11:45:58.206 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.193+0000 7f2241a8d700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f221c08ba40 0x7f221c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.206 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.193+0000 7f2241a8d700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f221c08ba40 0x7f221c08df00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2234009fd0 tx=0x7f2234009880).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:58.206 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.197+0000 7f2229ffb700 1 -- 172.21.15.90:0/1437157157 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f222c080cc0 con 0x7f223c0c69b0 2022-07-05T11:45:58.360 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.358+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f223c064ef0 con 0x7f223c0c69b0 2022-07-05T11:45:58.361 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.359+0000 7f2229ffb700 1 -- 172.21.15.90:0/1437157157 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16907 (secure 0 0 0) 0x7f222c0842e0 con 0x7f223c0c69b0 2022-07-05T11:45:58.363 INFO:teuthology.misc.health.smithi090.stdout: 2022-07-05T11:45:58.363 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":19,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:45:58.153821+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:45:58.366 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f221c08ba40 msgr2=0x7f221c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.366 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f221c08ba40 0x7f221c08df00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2234009fd0 tx=0x7f2234009880).stop 2022-07-05T11:45:58.367 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c0c69b0 msgr2=0x7f223c0cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.367 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c0c69b0 0x7f223c0cc210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f222c00c4c0 tx=0x7f222c007e00).stop 2022-07-05T11:45:58.368 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 shutdown_connections 2022-07-05T11:45:58.368 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f221c08ba40 0x7f221c08df00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.369 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c174ea0 0x7f223c176290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.369 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f223c0c4ca0 0x7f223c16cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.370 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 --2- 172.21.15.90:0/1437157157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f223c0c69b0 0x7f223c0cc210 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.370 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 >> 172.21.15.90:0/1437157157 conn(0x7f223c0f4b30 msgr2=0x7f223c0c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:58.370 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 shutdown_connections 2022-07-05T11:45:58.371 INFO:teuthology.misc.health.smithi090.stderr:2022-07-05T11:45:58.361+0000 7f2243cf1700 1 -- 172.21.15.90:0/1437157157 wait complete. 2022-07-05T11:45:58.375 DEBUG:teuthology.misc:12 of 12 OSDs are up 2022-07-05T11:45:58.375 INFO:tasks.ceph:Creating RBD pool 2022-07-05T11:45:58.376 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd pool create rbd 8 2022-07-05T11:45:58.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.486+0000 7f72557a0700 1 Processor -- start 2022-07-05T11:45:58.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.486+0000 7f72557a0700 1 -- start start 2022-07-05T11:45:58.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.487+0000 7f72557a0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7250175100 0x7f7250181120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.487+0000 7f72557a0700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7250181610 0x7f7250061f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.487+0000 7f72557a0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7250180c90 con 0x7f7250062400 2022-07-05T11:45:58.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.487+0000 7f72557a0700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500c9d80 con 0x7f7250175100 2022-07-05T11:45:58.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.487+0000 7f72557a0700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7250181ac0 con 0x7f7250181610 2022-07-05T11:45:58.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7250175100 0x7f7250181120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7250175100 0x7f7250181120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56052/0 (socket says 172.21.15.90:56052) 2022-07-05T11:45:58.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 -- 172.21.15.90:0/128952565 learned_addr learned my addr 172.21.15.90:0/128952565 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:58.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724e7fc700 1 --2- 172.21.15.90:0/128952565 >> v2:172.21.15.110:3300/0 conn(0x7f7250181610 0x7f7250061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 -- 172.21.15.90:0/128952565 >> v2:172.21.15.110:3300/0 conn(0x7f7250181610 msgr2=0x7f7250061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:58.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 --2- 172.21.15.90:0/128952565 >> v2:172.21.15.110:3300/0 conn(0x7f7250181610 0x7f7250061f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 -- 172.21.15.90:0/128952565 >> v1:172.21.15.149:6789/0 conn(0x7f7250062400 legacy=0x7f7250062830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 -- 172.21.15.90:0/128952565 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725017fda0 con 0x7f7250175100 2022-07-05T11:45:58.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724effd700 1 --2- 172.21.15.90:0/128952565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250175100 0x7f7250181120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7250066f00 tx=0x7f7240009840).ready entity=mon.0 client_cookie=5e38fefd66f6d506 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:58.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724dffb700 1 -- 172.21.15.90:0/128952565 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000e070 con 0x7f7250175100 2022-07-05T11:45:58.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724dffb700 1 -- 172.21.15.90:0/128952565 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000ba50 con 0x7f7250175100 2022-07-05T11:45:58.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.488+0000 7f724dffb700 1 -- 172.21.15.90:0/128952565 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000bdd0 con 0x7f7250175100 2022-07-05T11:45:58.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 -- 172.21.15.90:0/128952565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250175100 msgr2=0x7f7250181120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 --2- 172.21.15.90:0/128952565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250175100 0x7f7250181120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7250066f00 tx=0x7f7240009840).stop 2022-07-05T11:45:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 -- 172.21.15.90:0/128952565 shutdown_connections 2022-07-05T11:45:58.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 --2- 172.21.15.90:0/128952565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250175100 0x7f7250181120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 --2- 172.21.15.90:0/128952565 >> v2:172.21.15.110:3300/0 conn(0x7f7250181610 0x7f7250061f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 -- 172.21.15.90:0/128952565 >> 172.21.15.90:0/128952565 conn(0x7f725005d9a0 msgr2=0x7f725005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:58.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 -- 172.21.15.90:0/128952565 shutdown_connections 2022-07-05T11:45:58.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.489+0000 7f72557a0700 1 -- 172.21.15.90:0/128952565 wait complete. 2022-07-05T11:45:58.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.490+0000 7f72557a0700 1 Processor -- start 2022-07-05T11:45:58.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.490+0000 7f72557a0700 1 -- start start 2022-07-05T11:45:58.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f72557a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7250062400 0x7f725016c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f72557a0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7250175100 0x7f72500eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f72557a0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250181610 0x7f7250190160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f72557a0700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725016c630 con 0x7f7250181610 2022-07-05T11:45:58.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f72557a0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500eaee0 con 0x7f7250175100 2022-07-05T11:45:58.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f72557a0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500eb860 con 0x7f7250062400 2022-07-05T11:45:58.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f724f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250181610 0x7f7250190160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f724f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250181610 0x7f7250190160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56062/0 (socket says 172.21.15.90:56062) 2022-07-05T11:45:58.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f724f7fe700 1 -- 172.21.15.90:0/3188134496 learned_addr learned my addr 172.21.15.90:0/3188134496 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:58.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.491+0000 7f724effd700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7250062400 0x7f725016c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724e7fc700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7250175100 0x7f72500eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724f7fe700 1 -- 172.21.15.90:0/3188134496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7250062400 msgr2=0x7f725016c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724f7fe700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7250062400 0x7f725016c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724f7fe700 1 -- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7250175100 msgr2=0x7f72500eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:58.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724f7fe700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7250175100 0x7f72500eb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:58.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724f7fe700 1 -- 172.21.15.90:0/3188134496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009ae0 con 0x7f7250181610 2022-07-05T11:45:58.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724e7fc700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7250175100 0x7f72500eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:45:58.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f724f7fe700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250181610 0x7f7250190160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f724800c440 tx=0x7f7248007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:58.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f7236ffd700 1 -- 172.21.15.90:0/3188134496 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800ce40 con 0x7f7250181610 2022-07-05T11:45:58.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f7236ffd700 1 -- 172.21.15.90:0/3188134496 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800f470 con 0x7f7250181610 2022-07-05T11:45:58.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7250190650 con 0x7f7250181610 2022-07-05T11:45:58.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f7236ffd700 1 -- 172.21.15.90:0/3188134496 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800f7f0 con 0x7f7250181610 2022-07-05T11:45:58.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.492+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72500ea2d0 con 0x7f7250181610 2022-07-05T11:45:58.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.493+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500eb050 con 0x7f7250181610 2022-07-05T11:45:58.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.494+0000 7f7236ffd700 1 -- 172.21.15.90:0/3188134496 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7248010070 con 0x7f7250181610 2022-07-05T11:45:58.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.494+0000 7f7236ffd700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f723008ba40 0x7f723008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:58.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.494+0000 7f7236ffd700 1 -- 172.21.15.90:0/3188134496 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6756+0+0 (secure 0 0 0) 0x7f72480af440 con 0x7f7250181610 2022-07-05T11:45:58.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.494+0000 7f724effd700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f723008ba40 0x7f723008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:58.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.495+0000 7f724effd700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f723008ba40 0x7f723008df00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f72500c7df0 tx=0x7f7240009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:58.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.498+0000 7f7236ffd700 1 -- 172.21.15.90:0/3188134496 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f7248080950 con 0x7f7250181610 2022-07-05T11:45:58.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:58.658+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7250180080 con 0x7f7250181610 2022-07-05T11:45:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.167+0000 7f7236ffd700 1 -- 172.21.15.90:0/3188134496 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7248083f70 con 0x7f7250181610 2022-07-05T11:45:59.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f723008ba40 msgr2=0x7f723008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:59.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f723008ba40 0x7f723008df00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f72500c7df0 tx=0x7f7240009840).stop 2022-07-05T11:45:59.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250181610 msgr2=0x7f7250190160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:59.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250181610 0x7f7250190160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f724800c440 tx=0x7f7248007dd0).stop 2022-07-05T11:45:59.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 shutdown_connections 2022-07-05T11:45:59.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f723008ba40 0x7f723008df00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7250181610 0x7f7250190160 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7250062400 0x7f725016c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 --2- 172.21.15.90:0/3188134496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7250175100 0x7f72500eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 >> 172.21.15.90:0/3188134496 conn(0x7f725005d9a0 msgr2=0x7f7250084a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:59.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.169+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 shutdown_connections 2022-07-05T11:45:59.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.170+0000 7f72557a0700 1 -- 172.21.15.90:0/3188134496 wait complete. 2022-07-05T11:45:59.178 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'rbd' created 2022-07-05T11:45:59.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-07-05T11:45:59.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.299+0000 7f993da38700 1 Processor -- start 2022-07-05T11:45:59.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.299+0000 7f993da38700 1 -- start start 2022-07-05T11:45:59.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f993da38700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f993817b710 0x7f993817baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:59.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f993da38700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99380c8400 0x7f99380c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:59.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f993da38700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380c3320 con 0x7f99380c3cf0 2022-07-05T11:45:59.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f993da38700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380c8c10 con 0x7f993817b710 2022-07-05T11:45:59.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f993da38700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380c8ef0 con 0x7f99380c8400 2022-07-05T11:45:59.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f9936ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f993817b710 0x7f993817baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:59.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f99377fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f99380c3cf0 0x7f99380c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49010/0 (socket says 172.21.15.90:49010) 2022-07-05T11:45:59.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f9936ffd700 1 --2- 172.21.15.90:0/1796182457 >> v2:172.21.15.90:3300/0 conn(0x7f993817b710 0x7f993817baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56066/0 (socket says 172.21.15.90:56066) 2022-07-05T11:45:59.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f99377fe700 1 -- 172.21.15.90:0/1796182457 learned_addr learned my addr 172.21.15.90:0/1796182457 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:45:59.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f992e7fc700 1 --2- 172.21.15.90:0/1796182457 >> v2:172.21.15.110:3300/0 conn(0x7f99380c8400 0x7f99380c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:59.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f9936ffd700 1 -- 172.21.15.90:0/1796182457 >> v2:172.21.15.110:3300/0 conn(0x7f99380c8400 msgr2=0x7f99380c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:45:59.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f9936ffd700 1 --2- 172.21.15.90:0/1796182457 >> v2:172.21.15.110:3300/0 conn(0x7f99380c8400 0x7f99380c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f9936ffd700 1 -- 172.21.15.90:0/1796182457 >> v1:172.21.15.90:6789/0 conn(0x7f99380c3cf0 legacy=0x7f99380c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:59.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f99367fc700 1 -- 172.21.15.90:0/1796182457 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222421618 0 0) 0x7f99380c3320 con 0x7f99380c3cf0 2022-07-05T11:45:59.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f9936ffd700 1 -- 172.21.15.90:0/1796182457 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380c91d0 con 0x7f993817b710 2022-07-05T11:45:59.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f992e7fc700 1 --2- 172.21.15.90:0/1796182457 >> v2:172.21.15.110:3300/0 conn(0x7f99380c8400 0x7f99380c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:45:59.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f9936ffd700 1 --2- 172.21.15.90:0/1796182457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f993817baf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9938084dc0 tx=0x7f9928009060).ready entity=mon.0 client_cookie=bc88557bc329f86c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:59.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f99367fc700 1 -- 172.21.15.90:0/1796182457 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992800b580 con 0x7f993817b710 2022-07-05T11:45:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f99367fc700 1 -- 172.21.15.90:0/1796182457 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992800b6e0 con 0x7f993817b710 2022-07-05T11:45:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.300+0000 7f99367fc700 1 -- 172.21.15.90:0/1796182457 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992800ba60 con 0x7f993817b710 2022-07-05T11:45:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 -- 172.21.15.90:0/1796182457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 msgr2=0x7f993817baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 --2- 172.21.15.90:0/1796182457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f993817baf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9938084dc0 tx=0x7f9928009060).stop 2022-07-05T11:45:59.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 -- 172.21.15.90:0/1796182457 shutdown_connections 2022-07-05T11:45:59.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 --2- 172.21.15.90:0/1796182457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f993817baf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 --2- 172.21.15.90:0/1796182457 >> v2:172.21.15.110:3300/0 conn(0x7f99380c8400 0x7f99380c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 -- 172.21.15.90:0/1796182457 >> 172.21.15.90:0/1796182457 conn(0x7f99380ed910 msgr2=0x7f99380edd20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:45:59.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 -- 172.21.15.90:0/1796182457 shutdown_connections 2022-07-05T11:45:59.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.301+0000 7f993da38700 1 -- 172.21.15.90:0/1796182457 wait complete. 2022-07-05T11:45:59.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.302+0000 7f993da38700 1 Processor -- start 2022-07-05T11:45:59.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.303+0000 7f993da38700 1 -- start start 2022-07-05T11:45:59.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.303+0000 7f993da38700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380c3cf0 0x7f99381923b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:59.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.303+0000 7f993da38700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99380c8400 0x7f993816ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:59.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.303+0000 7f993da38700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f9938179960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:59.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.303+0000 7f993da38700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380e8280 con 0x7f993817b710 2022-07-05T11:45:59.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.303+0000 7f993da38700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99381928a0 con 0x7f99380c3cf0 2022-07-05T11:45:59.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.303+0000 7f993da38700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993816f180 con 0x7f99380c8400 2022-07-05T11:45:59.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f9938179960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:59.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f9938179960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56076/0 (socket says 172.21.15.90:56076) 2022-07-05T11:45:59.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 -- 172.21.15.90:0/4028111209 learned_addr learned my addr 172.21.15.90:0/4028111209 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:45:59.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f9936ffd700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380c3cf0 0x7f99381923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:59.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f992e7fc700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99380c8400 0x7f993816ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:59.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 -- 172.21.15.90:0/4028111209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99380c8400 msgr2=0x7f993816ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:59.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99380c8400 0x7f993816ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 -- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380c3cf0 msgr2=0x7f99381923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:45:59.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380c3cf0 0x7f99381923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:45:59.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 -- 172.21.15.90:0/4028111209 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280092a0 con 0x7f993817b710 2022-07-05T11:45:59.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f99377fe700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f9938179960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f993000c790 tx=0x7f9930007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:59.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f992f7fe700 1 -- 172.21.15.90:0/4028111209 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930005d30 con 0x7f993817b710 2022-07-05T11:45:59.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f992f7fe700 1 -- 172.21.15.90:0/4028111209 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930007110 con 0x7f993817b710 2022-07-05T11:45:59.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99380e9d90 con 0x7f993817b710 2022-07-05T11:45:59.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f992f7fe700 1 -- 172.21.15.90:0/4028111209 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99300074d0 con 0x7f993817b710 2022-07-05T11:45:59.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.304+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9938178e80 con 0x7f993817b710 2022-07-05T11:45:59.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.305+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9938046db0 con 0x7f993817b710 2022-07-05T11:45:59.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.306+0000 7f992f7fe700 1 -- 172.21.15.90:0/4028111209 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f9930010030 con 0x7f993817b710 2022-07-05T11:45:59.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.306+0000 7f992f7fe700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f991c08ba40 0x7f991c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:45:59.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.306+0000 7f992f7fe700 1 -- 172.21.15.90:0/4028111209 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 7098+0+0 (secure 0 0 0) 0x7f99300b0160 con 0x7f993817b710 2022-07-05T11:45:59.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.307+0000 7f9936ffd700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f991c08ba40 0x7f991c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:45:59.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.307+0000 7f9936ffd700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f991c08ba40 0x7f991c08df00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f992800b340 tx=0x7f9928017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:45:59.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.310+0000 7f992f7fe700 1 -- 172.21.15.90:0/4028111209 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f9930081410 con 0x7f993817b710 2022-07-05T11:45:59.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:45:59.473+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f99380c94b0 con 0x7f993817b710 2022-07-05T11:46:00.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.169+0000 7f992f7fe700 1 -- 172.21.15.90:0/4028111209 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9930084a30 con 0x7f993817b710 2022-07-05T11:46:00.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.171+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f991c08ba40 msgr2=0x7f991c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.171+0000 7f993da38700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f991c08ba40 0x7f991c08df00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f992800b340 tx=0x7f9928017000).stop 2022-07-05T11:46:00.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.171+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 msgr2=0x7f9938179960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.171+0000 7f993da38700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f9938179960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f993000c790 tx=0x7f9930007f30).stop 2022-07-05T11:46:00.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 shutdown_connections 2022-07-05T11:46:00.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f991c08ba40 0x7f991c08df00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f993817b710 0x7f9938179960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99380c3cf0 0x7f99381923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 --2- 172.21.15.90:0/4028111209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99380c8400 0x7f993816ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 >> 172.21.15.90:0/4028111209 conn(0x7f99380ed910 msgr2=0x7f99380edcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:00.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 shutdown_connections 2022-07-05T11:46:00.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.172+0000 7f993da38700 1 -- 172.21.15.90:0/4028111209 wait complete. 2022-07-05T11:46:00.177 INFO:teuthology.orchestra.run.smithi090.stderr:enabled application 'rbd' on pool 'rbd' 2022-07-05T11:46:00.188 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-07-05T11:46:00.189 INFO:tasks.ceph.mds.a:Restarting daemon 2022-07-05T11:46:00.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-07-05T11:46:00.194 INFO:tasks.ceph.mds.a:Started 2022-07-05T11:46:00.194 INFO:tasks.ceph.mds.d:Restarting daemon 2022-07-05T11:46:00.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-07-05T11:46:00.197 INFO:tasks.ceph.mds.d:Started 2022-07-05T11:46:00.197 INFO:tasks.ceph.mds.g:Restarting daemon 2022-07-05T11:46:00.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i g 2022-07-05T11:46:00.200 INFO:tasks.ceph.mds.g:Started 2022-07-05T11:46:00.200 INFO:tasks.ceph.mds.j:Restarting daemon 2022-07-05T11:46:00.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i j 2022-07-05T11:46:00.202 INFO:tasks.ceph.mds.j:Started 2022-07-05T11:46:00.203 INFO:tasks.ceph.mds.b:Restarting daemon 2022-07-05T11:46:00.203 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-07-05T11:46:00.206 INFO:tasks.ceph.mds.b:Started 2022-07-05T11:46:00.206 INFO:tasks.ceph.mds.e:Restarting daemon 2022-07-05T11:46:00.207 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2022-07-05T11:46:00.209 INFO:tasks.ceph.mds.e:Started 2022-07-05T11:46:00.209 INFO:tasks.ceph.mds.h:Restarting daemon 2022-07-05T11:46:00.210 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i h 2022-07-05T11:46:00.212 INFO:tasks.ceph.mds.h:Started 2022-07-05T11:46:00.213 INFO:tasks.ceph.mds.k:Restarting daemon 2022-07-05T11:46:00.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i k 2022-07-05T11:46:00.215 INFO:tasks.ceph.mds.k:Started 2022-07-05T11:46:00.216 INFO:tasks.ceph.mds.c:Restarting daemon 2022-07-05T11:46:00.216 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-07-05T11:46:00.219 INFO:tasks.ceph.mds.c:Started 2022-07-05T11:46:00.219 INFO:tasks.ceph.mds.f:Restarting daemon 2022-07-05T11:46:00.220 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2022-07-05T11:46:00.222 INFO:tasks.ceph.mds.f:Started 2022-07-05T11:46:00.223 INFO:tasks.ceph.mds.i:Restarting daemon 2022-07-05T11:46:00.223 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i i 2022-07-05T11:46:00.225 INFO:tasks.ceph.mds.i:Started 2022-07-05T11:46:00.226 INFO:tasks.ceph.mds.l:Restarting daemon 2022-07-05T11:46:00.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i l 2022-07-05T11:46:00.229 INFO:tasks.ceph.mds.l:Started 2022-07-05T11:46:00.229 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-07-05T11:46:00.230 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:00.275 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2022-07-05T11:46:00.281 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2022-07-05T11:46:00.283 INFO:tasks.ceph.mds.g.smithi090.stdout:starting mds.g at 2022-07-05T11:46:00.284 INFO:tasks.ceph.mds.j.smithi090.stdout:starting mds.j at 2022-07-05T11:46:00.292 INFO:tasks.ceph.mds.e.smithi110.stdout:starting mds.e at 2022-07-05T11:46:00.292 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2022-07-05T11:46:00.298 INFO:tasks.ceph.mds.h.smithi110.stdout:starting mds.h at 2022-07-05T11:46:00.301 INFO:tasks.ceph.mds.k.smithi110.stdout:starting mds.k at 2022-07-05T11:46:00.305 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2022-07-05T11:46:00.308 INFO:tasks.ceph.mds.i.smithi149.stdout:starting mds.i at 2022-07-05T11:46:00.310 INFO:tasks.ceph.mds.f.smithi149.stdout:starting mds.f at 2022-07-05T11:46:00.314 INFO:tasks.ceph.mds.l.smithi149.stdout:starting mds.l at 2022-07-05T11:46:00.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.367+0000 7f117adc6700 1 Processor -- start 2022-07-05T11:46:00.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.367+0000 7f117adc6700 1 -- start start 2022-07-05T11:46:00.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.368+0000 7f117adc6700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1174084580 con 0x7f117417ba70 2022-07-05T11:46:00.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.368+0000 7f117adc6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740c7920 con 0x7f117417ef80 2022-07-05T11:46:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.368+0000 7f117adc6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117417f400 con 0x7f117417a680 2022-07-05T11:46:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.368+0000 7f117a5c5700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f117417ba70 0x7f11740c84c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49074/0 (socket says 172.21.15.90:49074) 2022-07-05T11:46:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.368+0000 7f117a5c5700 1 -- 172.21.15.90:0/3977542541 learned_addr learned my addr 172.21.15.90:0/3977542541 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69892202 0 0) 0x7f116c001110 con 0x7f117417ba70 2022-07-05T11:46:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11600033f0 con 0x7f117417ba70 2022-07-05T11:46:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798471839 0 0) 0x7f11740c7920 con 0x7f117417ef80 2022-07-05T11:46:00.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f116c001110 con 0x7f117417ef80 2022-07-05T11:46:00.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3932989816 0 0) 0x7f11600033f0 con 0x7f117417ba70 2022-07-05T11:46:00.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 >> v1:172.21.15.149:6789/0 conn(0x7f117417a680 legacy=0x7f117417e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 >> v1:172.21.15.110:6789/0 conn(0x7f117417ef80 legacy=0x7f11740c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740c31b0 con 0x7f117417ba70 2022-07-05T11:46:00.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f116c001600 con 0x7f117417ba70 2022-07-05T11:46:00.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 >> v1:172.21.15.90:6789/0 conn(0x7f117417ba70 legacy=0x7f11740c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1160004b30 0x7f1160004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160003630 0x7f1160003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11600041a0 0x7f116000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1168001230 con 0x7f1160004b30 2022-07-05T11:46:00.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116000c130 con 0x7f11600041a0 2022-07-05T11:46:00.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116000c2f0 con 0x7f1160003630 2022-07-05T11:46:00.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1179dc4700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1160004b30 0x7f1160004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f117a5c5700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11600041a0 0x7f116000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f11795c3700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160003630 0x7f1160003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1179dc4700 1 -- 172.21.15.90:0/3977542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160003630 msgr2=0x7f1160003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1179dc4700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160003630 0x7f1160003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1179dc4700 1 -- 172.21.15.90:0/3977542541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11600041a0 msgr2=0x7f116000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1179dc4700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11600041a0 0x7f116000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f117a5c5700 1 -- 172.21.15.90:0/3977542541 reap_dead start 2022-07-05T11:46:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1179dc4700 1 -- 172.21.15.90:0/3977542541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600033f0 con 0x7f1160004b30 2022-07-05T11:46:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.369+0000 7f1179dc4700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1160004b30 0x7f1160004f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1164001f20 tx=0x7f1164007f10).ready entity=mon.0 client_cookie=84b446169bfc19ab server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11640017e0 con 0x7f1160004b30 2022-07-05T11:46:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400c6d0 con 0x7f1160004b30 2022-07-05T11:46:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f1178dc2700 1 -- 172.21.15.90:0/3977542541 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400ca70 con 0x7f1160004b30 2022-07-05T11:46:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f117adc6700 1 -- 172.21.15.90:0/3977542541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1160004b30 msgr2=0x7f1160004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f117adc6700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1160004b30 0x7f1160004f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1164001f20 tx=0x7f1164007f10).stop 2022-07-05T11:46:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f117adc6700 1 -- 172.21.15.90:0/3977542541 shutdown_connections 2022-07-05T11:46:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f117adc6700 1 --2- 172.21.15.90:0/3977542541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1160004b30 0x7f1160004f10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f117adc6700 1 -- 172.21.15.90:0/3977542541 >> 172.21.15.90:0/3977542541 conn(0x7f11740ee1a0 msgr2=0x7f11740ee5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f117adc6700 1 -- 172.21.15.90:0/3977542541 shutdown_connections 2022-07-05T11:46:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.370+0000 7f117adc6700 1 -- 172.21.15.90:0/3977542541 wait complete. 2022-07-05T11:46:00.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.372+0000 7f117adc6700 1 Processor -- start 2022-07-05T11:46:00.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.372+0000 7f117adc6700 1 -- start start 2022-07-05T11:46:00.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160004b30 0x7f11740674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174191a30 0x7f1174069130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1174069620 0x7f1174173bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174192890 con 0x7f1174069620 2022-07-05T11:46:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741922d0 con 0x7f1174191a30 2022-07-05T11:46:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741925b0 con 0x7f1160004b30 2022-07-05T11:46:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f1179dc4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160004b30 0x7f11740674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1174069620 0x7f1174173bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f1179dc4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160004b30 0x7f11740674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37538/0 (socket says 172.21.15.90:37538) 2022-07-05T11:46:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1174069620 0x7f1174173bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56146/0 (socket says 172.21.15.90:56146) 2022-07-05T11:46:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f1179dc4700 1 -- 172.21.15.90:0/2034781367 learned_addr learned my addr 172.21.15.90:0/2034781367 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f11795c3700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174191a30 0x7f1174069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 -- 172.21.15.90:0/2034781367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160004b30 msgr2=0x7f11740674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160004b30 0x7f11740674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 -- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174191a30 msgr2=0x7f1174069130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174191a30 0x7f1174069130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 -- 172.21.15.90:0/2034781367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1174066a00 con 0x7f1174069620 2022-07-05T11:46:00.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f1179dc4700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160004b30 0x7f11740674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:00.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117a5c5700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1174069620 0x7f1174173bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f11740ebf50 tx=0x7f116c007850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:00.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f1171ffb700 1 -- 172.21.15.90:0/2034781367 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c007e10 con 0x7f1174069620 2022-07-05T11:46:00.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f1171ffb700 1 -- 172.21.15.90:0/2034781367 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0114c0 con 0x7f1174069620 2022-07-05T11:46:00.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1174066ce0 con 0x7f1174069620 2022-07-05T11:46:00.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f1171ffb700 1 -- 172.21.15.90:0/2034781367 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c011840 con 0x7f1174069620 2022-07-05T11:46:00.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.373+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174191eb0 con 0x7f1174069620 2022-07-05T11:46:00.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.374+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11741920a0 con 0x7f1174069620 2022-07-05T11:46:00.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.375+0000 7f1171ffb700 1 -- 172.21.15.90:0/2034781367 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f116c011c70 con 0x7f1174069620 2022-07-05T11:46:00.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.376+0000 7f1171ffb700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.376+0000 7f1171ffb700 1 -- 172.21.15.90:0/2034781367 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f116c0afd90 con 0x7f1174069620 2022-07-05T11:46:00.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.376+0000 7f1179dc4700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.376+0000 7f1179dc4700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1164007e20 tx=0x7f1164017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:00.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.379+0000 7f1171ffb700 1 -- 172.21.15.90:0/2034781367 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f116c081140 con 0x7f1174069620 2022-07-05T11:46:00.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.541+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1174084580 con 0x7f1174069620 2022-07-05T11:46:00.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.542+0000 7f1171ffb700 1 -- 172.21.15.90:0/2034781367 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f1174084580 con 0x7f1174069620 2022-07-05T11:46:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:00.545 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:00.166556+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:00.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 msgr2=0x7f115408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1164007e20 tx=0x7f1164017000).stop 2022-07-05T11:46:00.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1174069620 msgr2=0x7f1174173bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1174069620 0x7f1174173bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f11740ebf50 tx=0x7f116c007850).stop 2022-07-05T11:46:00.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 shutdown_connections 2022-07-05T11:46:00.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1174069620 0x7f1174173bb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1160004b30 0x7f11740674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 --2- 172.21.15.90:0/2034781367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174191a30 0x7f1174069130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 >> 172.21.15.90:0/2034781367 conn(0x7f11740ee1a0 msgr2=0x7f1174063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:00.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 shutdown_connections 2022-07-05T11:46:00.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.544+0000 7f117adc6700 1 -- 172.21.15.90:0/2034781367 wait complete. 2022-07-05T11:46:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-07-05T11:46:00.560 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:00.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.711+0000 7fcc86170700 1 Processor -- start 2022-07-05T11:46:00.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.711+0000 7fcc86170700 1 -- start start 2022-07-05T11:46:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc86170700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc8017da80 0x7fcc8017df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc86170700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800ec2a0 con 0x7fcc800eca10 2022-07-05T11:46:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc86170700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800ec580 con 0x7fcc801731c0 2022-07-05T11:46:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc86170700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8017eca0 con 0x7fcc8017da80 2022-07-05T11:46:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc7effd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fcc800eca10 0x7fcc800ece70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49092/0 (socket says 172.21.15.90:49092) 2022-07-05T11:46:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc7effd700 1 -- 172.21.15.90:0/697410680 learned_addr learned my addr 172.21.15.90:0/697410680 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305114158 0 0) 0x7fcc800ec2a0 con 0x7fcc800eca10 2022-07-05T11:46:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.712+0000 7fcc7ffff700 1 --2- 172.21.15.90:0/697410680 >> v2:172.21.15.110:3300/0 conn(0x7fcc8017da80 0x7fcc8017df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c0033f0 con 0x7fcc800eca10 2022-07-05T11:46:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790193444 0 0) 0x7fcc6c0033f0 con 0x7fcc800eca10 2022-07-05T11:46:00.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 >> v2:172.21.15.110:3300/0 conn(0x7fcc8017da80 msgr2=0x7fcc8017df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:00.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 --2- 172.21.15.90:0/697410680 >> v2:172.21.15.110:3300/0 conn(0x7fcc8017da80 0x7fcc8017df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 >> v1:172.21.15.149:6789/0 conn(0x7fcc801731c0 legacy=0x7fcc8017cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8017ef80 con 0x7fcc800eca10 2022-07-05T11:46:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fcc74001470 con 0x7fcc800eca10 2022-07-05T11:46:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 >> v1:172.21.15.90:6789/0 conn(0x7fcc800eca10 legacy=0x7fcc800ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c0038e0 0x7fcc6c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c004690 0x7fcc6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c005000 0x7fcc6c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8017eca0 con 0x7fcc6c0038e0 2022-07-05T11:46:00.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c00be50 con 0x7fcc6c004690 2022-07-05T11:46:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c00c010 con 0x7fcc6c005000 2022-07-05T11:46:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c0038e0 0x7fcc6c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7effd700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c004690 0x7fcc6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7ffff700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c005000 0x7fcc6c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7f7fe700 1 -- 172.21.15.90:0/697410680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c005000 msgr2=0x7fcc6c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc6c005000 0x7fcc6c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7f7fe700 1 -- 172.21.15.90:0/697410680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c004690 msgr2=0x7fcc6c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c004690 0x7fcc6c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7ffff700 1 -- 172.21.15.90:0/697410680 reap_dead start 2022-07-05T11:46:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7f7fe700 1 -- 172.21.15.90:0/697410680 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c0033f0 con 0x7fcc6c0038e0 2022-07-05T11:46:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c0038e0 0x7fcc6c003cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fcc70001820 tx=0x7fcc70007b90).ready entity=mon.0 client_cookie=e306cf339c02fa65 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70007ea0 con 0x7fcc6c0038e0 2022-07-05T11:46:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70012400 con 0x7fcc6c0038e0 2022-07-05T11:46:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.713+0000 7fcc7e7fc700 1 -- 172.21.15.90:0/697410680 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc700127a0 con 0x7fcc6c0038e0 2022-07-05T11:46:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.714+0000 7fcc86170700 1 -- 172.21.15.90:0/697410680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c0038e0 msgr2=0x7fcc6c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.714+0000 7fcc86170700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c0038e0 0x7fcc6c003cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fcc70001820 tx=0x7fcc70007b90).stop 2022-07-05T11:46:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.714+0000 7fcc86170700 1 -- 172.21.15.90:0/697410680 shutdown_connections 2022-07-05T11:46:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.714+0000 7fcc86170700 1 --2- 172.21.15.90:0/697410680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c0038e0 0x7fcc6c003cc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.714+0000 7fcc86170700 1 -- 172.21.15.90:0/697410680 >> 172.21.15.90:0/697410680 conn(0x7fcc8005d9a0 msgr2=0x7fcc8005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.714+0000 7fcc86170700 1 -- 172.21.15.90:0/697410680 shutdown_connections 2022-07-05T11:46:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.714+0000 7fcc86170700 1 -- 172.21.15.90:0/697410680 wait complete. 2022-07-05T11:46:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.715+0000 7fcc86170700 1 Processor -- start 2022-07-05T11:46:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.715+0000 7fcc86170700 1 -- start start 2022-07-05T11:46:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.716+0000 7fcc86170700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c0038e0 0x7fcc8018f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.716+0000 7fcc86170700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc8018fde0 0x7fcc8018d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.716+0000 7fcc86170700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc8018a990 0x7fcc8018d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.716+0000 7fcc86170700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8018f460 con 0x7fcc8018a990 2022-07-05T11:46:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.716+0000 7fcc86170700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8018e570 con 0x7fcc6c0038e0 2022-07-05T11:46:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.716+0000 7fcc86170700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8018e850 con 0x7fcc8018fde0 2022-07-05T11:46:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc8018a990 0x7fcc8018d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc8018a990 0x7fcc8018d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56164/0 (socket says 172.21.15.90:56164) 2022-07-05T11:46:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 -- 172.21.15.90:0/2705416873 learned_addr learned my addr 172.21.15.90:0/2705416873 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c0038e0 0x7fcc8018f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7effd700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc8018fde0 0x7fcc8018d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 -- 172.21.15.90:0/2705416873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc8018fde0 msgr2=0x7fcc8018d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc8018fde0 0x7fcc8018d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 -- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c0038e0 msgr2=0x7fcc8018f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c0038e0 0x7fcc8018f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 -- 172.21.15.90:0/2705416873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8018eb30 con 0x7fcc8018a990 2022-07-05T11:46:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7effd700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc8018fde0 0x7fcc8018d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c0038e0 0x7fcc8018f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc7ffff700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc8018a990 0x7fcc8018d5f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcc800e8950 tx=0x7fcc7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc677fe700 1 -- 172.21.15.90:0/2705416873 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800e040 con 0x7fcc8018a990 2022-07-05T11:46:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc677fe700 1 -- 172.21.15.90:0/2705416873 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800f040 con 0x7fcc8018a990 2022-07-05T11:46:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8018ee10 con 0x7fcc8018a990 2022-07-05T11:46:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc677fe700 1 -- 172.21.15.90:0/2705416873 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800fe20 con 0x7fcc8018a990 2022-07-05T11:46:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.717+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8018e1f0 con 0x7fcc8018a990 2022-07-05T11:46:00.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.718+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8006be40 con 0x7fcc8018a990 2022-07-05T11:46:00.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.719+0000 7fcc677fe700 1 -- 172.21.15.90:0/2705416873 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fcc78015660 con 0x7fcc8018a990 2022-07-05T11:46:00.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.719+0000 7fcc677fe700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcc6008ba40 0x7fcc6008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:00.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.719+0000 7fcc677fe700 1 -- 172.21.15.90:0/2705416873 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fcc780b0e30 con 0x7fcc8018a990 2022-07-05T11:46:00.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.719+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcc6008ba40 0x7fcc6008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:00.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.720+0000 7fcc7f7fe700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcc6008ba40 0x7fcc6008df00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcc70000ff0 tx=0x7fcc70016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.723+0000 7fcc677fe700 1 -- 172.21.15.90:0/2705416873 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fcc780821e0 con 0x7fcc8018a990 2022-07-05T11:46:00.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.883+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcc8017f260 con 0x7fcc8018a990 2022-07-05T11:46:00.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.883+0000 7fcc677fe700 1 -- 172.21.15.90:0/2705416873 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcc78085800 con 0x7fcc8018a990 2022-07-05T11:46:00.886 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcc6008ba40 msgr2=0x7fcc6008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcc6008ba40 0x7fcc6008df00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcc70000ff0 tx=0x7fcc70016000).stop 2022-07-05T11:46:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc8018a990 msgr2=0x7fcc8018d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc8018a990 0x7fcc8018d5f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcc800e8950 tx=0x7fcc7800b040).stop 2022-07-05T11:46:00.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 shutdown_connections 2022-07-05T11:46:00.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcc6008ba40 0x7fcc6008df00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc8018a990 0x7fcc8018d5f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc6c0038e0 0x7fcc8018f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 --2- 172.21.15.90:0/2705416873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc8018fde0 0x7fcc8018d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 >> 172.21.15.90:0/2705416873 conn(0x7fcc8005d9a0 msgr2=0x7fcc8017de90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 shutdown_connections 2022-07-05T11:46:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:00.885+0000 7fcc86170700 1 -- 172.21.15.90:0/2705416873 wait complete. 2022-07-05T11:46:00.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.010+0000 7f6dea0c1700 1 Processor -- start 2022-07-05T11:46:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.010+0000 7f6dea0c1700 1 -- start start 2022-07-05T11:46:01.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6dea0c1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6de4182a30 0x7f6de40eed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6dea0c1700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40ee170 con 0x7f6de417bda0 2022-07-05T11:46:01.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6dea0c1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de417c3f0 con 0x7f6de417e750 2022-07-05T11:46:01.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6dea0c1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de40ed280 con 0x7f6de4182a30 2022-07-05T11:46:01.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6de37fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6de417bda0 0x7f6de40ee600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49110/0 (socket says 172.21.15.90:49110) 2022-07-05T11:46:01.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6de37fe700 1 -- 172.21.15.90:0/1598886605 learned_addr learned my addr 172.21.15.90:0/1598886605 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:01.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6de2ffd700 1 --2- 172.21.15.90:0/1598886605 >> v2:172.21.15.149:3300/0 conn(0x7f6de4182a30 0x7f6de40eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050015549 0 0) 0x7f6de40ee170 con 0x7f6de417bda0 2022-07-05T11:46:01.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.011+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd00033f0 con 0x7f6de417bda0 2022-07-05T11:46:01.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490618352 0 0) 0x7f6dd00033f0 con 0x7f6de417bda0 2022-07-05T11:46:01.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 >> v2:172.21.15.149:3300/0 conn(0x7f6de4182a30 msgr2=0x7f6de40eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 --2- 172.21.15.90:0/1598886605 >> v2:172.21.15.149:3300/0 conn(0x7f6de4182a30 0x7f6de40eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 >> v1:172.21.15.149:6789/0 conn(0x7f6de417e750 legacy=0x7f6de417ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40ed560 con 0x7f6de417bda0 2022-07-05T11:46:01.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f6dd40017f0 con 0x7f6de417bda0 2022-07-05T11:46:01.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 >> v1:172.21.15.90:6789/0 conn(0x7f6de417bda0 legacy=0x7f6de40ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd0004690 0x7f6dd0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd0005000 0x7f6dd000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40ed280 con 0x7f6dd00038e0 2022-07-05T11:46:01.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd000be50 con 0x7f6dd0004690 2022-07-05T11:46:01.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd000c010 con 0x7f6dd0005000 2022-07-05T11:46:01.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de37fe700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de3fff700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd0005000 0x7f6dd000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de2ffd700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd0004690 0x7f6dd0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de37fe700 1 -- 172.21.15.90:0/1598886605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd0005000 msgr2=0x7f6dd000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de37fe700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd0005000 0x7f6dd000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de37fe700 1 -- 172.21.15.90:0/1598886605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd0004690 msgr2=0x7f6dd0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de37fe700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd0004690 0x7f6dd0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de3fff700 1 -- 172.21.15.90:0/1598886605 reap_dead start 2022-07-05T11:46:01.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de37fe700 1 -- 172.21.15.90:0/1598886605 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00033f0 con 0x7f6dd00038e0 2022-07-05T11:46:01.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de37fe700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6dd400c5f0 tx=0x7f6dd4001d90).ready entity=mon.0 client_cookie=afead1ca033dc407 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400ce80 con 0x7f6dd00038e0 2022-07-05T11:46:01.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd4001fc0 con 0x7f6dd00038e0 2022-07-05T11:46:01.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.012+0000 7f6de27fc700 1 -- 172.21.15.90:0/1598886605 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4005d30 con 0x7f6dd00038e0 2022-07-05T11:46:01.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.013+0000 7f6dea0c1700 1 -- 172.21.15.90:0/1598886605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd00038e0 msgr2=0x7f6dd0003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.013+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6dd400c5f0 tx=0x7f6dd4001d90).stop 2022-07-05T11:46:01.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.013+0000 7f6dea0c1700 1 -- 172.21.15.90:0/1598886605 shutdown_connections 2022-07-05T11:46:01.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.013+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/1598886605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003cc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.013+0000 7f6dea0c1700 1 -- 172.21.15.90:0/1598886605 >> 172.21.15.90:0/1598886605 conn(0x7f6de40f21d0 msgr2=0x7f6de4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:01.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.013+0000 7f6dea0c1700 1 -- 172.21.15.90:0/1598886605 shutdown_connections 2022-07-05T11:46:01.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.013+0000 7f6dea0c1700 1 -- 172.21.15.90:0/1598886605 wait complete. 2022-07-05T11:46:01.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.014+0000 7f6dea0c1700 1 Processor -- start 2022-07-05T11:46:01.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.014+0000 7f6dea0c1700 1 -- start start 2022-07-05T11:46:01.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6dea0c1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd00038e0 0x7f6de4175620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6dea0c1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de4196980 0x7f6de416b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6dea0c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4193fb0 0x7f6de416be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6dea0c1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de4174330 con 0x7f6de4193fb0 2022-07-05T11:46:01.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6dea0c1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de4175190 con 0x7f6de4196980 2022-07-05T11:46:01.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6dea0c1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de4174580 con 0x7f6dd00038e0 2022-07-05T11:46:01.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6de3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4193fb0 0x7f6de416be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6de3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4193fb0 0x7f6de416be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56186/0 (socket says 172.21.15.90:56186) 2022-07-05T11:46:01.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.015+0000 7f6de3fff700 1 -- 172.21.15.90:0/611106872 learned_addr learned my addr 172.21.15.90:0/611106872 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:01.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de2ffd700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de4196980 0x7f6de416b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de37fe700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd00038e0 0x7f6de4175620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de3fff700 1 -- 172.21.15.90:0/611106872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd00038e0 msgr2=0x7f6de4175620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de3fff700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd00038e0 0x7f6de4175620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de3fff700 1 -- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de4196980 msgr2=0x7f6de416b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de3fff700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de4196980 0x7f6de416b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de3fff700 1 -- 172.21.15.90:0/611106872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4174860 con 0x7f6de4193fb0 2022-07-05T11:46:01.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6de3fff700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4193fb0 0x7f6de416be90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6de40ebcb0 tx=0x7f6ddc007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6dcb7fe700 1 -- 172.21.15.90:0/611106872 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc011590 con 0x7f6de4193fb0 2022-07-05T11:46:01.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6dcb7fe700 1 -- 172.21.15.90:0/611106872 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc0116f0 con 0x7f6de4193fb0 2022-07-05T11:46:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de4174b40 con 0x7f6de4193fb0 2022-07-05T11:46:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6dcb7fe700 1 -- 172.21.15.90:0/611106872 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc011a90 con 0x7f6de4193fb0 2022-07-05T11:46:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.016+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de4196e00 con 0x7f6de4193fb0 2022-07-05T11:46:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.017+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de406b1e0 con 0x7f6de4193fb0 2022-07-05T11:46:01.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.018+0000 7f6dcb7fe700 1 -- 172.21.15.90:0/611106872 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6ddc01a030 con 0x7f6de4193fb0 2022-07-05T11:46:01.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.018+0000 7f6dcb7fe700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc408ba40 0x7f6dc408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.018+0000 7f6dcb7fe700 1 -- 172.21.15.90:0/611106872 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f6ddc0afa50 con 0x7f6de4193fb0 2022-07-05T11:46:01.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.018+0000 7f6de37fe700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc408ba40 0x7f6dc408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.019+0000 7f6de37fe700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc408ba40 0x7f6dc408df00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6dd4002130 tx=0x7f6dd4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.022+0000 7f6dcb7fe700 1 -- 172.21.15.90:0/611106872 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f6ddc080e00 con 0x7f6de4193fb0 2022-07-05T11:46:01.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.185+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6de406be40 con 0x7f6de4193fb0 2022-07-05T11:46:01.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.186+0000 7f6dcb7fe700 1 -- 172.21.15.90:0/611106872 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6ddc018070 con 0x7f6de4193fb0 2022-07-05T11:46:01.188 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:01.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc408ba40 msgr2=0x7f6dc408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc408ba40 0x7f6dc408df00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6dd4002130 tx=0x7f6dd4015000).stop 2022-07-05T11:46:01.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4193fb0 msgr2=0x7f6de416be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4193fb0 0x7f6de416be90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6de40ebcb0 tx=0x7f6ddc007b90).stop 2022-07-05T11:46:01.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 shutdown_connections 2022-07-05T11:46:01.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc408ba40 0x7f6dc408df00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4193fb0 0x7f6de416be90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd00038e0 0x7f6de4175620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 --2- 172.21.15.90:0/611106872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6de4196980 0x7f6de416b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 >> 172.21.15.90:0/611106872 conn(0x7f6de40f21d0 msgr2=0x7f6de40c7150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:01.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 shutdown_connections 2022-07-05T11:46:01.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.187+0000 7f6dea0c1700 1 -- 172.21.15.90:0/611106872 wait complete. 2022-07-05T11:46:01.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:01.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.314+0000 7f3b8aaf9700 1 Processor -- start 2022-07-05T11:46:01.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.315+0000 7f3b8aaf9700 1 -- start start 2022-07-05T11:46:01.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b8aaf9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3b84174b70 0x7f3b84174f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b8aaf9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b84180af0 0x7f3b84180f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b8aaf9700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b84175440 con 0x7f3b84181460 2022-07-05T11:46:01.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b8aaf9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840ca3c0 con 0x7f3b84174b70 2022-07-05T11:46:01.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b8aaf9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b84180660 con 0x7f3b84180af0 2022-07-05T11:46:01.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b88895700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3b84174b70 0x7f3b84174f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b89096700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3b84181460 0x7f3b84084090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49140/0 (socket says 172.21.15.90:49140) 2022-07-05T11:46:01.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b89096700 1 -- 172.21.15.90:0/3769294476 learned_addr learned my addr 172.21.15.90:0/3769294476 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:01.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b83fff700 1 --2- 172.21.15.90:0/3769294476 >> v2:172.21.15.149:3300/0 conn(0x7f3b84180af0 0x7f3b84180f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b88895700 1 -- 172.21.15.90:0/3769294476 >> v2:172.21.15.149:3300/0 conn(0x7f3b84180af0 msgr2=0x7f3b84180f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b88895700 1 --2- 172.21.15.90:0/3769294476 >> v2:172.21.15.149:3300/0 conn(0x7f3b84180af0 0x7f3b84180f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b88895700 1 -- 172.21.15.90:0/3769294476 >> v1:172.21.15.90:6789/0 conn(0x7f3b84181460 legacy=0x7f3b84084090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b88895700 1 -- 172.21.15.90:0/3769294476 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8417fa50 con 0x7f3b84174b70 2022-07-05T11:46:01.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b837fe700 1 -- 172.21.15.90:0/3769294476 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431643844 0 0) 0x7f3b7c001490 con 0x7f3b84181460 2022-07-05T11:46:01.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b88895700 1 --2- 172.21.15.90:0/3769294476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84174b70 0x7f3b84174f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3b84083690 tx=0x7f3b78009060).ready entity=mon.0 client_cookie=f466fe8fda0d1275 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b837fe700 1 -- 172.21.15.90:0/3769294476 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800f510 con 0x7f3b84174b70 2022-07-05T11:46:01.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b837fe700 1 -- 172.21.15.90:0/3769294476 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7800f670 con 0x7f3b84174b70 2022-07-05T11:46:01.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.316+0000 7f3b837fe700 1 -- 172.21.15.90:0/3769294476 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800f9f0 con 0x7f3b84174b70 2022-07-05T11:46:01.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/3769294476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84174b70 msgr2=0x7f3b84174f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/3769294476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84174b70 0x7f3b84174f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3b84083690 tx=0x7f3b78009060).stop 2022-07-05T11:46:01.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/3769294476 shutdown_connections 2022-07-05T11:46:01.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/3769294476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84174b70 0x7f3b84174f50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/3769294476 >> v2:172.21.15.149:3300/0 conn(0x7f3b84180af0 0x7f3b84180f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/3769294476 >> 172.21.15.90:0/3769294476 conn(0x7f3b8405e440 msgr2=0x7f3b840f1860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:01.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/3769294476 shutdown_connections 2022-07-05T11:46:01.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.317+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/3769294476 wait complete. 2022-07-05T11:46:01.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.318+0000 7f3b8aaf9700 1 Processor -- start 2022-07-05T11:46:01.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.318+0000 7f3b8aaf9700 1 -- start start 2022-07-05T11:46:01.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b8aaf9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b84174b70 0x7f3b8416c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b8aaf9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84180af0 0x7f3b8418ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b8aaf9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b84181460 0x7f3b84190fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b8aaf9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8418f9f0 con 0x7f3b84180af0 2022-07-05T11:46:01.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b8aaf9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84190b30 con 0x7f3b84174b70 2022-07-05T11:46:01.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b8aaf9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8418fc40 con 0x7f3b84181460 2022-07-05T11:46:01.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b83fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84180af0 0x7f3b8418ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b83fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84180af0 0x7f3b8418ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56206/0 (socket says 172.21.15.90:56206) 2022-07-05T11:46:01.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.319+0000 7f3b83fff700 1 -- 172.21.15.90:0/4072173997 learned_addr learned my addr 172.21.15.90:0/4072173997 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:01.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b88895700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b84174b70 0x7f3b8416c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b89096700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b84181460 0x7f3b84190fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b83fff700 1 -- 172.21.15.90:0/4072173997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b84181460 msgr2=0x7f3b84190fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b83fff700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b84181460 0x7f3b84190fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b83fff700 1 -- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b84174b70 msgr2=0x7f3b8416c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b83fff700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b84174b70 0x7f3b8416c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b83fff700 1 -- 172.21.15.90:0/4072173997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780092a0 con 0x7f3b84180af0 2022-07-05T11:46:01.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b88895700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b84174b70 0x7f3b8416c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:01.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b83fff700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84180af0 0x7f3b8418ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3b7000e930 tx=0x7f3b70009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b80ff9700 1 -- 172.21.15.90:0/4072173997 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000eed0 con 0x7f3b84180af0 2022-07-05T11:46:01.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b80ff9700 1 -- 172.21.15.90:0/4072173997 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b70009510 con 0x7f3b84180af0 2022-07-05T11:46:01.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8418ff20 con 0x7f3b84180af0 2022-07-05T11:46:01.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b80ff9700 1 -- 172.21.15.90:0/4072173997 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ca60 con 0x7f3b84180af0 2022-07-05T11:46:01.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.320+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b841904e0 con 0x7f3b84180af0 2022-07-05T11:46:01.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.321+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8406be40 con 0x7f3b84180af0 2022-07-05T11:46:01.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.322+0000 7f3b80ff9700 1 -- 172.21.15.90:0/4072173997 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3b70022070 con 0x7f3b84180af0 2022-07-05T11:46:01.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.322+0000 7f3b80ff9700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b6c08ba40 0x7f3b6c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.322+0000 7f3b80ff9700 1 -- 172.21.15.90:0/4072173997 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f3b700b06a0 con 0x7f3b84180af0 2022-07-05T11:46:01.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.322+0000 7f3b88895700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b6c08ba40 0x7f3b6c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.323+0000 7f3b88895700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b6c08ba40 0x7f3b6c08df00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3b78006d10 tx=0x7f3b78017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.326+0000 7f3b80ff9700 1 -- 172.21.15.90:0/4072173997 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3b70081a50 con 0x7f3b84180af0 2022-07-05T11:46:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.526+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b841751f0 con 0x7f3b84180af0 2022-07-05T11:46:01.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.527+0000 7f3b80ff9700 1 -- 172.21.15.90:0/4072173997 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+9590 (secure 0 0 0) 0x7f3b70085070 con 0x7f3b84180af0 2022-07-05T11:46:01.529 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:01.529 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4340,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4341,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4346,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4371,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-07-05T11:46:01.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b6c08ba40 msgr2=0x7f3b6c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b6c08ba40 0x7f3b6c08df00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3b78006d10 tx=0x7f3b78017000).stop 2022-07-05T11:46:01.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84180af0 msgr2=0x7f3b8418ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84180af0 0x7f3b8418ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3b7000e930 tx=0x7f3b70009060).stop 2022-07-05T11:46:01.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 shutdown_connections 2022-07-05T11:46:01.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b6c08ba40 0x7f3b6c08df00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b84181460 0x7f3b84190fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b84174b70 0x7f3b8416c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 --2- 172.21.15.90:0/4072173997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b84180af0 0x7f3b8418ede0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 >> 172.21.15.90:0/4072173997 conn(0x7f3b8405e440 msgr2=0x7f3b841821b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:01.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 shutdown_connections 2022-07-05T11:46:01.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.529+0000 7f3b8aaf9700 1 -- 172.21.15.90:0/4072173997 wait complete. 2022-07-05T11:46:01.535 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 3 2022-07-05T11:46:01.543 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:01.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.653+0000 7f2f49cda700 1 Processor -- start 2022-07-05T11:46:01.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.653+0000 7f2f49cda700 1 -- start start 2022-07-05T11:46:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f49cda700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f44174a30 0x7f2f44174e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f49cda700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2f44063ec0 0x7f2f44064370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f49cda700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f440ca190 con 0x7f2f44064860 2022-07-05T11:46:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f49cda700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f440c92a0 con 0x7f2f44063ec0 2022-07-05T11:46:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f49cda700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f440c9580 con 0x7f2f44174a30 2022-07-05T11:46:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f43fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2f44063ec0 0x7f2f44064370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f43fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2f44063ec0 0x7f2f44064370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56214/0 (socket says 172.21.15.90:56214) 2022-07-05T11:46:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f43fff700 1 -- 172.21.15.90:0/2367967343 learned_addr learned my addr 172.21.15.90:0/2367967343 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.654+0000 7f2f48cd8700 1 --2- 172.21.15.90:0/2367967343 >> v2:172.21.15.149:3300/0 conn(0x7f2f44174a30 0x7f2f44174e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f43fff700 1 -- 172.21.15.90:0/2367967343 >> v2:172.21.15.149:3300/0 conn(0x7f2f44174a30 msgr2=0x7f2f44174e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f43fff700 1 --2- 172.21.15.90:0/2367967343 >> v2:172.21.15.149:3300/0 conn(0x7f2f44174a30 0x7f2f44174e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f43fff700 1 -- 172.21.15.90:0/2367967343 >> v1:172.21.15.149:6789/0 conn(0x7f2f44064860 legacy=0x7f2f440ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f43fff700 1 -- 172.21.15.90:0/2367967343 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440c9860 con 0x7f2f44063ec0 2022-07-05T11:46:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f43fff700 1 --2- 172.21.15.90:0/2367967343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44063ec0 0x7f2f44064370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2f440865c0 tx=0x7f2f380090f0).ready entity=mon.0 client_cookie=507342a03c6a7b5e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f437fe700 1 -- 172.21.15.90:0/2367967343 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800b5a0 con 0x7f2f44063ec0 2022-07-05T11:46:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f437fe700 1 -- 172.21.15.90:0/2367967343 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3800b700 con 0x7f2f44063ec0 2022-07-05T11:46:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f437fe700 1 -- 172.21.15.90:0/2367967343 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800ba80 con 0x7f2f44063ec0 2022-07-05T11:46:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 -- 172.21.15.90:0/2367967343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44063ec0 msgr2=0x7f2f44064370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 --2- 172.21.15.90:0/2367967343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44063ec0 0x7f2f44064370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2f440865c0 tx=0x7f2f380090f0).stop 2022-07-05T11:46:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 -- 172.21.15.90:0/2367967343 shutdown_connections 2022-07-05T11:46:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 --2- 172.21.15.90:0/2367967343 >> v2:172.21.15.149:3300/0 conn(0x7f2f44174a30 0x7f2f44174e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 --2- 172.21.15.90:0/2367967343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44063ec0 0x7f2f44064370 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 -- 172.21.15.90:0/2367967343 >> 172.21.15.90:0/2367967343 conn(0x7f2f440f27c0 msgr2=0x7f2f440f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 -- 172.21.15.90:0/2367967343 shutdown_connections 2022-07-05T11:46:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.655+0000 7f2f49cda700 1 -- 172.21.15.90:0/2367967343 wait complete. 2022-07-05T11:46:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.657+0000 7f2f49cda700 1 Processor -- start 2022-07-05T11:46:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.657+0000 7f2f49cda700 1 -- start start 2022-07-05T11:46:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f49cda700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f44063ec0 0x7f2f4418f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f49cda700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f44174a30 0x7f2f44154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f49cda700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44154a50 0x7f2f44191080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f49cda700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44190bf0 con 0x7f2f44154a50 2022-07-05T11:46:01.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f49cda700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44154ed0 con 0x7f2f44063ec0 2022-07-05T11:46:01.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f49cda700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440e7c00 con 0x7f2f44174a30 2022-07-05T11:46:01.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44154a50 0x7f2f44191080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44154a50 0x7f2f44191080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56220/0 (socket says 172.21.15.90:56220) 2022-07-05T11:46:01.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 -- 172.21.15.90:0/3433350774 learned_addr learned my addr 172.21.15.90:0/3433350774 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:01.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f48cd8700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f44063ec0 0x7f2f4418f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f43fff700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f44174a30 0x7f2f44154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 -- 172.21.15.90:0/3433350774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f44174a30 msgr2=0x7f2f44154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f44174a30 0x7f2f44154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 -- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f44063ec0 msgr2=0x7f2f4418f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f44063ec0 0x7f2f4418f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 -- 172.21.15.90:0/3433350774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38009370 con 0x7f2f44154a50 2022-07-05T11:46:01.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f48cd8700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f44063ec0 0x7f2f4418f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:01.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.658+0000 7f2f494d9700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44154a50 0x7f2f44191080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2f3400c490 tx=0x7f2f34007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.659+0000 7f2f40ff9700 1 -- 172.21.15.90:0/3433350774 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400f470 con 0x7f2f44154a50 2022-07-05T11:46:01.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.659+0000 7f2f40ff9700 1 -- 172.21.15.90:0/3433350774 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3400f5f0 con 0x7f2f44154a50 2022-07-05T11:46:01.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.659+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4418ffe0 con 0x7f2f44154a50 2022-07-05T11:46:01.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.659+0000 7f2f40ff9700 1 -- 172.21.15.90:0/3433350774 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400f9b0 con 0x7f2f44154a50 2022-07-05T11:46:01.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.659+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f441905a0 con 0x7f2f44154a50 2022-07-05T11:46:01.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.659+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f44178500 con 0x7f2f44154a50 2022-07-05T11:46:01.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.660+0000 7f2f40ff9700 1 -- 172.21.15.90:0/3433350774 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2f34010070 con 0x7f2f44154a50 2022-07-05T11:46:01.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.661+0000 7f2f40ff9700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2f2408ba40 0x7f2f2408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.661+0000 7f2f40ff9700 1 -- 172.21.15.90:0/3433350774 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f2f340af6f0 con 0x7f2f44154a50 2022-07-05T11:46:01.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.661+0000 7f2f48cd8700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2f2408ba40 0x7f2f2408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.661+0000 7f2f48cd8700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2f2408ba40 0x7f2f2408df00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2f3c00e420 tx=0x7f2f3c007670).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.664+0000 7f2f40ff9700 1 -- 172.21.15.90:0/3433350774 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f2f34080aa0 con 0x7f2f44154a50 2022-07-05T11:46:01.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.824+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f4406be40 con 0x7f2f44154a50 2022-07-05T11:46:01.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.825+0000 7f2f40ff9700 1 -- 172.21.15.90:0/3433350774 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18414 (secure 0 0 0) 0x7f2f340840c0 con 0x7f2f44154a50 2022-07-05T11:46:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:01.827 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":22,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:01.167808+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:01.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2f2408ba40 msgr2=0x7f2f2408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2f2408ba40 0x7f2f2408df00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2f3c00e420 tx=0x7f2f3c007670).stop 2022-07-05T11:46:01.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44154a50 msgr2=0x7f2f44191080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44154a50 0x7f2f44191080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2f3400c490 tx=0x7f2f34007db0).stop 2022-07-05T11:46:01.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 shutdown_connections 2022-07-05T11:46:01.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2f2408ba40 0x7f2f2408df00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f44154a50 0x7f2f44191080 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f44063ec0 0x7f2f4418f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 --2- 172.21.15.90:0/3433350774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f44174a30 0x7f2f44154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 >> 172.21.15.90:0/3433350774 conn(0x7f2f440f27c0 msgr2=0x7f2f440f2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 shutdown_connections 2022-07-05T11:46:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.827+0000 7f2f49cda700 1 -- 172.21.15.90:0/3433350774 wait complete. 2022-07-05T11:46:01.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-07-05T11:46:01.843 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:01.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.954+0000 7f473ca99700 1 Processor -- start 2022-07-05T11:46:01.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.954+0000 7f473ca99700 1 -- start start 2022-07-05T11:46:01.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.955+0000 7f473ca99700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4738182a30 0x7f47380eed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.955+0000 7f473ca99700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f473817e750 0x7f473817ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.955+0000 7f473ca99700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47380ee170 con 0x7f473817bda0 2022-07-05T11:46:01.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.955+0000 7f473ca99700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473817c3f0 con 0x7f4738182a30 2022-07-05T11:46:01.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.955+0000 7f473ca99700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47380ed280 con 0x7f473817e750 2022-07-05T11:46:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4738182a30 0x7f47380eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4738182a30 0x7f47380eed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56226/0 (socket says 172.21.15.90:56226) 2022-07-05T11:46:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 -- 172.21.15.90:0/1408740949 learned_addr learned my addr 172.21.15.90:0/1408740949 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4736d9d700 1 --2- 172.21.15.90:0/1408740949 >> v2:172.21.15.149:3300/0 conn(0x7f473817e750 0x7f473817ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 -- 172.21.15.90:0/1408740949 >> v2:172.21.15.149:3300/0 conn(0x7f473817e750 msgr2=0x7f473817ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 --2- 172.21.15.90:0/1408740949 >> v2:172.21.15.149:3300/0 conn(0x7f473817e750 0x7f473817ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 -- 172.21.15.90:0/1408740949 >> v1:172.21.15.149:6789/0 conn(0x7f473817bda0 legacy=0x7f47380ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 -- 172.21.15.90:0/1408740949 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380ed560 con 0x7f4738182a30 2022-07-05T11:46:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f4735d9b700 1 --2- 172.21.15.90:0/1408740949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738182a30 0x7f47380eed10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f47380ef4d0 tx=0x7f47200090f0).ready entity=mon.0 client_cookie=7c539f623abd41bf server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f473559a700 1 -- 172.21.15.90:0/1408740949 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000b5a0 con 0x7f4738182a30 2022-07-05T11:46:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f473559a700 1 -- 172.21.15.90:0/1408740949 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000b700 con 0x7f4738182a30 2022-07-05T11:46:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.956+0000 7f473559a700 1 -- 172.21.15.90:0/1408740949 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000ba80 con 0x7f4738182a30 2022-07-05T11:46:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 -- 172.21.15.90:0/1408740949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738182a30 msgr2=0x7f47380eed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 --2- 172.21.15.90:0/1408740949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738182a30 0x7f47380eed10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f47380ef4d0 tx=0x7f47200090f0).stop 2022-07-05T11:46:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 -- 172.21.15.90:0/1408740949 shutdown_connections 2022-07-05T11:46:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 --2- 172.21.15.90:0/1408740949 >> v2:172.21.15.149:3300/0 conn(0x7f473817e750 0x7f473817ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 --2- 172.21.15.90:0/1408740949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738182a30 0x7f47380eed10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 -- 172.21.15.90:0/1408740949 >> 172.21.15.90:0/1408740949 conn(0x7f47380f21d0 msgr2=0x7f4738069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:01.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 -- 172.21.15.90:0/1408740949 shutdown_connections 2022-07-05T11:46:01.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.957+0000 7f473ca99700 1 -- 172.21.15.90:0/1408740949 wait complete. 2022-07-05T11:46:01.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.958+0000 7f473ca99700 1 Processor -- start 2022-07-05T11:46:01.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.958+0000 7f473ca99700 1 -- start start 2022-07-05T11:46:01.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f473ca99700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f473817bda0 0x7f473818eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f473ca99700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473817e750 0x7f473818f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f473ca99700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4738182a30 0x7f4738172190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f473ca99700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47380c7310 con 0x7f473817e750 2022-07-05T11:46:01.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f473ca99700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4738191ce0 con 0x7f473817bda0 2022-07-05T11:46:01.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f473ca99700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4738191160 con 0x7f4738182a30 2022-07-05T11:46:01.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473817e750 0x7f473818f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473817e750 0x7f473818f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56232/0 (socket says 172.21.15.90:56232) 2022-07-05T11:46:01.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 -- 172.21.15.90:0/219963856 learned_addr learned my addr 172.21.15.90:0/219963856 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:01.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f473659c700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f473817bda0 0x7f473818eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 -- 172.21.15.90:0/219963856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4738182a30 msgr2=0x7f4738172190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4738182a30 0x7f4738172190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:01.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 -- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f473817bda0 msgr2=0x7f473818eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:01.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f473817bda0 0x7f473818eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:01.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.959+0000 7f4735d9b700 1 -- 172.21.15.90:0/219963856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009370 con 0x7f473817e750 2022-07-05T11:46:01.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.960+0000 7f4735d9b700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473817e750 0x7f473818f4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4720009130 tx=0x7f4720015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.960+0000 7f472e7fc700 1 -- 172.21.15.90:0/219963856 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000ba80 con 0x7f473817e750 2022-07-05T11:46:01.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.960+0000 7f472e7fc700 1 -- 172.21.15.90:0/219963856 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720000d10 con 0x7f473817e750 2022-07-05T11:46:01.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.960+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4738191440 con 0x7f473817e750 2022-07-05T11:46:01.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.960+0000 7f472e7fc700 1 -- 172.21.15.90:0/219963856 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472001d680 con 0x7f473817e750 2022-07-05T11:46:01.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.960+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4738191a00 con 0x7f473817e750 2022-07-05T11:46:01.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.961+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47380c7480 con 0x7f473817e750 2022-07-05T11:46:01.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.962+0000 7f472e7fc700 1 -- 172.21.15.90:0/219963856 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4720023020 con 0x7f473817e750 2022-07-05T11:46:01.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.962+0000 7f472e7fc700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f471c08ba40 0x7f471c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:01.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.962+0000 7f472e7fc700 1 -- 172.21.15.90:0/219963856 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f47200b20e0 con 0x7f473817e750 2022-07-05T11:46:01.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.962+0000 7f473659c700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f471c08ba40 0x7f471c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:01.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.963+0000 7f473659c700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f471c08ba40 0x7f471c08df00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4728006fd0 tx=0x7f4728008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:01.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:01.966+0000 7f472e7fc700 1 -- 172.21.15.90:0/219963856 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f47380c7480 con 0x7f473817e750 2022-07-05T11:46:02.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.125+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f47380c7450 con 0x7f473817e750 2022-07-05T11:46:02.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.126+0000 7f472e7fc700 1 -- 172.21.15.90:0/219963856 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4720083490 con 0x7f473817e750 2022-07-05T11:46:02.128 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:02.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f471c08ba40 msgr2=0x7f471c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f471c08ba40 0x7f471c08df00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4728006fd0 tx=0x7f4728008040).stop 2022-07-05T11:46:02.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473817e750 msgr2=0x7f473818f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473817e750 0x7f473818f4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4720009130 tx=0x7f4720015000).stop 2022-07-05T11:46:02.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 shutdown_connections 2022-07-05T11:46:02.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f471c08ba40 0x7f471c08df00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4738182a30 0x7f4738172190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:02.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f473817bda0 0x7f473818eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 --2- 172.21.15.90:0/219963856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473817e750 0x7f473818f4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 >> 172.21.15.90:0/219963856 conn(0x7f47380f21d0 msgr2=0x7f4738181500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:02.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 shutdown_connections 2022-07-05T11:46:02.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.127+0000 7f473ca99700 1 -- 172.21.15.90:0/219963856 wait complete. 2022-07-05T11:46:02.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:02.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.257+0000 7fc9dde3a700 1 Processor -- start 2022-07-05T11:46:02.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.257+0000 7fc9dde3a700 1 -- start start 2022-07-05T11:46:02.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dde3a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9d817b9f0 0x7fc9d80c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dde3a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc9d80c9410 0x7fc9d80ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dde3a700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d80e8ba0 con 0x7fc9d80e9030 2022-07-05T11:46:02.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dde3a700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d80e7fb0 con 0x7fc9d80c9410 2022-07-05T11:46:02.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dde3a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d817d150 con 0x7fc9d817b9f0 2022-07-05T11:46:02.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dd639700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc9d80c9410 0x7fc9d80ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9d7fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc9d80e9030 0x7fc9d80c8d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49180/0 (socket says 172.21.15.90:49180) 2022-07-05T11:46:02.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9d7fff700 1 -- 172.21.15.90:0/2258165441 learned_addr learned my addr 172.21.15.90:0/2258165441 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:02.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dce38700 1 --2- 172.21.15.90:0/2258165441 >> v2:172.21.15.149:3300/0 conn(0x7fc9d817b9f0 0x7fc9d80c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dd639700 1 -- 172.21.15.90:0/2258165441 >> v2:172.21.15.149:3300/0 conn(0x7fc9d817b9f0 msgr2=0x7fc9d80c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:02.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dd639700 1 --2- 172.21.15.90:0/2258165441 >> v2:172.21.15.149:3300/0 conn(0x7fc9d817b9f0 0x7fc9d80c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dd639700 1 -- 172.21.15.90:0/2258165441 >> v1:172.21.15.90:6789/0 conn(0x7fc9d80e9030 legacy=0x7fc9d80c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.258+0000 7fc9dd639700 1 -- 172.21.15.90:0/2258165441 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80e8270 con 0x7fc9d80c9410 2022-07-05T11:46:02.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dd639700 1 --2- 172.21.15.90:0/2258165441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d80c9410 0x7fc9d80ec8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc9d80f0e20 tx=0x7fc9d0009780).ready entity=mon.0 client_cookie=a215475a3dac6176 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9d77fe700 1 -- 172.21.15.90:0/2258165441 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000e070 con 0x7fc9d80c9410 2022-07-05T11:46:02.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9d77fe700 1 -- 172.21.15.90:0/2258165441 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000bc30 con 0x7fc9d80c9410 2022-07-05T11:46:02.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9d77fe700 1 -- 172.21.15.90:0/2258165441 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0012410 con 0x7fc9d80c9410 2022-07-05T11:46:02.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2258165441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d80c9410 msgr2=0x7fc9d80ec8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2258165441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d80c9410 0x7fc9d80ec8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc9d80f0e20 tx=0x7fc9d0009780).stop 2022-07-05T11:46:02.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2258165441 shutdown_connections 2022-07-05T11:46:02.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2258165441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d80c9410 0x7fc9d80ec8c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2258165441 >> v2:172.21.15.149:3300/0 conn(0x7fc9d817b9f0 0x7fc9d80c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2258165441 >> 172.21.15.90:0/2258165441 conn(0x7fc9d8083570 msgr2=0x7fc9d8083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:02.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2258165441 shutdown_connections 2022-07-05T11:46:02.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.259+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2258165441 wait complete. 2022-07-05T11:46:02.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.260+0000 7fc9dde3a700 1 Processor -- start 2022-07-05T11:46:02.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.261+0000 7fc9dde3a700 1 -- start start 2022-07-05T11:46:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9d80c9410 0x7fc9d8174ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d80e9030 0x7fc9d816f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d817b9f0 0x7fc9d8171200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d81746d0 con 0x7fc9d817b9f0 2022-07-05T11:46:02.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8174b60 con 0x7fc9d80c9410 2022-07-05T11:46:02.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d81737e0 con 0x7fc9d80e9030 2022-07-05T11:46:02.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d817b9f0 0x7fc9d8171200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d817b9f0 0x7fc9d8171200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56248/0 (socket says 172.21.15.90:56248) 2022-07-05T11:46:02.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 -- 172.21.15.90:0/2255318799 learned_addr learned my addr 172.21.15.90:0/2255318799 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:02.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dce38700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9d80c9410 0x7fc9d8174ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9d7fff700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d80e9030 0x7fc9d816f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 -- 172.21.15.90:0/2255318799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d80e9030 msgr2=0x7fc9d816f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d80e9030 0x7fc9d816f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 -- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9d80c9410 msgr2=0x7fc9d8174ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9d80c9410 0x7fc9d8174ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 -- 172.21.15.90:0/2255318799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0009a20 con 0x7fc9d817b9f0 2022-07-05T11:46:02.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dd639700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d817b9f0 0x7fc9d8171200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc9d80852b0 tx=0x7fc9d0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9d4ff9700 1 -- 172.21.15.90:0/2255318799 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d001d700 con 0x7fc9d817b9f0 2022-07-05T11:46:02.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9d4ff9700 1 -- 172.21.15.90:0/2255318799 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d001d860 con 0x7fc9d817b9f0 2022-07-05T11:46:02.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d8173ac0 con 0x7fc9d817b9f0 2022-07-05T11:46:02.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9d4ff9700 1 -- 172.21.15.90:0/2255318799 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d001dc20 con 0x7fc9d817b9f0 2022-07-05T11:46:02.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.262+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d8174080 con 0x7fc9d817b9f0 2022-07-05T11:46:02.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.263+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d8174860 con 0x7fc9d817b9f0 2022-07-05T11:46:02.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.264+0000 7fc9d4ff9700 1 -- 172.21.15.90:0/2255318799 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc9d001c590 con 0x7fc9d817b9f0 2022-07-05T11:46:02.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.265+0000 7fc9d4ff9700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9c008ba40 0x7fc9c008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.265+0000 7fc9d4ff9700 1 -- 172.21.15.90:0/2255318799 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fc9d00b2690 con 0x7fc9d817b9f0 2022-07-05T11:46:02.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.265+0000 7fc9dce38700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9c008ba40 0x7fc9c008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.265+0000 7fc9dce38700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9c008ba40 0x7fc9c008df00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fc9cc00bb10 tx=0x7fc9cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.269+0000 7fc9d4ff9700 1 -- 172.21.15.90:0/2255318799 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fc9d0083930 con 0x7fc9d817b9f0 2022-07-05T11:46:02.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.429+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9d80e8550 con 0x7fc9d817b9f0 2022-07-05T11:46:02.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.430+0000 7fc9d4ff9700 1 -- 172.21.15.90:0/2255318799 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9d0017020 con 0x7fc9d817b9f0 2022-07-05T11:46:02.432 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:02.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9c008ba40 msgr2=0x7fc9c008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9c008ba40 0x7fc9c008df00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fc9cc00bb10 tx=0x7fc9cc008040).stop 2022-07-05T11:46:02.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d817b9f0 msgr2=0x7fc9d8171200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d817b9f0 0x7fc9d8171200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc9d80852b0 tx=0x7fc9d0009780).stop 2022-07-05T11:46:02.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 shutdown_connections 2022-07-05T11:46:02.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9c008ba40 0x7fc9c008df00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9d817b9f0 0x7fc9d8171200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9d80c9410 0x7fc9d8174ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 --2- 172.21.15.90:0/2255318799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d80e9030 0x7fc9d816f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 >> 172.21.15.90:0/2255318799 conn(0x7fc9d8083570 msgr2=0x7fc9d80c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:02.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 shutdown_connections 2022-07-05T11:46:02.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.432+0000 7fc9dde3a700 1 -- 172.21.15.90:0/2255318799 wait complete. 2022-07-05T11:46:02.446 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-07-05T11:46:02.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.556+0000 7ff07eeaa700 1 Processor -- start 2022-07-05T11:46:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.556+0000 7ff07eeaa700 1 -- start start 2022-07-05T11:46:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff07eeaa700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff07817a170 0x7ff07817ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff07eeaa700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff078178770 con 0x7ff07817aff0 2022-07-05T11:46:02.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff07eeaa700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0781795d0 con 0x7ff078174b30 2022-07-05T11:46:02.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff07eeaa700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0780eb360 con 0x7ff07817a170 2022-07-05T11:46:02.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff077fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff07817a170 0x7ff07817ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff077fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff07817a170 0x7ff07817ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56252/0 (socket says 172.21.15.90:56252) 2022-07-05T11:46:02.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff077fff700 1 -- 172.21.15.90:0/649400832 learned_addr learned my addr 172.21.15.90:0/649400832 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:02.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff077fff700 1 -- 172.21.15.90:0/649400832 >> v1:172.21.15.149:6789/0 conn(0x7ff078174b30 legacy=0x7ff078179a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff077fff700 1 -- 172.21.15.90:0/649400832 >> v1:172.21.15.110:6789/0 conn(0x7ff07817aff0 legacy=0x7ff07817b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff077fff700 1 -- 172.21.15.90:0/649400832 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0781789c0 con 0x7ff07817a170 2022-07-05T11:46:02.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.557+0000 7ff077fff700 1 --2- 172.21.15.90:0/649400832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07817ab00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff060006fd0 tx=0x7ff06000a2b0).ready entity=mon.0 client_cookie=ca2701a4652106e6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff0777fe700 1 -- 172.21.15.90:0/649400832 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000c970 con 0x7ff07817a170 2022-07-05T11:46:02.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff0777fe700 1 -- 172.21.15.90:0/649400832 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000cad0 con 0x7ff07817a170 2022-07-05T11:46:02.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff0777fe700 1 -- 172.21.15.90:0/649400832 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000ce50 con 0x7ff07817a170 2022-07-05T11:46:02.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff07eeaa700 1 -- 172.21.15.90:0/649400832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 msgr2=0x7ff07817ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/649400832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07817ab00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff060006fd0 tx=0x7ff06000a2b0).stop 2022-07-05T11:46:02.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff07eeaa700 1 -- 172.21.15.90:0/649400832 shutdown_connections 2022-07-05T11:46:02.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/649400832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07817ab00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff07eeaa700 1 -- 172.21.15.90:0/649400832 >> 172.21.15.90:0/649400832 conn(0x7ff0780ee510 msgr2=0x7ff078083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:02.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff07eeaa700 1 -- 172.21.15.90:0/649400832 shutdown_connections 2022-07-05T11:46:02.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.558+0000 7ff07eeaa700 1 -- 172.21.15.90:0/649400832 wait complete. 2022-07-05T11:46:02.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.559+0000 7ff07eeaa700 1 Processor -- start 2022-07-05T11:46:02.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.560+0000 7ff07eeaa700 1 -- start start 2022-07-05T11:46:02.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff078174b30 0x7ff07817fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07816ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff07817aff0 0x7ff07818ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff078190be0 con 0x7ff07817a170 2022-07-05T11:46:02.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07818f9a0 con 0x7ff07817aff0 2022-07-05T11:46:02.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07818fc80 con 0x7ff078174b30 2022-07-05T11:46:02.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07816ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07816ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56256/0 (socket says 172.21.15.90:56256) 2022-07-05T11:46:02.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 -- 172.21.15.90:0/828653823 learned_addr learned my addr 172.21.15.90:0/828653823 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:02.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07cc46700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff078174b30 0x7ff07817fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07d447700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff07817aff0 0x7ff07818ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 -- 172.21.15.90:0/828653823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff078174b30 msgr2=0x7ff07817fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff078174b30 0x7ff07817fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 -- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff07817aff0 msgr2=0x7ff07818ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff07817aff0 0x7ff07818ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 -- 172.21.15.90:0/828653823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06000a510 con 0x7ff07817a170 2022-07-05T11:46:02.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07cc46700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff078174b30 0x7ff07817fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:02.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff077fff700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07816ca40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff078084cf0 tx=0x7ff078179540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff074ff9700 1 -- 172.21.15.90:0/828653823 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000ce50 con 0x7ff07817a170 2022-07-05T11:46:02.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff074ff9700 1 -- 172.21.15.90:0/828653823 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff060006910 con 0x7ff07817a170 2022-07-05T11:46:02.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff078190590 con 0x7ff07817a170 2022-07-05T11:46:02.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff074ff9700 1 -- 172.21.15.90:0/828653823 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060023680 con 0x7ff07817a170 2022-07-05T11:46:02.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.561+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff078180390 con 0x7ff07817a170 2022-07-05T11:46:02.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.562+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff078190d90 con 0x7ff07817a170 2022-07-05T11:46:02.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.563+0000 7ff074ff9700 1 -- 172.21.15.90:0/828653823 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff06002a070 con 0x7ff07817a170 2022-07-05T11:46:02.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.564+0000 7ff074ff9700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff05c08ba40 0x7ff05c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.564+0000 7ff074ff9700 1 -- 172.21.15.90:0/828653823 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7ff0600b16b0 con 0x7ff07817a170 2022-07-05T11:46:02.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.564+0000 7ff07cc46700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff05c08ba40 0x7ff05c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.564+0000 7ff07cc46700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff05c08ba40 0x7ff05c08df00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff070001600 tx=0x7ff070009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.567+0000 7ff074ff9700 1 -- 172.21.15.90:0/828653823 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7ff078190d90 con 0x7ff07817a170 2022-07-05T11:46:02.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.731+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff07806be40 con 0x7ff07817a170 2022-07-05T11:46:02.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.732+0000 7ff074ff9700 1 -- 172.21.15.90:0/828653823 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff060028090 con 0x7ff07817a170 2022-07-05T11:46:02.735 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:02.735 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2022-07-05T11:46:02.735 INFO:teuthology.orchestra.run.smithi090.stdout: { 2022-07-05T11:46:02.736 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2022-07-05T11:46:02.736 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "device_health_metrics" 2022-07-05T11:46:02.736 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2022-07-05T11:46:02.736 INFO:teuthology.orchestra.run.smithi090.stdout: { 2022-07-05T11:46:02.736 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 2, 2022-07-05T11:46:02.737 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "rbd" 2022-07-05T11:46:02.737 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:46:02.737 INFO:teuthology.orchestra.run.smithi090.stdout:] 2022-07-05T11:46:02.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff05c08ba40 msgr2=0x7ff05c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff05c08ba40 0x7ff05c08df00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff070001600 tx=0x7ff070009040).stop 2022-07-05T11:46:02.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 msgr2=0x7ff07816ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07816ca40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff078084cf0 tx=0x7ff078179540).stop 2022-07-05T11:46:02.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 shutdown_connections 2022-07-05T11:46:02.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff05c08ba40 0x7ff05c08df00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff07817aff0 0x7ff07818ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff078174b30 0x7ff07817fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 --2- 172.21.15.90:0/828653823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07817a170 0x7ff07816ca40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 >> 172.21.15.90:0/828653823 conn(0x7ff0780ee510 msgr2=0x7ff078179960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:02.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 shutdown_connections 2022-07-05T11:46:02.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.733+0000 7ff07eeaa700 1 -- 172.21.15.90:0/828653823 wait complete. 2022-07-05T11:46:02.747 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-07-05T11:46:02.747 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2022-07-05T11:46:02.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.861+0000 7fb8ac39a700 1 Processor -- start 2022-07-05T11:46:02.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.861+0000 7fb8ac39a700 1 -- start start 2022-07-05T11:46:02.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.862+0000 7fb8ac39a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb8a417df30 0x7fb8a40cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.862+0000 7fb8ac39a700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cc4b0 con 0x7fb8a40cce30 2022-07-05T11:46:02.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.862+0000 7fb8ac39a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cb5c0 con 0x7fb8a417db50 2022-07-05T11:46:02.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.862+0000 7fb8ac39a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40cb8a0 con 0x7fb8a417df30 2022-07-05T11:46:02.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8aa937700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb8a40cce30 0x7fb8a4184cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49204/0 (socket says 172.21.15.90:49204) 2022-07-05T11:46:02.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8aa937700 1 -- 172.21.15.90:0/2702467946 learned_addr learned my addr 172.21.15.90:0/2702467946 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:02.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9935700 1 --2- 172.21.15.90:0/2702467946 >> v2:172.21.15.149:3300/0 conn(0x7fb8a417df30 0x7fb8a40cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9134700 1 -- 172.21.15.90:0/2702467946 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772243612 0 0) 0x7fb8a40cc4b0 con 0x7fb8a40cce30 2022-07-05T11:46:02.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9134700 1 -- 172.21.15.90:0/2702467946 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8900033f0 con 0x7fb8a40cce30 2022-07-05T11:46:02.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9134700 1 -- 172.21.15.90:0/2702467946 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706442251 0 0) 0x7fb8a40cb5c0 con 0x7fb8a417db50 2022-07-05T11:46:02.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9134700 1 -- 172.21.15.90:0/2702467946 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a40cc4b0 con 0x7fb8a417db50 2022-07-05T11:46:02.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9935700 1 -- 172.21.15.90:0/2702467946 >> v1:172.21.15.149:6789/0 conn(0x7fb8a417db50 legacy=0x7fb8a40efc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9935700 1 -- 172.21.15.90:0/2702467946 >> v1:172.21.15.90:6789/0 conn(0x7fb8a40cce30 legacy=0x7fb8a4184cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9935700 1 -- 172.21.15.90:0/2702467946 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40cbb80 con 0x7fb8a417df30 2022-07-05T11:46:02.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9935700 1 --2- 172.21.15.90:0/2702467946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417df30 0x7fb8a40cc940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb898009760 tx=0x7fb898009060).ready entity=mon.2 client_cookie=1a467a59a8fe9ad server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9134700 1 -- 172.21.15.90:0/2702467946 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800d4a0 con 0x7fb8a417df30 2022-07-05T11:46:02.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9134700 1 -- 172.21.15.90:0/2702467946 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89800d600 con 0x7fb8a417df30 2022-07-05T11:46:02.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.863+0000 7fb8a9134700 1 -- 172.21.15.90:0/2702467946 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800d980 con 0x7fb8a417df30 2022-07-05T11:46:02.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.864+0000 7fb8ac39a700 1 -- 172.21.15.90:0/2702467946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417df30 msgr2=0x7fb8a40cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.864+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/2702467946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417df30 0x7fb8a40cc940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb898009760 tx=0x7fb898009060).stop 2022-07-05T11:46:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.864+0000 7fb8ac39a700 1 -- 172.21.15.90:0/2702467946 shutdown_connections 2022-07-05T11:46:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.864+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/2702467946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417df30 0x7fb8a40cc940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.864+0000 7fb8ac39a700 1 -- 172.21.15.90:0/2702467946 >> 172.21.15.90:0/2702467946 conn(0x7fb8a40f5590 msgr2=0x7fb8a40f1560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.864+0000 7fb8ac39a700 1 -- 172.21.15.90:0/2702467946 shutdown_connections 2022-07-05T11:46:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.864+0000 7fb8ac39a700 1 -- 172.21.15.90:0/2702467946 wait complete. 2022-07-05T11:46:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.865+0000 7fb8ac39a700 1 Processor -- start 2022-07-05T11:46:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.865+0000 7fb8ac39a700 1 -- start start 2022-07-05T11:46:02.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8ac39a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a40cce30 0x7fb8a4176410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8ac39a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417db50 0x7fb8a4069b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8ac39a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a417df30 0x7fb8a406a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8ac39a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406a560 con 0x7fb8a40cce30 2022-07-05T11:46:02.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8ac39a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4176900 con 0x7fb8a417df30 2022-07-05T11:46:02.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8ac39a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a418d0b0 con 0x7fb8a417db50 2022-07-05T11:46:02.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8aa136700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a40cce30 0x7fb8a4176410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8aa136700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a40cce30 0x7fb8a4176410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56270/0 (socket says 172.21.15.90:56270) 2022-07-05T11:46:02.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.866+0000 7fb8aa136700 1 -- 172.21.15.90:0/47691981 learned_addr learned my addr 172.21.15.90:0/47691981 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:02.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8a9935700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417db50 0x7fb8a4069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa937700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a417df30 0x7fb8a406a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa136700 1 -- 172.21.15.90:0/47691981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417db50 msgr2=0x7fb8a4069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa136700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417db50 0x7fb8a4069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa136700 1 -- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a417df30 msgr2=0x7fb8a406a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:02.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa136700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a417df30 0x7fb8a406a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:02.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa136700 1 -- 172.21.15.90:0/47691981 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980092a0 con 0x7fb8a40cce30 2022-07-05T11:46:02.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa937700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a417df30 0x7fb8a406a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:02.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8a9935700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417db50 0x7fb8a4069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:02.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8aa136700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a40cce30 0x7fb8a4176410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb89400c7f0 tx=0x7fb894002660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8a27fc700 1 -- 172.21.15.90:0/47691981 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894010510 con 0x7fb8a40cce30 2022-07-05T11:46:02.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8a27fc700 1 -- 172.21.15.90:0/47691981 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894010670 con 0x7fb8a40cce30 2022-07-05T11:46:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a418c200 con 0x7fb8a40cce30 2022-07-05T11:46:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8a27fc700 1 -- 172.21.15.90:0/47691981 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894010a30 con 0x7fb8a40cce30 2022-07-05T11:46:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.867+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a418c780 con 0x7fb8a40cce30 2022-07-05T11:46:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.868+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a40c62c0 con 0x7fb8a40cce30 2022-07-05T11:46:02.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.869+0000 7fb8a27fc700 1 -- 172.21.15.90:0/47691981 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb894010070 con 0x7fb8a40cce30 2022-07-05T11:46:02.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.869+0000 7fb8a27fc700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb88408ba40 0x7fb88408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:02.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.869+0000 7fb8a27fc700 1 -- 172.21.15.90:0/47691981 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fb8940aff90 con 0x7fb8a40cce30 2022-07-05T11:46:02.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.869+0000 7fb8a9935700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb88408ba40 0x7fb88408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.870+0000 7fb8a9935700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb88408ba40 0x7fb88408df00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb898006d60 tx=0x7fb898016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:02.873+0000 7fb8a27fc700 1 -- 172.21.15.90:0/47691981 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fb894081340 con 0x7fb8a40cce30 2022-07-05T11:46:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.034+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fb8a406be40 con 0x7fb8a40cce30 2022-07-05T11:46:03.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.184+0000 7fb8a27fc700 1 -- 172.21.15.90:0/47691981 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v23) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb89400a2b0 con 0x7fb8a40cce30 2022-07-05T11:46:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb88408ba40 msgr2=0x7fb88408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb88408ba40 0x7fb88408df00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb898006d60 tx=0x7fb898016000).stop 2022-07-05T11:46:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a40cce30 msgr2=0x7fb8a4176410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:03.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a40cce30 0x7fb8a4176410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb89400c7f0 tx=0x7fb894002660).stop 2022-07-05T11:46:03.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 shutdown_connections 2022-07-05T11:46:03.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb88408ba40 0x7fb88408df00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a417df30 0x7fb8a406a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a40cce30 0x7fb8a4176410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 --2- 172.21.15.90:0/47691981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a417db50 0x7fb8a4069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 >> 172.21.15.90:0/47691981 conn(0x7fb8a40f5590 msgr2=0x7fb8a40f38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 shutdown_connections 2022-07-05T11:46:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.187+0000 7fb8ac39a700 1 -- 172.21.15.90:0/47691981 wait complete. 2022-07-05T11:46:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2022-07-05T11:46:03.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2022-07-05T11:46:03.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.320+0000 7fe913d96700 1 Processor -- start 2022-07-05T11:46:03.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.320+0000 7fe913d96700 1 -- start start 2022-07-05T11:46:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.321+0000 7fe913d96700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe90c175fe0 0x7fe90c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.321+0000 7fe913d96700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c0c4a00 con 0x7fe90c17df30 2022-07-05T11:46:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.321+0000 7fe913d96700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c0690f0 con 0x7fe90c17d090 2022-07-05T11:46:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.321+0000 7fe913d96700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c068f10 con 0x7fe90c175fe0 2022-07-05T11:46:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.321+0000 7fe912333700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe90c17df30 0x7fe90c0ed320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49222/0 (socket says 172.21.15.90:49222) 2022-07-05T11:46:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.321+0000 7fe912333700 1 -- 172.21.15.90:0/643323337 learned_addr learned my addr 172.21.15.90:0/643323337 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738126588 0 0) 0x7fe90c0c4a00 con 0x7fe90c17df30 2022-07-05T11:46:03.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f80033f0 con 0x7fe90c17df30 2022-07-05T11:46:03.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe911b32700 1 --2- 172.21.15.90:0/643323337 >> v2:172.21.15.149:3300/0 conn(0x7fe90c175fe0 0x7fe90c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:03.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1596342833 0 0) 0x7fe8f80033f0 con 0x7fe90c17df30 2022-07-05T11:46:03.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 >> v2:172.21.15.149:3300/0 conn(0x7fe90c175fe0 msgr2=0x7fe90c068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:03.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 --2- 172.21.15.90:0/643323337 >> v2:172.21.15.149:3300/0 conn(0x7fe90c175fe0 0x7fe90c068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 >> v1:172.21.15.110:6789/0 conn(0x7fe90c17d090 legacy=0x7fe90c17d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:03.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0693d0 con 0x7fe90c17df30 2022-07-05T11:46:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fe904001470 con 0x7fe90c17df30 2022-07-05T11:46:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 >> v1:172.21.15.90:6789/0 conn(0x7fe90c17df30 legacy=0x7fe90c0ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8003930 0x7fe8f8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8004690 0x7fe8f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8f8005000 0x7fe8f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c068f10 con 0x7fe8f8005000 2022-07-05T11:46:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f800bf30 con 0x7fe8f8003930 2022-07-05T11:46:03.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f800c0f0 con 0x7fe8f8004690 2022-07-05T11:46:03.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8f8005000 0x7fe8f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:03.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe911b32700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8003930 0x7fe8f8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:03.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe911331700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8004690 0x7fe8f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 -- 172.21.15.90:0/643323337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8004690 msgr2=0x7fe8f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8004690 0x7fe8f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 -- 172.21.15.90:0/643323337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8003930 msgr2=0x7fe8f8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8003930 0x7fe8f8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 -- 172.21.15.90:0/643323337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f80033f0 con 0x7fe8f8005000 2022-07-05T11:46:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 -- 172.21.15.90:0/643323337 reap_dead start 2022-07-05T11:46:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.322+0000 7fe912333700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8f8005000 0x7fe8f800b8e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe90c0c3250 tx=0x7fe90c0c4b90).ready entity=mon.0 client_cookie=af86519078934681 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400ca30 con 0x7fe8f8005000 2022-07-05T11:46:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90400cb90 con 0x7fe8f8005000 2022-07-05T11:46:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe910b30700 1 -- 172.21.15.90:0/643323337 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040070d0 con 0x7fe8f8005000 2022-07-05T11:46:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe913d96700 1 -- 172.21.15.90:0/643323337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8f8005000 msgr2=0x7fe8f800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe913d96700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8f8005000 0x7fe8f800b8e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe90c0c3250 tx=0x7fe90c0c4b90).stop 2022-07-05T11:46:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe913d96700 1 -- 172.21.15.90:0/643323337 shutdown_connections 2022-07-05T11:46:03.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe913d96700 1 --2- 172.21.15.90:0/643323337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8f8005000 0x7fe8f800b8e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe913d96700 1 -- 172.21.15.90:0/643323337 >> 172.21.15.90:0/643323337 conn(0x7fe90c0f2d90 msgr2=0x7fe90c0f31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:03.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe913d96700 1 -- 172.21.15.90:0/643323337 shutdown_connections 2022-07-05T11:46:03.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.323+0000 7fe913d96700 1 -- 172.21.15.90:0/643323337 wait complete. 2022-07-05T11:46:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.325+0000 7fe913d96700 1 Processor -- start 2022-07-05T11:46:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.325+0000 7fe913d96700 1 -- start start 2022-07-05T11:46:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8005000 0x7fe90c1690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0c75e0 0x7fe90c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0c7a60 0x7fe90c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0c6160 con 0x7fe90c0c75e0 2022-07-05T11:46:03.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0c5270 con 0x7fe8f8005000 2022-07-05T11:46:03.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0c5550 con 0x7fe90c0c7a60 2022-07-05T11:46:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0c75e0 0x7fe90c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0c75e0 0x7fe90c0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56294/0 (socket says 172.21.15.90:56294) 2022-07-05T11:46:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 -- 172.21.15.90:0/3904679973 learned_addr learned my addr 172.21.15.90:0/3904679973 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe912333700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0c7a60 0x7fe90c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 -- 172.21.15.90:0/3904679973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0c7a60 msgr2=0x7fe90c0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:03.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0c7a60 0x7fe90c0c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:03.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 -- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8005000 msgr2=0x7fe90c1690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:03.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8005000 0x7fe90c1690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:03.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 -- 172.21.15.90:0/3904679973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0c5830 con 0x7fe90c0c75e0 2022-07-05T11:46:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe911331700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0c75e0 0x7fe90c0c8400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe900007cc0 tx=0x7fe900007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe909ffb700 1 -- 172.21.15.90:0/3904679973 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900011590 con 0x7fe90c0c75e0 2022-07-05T11:46:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe909ffb700 1 -- 172.21.15.90:0/3904679973 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000116f0 con 0x7fe90c0c75e0 2022-07-05T11:46:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe909ffb700 1 -- 172.21.15.90:0/3904679973 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900011a90 con 0x7fe90c0c75e0 2022-07-05T11:46:03.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c0c5b10 con 0x7fe90c0c75e0 2022-07-05T11:46:03.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.326+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90c1695a0 con 0x7fe90c0c75e0 2022-07-05T11:46:03.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.327+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90c06be40 con 0x7fe90c0c75e0 2022-07-05T11:46:03.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.328+0000 7fe909ffb700 1 -- 172.21.15.90:0/3904679973 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe90001b030 con 0x7fe90c0c75e0 2022-07-05T11:46:03.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.328+0000 7fe909ffb700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe8ec08ba40 0x7fe8ec08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:03.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.328+0000 7fe909ffb700 1 -- 172.21.15.90:0/3904679973 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7479+0+0 (secure 0 0 0) 0x7fe9000afee0 con 0x7fe90c0c75e0 2022-07-05T11:46:03.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.329+0000 7fe911b32700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe8ec08ba40 0x7fe8ec08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:03.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.329+0000 7fe911b32700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe8ec08ba40 0x7fe8ec08df00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe8fc009750 tx=0x7fe8fc00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:03.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.332+0000 7fe909ffb700 1 -- 172.21.15.90:0/3904679973 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fe900081120 con 0x7fe90c0c75e0 2022-07-05T11:46:03.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:03.494+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe90c0696b0 con 0x7fe90c0c75e0 2022-07-05T11:46:04.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.192+0000 7fe909ffb700 1 -- 172.21.15.90:0/3904679973 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v24) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe900019070 con 0x7fe90c0c75e0 2022-07-05T11:46:04.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe8ec08ba40 msgr2=0x7fe8ec08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe8ec08ba40 0x7fe8ec08df00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe8fc009750 tx=0x7fe8fc00b040).stop 2022-07-05T11:46:04.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0c75e0 msgr2=0x7fe90c0c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0c75e0 0x7fe90c0c8400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe900007cc0 tx=0x7fe900007bb0).stop 2022-07-05T11:46:04.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 shutdown_connections 2022-07-05T11:46:04.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe8ec08ba40 0x7fe8ec08df00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0c7a60 0x7fe90c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f8005000 0x7fe90c1690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:04.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 --2- 172.21.15.90:0/3904679973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0c75e0 0x7fe90c0c8400 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.199+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 >> 172.21.15.90:0/3904679973 conn(0x7fe90c0f2d90 msgr2=0x7fe90c067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:04.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.202+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 shutdown_connections 2022-07-05T11:46:04.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.202+0000 7fe913d96700 1 -- 172.21.15.90:0/3904679973 wait complete. 2022-07-05T11:46:04.207 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2022-07-05T11:46:04.226 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-07-05T11:46:04.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.360+0000 7f4e7e955700 1 Processor -- start 2022-07-05T11:46:04.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.360+0000 7f4e7e955700 1 -- start start 2022-07-05T11:46:04.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.361+0000 7f4e7e955700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4e781785f0 0x7f4e781789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.361+0000 7f4e7e955700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e78083f40 con 0x7f4e780843d0 2022-07-05T11:46:04.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.361+0000 7f4e7e955700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7817e250 con 0x7f4e78181dc0 2022-07-05T11:46:04.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.361+0000 7f4e7e955700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7817e530 con 0x7f4e781785f0 2022-07-05T11:46:04.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.361+0000 7f4e777fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4e780843d0 0x7f4e78084880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49252/0 (socket says 172.21.15.90:49252) 2022-07-05T11:46:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.361+0000 7f4e777fe700 1 -- 172.21.15.90:0/1691715603 learned_addr learned my addr 172.21.15.90:0/1691715603 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1691715603 >> v2:172.21.15.149:3300/0 conn(0x7f4e781785f0 0x7f4e781789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265545239 0 0) 0x7f4e78083f40 con 0x7f4e780843d0 2022-07-05T11:46:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e640033f0 con 0x7f4e780843d0 2022-07-05T11:46:04.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333995892 0 0) 0x7f4e640033f0 con 0x7f4e780843d0 2022-07-05T11:46:04.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 >> v2:172.21.15.149:3300/0 conn(0x7f4e781785f0 msgr2=0x7f4e781789d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:04.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 --2- 172.21.15.90:0/1691715603 >> v2:172.21.15.149:3300/0 conn(0x7f4e781785f0 0x7f4e781789d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 >> v1:172.21.15.149:6789/0 conn(0x7f4e78181dc0 legacy=0x7f4e781821a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78083610 con 0x7f4e780843d0 2022-07-05T11:46:04.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f4e6c001470 con 0x7f4e780843d0 2022-07-05T11:46:04.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 >> v1:172.21.15.90:6789/0 conn(0x7f4e780843d0 legacy=0x7f4e78084880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e64004690 0x7f4e64004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e64005120 0x7f4e6400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7817e530 con 0x7f4e64003980 2022-07-05T11:46:04.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6400c080 con 0x7f4e64005120 2022-07-05T11:46:04.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6400c240 con 0x7f4e64004690 2022-07-05T11:46:04.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e777fe700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e64004690 0x7f4e64004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e77fff700 1 -- 172.21.15.90:0/1691715603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e64004690 msgr2=0x7f4e64004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:04.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e7cef2700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e64005120 0x7f4e6400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e64004690 0x7f4e64004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e77fff700 1 -- 172.21.15.90:0/1691715603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e64005120 msgr2=0x7f4e6400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:04.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e64005120 0x7f4e6400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e77fff700 1 -- 172.21.15.90:0/1691715603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640033f0 con 0x7f4e64003980 2022-07-05T11:46:04.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e7cef2700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e64005120 0x7f4e6400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:04.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.362+0000 7f4e7cef2700 1 -- 172.21.15.90:0/1691715603 reap_dead start 2022-07-05T11:46:04.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e64003da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4e68009a60 tx=0x7f4e68009060).ready entity=mon.0 client_cookie=52f9d1bc528b71b3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:04.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68009ea0 con 0x7f4e64003980 2022-07-05T11:46:04.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e68009430 con 0x7f4e64003980 2022-07-05T11:46:04.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e76ffd700 1 -- 172.21.15.90:0/1691715603 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800e870 con 0x7f4e64003980 2022-07-05T11:46:04.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e7e955700 1 -- 172.21.15.90:0/1691715603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 msgr2=0x7f4e64003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e64003da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4e68009a60 tx=0x7f4e68009060).stop 2022-07-05T11:46:04.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e7e955700 1 -- 172.21.15.90:0/1691715603 shutdown_connections 2022-07-05T11:46:04.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1691715603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e64003da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e7e955700 1 -- 172.21.15.90:0/1691715603 >> 172.21.15.90:0/1691715603 conn(0x7f4e780effb0 msgr2=0x7f4e78061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:04.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e7e955700 1 -- 172.21.15.90:0/1691715603 shutdown_connections 2022-07-05T11:46:04.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.363+0000 7f4e7e955700 1 -- 172.21.15.90:0/1691715603 wait complete. 2022-07-05T11:46:04.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.365+0000 7f4e7e955700 1 Processor -- start 2022-07-05T11:46:04.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.365+0000 7f4e7e955700 1 -- start start 2022-07-05T11:46:04.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e78061fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e780624b0 0x7f4e78166850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e78166d40 0x7f4e780c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780f28c0 con 0x7f4e64003980 2022-07-05T11:46:04.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780f11b0 con 0x7f4e78166d40 2022-07-05T11:46:04.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780c8460 con 0x7f4e780624b0 2022-07-05T11:46:04.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e78061fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e78061fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56320/0 (socket says 172.21.15.90:56320) 2022-07-05T11:46:04.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 -- 172.21.15.90:0/1575282306 learned_addr learned my addr 172.21.15.90:0/1575282306 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:04.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e777fe700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e780624b0 0x7f4e78166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 -- 172.21.15.90:0/1575282306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e780624b0 msgr2=0x7f4e78166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e780624b0 0x7f4e78166850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 -- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e78166d40 msgr2=0x7f4e780c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7cef2700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e78166d40 0x7f4e780c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e78166d40 0x7f4e780c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 -- 172.21.15.90:0/1575282306 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e780c8720 con 0x7f4e64003980 2022-07-05T11:46:04.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e77fff700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e78061fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4e6800e4b0 tx=0x7f4e6801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:04.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e5ffff700 1 -- 172.21.15.90:0/1575282306 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6801baa0 con 0x7f4e64003980 2022-07-05T11:46:04.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e5ffff700 1 -- 172.21.15.90:0/1575282306 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6801bc00 con 0x7f4e64003980 2022-07-05T11:46:04.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e780c8a00 con 0x7f4e64003980 2022-07-05T11:46:04.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e5ffff700 1 -- 172.21.15.90:0/1575282306 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68025440 con 0x7f4e64003980 2022-07-05T11:46:04.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.366+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e780c8fc0 con 0x7f4e64003980 2022-07-05T11:46:04.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.367+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7806be40 con 0x7f4e64003980 2022-07-05T11:46:04.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.368+0000 7f4e5ffff700 1 -- 172.21.15.90:0/1575282306 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4e6802b020 con 0x7f4e64003980 2022-07-05T11:46:04.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.368+0000 7f4e5ffff700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4e5808ba40 0x7f4e5808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.369+0000 7f4e5ffff700 1 -- 172.21.15.90:0/1575282306 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7861+0+0 (secure 0 0 0) 0x7f4e680b2190 con 0x7f4e64003980 2022-07-05T11:46:04.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.369+0000 7f4e777fe700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4e5808ba40 0x7f4e5808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.369+0000 7f4e777fe700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4e5808ba40 0x7f4e5808df00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4e78177dc0 tx=0x7f4e6c001d80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:04.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.372+0000 7f4e5ffff700 1 -- 172.21.15.90:0/1575282306 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f4e68083140 con 0x7f4e64003980 2022-07-05T11:46:04.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.572+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4e780838f0 con 0x7f4e64003980 2022-07-05T11:46:04.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.577+0000 7f4e5ffff700 1 -- 172.21.15.90:0/1575282306 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4e68016070 con 0x7f4e64003980 2022-07-05T11:46:04.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4e5808ba40 msgr2=0x7f4e5808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4e5808ba40 0x7f4e5808df00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4e78177dc0 tx=0x7f4e6c001d80).stop 2022-07-05T11:46:04.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 msgr2=0x7f4e78061fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e78061fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4e6800e4b0 tx=0x7f4e6801a000).stop 2022-07-05T11:46:04.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 shutdown_connections 2022-07-05T11:46:04.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4e5808ba40 0x7f4e5808df00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e78166d40 0x7f4e780c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e64003980 0x7f4e78061fc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 --2- 172.21.15.90:0/1575282306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e780624b0 0x7f4e78166850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.582+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 >> 172.21.15.90:0/1575282306 conn(0x7f4e780effb0 msgr2=0x7f4e780850e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:04.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.583+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 shutdown_connections 2022-07-05T11:46:04.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.583+0000 7f4e7e955700 1 -- 172.21.15.90:0/1575282306 wait complete. 2022-07-05T11:46:04.594 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 3 and data pool 4 2022-07-05T11:46:04.605 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2022-07-05T11:46:04.605 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2022-07-05T11:46:04.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.720+0000 7f277249b700 1 Processor -- start 2022-07-05T11:46:04.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.720+0000 7f277249b700 1 -- start start 2022-07-05T11:46:04.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f277249b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f276c17ba90 0x7f276c0837d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f277249b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c0ee100 con 0x7f276c068000 2022-07-05T11:46:04.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f277249b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c083cc0 con 0x7f276c068480 2022-07-05T11:46:04.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f277249b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c0ed210 con 0x7f276c17ba90 2022-07-05T11:46:04.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f2770c98700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f276c068000 0x7f276c17e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49274/0 (socket says 172.21.15.90:49274) 2022-07-05T11:46:04.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f2770c98700 1 -- 172.21.15.90:0/4131945035 learned_addr learned my addr 172.21.15.90:0/4131945035 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:04.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f2771499700 1 --2- 172.21.15.90:0/4131945035 >> v2:172.21.15.110:3300/0 conn(0x7f276c17ba90 0x7f276c0837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f276bfff700 1 -- 172.21.15.90:0/4131945035 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250254678 0 0) 0x7f276c0ee100 con 0x7f276c068000 2022-07-05T11:46:04.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f276bfff700 1 -- 172.21.15.90:0/4131945035 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27580033f0 con 0x7f276c068000 2022-07-05T11:46:04.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f276bfff700 1 -- 172.21.15.90:0/4131945035 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4025042831 0 0) 0x7f27580033f0 con 0x7f276c068000 2022-07-05T11:46:04.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f2771499700 1 -- 172.21.15.90:0/4131945035 >> v1:172.21.15.149:6789/0 conn(0x7f276c068480 legacy=0x7f276c17ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.721+0000 7f2771499700 1 -- 172.21.15.90:0/4131945035 >> v1:172.21.15.90:6789/0 conn(0x7f276c068000 legacy=0x7f276c17e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f2771499700 1 -- 172.21.15.90:0/4131945035 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0ed4f0 con 0x7f276c17ba90 2022-07-05T11:46:04.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f2771499700 1 --2- 172.21.15.90:0/4131945035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 0x7f276c0837d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f275c009e60 tx=0x7f275c009780).ready entity=mon.1 client_cookie=bbffcd6f3e143ec3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:04.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f276bfff700 1 -- 172.21.15.90:0/4131945035 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00e070 con 0x7f276c17ba90 2022-07-05T11:46:04.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f276bfff700 1 -- 172.21.15.90:0/4131945035 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c00b850 con 0x7f276c17ba90 2022-07-05T11:46:04.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f276bfff700 1 -- 172.21.15.90:0/4131945035 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760001470 con 0x7f276c17ba90 2022-07-05T11:46:04.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f277249b700 1 -- 172.21.15.90:0/4131945035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 msgr2=0x7f276c0837d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f277249b700 1 --2- 172.21.15.90:0/4131945035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 0x7f276c0837d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f275c009e60 tx=0x7f275c009780).stop 2022-07-05T11:46:04.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f277249b700 1 -- 172.21.15.90:0/4131945035 shutdown_connections 2022-07-05T11:46:04.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f277249b700 1 --2- 172.21.15.90:0/4131945035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 0x7f276c0837d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f277249b700 1 -- 172.21.15.90:0/4131945035 >> 172.21.15.90:0/4131945035 conn(0x7f276c0f27d0 msgr2=0x7f276c0f2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:04.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f277249b700 1 -- 172.21.15.90:0/4131945035 shutdown_connections 2022-07-05T11:46:04.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.722+0000 7f277249b700 1 -- 172.21.15.90:0/4131945035 wait complete. 2022-07-05T11:46:04.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.724+0000 7f277249b700 1 Processor -- start 2022-07-05T11:46:04.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.724+0000 7f277249b700 1 -- start start 2022-07-05T11:46:04.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f277249b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276c068000 0x7f276c0eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f277249b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276c068480 0x7f276c16bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f277249b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 0x7f276c180310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f277249b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c17fe80 con 0x7f276c068000 2022-07-05T11:46:04.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f277249b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0eb2f0 con 0x7f276c17ba90 2022-07-05T11:46:04.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f277249b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c17f870 con 0x7f276c068480 2022-07-05T11:46:04.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276c068000 0x7f276c0eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276c068000 0x7f276c0eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56338/0 (socket says 172.21.15.90:56338) 2022-07-05T11:46:04.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 -- 172.21.15.90:0/3922144918 learned_addr learned my addr 172.21.15.90:0/3922144918 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:04.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771c9a700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 0x7f276c180310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 -- 172.21.15.90:0/3922144918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276c068480 msgr2=0x7f276c16bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276c068480 0x7f276c16bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:04.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 -- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 msgr2=0x7f276c180310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:04.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 0x7f276c180310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:04.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 -- 172.21.15.90:0/3922144918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c009a20 con 0x7f276c068000 2022-07-05T11:46:04.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.725+0000 7f2771499700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276c068000 0x7f276c0eae00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f275c00b6c0 tx=0x7f275c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:04.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.726+0000 7f27697fa700 1 -- 172.21.15.90:0/3922144918 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c012ea0 con 0x7f276c068000 2022-07-05T11:46:04.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.726+0000 7f27697fa700 1 -- 172.21.15.90:0/3922144918 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c000f40 con 0x7f276c068000 2022-07-05T11:46:04.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.726+0000 7f27697fa700 1 -- 172.21.15.90:0/3922144918 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c01e690 con 0x7f276c068000 2022-07-05T11:46:04.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.726+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c16c040 con 0x7f276c068000 2022-07-05T11:46:04.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.726+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c172f70 con 0x7f276c068000 2022-07-05T11:46:04.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.726+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c180160 con 0x7f276c068000 2022-07-05T11:46:04.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.727+0000 7f27697fa700 1 -- 172.21.15.90:0/3922144918 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f275c025030 con 0x7f276c068000 2022-07-05T11:46:04.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.728+0000 7f27697fa700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f274c08ba40 0x7f274c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:04.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.728+0000 7f27697fa700 1 -- 172.21.15.90:0/3922144918 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7961+0+0 (secure 0 0 0) 0x7f275c0b21f0 con 0x7f276c068000 2022-07-05T11:46:04.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.728+0000 7f2770c98700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f274c08ba40 0x7f274c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:04.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.728+0000 7f2770c98700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f274c08ba40 0x7f274c08df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2760001ed0 tx=0x7f27600012c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:04.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.731+0000 7f27697fa700 1 -- 172.21.15.90:0/3922144918 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f275c083140 con 0x7f276c068000 2022-07-05T11:46:04.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:04.902+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f276c046db0 con 0x7f276c068000 2022-07-05T11:46:05.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.582+0000 7f27697fa700 1 -- 172.21.15.90:0/3922144918 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v26) v1 ==== 157+0+0 (secure 0 0 0) 0x7f275c023020 con 0x7f276c068000 2022-07-05T11:46:05.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.584+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f274c08ba40 msgr2=0x7f274c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:05.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.584+0000 7f277249b700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f274c08ba40 0x7f274c08df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2760001ed0 tx=0x7f27600012c0).stop 2022-07-05T11:46:05.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.584+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276c068000 msgr2=0x7f276c0eae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:05.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.584+0000 7f277249b700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276c068000 0x7f276c0eae00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f275c00b6c0 tx=0x7f275c009780).stop 2022-07-05T11:46:05.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.584+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 shutdown_connections 2022-07-05T11:46:05.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.585+0000 7f277249b700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f274c08ba40 0x7f274c08df00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:05.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.585+0000 7f277249b700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c17ba90 0x7f276c180310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:05.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.585+0000 7f277249b700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276c068000 0x7f276c0eae00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:05.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.585+0000 7f277249b700 1 --2- 172.21.15.90:0/3922144918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276c068480 0x7f276c16bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:05.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.585+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 >> 172.21.15.90:0/3922144918 conn(0x7f276c0f27d0 msgr2=0x7f276c0688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:05.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.585+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 shutdown_connections 2022-07-05T11:46:05.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.585+0000 7f277249b700 1 -- 172.21.15.90:0/3922144918 wait complete. 2022-07-05T11:46:05.602 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2022-07-05T11:46:05.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.725+0000 7f5307fff700 1 Processor -- start 2022-07-05T11:46:05.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.725+0000 7f5307fff700 1 -- start start 2022-07-05T11:46:05.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.726+0000 7f5307fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f530817ba70 0x7f53080c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:05.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.726+0000 7f5307fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53080c44c0 0x7f5308068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:05.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.726+0000 7f5307fff700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5308085eb0 con 0x7f5308068970 2022-07-05T11:46:05.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.726+0000 7f5307fff700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5308067ff0 con 0x7f530817ba70 2022-07-05T11:46:05.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.726+0000 7f5307fff700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080ee180 con 0x7f53080c44c0 2022-07-05T11:46:05.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f530817ba70 0x7f53080c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:05.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f530817ba70 0x7f53080c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56346/0 (socket says 172.21.15.90:56346) 2022-07-05T11:46:05.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 -- 172.21.15.90:0/1057983549 learned_addr learned my addr 172.21.15.90:0/1057983549 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:05.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 -- 172.21.15.90:0/1057983549 >> v2:172.21.15.110:3300/0 conn(0x7f53080c44c0 msgr2=0x7f5308068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:05.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 --2- 172.21.15.90:0/1057983549 >> v2:172.21.15.110:3300/0 conn(0x7f53080c44c0 0x7f5308068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:05.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 -- 172.21.15.90:0/1057983549 >> v1:172.21.15.110:6789/0 conn(0x7f5308068970 legacy=0x7f53080841e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:05.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 -- 172.21.15.90:0/1057983549 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308085330 con 0x7f530817ba70 2022-07-05T11:46:05.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5306ffd700 1 --2- 172.21.15.90:0/1057983549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f530817ba70 0x7f53080c3fd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f53080c7f80 tx=0x7f52f8009840).ready entity=mon.0 client_cookie=605876c51e5acf04 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:05.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5305ffb700 1 -- 172.21.15.90:0/1057983549 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800e070 con 0x7f530817ba70 2022-07-05T11:46:05.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5305ffb700 1 -- 172.21.15.90:0/1057983549 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f800ba10 con 0x7f530817ba70 2022-07-05T11:46:05.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.727+0000 7f5305ffb700 1 -- 172.21.15.90:0/1057983549 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800bd90 con 0x7f530817ba70 2022-07-05T11:46:05.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 -- 172.21.15.90:0/1057983549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f530817ba70 msgr2=0x7f53080c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:05.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 --2- 172.21.15.90:0/1057983549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f530817ba70 0x7f53080c3fd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f53080c7f80 tx=0x7f52f8009840).stop 2022-07-05T11:46:05.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 -- 172.21.15.90:0/1057983549 shutdown_connections 2022-07-05T11:46:05.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 --2- 172.21.15.90:0/1057983549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f530817ba70 0x7f53080c3fd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:05.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 --2- 172.21.15.90:0/1057983549 >> v2:172.21.15.110:3300/0 conn(0x7f53080c44c0 0x7f5308068480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:05.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 -- 172.21.15.90:0/1057983549 >> 172.21.15.90:0/1057983549 conn(0x7f53080f27d0 msgr2=0x7f53080f2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:05.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 -- 172.21.15.90:0/1057983549 shutdown_connections 2022-07-05T11:46:05.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.728+0000 7f5307fff700 1 -- 172.21.15.90:0/1057983549 wait complete. 2022-07-05T11:46:05.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.729+0000 7f5307fff700 1 Processor -- start 2022-07-05T11:46:05.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.729+0000 7f5307fff700 1 -- start start 2022-07-05T11:46:05.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f5307fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5308068970 0x7f530818e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:05.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f5307fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53080c44c0 0x7f5308171c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:05.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f5307fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f530817ba70 0x7f5308172170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:05.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f5307fff700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308064dd0 con 0x7f53080c44c0 2022-07-05T11:46:05.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f5307fff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308063ee0 con 0x7f5308068970 2022-07-05T11:46:05.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f5307fff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080641c0 con 0x7f530817ba70 2022-07-05T11:46:05.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f53067fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53080c44c0 0x7f5308171c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:05.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f53067fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53080c44c0 0x7f5308171c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56354/0 (socket says 172.21.15.90:56354) 2022-07-05T11:46:05.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f53067fc700 1 -- 172.21.15.90:0/2330255761 learned_addr learned my addr 172.21.15.90:0/2330255761 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:05.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f5306ffd700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5308068970 0x7f530818e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:05.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f53067fc700 1 -- 172.21.15.90:0/2330255761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f530817ba70 msgr2=0x7f5308172170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:05.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.730+0000 7f53067fc700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f530817ba70 0x7f5308172170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:05.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f53067fc700 1 -- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5308068970 msgr2=0x7f530818e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:05.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f53067fc700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5308068970 0x7f530818e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:05.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f53067fc700 1 -- 172.21.15.90:0/2330255761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f8009ae0 con 0x7f53080c44c0 2022-07-05T11:46:05.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f5306ffd700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5308068970 0x7f530818e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:05.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f53067fc700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53080c44c0 0x7f5308171c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f52f000b490 tx=0x7f52f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:05.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f52feffd700 1 -- 172.21.15.90:0/2330255761 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0002320 con 0x7f53080c44c0 2022-07-05T11:46:05.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f52feffd700 1 -- 172.21.15.90:0/2330255761 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f00024a0 con 0x7f53080c44c0 2022-07-05T11:46:05.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f52feffd700 1 -- 172.21.15.90:0/2330255761 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0002860 con 0x7f53080c44c0 2022-07-05T11:46:05.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53080644a0 con 0x7f53080c44c0 2022-07-05T11:46:05.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.731+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5308064a60 con 0x7f53080c44c0 2022-07-05T11:46:05.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.732+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5308064bf0 con 0x7f53080c44c0 2022-07-05T11:46:05.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.732+0000 7f52feffd700 1 -- 172.21.15.90:0/2330255761 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f52f000f030 con 0x7f53080c44c0 2022-07-05T11:46:05.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.733+0000 7f52feffd700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f52ec08ba40 0x7f52ec08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:05.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.733+0000 7f52feffd700 1 -- 172.21.15.90:0/2330255761 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 8220+0+0 (secure 0 0 0) 0x7f52f00b03a0 con 0x7f53080c44c0 2022-07-05T11:46:05.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.733+0000 7f5306ffd700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f52ec08ba40 0x7f52ec08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:05.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.734+0000 7f5306ffd700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f52ec08ba40 0x7f52ec08df00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f52f8009540 tx=0x7f52f8009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:05.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.737+0000 7f52feffd700 1 -- 172.21.15.90:0/2330255761 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f52f0081270 con 0x7f53080c44c0 2022-07-05T11:46:05.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:05.896+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5308046db0 con 0x7f53080c44c0 2022-07-05T11:46:06.319 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T11:46:06.315+0000 7fc11e5c3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2022-07-05T11:46:07.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.598+0000 7f52feffd700 1 -- 172.21.15.90:0/2330255761 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v28) v1 ==== 228+0+0 (secure 0 0 0) 0x7f52f0084890 con 0x7f53080c44c0 2022-07-05T11:46:07.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.602+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f52ec08ba40 msgr2=0x7f52ec08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:07.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.602+0000 7f5307fff700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f52ec08ba40 0x7f52ec08df00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f52f8009540 tx=0x7f52f8009840).stop 2022-07-05T11:46:07.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.602+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53080c44c0 msgr2=0x7f5308171c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:07.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.602+0000 7f5307fff700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53080c44c0 0x7f5308171c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f52f000b490 tx=0x7f52f0009060).stop 2022-07-05T11:46:07.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.603+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 shutdown_connections 2022-07-05T11:46:07.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.603+0000 7f5307fff700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f52ec08ba40 0x7f52ec08df00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:07.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.603+0000 7f5307fff700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f530817ba70 0x7f5308172170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:07.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.603+0000 7f5307fff700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5308068970 0x7f530818e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:07.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.603+0000 7f5307fff700 1 --2- 172.21.15.90:0/2330255761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53080c44c0 0x7f5308171c80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:07.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.604+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 >> 172.21.15.90:0/2330255761 conn(0x7f53080f27d0 msgr2=0x7f5308068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:07.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.605+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 shutdown_connections 2022-07-05T11:46:07.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.605+0000 7f5307fff700 1 -- 172.21.15.90:0/2330255761 wait complete. 2022-07-05T11:46:07.618 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data_ec' created 2022-07-05T11:46:07.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2022-07-05T11:46:07.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.744+0000 7f6223493700 1 Processor -- start 2022-07-05T11:46:07.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.744+0000 7f6223493700 1 -- start start 2022-07-05T11:46:07.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6223493700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f621c17c0a0 0x7f621c17d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:07.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6223493700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c17d410 con 0x7f621c178520 2022-07-05T11:46:07.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6223493700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c178900 con 0x7f621c17dd90 2022-07-05T11:46:07.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6223493700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621c17c520 con 0x7f621c17c0a0 2022-07-05T11:46:07.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6221c90700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f621c17c0a0 0x7f621c17d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:07.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6221c90700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f621c17c0a0 0x7f621c17d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56372/0 (socket says 172.21.15.90:56372) 2022-07-05T11:46:07.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6221c90700 1 -- 172.21.15.90:0/4211821775 learned_addr learned my addr 172.21.15.90:0/4211821775 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:07.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.745+0000 7f6221c90700 1 -- 172.21.15.90:0/4211821775 >> v1:172.21.15.149:6789/0 conn(0x7f621c17dd90 legacy=0x7f621c184d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:07.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6221c90700 1 -- 172.21.15.90:0/4211821775 >> v1:172.21.15.110:6789/0 conn(0x7f621c178520 legacy=0x7f621c0efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:07.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6221c90700 1 -- 172.21.15.90:0/4211821775 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c17c800 con 0x7f621c17c0a0 2022-07-05T11:46:07.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6221c90700 1 --2- 172.21.15.90:0/4211821775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c17d8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f620c006fd0 tx=0x7f620c0090f0).ready entity=mon.0 client_cookie=3cd4b6b3eefbadba server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:07.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f622148f700 1 -- 172.21.15.90:0/4211821775 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00b600 con 0x7f621c17c0a0 2022-07-05T11:46:07.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f622148f700 1 -- 172.21.15.90:0/4211821775 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00b760 con 0x7f621c17c0a0 2022-07-05T11:46:07.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f622148f700 1 -- 172.21.15.90:0/4211821775 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00bae0 con 0x7f621c17c0a0 2022-07-05T11:46:07.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6223493700 1 -- 172.21.15.90:0/4211821775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 msgr2=0x7f621c17d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:07.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6223493700 1 --2- 172.21.15.90:0/4211821775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c17d8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f620c006fd0 tx=0x7f620c0090f0).stop 2022-07-05T11:46:07.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6223493700 1 -- 172.21.15.90:0/4211821775 shutdown_connections 2022-07-05T11:46:07.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6223493700 1 --2- 172.21.15.90:0/4211821775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c17d8a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:07.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6223493700 1 -- 172.21.15.90:0/4211821775 >> 172.21.15.90:0/4211821775 conn(0x7f621c0f13f0 msgr2=0x7f621c0f1800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:07.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6223493700 1 -- 172.21.15.90:0/4211821775 shutdown_connections 2022-07-05T11:46:07.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.746+0000 7f6223493700 1 -- 172.21.15.90:0/4211821775 wait complete. 2022-07-05T11:46:07.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.748+0000 7f6223493700 1 Processor -- start 2022-07-05T11:46:07.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.748+0000 7f6223493700 1 -- start start 2022-07-05T11:46:07.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c178520 0x7f621c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:07.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:07.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f621c17dd90 0x7f621c190da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:07.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c190910 con 0x7f621c17c0a0 2022-07-05T11:46:07.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0c9d50 con 0x7f621c17dd90 2022-07-05T11:46:07.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0c8fe0 con 0x7f621c178520 2022-07-05T11:46:07.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:07.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c1689d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56376/0 (socket says 172.21.15.90:56376) 2022-07-05T11:46:07.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 -- 172.21.15.90:0/594919715 learned_addr learned my addr 172.21.15.90:0/594919715 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:07.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6222491700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c178520 0x7f621c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:07.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6222c92700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f621c17dd90 0x7f621c190da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:07.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 -- 172.21.15.90:0/594919715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c178520 msgr2=0x7f621c0c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:07.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c178520 0x7f621c0c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:07.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 -- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f621c17dd90 msgr2=0x7f621c190da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:07.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f621c17dd90 0x7f621c190da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:07.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 -- 172.21.15.90:0/594919715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c009370 con 0x7f621c17c0a0 2022-07-05T11:46:07.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6222c92700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f621c17dd90 0x7f621c190da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:07.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6222491700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c178520 0x7f621c0c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:07.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6221c90700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c1689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f621c05dac0 tx=0x7f620c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:07.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f620a7fc700 1 -- 172.21.15.90:0/594919715 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00bae0 con 0x7f621c17c0a0 2022-07-05T11:46:07.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f620a7fc700 1 -- 172.21.15.90:0/594919715 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c000c90 con 0x7f621c17c0a0 2022-07-05T11:46:07.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c0c92c0 con 0x7f621c17c0a0 2022-07-05T11:46:07.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f620a7fc700 1 -- 172.21.15.90:0/594919715 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c01c650 con 0x7f621c17c0a0 2022-07-05T11:46:07.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.749+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c1905a0 con 0x7f621c17c0a0 2022-07-05T11:46:07.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.750+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c046db0 con 0x7f621c17c0a0 2022-07-05T11:46:07.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.751+0000 7f620a7fc700 1 -- 172.21.15.90:0/594919715 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f620c00f070 con 0x7f621c17c0a0 2022-07-05T11:46:07.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.752+0000 7f620a7fc700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f61fc08ba40 0x7f61fc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:07.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.752+0000 7f620a7fc700 1 -- 172.21.15.90:0/594919715 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8713+0+0 (secure 0 0 0) 0x7f620c0b2890 con 0x7f621c17c0a0 2022-07-05T11:46:07.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.752+0000 7f6222491700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f61fc08ba40 0x7f61fc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:07.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.752+0000 7f6222491700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f61fc08ba40 0x7f61fc08df00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6218007fd0 tx=0x7f6218009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:07.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.755+0000 7f620a7fc700 1 -- 172.21.15.90:0/594919715 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f620c083570 con 0x7f621c17c0a0 2022-07-05T11:46:07.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:07.915+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f621c0c3e90 con 0x7f621c17c0a0 2022-07-05T11:46:08.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.602+0000 7f620a7fc700 1 -- 172.21.15.90:0/594919715 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f620c020070 con 0x7f621c17c0a0 2022-07-05T11:46:08.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f61fc08ba40 msgr2=0x7f61fc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:08.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f61fc08ba40 0x7f61fc08df00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6218007fd0 tx=0x7f6218009040).stop 2022-07-05T11:46:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 msgr2=0x7f621c1689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c1689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f621c05dac0 tx=0x7f620c017000).stop 2022-07-05T11:46:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 shutdown_connections 2022-07-05T11:46:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f61fc08ba40 0x7f61fc08df00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f621c17dd90 0x7f621c190da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c178520 0x7f621c0c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 --2- 172.21.15.90:0/594919715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f621c17c0a0 0x7f621c1689d0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0x7f621c05dac0 tx=0x7f620c017000).stop 2022-07-05T11:46:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.606+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 >> 172.21.15.90:0/594919715 conn(0x7f621c0f13f0 msgr2=0x7f621c0c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:08.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.609+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 shutdown_connections 2022-07-05T11:46:08.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.610+0000 7f6223493700 1 -- 172.21.15.90:0/594919715 wait complete. 2022-07-05T11:46:08.620 INFO:teuthology.orchestra.run.smithi090.stderr:set pool 5 allow_ec_overwrites to true 2022-07-05T11:46:08.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2022-07-05T11:46:08.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.748+0000 7f9965510700 1 Processor -- start 2022-07-05T11:46:08.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.748+0000 7f9965510700 1 -- start start 2022-07-05T11:46:08.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f9965510700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f996017dcd0 0x7f9960063200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:08.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f9965510700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960061f10 con 0x7f99600636f0 2022-07-05T11:46:08.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f9965510700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960062d70 con 0x7f9960063b70 2022-07-05T11:46:08.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f9965510700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996017f2d0 con 0x7f996017dcd0 2022-07-05T11:46:08.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f995ffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f996017dcd0 0x7f9960063200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:08.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f995ffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f996017dcd0 0x7f9960063200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56382/0 (socket says 172.21.15.90:56382) 2022-07-05T11:46:08.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f995ffff700 1 -- 172.21.15.90:0/3290600583 learned_addr learned my addr 172.21.15.90:0/3290600583 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:08.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f995ffff700 1 -- 172.21.15.90:0/3290600583 >> v1:172.21.15.149:6789/0 conn(0x7f9960063b70 legacy=0x7f996017ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:08.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f995ffff700 1 -- 172.21.15.90:0/3290600583 >> v1:172.21.15.110:6789/0 conn(0x7f99600636f0 legacy=0x7f996017e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:08.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.749+0000 7f995ffff700 1 -- 172.21.15.90:0/3290600583 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960062160 con 0x7f996017dcd0 2022-07-05T11:46:08.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f995ffff700 1 --2- 172.21.15.90:0/3290600583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996017dcd0 0x7f9960063200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9950006fd0 tx=0x7f99500090f0).ready entity=mon.0 client_cookie=c60a03a4dec596ad server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f995effd700 1 -- 172.21.15.90:0/3290600583 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000b580 con 0x7f996017dcd0 2022-07-05T11:46:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f995effd700 1 -- 172.21.15.90:0/3290600583 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995000b6e0 con 0x7f996017dcd0 2022-07-05T11:46:08.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f995effd700 1 -- 172.21.15.90:0/3290600583 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000ba80 con 0x7f996017dcd0 2022-07-05T11:46:08.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f9965510700 1 -- 172.21.15.90:0/3290600583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996017dcd0 msgr2=0x7f9960063200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:08.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f9965510700 1 --2- 172.21.15.90:0/3290600583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996017dcd0 0x7f9960063200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9950006fd0 tx=0x7f99500090f0).stop 2022-07-05T11:46:08.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f9965510700 1 -- 172.21.15.90:0/3290600583 shutdown_connections 2022-07-05T11:46:08.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f9965510700 1 --2- 172.21.15.90:0/3290600583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996017dcd0 0x7f9960063200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f9965510700 1 -- 172.21.15.90:0/3290600583 >> 172.21.15.90:0/3290600583 conn(0x7f99600f5470 msgr2=0x7f99600f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:08.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f9965510700 1 -- 172.21.15.90:0/3290600583 shutdown_connections 2022-07-05T11:46:08.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.750+0000 7f9965510700 1 -- 172.21.15.90:0/3290600583 wait complete. 2022-07-05T11:46:08.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.752+0000 7f9965510700 1 Processor -- start 2022-07-05T11:46:08.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.752+0000 7f9965510700 1 -- start start 2022-07-05T11:46:08.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99600636f0 0x7f996017b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:08.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9960063b70 0x7f99600c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:08.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996017dcd0 0x7f996015f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:08.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996017b070 con 0x7f9960063b70 2022-07-05T11:46:08.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996017a180 con 0x7f99600636f0 2022-07-05T11:46:08.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996017a460 con 0x7f996017dcd0 2022-07-05T11:46:08.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9960063b70 0x7f99600c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:08.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9960063b70 0x7f99600c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56390/0 (socket says 172.21.15.90:56390) 2022-07-05T11:46:08.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 -- 172.21.15.90:0/2605084478 learned_addr learned my addr 172.21.15.90:0/2605084478 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:08.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995ffff700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99600636f0 0x7f996017b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:08.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9964d0f700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996017dcd0 0x7f996015f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 -- 172.21.15.90:0/2605084478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996017dcd0 msgr2=0x7f996015f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996017dcd0 0x7f996015f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 -- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99600636f0 msgr2=0x7f996017b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:08.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99600636f0 0x7f996017b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 -- 172.21.15.90:0/2605084478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950009370 con 0x7f9960063b70 2022-07-05T11:46:08.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9964d0f700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996017dcd0 0x7f996015f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:08.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995ffff700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99600636f0 0x7f996017b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:08.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f995f7fe700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9960063b70 0x7f99600c7b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f995400b460 tx=0x7f9954006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:08.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9947fff700 1 -- 172.21.15.90:0/2605084478 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954012410 con 0x7f9960063b70 2022-07-05T11:46:08.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9947fff700 1 -- 172.21.15.90:0/2605084478 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954012590 con 0x7f9960063b70 2022-07-05T11:46:08.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996017a740 con 0x7f9960063b70 2022-07-05T11:46:08.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9947fff700 1 -- 172.21.15.90:0/2605084478 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954012950 con 0x7f9960063b70 2022-07-05T11:46:08.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.753+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996017ad00 con 0x7f9960063b70 2022-07-05T11:46:08.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.754+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996017b1e0 con 0x7f9960063b70 2022-07-05T11:46:08.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.755+0000 7f9947fff700 1 -- 172.21.15.90:0/2605084478 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f995400f030 con 0x7f9960063b70 2022-07-05T11:46:08.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.755+0000 7f9947fff700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f994008ba40 0x7f994008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:08.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.756+0000 7f9947fff700 1 -- 172.21.15.90:0/2605084478 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8713+0+0 (secure 0 0 0) 0x7f99540b05a0 con 0x7f9960063b70 2022-07-05T11:46:08.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.756+0000 7f995ffff700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f994008ba40 0x7f994008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:08.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.756+0000 7f995ffff700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f994008ba40 0x7f994008df00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9950006df0 tx=0x7f9950017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:08.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.759+0000 7f9947fff700 1 -- 172.21.15.90:0/2605084478 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f9954081200 con 0x7f9960063b70 2022-07-05T11:46:08.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.968+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9960046db0 con 0x7f9960063b70 2022-07-05T11:46:08.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.973+0000 7f9947fff700 1 -- 172.21.15.90:0/2605084478 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9954084820 con 0x7f9960063b70 2022-07-05T11:46:08.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f994008ba40 msgr2=0x7f994008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:08.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f994008ba40 0x7f994008df00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9950006df0 tx=0x7f9950017000).stop 2022-07-05T11:46:08.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9960063b70 msgr2=0x7f99600c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:08.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9960063b70 0x7f99600c7b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f995400b460 tx=0x7f9954006f20).stop 2022-07-05T11:46:08.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 shutdown_connections 2022-07-05T11:46:08.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f994008ba40 0x7f994008df00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996017dcd0 0x7f996015f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99600636f0 0x7f996017b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 --2- 172.21.15.90:0/2605084478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9960063b70 0x7f99600c7b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:08.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 >> 172.21.15.90:0/2605084478 conn(0x7f99600f5470 msgr2=0x7f99600f3540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:08.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 shutdown_connections 2022-07-05T11:46:08.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:08.975+0000 7f9965510700 1 -- 172.21.15.90:0/2605084478 wait complete. 2022-07-05T11:46:08.989 INFO:teuthology.orchestra.run.smithi090.stderr:added data pool 5 to fsmap 2022-07-05T11:46:08.991 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:09.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.108+0000 7fb0c19c3700 1 Processor -- start 2022-07-05T11:46:09.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.108+0000 7fb0c19c3700 1 -- start start 2022-07-05T11:46:09.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0c19c3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb0bc175f60 0x7fb0bc176340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0c19c3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb0bc180330 0x7fb0bc17e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0c19c3700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0bc17dfd0 con 0x7fb0bc17e950 2022-07-05T11:46:09.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0c19c3700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc067690 con 0x7fb0bc180330 2022-07-05T11:46:09.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0c19c3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc067970 con 0x7fb0bc175f60 2022-07-05T11:46:09.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0ba7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb0bc180330 0x7fb0bc17e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0bb7fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb0bc17e950 0x7fb0bc0c3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49340/0 (socket says 172.21.15.90:49340) 2022-07-05T11:46:09.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0bb7fe700 1 -- 172.21.15.90:0/2228018373 learned_addr learned my addr 172.21.15.90:0/2228018373 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:09.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0baffd700 1 --2- 172.21.15.90:0/2228018373 >> v2:172.21.15.149:3300/0 conn(0x7fb0bc175f60 0x7fb0bc176340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0ba7fc700 1 -- 172.21.15.90:0/2228018373 >> v2:172.21.15.149:3300/0 conn(0x7fb0bc175f60 msgr2=0x7fb0bc176340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:09.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0ba7fc700 1 --2- 172.21.15.90:0/2228018373 >> v2:172.21.15.149:3300/0 conn(0x7fb0bc175f60 0x7fb0bc176340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0ba7fc700 1 -- 172.21.15.90:0/2228018373 >> v1:172.21.15.90:6789/0 conn(0x7fb0bc17e950 legacy=0x7fb0bc0c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0b9ffb700 1 -- 172.21.15.90:0/2228018373 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867024851 0 0) 0x7fb0bc17dfd0 con 0x7fb0bc17e950 2022-07-05T11:46:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0ba7fc700 1 -- 172.21.15.90:0/2228018373 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc17d6a0 con 0x7fb0bc180330 2022-07-05T11:46:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0ba7fc700 1 --2- 172.21.15.90:0/2228018373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc180330 0x7fb0bc17e460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb0bc060280 tx=0x7fb0a4009060).ready entity=mon.0 client_cookie=fd78dc491dad1fe2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0b9ffb700 1 -- 172.21.15.90:0/2228018373 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400b580 con 0x7fb0bc180330 2022-07-05T11:46:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0b9ffb700 1 -- 172.21.15.90:0/2228018373 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a400b6e0 con 0x7fb0bc180330 2022-07-05T11:46:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.110+0000 7fb0b9ffb700 1 -- 172.21.15.90:0/2228018373 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400ba60 con 0x7fb0bc180330 2022-07-05T11:46:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 -- 172.21.15.90:0/2228018373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc180330 msgr2=0x7fb0bc17e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/2228018373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc180330 0x7fb0bc17e460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb0bc060280 tx=0x7fb0a4009060).stop 2022-07-05T11:46:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 -- 172.21.15.90:0/2228018373 shutdown_connections 2022-07-05T11:46:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/2228018373 >> v2:172.21.15.149:3300/0 conn(0x7fb0bc175f60 0x7fb0bc176340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/2228018373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc180330 0x7fb0bc17e460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 -- 172.21.15.90:0/2228018373 >> 172.21.15.90:0/2228018373 conn(0x7fb0bc0ef400 msgr2=0x7fb0bc0ef810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:09.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 -- 172.21.15.90:0/2228018373 shutdown_connections 2022-07-05T11:46:09.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.111+0000 7fb0c19c3700 1 -- 172.21.15.90:0/2228018373 wait complete. 2022-07-05T11:46:09.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.112+0000 7fb0c19c3700 1 Processor -- start 2022-07-05T11:46:09.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.112+0000 7fb0c19c3700 1 -- start start 2022-07-05T11:46:09.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0c19c3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc175f60 0x7fb0bc14d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0c19c3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc17e950 0x7fb0bc14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0c19c3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0bc180330 0x7fb0bc18da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0c19c3700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc18f7e0 con 0x7fb0bc175f60 2022-07-05T11:46:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0c19c3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc14e0f0 con 0x7fb0bc180330 2022-07-05T11:46:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0c19c3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc18e880 con 0x7fb0bc17e950 2022-07-05T11:46:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0baffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc175f60 0x7fb0bc14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0baffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc175f60 0x7fb0bc14d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56402/0 (socket says 172.21.15.90:56402) 2022-07-05T11:46:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.113+0000 7fb0baffd700 1 -- 172.21.15.90:0/18563310 learned_addr learned my addr 172.21.15.90:0/18563310 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:09.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0bb7fe700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0bc180330 0x7fb0bc18da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0ba7fc700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc17e950 0x7fb0bc14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0baffd700 1 -- 172.21.15.90:0/18563310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc17e950 msgr2=0x7fb0bc14dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0baffd700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc17e950 0x7fb0bc14dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0baffd700 1 -- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0bc180330 msgr2=0x7fb0bc18da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0baffd700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0bc180330 0x7fb0bc18da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0baffd700 1 -- 172.21.15.90:0/18563310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40092a0 con 0x7fb0bc175f60 2022-07-05T11:46:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0ba7fc700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc17e950 0x7fb0bc14dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0bb7fe700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0bc180330 0x7fb0bc18da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0baffd700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc175f60 0x7fb0bc14d710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb0ac007f60 tx=0x7fb0ac009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0b2ffd700 1 -- 172.21.15.90:0/18563310 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00ecf0 con 0x7fb0bc175f60 2022-07-05T11:46:09.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0b2ffd700 1 -- 172.21.15.90:0/18563310 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac00ee50 con 0x7fb0bc175f60 2022-07-05T11:46:09.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0b2ffd700 1 -- 172.21.15.90:0/18563310 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac014610 con 0x7fb0bc175f60 2022-07-05T11:46:09.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc18eb60 con 0x7fb0bc175f60 2022-07-05T11:46:09.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.114+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc18f120 con 0x7fb0bc175f60 2022-07-05T11:46:09.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.115+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0bc06be40 con 0x7fb0bc175f60 2022-07-05T11:46:09.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.116+0000 7fb0b2ffd700 1 -- 172.21.15.90:0/18563310 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb0ac01b030 con 0x7fb0bc175f60 2022-07-05T11:46:09.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.116+0000 7fb0b2ffd700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb0a008ba40 0x7fb0a008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.117+0000 7fb0b2ffd700 1 -- 172.21.15.90:0/18563310 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb0ac0b0bc0 con 0x7fb0bc175f60 2022-07-05T11:46:09.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.117+0000 7fb0ba7fc700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb0a008ba40 0x7fb0a008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.117+0000 7fb0ba7fc700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb0a008ba40 0x7fb0a008df00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb0a4009fd0 tx=0x7fb0a4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.120+0000 7fb0b2ffd700 1 -- 172.21.15.90:0/18563310 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fb0ac085310 con 0x7fb0bc175f60 2022-07-05T11:46:09.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.320+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0bc17b490 con 0x7fb0bc175f60 2022-07-05T11:46:09.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.321+0000 7fb0b2ffd700 1 -- 172.21.15.90:0/18563310 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+10551 (secure 0 0 0) 0x7fb0ac019030 con 0x7fb0bc175f60 2022-07-05T11:46:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:09.324 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4340,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4341,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4346,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:08.970372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-07-05T11:46:09.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb0a008ba40 msgr2=0x7fb0a008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb0a008ba40 0x7fb0a008df00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb0a4009fd0 tx=0x7fb0a4017000).stop 2022-07-05T11:46:09.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc175f60 msgr2=0x7fb0bc14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc175f60 0x7fb0bc14d710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb0ac007f60 tx=0x7fb0ac009860).stop 2022-07-05T11:46:09.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 shutdown_connections 2022-07-05T11:46:09.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb0a008ba40 0x7fb0a008df00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0bc180330 0x7fb0bc18da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0bc175f60 0x7fb0bc14d710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 --2- 172.21.15.90:0/18563310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc17e950 0x7fb0bc14dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 >> 172.21.15.90:0/18563310 conn(0x7fb0bc0ef400 msgr2=0x7fb0bc069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:09.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 shutdown_connections 2022-07-05T11:46:09.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.322+0000 7fb0c19c3700 1 -- 172.21.15.90:0/18563310 wait complete. 2022-07-05T11:46:09.331 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2022-07-05T11:46:09.337 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:09.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.453+0000 7f3cb3649700 1 Processor -- start 2022-07-05T11:46:09.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.453+0000 7f3cb3649700 1 -- start start 2022-07-05T11:46:09.458 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb3649700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cac17fa70 0x7f3cac17f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.458 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb3649700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3cac1786b0 0x7f3cac0ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.458 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb3649700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0854c0 con 0x7f3cac1782d0 2022-07-05T11:46:09.459 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb3649700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac178b40 con 0x7f3cac17fa70 2022-07-05T11:46:09.459 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb3649700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac086060 con 0x7f3cac1786b0 2022-07-05T11:46:09.459 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb13e5700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3cac1782d0 0x7f3cac085950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49350/0 (socket says 172.21.15.90:49350) 2022-07-05T11:46:09.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb0be4700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cac17fa70 0x7f3cac17f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb13e5700 1 -- 172.21.15.90:0/3227118135 learned_addr learned my addr 172.21.15.90:0/3227118135 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:09.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb1be6700 1 --2- 172.21.15.90:0/3227118135 >> v2:172.21.15.149:3300/0 conn(0x7f3cac1786b0 0x7f3cac0ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb0be4700 1 -- 172.21.15.90:0/3227118135 >> v2:172.21.15.149:3300/0 conn(0x7f3cac1786b0 msgr2=0x7f3cac0ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:09.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb0be4700 1 --2- 172.21.15.90:0/3227118135 >> v2:172.21.15.149:3300/0 conn(0x7f3cac1786b0 0x7f3cac0ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb0be4700 1 -- 172.21.15.90:0/3227118135 >> v1:172.21.15.90:6789/0 conn(0x7f3cac1782d0 legacy=0x7f3cac085950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cabfff700 1 -- 172.21.15.90:0/3227118135 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477846299 0 0) 0x7f3cac0854c0 con 0x7f3cac1782d0 2022-07-05T11:46:09.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb0be4700 1 -- 172.21.15.90:0/3227118135 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0845d0 con 0x7f3cac17fa70 2022-07-05T11:46:09.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cb0be4700 1 --2- 172.21.15.90:0/3227118135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac17f0e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3cac0c4bb0 tx=0x7f3ca0009060).ready entity=mon.0 client_cookie=90db8a96b7637322 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cabfff700 1 -- 172.21.15.90:0/3227118135 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000b580 con 0x7f3cac17fa70 2022-07-05T11:46:09.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cabfff700 1 -- 172.21.15.90:0/3227118135 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca000b6e0 con 0x7f3cac17fa70 2022-07-05T11:46:09.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.455+0000 7f3cabfff700 1 -- 172.21.15.90:0/3227118135 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000ba60 con 0x7f3cac17fa70 2022-07-05T11:46:09.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 -- 172.21.15.90:0/3227118135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 msgr2=0x7f3cac17f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 --2- 172.21.15.90:0/3227118135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac17f0e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3cac0c4bb0 tx=0x7f3ca0009060).stop 2022-07-05T11:46:09.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 -- 172.21.15.90:0/3227118135 shutdown_connections 2022-07-05T11:46:09.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 --2- 172.21.15.90:0/3227118135 >> v2:172.21.15.149:3300/0 conn(0x7f3cac1786b0 0x7f3cac0ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 --2- 172.21.15.90:0/3227118135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac17f0e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 -- 172.21.15.90:0/3227118135 >> 172.21.15.90:0/3227118135 conn(0x7f3cac0f2960 msgr2=0x7f3cac0f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:09.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 -- 172.21.15.90:0/3227118135 shutdown_connections 2022-07-05T11:46:09.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.456+0000 7f3cb3649700 1 -- 172.21.15.90:0/3227118135 wait complete. 2022-07-05T11:46:09.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.457+0000 7f3cb3649700 1 Processor -- start 2022-07-05T11:46:09.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.457+0000 7f3cb3649700 1 -- start start 2022-07-05T11:46:09.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.458+0000 7f3cb3649700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cac1782d0 0x7f3cac083800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.458+0000 7f3cb3649700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cac1786b0 0x7f3cac16fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.458+0000 7f3cb3649700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.458+0000 7f3cb3649700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac192180 con 0x7f3cac17fa70 2022-07-05T11:46:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.458+0000 7f3cb3649700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1929e0 con 0x7f3cac1786b0 2022-07-05T11:46:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.458+0000 7f3cb3649700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0c7150 con 0x7f3cac1782d0 2022-07-05T11:46:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.458+0000 7f3cb1be6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac0c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56418/0 (socket says 172.21.15.90:56418) 2022-07-05T11:46:09.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 -- 172.21.15.90:0/1865889451 learned_addr learned my addr 172.21.15.90:0/1865889451 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:09.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb13e5700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cac1782d0 0x7f3cac083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb0be4700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cac1786b0 0x7f3cac16fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 -- 172.21.15.90:0/1865889451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cac1782d0 msgr2=0x7f3cac083800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cac1782d0 0x7f3cac083800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 -- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cac1786b0 msgr2=0x7f3cac16fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cac1786b0 0x7f3cac16fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 -- 172.21.15.90:0/1865889451 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00092a0 con 0x7f3cac17fa70 2022-07-05T11:46:09.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb1be6700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac0c66c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3ca400d890 tx=0x7f3ca4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3ca97fa700 1 -- 172.21.15.90:0/1865889451 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011590 con 0x7f3cac17fa70 2022-07-05T11:46:09.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3ca97fa700 1 -- 172.21.15.90:0/1865889451 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca40116f0 con 0x7f3cac17fa70 2022-07-05T11:46:09.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3ca97fa700 1 -- 172.21.15.90:0/1865889451 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011a70 con 0x7f3cac17fa70 2022-07-05T11:46:09.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac0c7430 con 0x7f3cac17fa70 2022-07-05T11:46:09.478 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.459+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac192670 con 0x7f3cac17fa70 2022-07-05T11:46:09.478 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.460+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac192b70 con 0x7f3cac17fa70 2022-07-05T11:46:09.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.461+0000 7f3ca97fa700 1 -- 172.21.15.90:0/1865889451 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3ca401c460 con 0x7f3cac17fa70 2022-07-05T11:46:09.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.461+0000 7f3ca97fa700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3c8c08ba10 0x7f3c8c08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.461+0000 7f3ca97fa700 1 -- 172.21.15.90:0/1865889451 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3ca40b0810 con 0x7f3cac17fa70 2022-07-05T11:46:09.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.462+0000 7f3cb13e5700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3c8c08ba10 0x7f3c8c08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.462+0000 7f3cb13e5700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3c8c08ba10 0x7f3c8c08ded0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3c9c001560 tx=0x7f3c9c007f30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.465+0000 7f3ca97fa700 1 -- 172.21.15.90:0/1865889451 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3ca40814d0 con 0x7f3cac17fa70 2022-07-05T11:46:09.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.628+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cac06be40 con 0x7f3cac17fa70 2022-07-05T11:46:09.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.629+0000 7f3ca97fa700 1 -- 172.21.15.90:0/1865889451 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23522 (secure 0 0 0) 0x7f3ca4084af0 con 0x7f3cac17fa70 2022-07-05T11:46:09.633 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:09.633 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":30,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:08.970106+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:09.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3c8c08ba10 msgr2=0x7f3c8c08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3c8c08ba10 0x7f3c8c08ded0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3c9c001560 tx=0x7f3c9c007f30).stop 2022-07-05T11:46:09.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 msgr2=0x7f3cac0c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac0c66c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3ca400d890 tx=0x7f3ca4008040).stop 2022-07-05T11:46:09.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 shutdown_connections 2022-07-05T11:46:09.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3c8c08ba10 0x7f3c8c08ded0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cac17fa70 0x7f3cac0c66c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cac1782d0 0x7f3cac083800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 --2- 172.21.15.90:0/1865889451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cac1786b0 0x7f3cac16fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 >> 172.21.15.90:0/1865889451 conn(0x7f3cac0f2960 msgr2=0x7f3cac0c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:09.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 shutdown_connections 2022-07-05T11:46:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.631+0000 7f3cb3649700 1 -- 172.21.15.90:0/1865889451 wait complete. 2022-07-05T11:46:09.652 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:09.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.762+0000 7fa8d2907700 1 Processor -- start 2022-07-05T11:46:09.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.762+0000 7fa8d2907700 1 -- start start 2022-07-05T11:46:09.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.763+0000 7fa8d2907700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8cc17da60 0x7fa8cc17de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.763+0000 7fa8d2907700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0c9090 con 0x7fa8cc0c7d00 2022-07-05T11:46:09.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.763+0000 7fa8d2907700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0c81a0 con 0x7fa8cc0c9520 2022-07-05T11:46:09.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.763+0000 7fa8d2907700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c8480 con 0x7fa8cc17da60 2022-07-05T11:46:09.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.763+0000 7fa8cb7fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa8cc0c7d00 0x7fa8cc17eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49366/0 (socket says 172.21.15.90:49366) 2022-07-05T11:46:09.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.763+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/2438683493 learned_addr learned my addr 172.21.15.90:0/2438683493 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:09.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cbfff700 1 --2- 172.21.15.90:0/2438683493 >> v2:172.21.15.110:3300/0 conn(0x7fa8cc17da60 0x7fa8cc17de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899827735 0 0) 0x7fa8cc0c9090 con 0x7fa8cc0c7d00 2022-07-05T11:46:09.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b80033f0 con 0x7fa8cc0c7d00 2022-07-05T11:46:09.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3441734872 0 0) 0x7fa8b80033f0 con 0x7fa8cc0c7d00 2022-07-05T11:46:09.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 >> v2:172.21.15.110:3300/0 conn(0x7fa8cc17da60 msgr2=0x7fa8cc17de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:09.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 --2- 172.21.15.90:0/2438683493 >> v2:172.21.15.110:3300/0 conn(0x7fa8cc17da60 0x7fa8cc17de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 >> v1:172.21.15.149:6789/0 conn(0x7fa8cc0c9520 legacy=0x7fa8cc0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0c8760 con 0x7fa8cc0c7d00 2022-07-05T11:46:09.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fa8c0001470 con 0x7fa8cc0c7d00 2022-07-05T11:46:09.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 >> v1:172.21.15.90:6789/0 conn(0x7fa8cc0c7d00 legacy=0x7fa8cc17eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b8003930 0x7fa8b8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b8004690 0x7fa8b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8005000 0x7fa8b800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c8480 con 0x7fa8b8004690 2022-07-05T11:46:09.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b800bf30 con 0x7fa8b8005000 2022-07-05T11:46:09.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b800c0f0 con 0x7fa8b8003930 2022-07-05T11:46:09.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cb7fe700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b8004690 0x7fa8b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cbfff700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b8003930 0x7fa8b8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8d0ea4700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8005000 0x7fa8b800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/2438683493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b8003930 msgr2=0x7fa8b8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:09.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cb7fe700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b8003930 0x7fa8b8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/2438683493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8005000 msgr2=0x7fa8b800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:09.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cb7fe700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8005000 0x7fa8b800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8d0ea4700 1 -- 172.21.15.90:0/2438683493 reap_dead start 2022-07-05T11:46:09.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/2438683493 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80033f0 con 0x7fa8b8004690 2022-07-05T11:46:09.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.764+0000 7fa8cb7fe700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b8004690 0x7fa8b8004b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa8c000c190 tx=0x7fa8c0001e50).ready entity=mon.0 client_cookie=2ba0e25870556722 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0007a20 con 0x7fa8b8004690 2022-07-05T11:46:09.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c000cac0 con 0x7fa8b8004690 2022-07-05T11:46:09.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8caffd700 1 -- 172.21.15.90:0/2438683493 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000ce60 con 0x7fa8b8004690 2022-07-05T11:46:09.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8d2907700 1 -- 172.21.15.90:0/2438683493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b8004690 msgr2=0x7fa8b8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8d2907700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b8004690 0x7fa8b8004b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa8c000c190 tx=0x7fa8c0001e50).stop 2022-07-05T11:46:09.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8d2907700 1 -- 172.21.15.90:0/2438683493 shutdown_connections 2022-07-05T11:46:09.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8d2907700 1 --2- 172.21.15.90:0/2438683493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b8004690 0x7fa8b8004b10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8d2907700 1 -- 172.21.15.90:0/2438683493 >> 172.21.15.90:0/2438683493 conn(0x7fa8cc0f4b70 msgr2=0x7fa8cc0f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:09.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8d2907700 1 -- 172.21.15.90:0/2438683493 shutdown_connections 2022-07-05T11:46:09.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.765+0000 7fa8d2907700 1 -- 172.21.15.90:0/2438683493 wait complete. 2022-07-05T11:46:09.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.766+0000 7fa8d2907700 1 Processor -- start 2022-07-05T11:46:09.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.767+0000 7fa8d2907700 1 -- start start 2022-07-05T11:46:09.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8004690 0x7fa8cc15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc083570 0x7fa8cc0839f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8cc1918c0 0x7fa8cc191d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc161470 con 0x7fa8cc083570 2022-07-05T11:46:09.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c6b20 con 0x7fa8b8004690 2022-07-05T11:46:09.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc161900 con 0x7fa8cc1918c0 2022-07-05T11:46:09.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc083570 0x7fa8cc0839f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc083570 0x7fa8cc0839f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56438/0 (socket says 172.21.15.90:56438) 2022-07-05T11:46:09.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/3495737244 learned_addr learned my addr 172.21.15.90:0/3495737244 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:09.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cbfff700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8004690 0x7fa8cc15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d0ea4700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8cc1918c0 0x7fa8cc191d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/3495737244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8cc1918c0 msgr2=0x7fa8cc191d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8cc1918c0 0x7fa8cc191d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8004690 msgr2=0x7fa8cc15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8004690 0x7fa8cc15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 -- 172.21.15.90:0/3495737244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc160580 con 0x7fa8cc083570 2022-07-05T11:46:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8cb7fe700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc083570 0x7fa8cc0839f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa8b800bf00 tx=0x7fa8c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8b3fff700 1 -- 172.21.15.90:0/3495737244 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0007640 con 0x7fa8cc083570 2022-07-05T11:46:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8b3fff700 1 -- 172.21.15.90:0/3495737244 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c00046b0 con 0x7fa8cc083570 2022-07-05T11:46:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc160860 con 0x7fa8cc083570 2022-07-05T11:46:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8b3fff700 1 -- 172.21.15.90:0/3495737244 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0004a70 con 0x7fa8cc083570 2022-07-05T11:46:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.768+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc160e20 con 0x7fa8cc083570 2022-07-05T11:46:09.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.769+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc06be40 con 0x7fa8cc083570 2022-07-05T11:46:09.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.770+0000 7fa8b3fff700 1 -- 172.21.15.90:0/3495737244 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fa8c0027070 con 0x7fa8cc083570 2022-07-05T11:46:09.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.771+0000 7fa8b3fff700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa8ac08ba10 0x7fa8ac08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:09.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.771+0000 7fa8b3fff700 1 -- 172.21.15.90:0/3495737244 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa8c00b13c0 con 0x7fa8cc083570 2022-07-05T11:46:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.771+0000 7fa8cbfff700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa8ac08ba10 0x7fa8ac08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.771+0000 7fa8cbfff700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa8ac08ba10 0x7fa8ac08ded0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa8bc006d80 tx=0x7fa8bc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:09.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.775+0000 7fa8b3fff700 1 -- 172.21.15.90:0/3495737244 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fa8c0082000 con 0x7fa8cc083570 2022-07-05T11:46:09.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.935+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8cc0c8a40 con 0x7fa8cc083570 2022-07-05T11:46:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.936+0000 7fa8b3fff700 1 -- 172.21.15.90:0/3495737244 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23522 (secure 0 0 0) 0x7fa8c0025030 con 0x7fa8cc083570 2022-07-05T11:46:09.940 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:09.941 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":30,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:08.970106+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa8ac08ba10 msgr2=0x7fa8ac08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa8ac08ba10 0x7fa8ac08ded0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa8bc006d80 tx=0x7fa8bc008040).stop 2022-07-05T11:46:09.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc083570 msgr2=0x7fa8cc0839f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:09.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc083570 0x7fa8cc0839f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa8b800bf00 tx=0x7fa8c0015000).stop 2022-07-05T11:46:09.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 shutdown_connections 2022-07-05T11:46:09.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa8ac08ba10 0x7fa8ac08ded0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8cc1918c0 0x7fa8cc191d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8b8004690 0x7fa8cc15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 --2- 172.21.15.90:0/3495737244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc083570 0x7fa8cc0839f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:09.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 >> 172.21.15.90:0/3495737244 conn(0x7fa8cc0f4b70 msgr2=0x7fa8cc1784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 shutdown_connections 2022-07-05T11:46:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:09.938+0000 7fa8d2907700 1 -- 172.21.15.90:0/3495737244 wait complete. 2022-07-05T11:46:09.976 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:10.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.086+0000 7fc9bb59e700 1 Processor -- start 2022-07-05T11:46:10.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.086+0000 7fc9bb59e700 1 -- start start 2022-07-05T11:46:10.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.087+0000 7fc9bb59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc0ee6c0 con 0x7fc9bc0ee270 2022-07-05T11:46:10.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.087+0000 7fc9bb59e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc083710 con 0x7fc9bc17b750 2022-07-05T11:46:10.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.087+0000 7fc9bb59e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc0839f0 con 0x7fc9bc17bb30 2022-07-05T11:46:10.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.087+0000 7fc9bad9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc9bc0ee270 0x7fc9bc084ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49386/0 (socket says 172.21.15.90:49386) 2022-07-05T11:46:10.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.087+0000 7fc9bad9d700 1 -- 172.21.15.90:0/3889397819 learned_addr learned my addr 172.21.15.90:0/3889397819 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:10.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.087+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800494173 0 0) 0x7fc9bc0ee6c0 con 0x7fc9bc0ee270 2022-07-05T11:46:10.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.087+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc99c0033f0 con 0x7fc9bc0ee270 2022-07-05T11:46:10.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2688954469 0 0) 0x7fc99c0033f0 con 0x7fc9bc0ee270 2022-07-05T11:46:10.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 >> v1:172.21.15.149:6789/0 conn(0x7fc9bc17bb30 legacy=0x7fc9bc0847b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 >> v1:172.21.15.110:6789/0 conn(0x7fc9bc17b750 legacy=0x7fc9bc0edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc083cd0 con 0x7fc9bc0ee270 2022-07-05T11:46:10.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fc9b40017f0 con 0x7fc9bc0ee270 2022-07-05T11:46:10.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 >> v1:172.21.15.90:6789/0 conn(0x7fc9bc0ee270 legacy=0x7fc9bc084ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c003910 0x7fc99c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:10.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c004690 0x7fc99c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:10.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc99c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:10.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c00c120 con 0x7fc99c005200 2022-07-05T11:46:10.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c00c290 con 0x7fc99c004690 2022-07-05T11:46:10.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c00c450 con 0x7fc99c003910 2022-07-05T11:46:10.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc99c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:10.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9ba59c700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c003910 0x7fc99c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:10.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b3fff700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c004690 0x7fc99c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:10.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 -- 172.21.15.90:0/3889397819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c003910 msgr2=0x7fc99c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:10.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c003910 0x7fc99c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:10.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 -- 172.21.15.90:0/3889397819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c004690 msgr2=0x7fc99c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c004690 0x7fc99c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 -- 172.21.15.90:0/3889397819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0033f0 con 0x7fc99c005200 2022-07-05T11:46:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 -- 172.21.15.90:0/3889397819 reap_dead start 2022-07-05T11:46:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9bad9d700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc99c00b8e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fc9b400c5c0 tx=0x7fc9b4007f20).ready entity=mon.0 client_cookie=d6cfc1c2e8383833 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400cdc0 con 0x7fc99c005200 2022-07-05T11:46:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4005b20 con 0x7fc99c005200 2022-07-05T11:46:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.088+0000 7fc9b9d9b700 1 -- 172.21.15.90:0/3889397819 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40070d0 con 0x7fc99c005200 2022-07-05T11:46:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.089+0000 7fc9bb59e700 1 -- 172.21.15.90:0/3889397819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 msgr2=0x7fc99c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.089+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc99c00b8e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fc9b400c5c0 tx=0x7fc9b4007f20).stop 2022-07-05T11:46:10.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.089+0000 7fc9bb59e700 1 -- 172.21.15.90:0/3889397819 shutdown_connections 2022-07-05T11:46:10.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.089+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/3889397819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc99c00b8e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:10.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.089+0000 7fc9bb59e700 1 -- 172.21.15.90:0/3889397819 >> 172.21.15.90:0/3889397819 conn(0x7fc9bc0f27c0 msgr2=0x7fc9bc0f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:10.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.089+0000 7fc9bb59e700 1 -- 172.21.15.90:0/3889397819 shutdown_connections 2022-07-05T11:46:10.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.089+0000 7fc9bb59e700 1 -- 172.21.15.90:0/3889397819 wait complete. 2022-07-05T11:46:10.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.090+0000 7fc9bb59e700 1 Processor -- start 2022-07-05T11:46:10.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.090+0000 7fc9bb59e700 1 -- start start 2022-07-05T11:46:10.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9bb59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc9bc1726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:10.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9bb59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc190ff0 0x7fc9bc157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:10.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9bb59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9bc157f90 0x7fc9bc069940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:10.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9bb59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc190b60 con 0x7fc99c005200 2022-07-05T11:46:10.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9bb59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc18fc70 con 0x7fc9bc157f90 2022-07-05T11:46:10.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9bb59e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc18ff50 con 0x7fc9bc190ff0 2022-07-05T11:46:10.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9ba59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc9bc1726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:10.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9ba59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc9bc1726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56458/0 (socket says 172.21.15.90:56458) 2022-07-05T11:46:10.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9ba59c700 1 -- 172.21.15.90:0/392610697 learned_addr learned my addr 172.21.15.90:0/392610697 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:10.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.091+0000 7fc9bad9d700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9bc157f90 0x7fc9bc069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:10.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9ba59c700 1 -- 172.21.15.90:0/392610697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc190ff0 msgr2=0x7fc9bc157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9ba59c700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc190ff0 0x7fc9bc157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:10.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9ba59c700 1 -- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9bc157f90 msgr2=0x7fc9bc069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9ba59c700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9bc157f90 0x7fc9bc069940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:10.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9ba59c700 1 -- 172.21.15.90:0/392610697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc190230 con 0x7fc99c005200 2022-07-05T11:46:10.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9ba59c700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc9bc1726a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc9ac0011a0 tx=0x7fc9ac007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:10.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9b27fc700 1 -- 172.21.15.90:0/392610697 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00f8d0 con 0x7fc99c005200 2022-07-05T11:46:10.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9b27fc700 1 -- 172.21.15.90:0/392610697 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00fa30 con 0x7fc99c005200 2022-07-05T11:46:10.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc190510 con 0x7fc99c005200 2022-07-05T11:46:10.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9b27fc700 1 -- 172.21.15.90:0/392610697 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00fdd0 con 0x7fc99c005200 2022-07-05T11:46:10.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.092+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc18f860 con 0x7fc99c005200 2022-07-05T11:46:10.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.093+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc1909b0 con 0x7fc99c005200 2022-07-05T11:46:10.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.094+0000 7fc9b27fc700 1 -- 172.21.15.90:0/392610697 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc9ac01b030 con 0x7fc99c005200 2022-07-05T11:46:10.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.094+0000 7fc9b27fc700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9a008ba40 0x7fc9a008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:10.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.094+0000 7fc9b27fc700 1 -- 172.21.15.90:0/392610697 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc9ac0b0760 con 0x7fc99c005200 2022-07-05T11:46:10.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.094+0000 7fc9b3fff700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9a008ba40 0x7fc9a008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:10.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.095+0000 7fc9b3fff700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9a008ba40 0x7fc9a008df00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc9a4007cc0 tx=0x7fc9a4007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:10.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.098+0000 7fc9b27fc700 1 -- 172.21.15.90:0/392610697 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fc9ac081420 con 0x7fc99c005200 2022-07-05T11:46:10.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.300+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9bc190e40 con 0x7fc99c005200 2022-07-05T11:46:10.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.301+0000 7fc9b27fc700 1 -- 172.21.15.90:0/392610697 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+10551 (secure 0 0 0) 0x7fc9ac019030 con 0x7fc99c005200 2022-07-05T11:46:10.306 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:10.307 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4340,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4341,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4346,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:08.970372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-07-05T11:46:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9a008ba40 msgr2=0x7fc9a008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9a008ba40 0x7fc9a008df00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc9a4007cc0 tx=0x7fc9a4007bb0).stop 2022-07-05T11:46:10.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 msgr2=0x7fc9bc1726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:10.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc9bc1726a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc9ac0011a0 tx=0x7fc9ac007bb0).stop 2022-07-05T11:46:10.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 shutdown_connections 2022-07-05T11:46:10.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc9a008ba40 0x7fc9a008df00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:10.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9bc157f90 0x7fc9bc069940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:10.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c005200 0x7fc9bc1726a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:10.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 --2- 172.21.15.90:0/392610697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc190ff0 0x7fc9bc157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:10.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 >> 172.21.15.90:0/392610697 conn(0x7fc9bc0f27c0 msgr2=0x7fc9bc085b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:10.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 shutdown_connections 2022-07-05T11:46:10.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:10.302+0000 7fc9bb59e700 1 -- 172.21.15.90:0/392610697 wait complete. 2022-07-05T11:46:10.315 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2022-07-05T11:46:11.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-07-05T11:46:04.574721+0000', 'modified': '2022-07-05T11:46:08.970372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4371}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4371': {'gid': 4371, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/3440068716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 3440068716}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3440068716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2022-07-05T11:46:11.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-07-05T11:46:11.536 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-07-05T11:46:11.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.661+0000 7f3f8eae3700 1 Processor -- start 2022-07-05T11:46:11.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.661+0000 7f3f8eae3700 1 -- start start 2022-07-05T11:46:11.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.662+0000 7f3f8eae3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3f88174e10 0x7f3f880645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.662+0000 7f3f8eae3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f880ca620 0x7f3f880caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.662+0000 7f3f8eae3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f88064ac0 con 0x7f3f88174a30 2022-07-05T11:46:11.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.662+0000 7f3f8eae3700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f880ca190 con 0x7f3f88174e10 2022-07-05T11:46:11.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.662+0000 7f3f8eae3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f880c92a0 con 0x7f3f880ca620 2022-07-05T11:46:11.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.662+0000 7f3f8d2e0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3f88174e10 0x7f3f880645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8d2e0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3f88174e10 0x7f3f880645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56466/0 (socket says 172.21.15.90:56466) 2022-07-05T11:46:11.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2787114960 learned_addr learned my addr 172.21.15.90:0/2787114960 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:11.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8e2e2700 1 --2- 172.21.15.90:0/2787114960 >> v2:172.21.15.149:3300/0 conn(0x7f3f880ca620 0x7f3f880caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2787114960 >> v2:172.21.15.149:3300/0 conn(0x7f3f880ca620 msgr2=0x7f3f880caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2787114960 >> v2:172.21.15.149:3300/0 conn(0x7f3f880ca620 0x7f3f880caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2787114960 >> v1:172.21.15.149:6789/0 conn(0x7f3f88174a30 legacy=0x7f3f88063ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2787114960 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f880c9580 con 0x7f3f88174e10 2022-07-05T11:46:11.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2787114960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880645d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3f880ece10 tx=0x7f3f7c0090f0).ready entity=mon.0 client_cookie=c9f64f59ebd15dab server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:11.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8cadf700 1 -- 172.21.15.90:0/2787114960 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00b600 con 0x7f3f88174e10 2022-07-05T11:46:11.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8cadf700 1 -- 172.21.15.90:0/2787114960 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c00b760 con 0x7f3f88174e10 2022-07-05T11:46:11.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8cadf700 1 -- 172.21.15.90:0/2787114960 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00bae0 con 0x7f3f88174e10 2022-07-05T11:46:11.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2787114960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 msgr2=0x7f3f880645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.663+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2787114960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880645d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3f880ece10 tx=0x7f3f7c0090f0).stop 2022-07-05T11:46:11.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.664+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2787114960 shutdown_connections 2022-07-05T11:46:11.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.664+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2787114960 >> v2:172.21.15.149:3300/0 conn(0x7f3f880ca620 0x7f3f880caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.664+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2787114960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880645d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.664+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2787114960 >> 172.21.15.90:0/2787114960 conn(0x7f3f880f27c0 msgr2=0x7f3f880f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:11.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.664+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2787114960 shutdown_connections 2022-07-05T11:46:11.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.664+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2787114960 wait complete. 2022-07-05T11:46:11.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.665+0000 7f3f8eae3700 1 Processor -- start 2022-07-05T11:46:11.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.665+0000 7f3f8eae3700 1 -- start start 2022-07-05T11:46:11.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8eae3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f880ca620 0x7f3f88155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8eae3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88174a30 0x7f3f88177950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8eae3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880e7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8eae3700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f880e7480 con 0x7f3f88174e10 2022-07-05T11:46:11.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8eae3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88156220 con 0x7f3f880ca620 2022-07-05T11:46:11.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8eae3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88084dc0 con 0x7f3f88174a30 2022-07-05T11:46:11.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880e7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56474/0 (socket says 172.21.15.90:56474) 2022-07-05T11:46:11.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 -- 172.21.15.90:0/2316235449 learned_addr learned my addr 172.21.15.90:0/2316235449 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:11.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88174a30 0x7f3f88177950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f880ca620 0x7f3f88155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 -- 172.21.15.90:0/2316235449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88174a30 msgr2=0x7f3f88177950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88174a30 0x7f3f88177950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 -- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f880ca620 msgr2=0x7f3f88155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f880ca620 0x7f3f88155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8e2e2700 1 -- 172.21.15.90:0/2316235449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c009370 con 0x7f3f88174e10 2022-07-05T11:46:11.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.666+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f880ca620 0x7f3f88155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:11.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.667+0000 7f3f8e2e2700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880e7910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3f8000d890 tx=0x7f3f80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:11.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.667+0000 7f3f85ffb700 1 -- 172.21.15.90:0/2316235449 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800125f0 con 0x7f3f88174e10 2022-07-05T11:46:11.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.667+0000 7f3f85ffb700 1 -- 172.21.15.90:0/2316235449 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f80012750 con 0x7f3f88174e10 2022-07-05T11:46:11.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.667+0000 7f3f85ffb700 1 -- 172.21.15.90:0/2316235449 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80012ad0 con 0x7f3f88174e10 2022-07-05T11:46:11.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.667+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f88084ae0 con 0x7f3f88174e10 2022-07-05T11:46:11.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.667+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f880e6e30 con 0x7f3f88174e10 2022-07-05T11:46:11.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.668+0000 7f3f85ffb700 1 -- 172.21.15.90:0/2316235449 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3f80013480 con 0x7f3f88174e10 2022-07-05T11:46:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.669+0000 7f3f85ffb700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3f6808ba40 0x7f3f6808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.669+0000 7f3f85ffb700 1 -- 172.21.15.90:0/2316235449 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3f800b0b10 con 0x7f3f88174e10 2022-07-05T11:46:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.669+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3f6808ba40 0x7f3f6808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.670+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3f6808ba40 0x7f3f6808df00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3f78007fd0 tx=0x7f3f78009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.671+0000 7f3fa16d1b80 1 Processor -- start 2022-07-05T11:46:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.671+0000 7f3fa16d1b80 1 -- start start 2022-07-05T11:46:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc784e0d50 0x55bc7852ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc78524cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc784aa280 con 0x55bc78524460 2022-07-05T11:46:11.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc78421a50 con 0x55bc78524840 2022-07-05T11:46:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc78436900 con 0x55bc784e0d50 2022-07-05T11:46:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56478/0 (socket says 172.21.15.90:56478) 2022-07-05T11:46:11.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 -- 172.21.15.90:0/3260059550 learned_addr learned my addr 172.21.15.90:0/3260059550 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8e2e2700 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc78524cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc784e0d50 0x55bc7852ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 -- 172.21.15.90:0/3260059550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc784e0d50 msgr2=0x55bc7852ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc784e0d50 0x55bc7852ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 -- 172.21.15.90:0/3260059550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 msgr2=0x55bc78524cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc78524cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 -- 172.21.15.90:0/3260059550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc78268990 con 0x55bc78524460 2022-07-05T11:46:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc784e0d50 0x55bc7852ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e0860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3f7800db00 tx=0x7f3f78012000).ready entity=mon.0 client_cookie=16f30179fc003475 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f66ffd700 1 -- 172.21.15.90:0/3260059550 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78012ab0 con 0x55bc78524460 2022-07-05T11:46:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f66ffd700 1 -- 172.21.15.90:0/3260059550 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78016070 con 0x55bc78524460 2022-07-05T11:46:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.672+0000 7f3f66ffd700 1 -- 172.21.15.90:0/3260059550 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78012c10 con 0x55bc78524460 2022-07-05T11:46:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/3260059550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 msgr2=0x55bc784e0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e0860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3f7800db00 tx=0x7f3f78012000).stop 2022-07-05T11:46:11.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/3260059550 shutdown_connections 2022-07-05T11:46:11.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc78524cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e0860 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/3260059550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc784e0d50 0x55bc7852ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/3260059550 >> 172.21.15.90:0/3260059550 conn(0x55bc7834f170 msgr2=0x55bc784e3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/3260059550 shutdown_connections 2022-07-05T11:46:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.673+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/3260059550 wait complete. 2022-07-05T11:46:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.674+0000 7f3fa16d1b80 1 -- start start 2022-07-05T11:46:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.674+0000 7f3fa16d1b80 1 Processor -- start 2022-07-05T11:46:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78519580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 0x55bc7851f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc7852de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc783fe0d0 con 0x55bc784e0d50 2022-07-05T11:46:11.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7852ed50 con 0x55bc78524840 2022-07-05T11:46:11.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc78563950 con 0x55bc78524460 2022-07-05T11:46:11.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3fa16d1b80 10 client.0 ll_register_callbacks cb 0x55bc784a4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:11.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78519580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78519580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56484/0 (socket says 172.21.15.90:56484) 2022-07-05T11:46:11.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2403277088 learned_addr learned my addr 172.21.15.90:0/2403277088 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:11.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8e2e2700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc7852de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 msgr2=0x55bc7851f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 0x55bc7851f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 0x55bc7851f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2403277088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 msgr2=0x55bc7852de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc7852de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2403277088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f88064ac0 con 0x55bc784e0d50 2022-07-05T11:46:11.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.675+0000 7f3f8e2e2700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc7852de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:11.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78519580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3f7800d600 tx=0x7f3f78016000).ready entity=mon.0 client_cookie=59519b921434106b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:11.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3f5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:11.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2403277088 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800d7b0 con 0x55bc784e0d50 2022-07-05T11:46:11.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc784de640 con 0x55bc784e0d50 2022-07-05T11:46:11.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2403277088 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3f78025070 con 0x55bc784e0d50 2022-07-05T11:46:11.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2403277088 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f7801ee00 con 0x55bc784e0d50 2022-07-05T11:46:11.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 10 client.4512 fetch_fsmap learned FSMap version 7 2022-07-05T11:46:11.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55bc782d7c80 con 0x55bc784e0d50 2022-07-05T11:46:11.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2403277088 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78033020 con 0x55bc784e0d50 2022-07-05T11:46:11.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2403277088 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f3f780285e0 con 0x55bc784e0d50 2022-07-05T11:46:11.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 10 client.4512 fetch_fsmap finished waiting for FSMap version 7 2022-07-05T11:46:11.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 10 client.4512 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:11.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 20 client.4512 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:11.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc78563220 0x55bc784e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 4 client.4512 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:11.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.676+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc7842c7a0 con 0x55bc78563220 2022-07-05T11:46:11.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.677+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc78563220 0x55bc784e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.677+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc78563220 0x55bc784e4ea0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=64a0a5eb4b58e664 server_cookie=bc75711692d6d4b in_seq=0 out_seq=0 2022-07-05T11:46:11.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.677+0000 7f3f5ffff700 10 client.4512 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:11.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2403277088 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55bc7842c7a0 con 0x55bc78563220 2022-07-05T11:46:11.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3f5ffff700 10 client.4512 handle_command_reply: tid=0 2022-07-05T11:46:11.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 client.4512 shutdown 2022-07-05T11:46:11.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 msgr2=0x55bc78519580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78519580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3f7800d600 tx=0x7f3f78016000).stop 2022-07-05T11:46:11.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 shutdown_connections 2022-07-05T11:46:11.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc78563220 0x55bc784e4ea0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc7852de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3f5ffff700 0 client.4512 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:11.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78519580 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2403277088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 0x55bc7851f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 >> 172.21.15.90:0/2403277088 conn(0x55bc7834f170 msgr2=0x55bc784e1810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:11.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 shutdown_connections 2022-07-05T11:46:11.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2403277088 wait complete. 2022-07-05T11:46:11.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.678+0000 7f3fa16d1b80 20 client.4512 trim_cache size 0 max 16384 2022-07-05T11:46:11.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.694+0000 7f3fa16d1b80 1 Processor -- start 2022-07-05T11:46:11.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.694+0000 7f3fa16d1b80 1 -- start start 2022-07-05T11:46:11.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc784e0d50 0x55bc78521a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524840 0x55bc78556c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc78556630 con 0x55bc78524460 2022-07-05T11:46:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc784e0200 con 0x55bc784e0d50 2022-07-05T11:46:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc784e0410 con 0x55bc78524840 2022-07-05T11:46:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8d2e0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8d2e0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56494/0 (socket says 172.21.15.90:56494) 2022-07-05T11:46:11.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2438178330 learned_addr learned my addr 172.21.15.90:0/2438178330 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:11.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2438178330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524840 msgr2=0x55bc78556c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524840 0x55bc78556c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:11.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc784e0d50 0x55bc78521a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2438178330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc784e0d50 msgr2=0x55bc78521a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.695+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc784e0d50 0x55bc78521a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3f8d2e0700 1 -- 172.21.15.90:0/2438178330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc782a5f80 con 0x55bc78524460 2022-07-05T11:46:11.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e3bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f3f88086cf0 tx=0x7f3f7c025280).ready entity=mon.0 client_cookie=77fd79e164a56302 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:11.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3f677fe700 1 -- 172.21.15.90:0/2438178330 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c024070 con 0x55bc78524460 2022-07-05T11:46:11.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3f677fe700 1 -- 172.21.15.90:0/2438178330 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c000c40 con 0x55bc78524460 2022-07-05T11:46:11.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3f677fe700 1 -- 172.21.15.90:0/2438178330 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00b8d0 con 0x55bc78524460 2022-07-05T11:46:11.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2438178330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 msgr2=0x55bc784e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e3bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f3f88086cf0 tx=0x7f3f7c025280).stop 2022-07-05T11:46:11.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2438178330 shutdown_connections 2022-07-05T11:46:11.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524840 0x55bc78556c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:11.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc784e0d50 0x55bc78521a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2438178330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc78524460 0x55bc784e3bb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2438178330 >> 172.21.15.90:0/2438178330 conn(0x55bc7834f170 msgr2=0x55bc785511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:11.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2438178330 shutdown_connections 2022-07-05T11:46:11.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.696+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2438178330 wait complete. 2022-07-05T11:46:11.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.697+0000 7f3fa16d1b80 1 -- start start 2022-07-05T11:46:11.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.697+0000 7f3fa16d1b80 1 Processor -- start 2022-07-05T11:46:11.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78550c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 0x55bc78523a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3fa16d1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc78556a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc784db030 con 0x55bc784e0d50 2022-07-05T11:46:11.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc78523f10 con 0x55bc78524840 2022-07-05T11:46:11.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3fa16d1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc785bc3a0 con 0x55bc78524460 2022-07-05T11:46:11.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3fa16d1b80 10 client.0 ll_register_callbacks cb 0x55bc784a4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:11.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3f8dae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78550c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3f8dae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78550c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56500/0 (socket says 172.21.15.90:56500) 2022-07-05T11:46:11.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2260322805 learned_addr learned my addr 172.21.15.90:0/2260322805 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:11.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2260322805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 msgr2=0x55bc78523a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 0x55bc78523a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:11.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2260322805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 msgr2=0x55bc78556a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:11.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.698+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc78556a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:11.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f8dae1700 1 -- 172.21.15.90:0/2260322805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f880c9580 con 0x55bc784e0d50 2022-07-05T11:46:11.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f8dae1700 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78550c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f3f78012e10 tx=0x7f3f78025000).ready entity=mon.0 client_cookie=dd773852864bf301 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:11.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:11.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2260322805 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800d7b0 con 0x55bc784e0d50 2022-07-05T11:46:11.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f78016070 con 0x55bc784e0d50 2022-07-05T11:46:11.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2260322805 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3f78034080 con 0x55bc784e0d50 2022-07-05T11:46:11.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2260322805 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f7801ea70 con 0x55bc784e0d50 2022-07-05T11:46:11.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 10 client.4518 fetch_fsmap learned FSMap version 7 2022-07-05T11:46:11.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55bc78556ef0 con 0x55bc784e0d50 2022-07-05T11:46:11.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2260322805 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78016070 con 0x55bc784e0d50 2022-07-05T11:46:11.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2260322805 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f3f78012fd0 con 0x55bc784e0d50 2022-07-05T11:46:11.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 10 client.4518 fetch_fsmap finished waiting for FSMap version 7 2022-07-05T11:46:11.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 10 client.4518 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:11.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 20 client.4518 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:11.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc784e9af0 0x55bc784e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:11.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 4 client.4518 mds_command: new command op to 4371 tid=0[{"prefix": "status"}] 2022-07-05T11:46:11.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc78423640 con 0x55bc784e9af0 2022-07-05T11:46:11.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.699+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc784e9af0 0x55bc784e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:11.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3f8d2e0700 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc784e9af0 0x55bc784e9ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4067cc19bb735488 server_cookie=f13d4e6e9adf0107 in_seq=0 out_seq=0 2022-07-05T11:46:11.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3f5ffff700 10 client.4518 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:11.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3f5ffff700 1 -- 172.21.15.90:0/2260322805 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55bc78423640 con 0x55bc784e9af0 2022-07-05T11:46:11.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3f5ffff700 10 client.4518 handle_command_reply: tid=0 2022-07-05T11:46:11.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 client.4518 shutdown 2022-07-05T11:46:11.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 msgr2=0x55bc78550c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78550c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f3f78012e10 tx=0x7f3f78025000).stop 2022-07-05T11:46:11.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 shutdown_connections 2022-07-05T11:46:11.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bc784e9af0 0x55bc784e9ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc78524840 0x55bc78556a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:11.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3f5ffff700 0 client.4518 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:11.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc784e0d50 0x55bc78550c20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 --2- 172.21.15.90:0/2260322805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bc78524460 0x55bc78523a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:11.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 >> 172.21.15.90:0/2260322805 conn(0x55bc7834f170 msgr2=0x55bc785511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:11.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 shutdown_connections 2022-07-05T11:46:11.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 1 -- 172.21.15.90:0/2260322805 wait complete. 2022-07-05T11:46:11.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.700+0000 7f3fa16d1b80 20 client.4518 trim_cache size 0 max 16384 2022-07-05T11:46:11.811 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:11.811 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:11.812 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2022-07-05T11:46:11.812 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4371, 2022-07-05T11:46:11.812 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:11.812 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:11.812 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:11.813 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 7.125127065, 2022-07-05T11:46:11.813 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 7, 2022-07-05T11:46:11.813 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:11.813 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 29, 2022-07-05T11:46:11.814 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 11.389864104000001 2022-07-05T11:46:11.814 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:11.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3f6808ba40 msgr2=0x7f3f6808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3f6808ba40 0x7f3f6808df00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3f78007fd0 tx=0x7f3f78009040).stop 2022-07-05T11:46:11.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 msgr2=0x7f3f880e7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:11.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880e7910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3f8000d890 tx=0x7f3f80008040).stop 2022-07-05T11:46:11.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 shutdown_connections 2022-07-05T11:46:11.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3f6808ba40 0x7f3f6808df00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f88174e10 0x7f3f880e7910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f880ca620 0x7f3f88155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 --2- 172.21.15.90:0/2316235449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88174a30 0x7f3f88177950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:11.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 >> 172.21.15.90:0/2316235449 conn(0x7f3f880f27c0 msgr2=0x7f3f880f2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:11.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 shutdown_connections 2022-07-05T11:46:11.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:11.701+0000 7f3f8eae3700 1 -- 172.21.15.90:0/2316235449 wait complete. 2022-07-05T11:46:11.819 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-07-05T11:46:11.821 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2022-07-05T11:46:11.821 INFO:tasks.cephfs.mount:self.client.name = client.admin 2022-07-05T11:46:11.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2022-07-05T11:46:11.822 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2022-07-05T11:46:11.823 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-07-05T11:46:11.823 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-07-05T11:46:11.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2022-07-05T11:46:11.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:11.826 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2022-07-05T11:46:11.843 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-07-05T11:46:11.844 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-07-05T11:46:11.845 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2022-07-05T11:46:11.845 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2022-07-05T11:46:11.846 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2022-07-05T11:46:11.846 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2022-07-05T11:46:11.847 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-07-05T11:46:11.847 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:11.848 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-07-05T11:46:11.848 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:11.848 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-07-05T11:46:11.849 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:11.849 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-07-05T11:46:11.850 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:11.850 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-07-05T11:46:11.851 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42704sec preferred_lft 42704sec 2022-07-05T11:46:11.851 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2022-07-05T11:46:11.852 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2022-07-05T11:46:11.853 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-07-05T11:46:11.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:11.855 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:11.856 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:11.857 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2022-07-05T11:46:11.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2022-07-05T11:46:11.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2022-07-05T11:46:11.859 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-07-05T11:46:11.860 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:11.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:11.996 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-07-05T11:46:12.030 INFO:teuthology.orchestra.run.smithi090.stdout:1 2022-07-05T11:46:12.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:12.032 DEBUG:teuthology.orchestra.run.smithi090:> route 2022-07-05T11:46:12.103 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2022-07-05T11:46:12.104 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-07-05T11:46:12.104 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-07-05T11:46:12.105 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-07-05T11:46:12.105 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-07-05T11:46:12.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:12.106 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:12.107 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:12.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-07-05T11:46:12.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-07-05T11:46:12.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-07-05T11:46:12.109 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:12.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:12.291 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2022-07-05T11:46:12.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:12.308 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2022-07-05T11:46:12.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:12.363 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:12.363 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:12.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-07-05T11:46:12.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2022-07-05T11:46:12.366 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:12.450 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2022-07-05T11:46:12.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:12.451 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:12.451 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:12.452 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2022-07-05T11:46:12.453 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-07-05T11:46:12.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2022-07-05T11:46:12.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2022-07-05T11:46:12.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2022-07-05T11:46:12.456 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:12.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:12.627 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:12.628 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:12.628 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2022-07-05T11:46:12.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2022-07-05T11:46:12.633 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:12.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:12.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.852+0000 7f1bf231d700 1 Processor -- start 2022-07-05T11:46:12.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.852+0000 7f1bf231d700 1 -- start start 2022-07-05T11:46:12.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.853+0000 7f1bf231d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1bec171850 0x7f1bec17b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:12.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.853+0000 7f1bf231d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1bec1795a0 0x7f1bec0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:12.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.853+0000 7f1bf231d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec17be40 con 0x7f1bec17b990 2022-07-05T11:46:12.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.853+0000 7f1bf231d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec062f20 con 0x7f1bec171850 2022-07-05T11:46:12.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.853+0000 7f1bf231d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec0631e0 con 0x7f1bec1795a0 2022-07-05T11:46:12.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1bec1795a0 0x7f1bec0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:12.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf131b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1bec171850 0x7f1bec17b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:12.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1bec1795a0 0x7f1bec0c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37902/0 (socket says 172.21.15.90:37902) 2022-07-05T11:46:12.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 -- 172.21.15.90:0/3764489736 learned_addr learned my addr 172.21.15.90:0/3764489736 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:12.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf0b1a700 1 --1- 172.21.15.90:0/3764489736 >> v1:172.21.15.110:6789/0 conn(0x7f1bec17b990 0x7f1bec178e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59048/0 (socket says 172.21.15.90:59048) 2022-07-05T11:46:12.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 -- 172.21.15.90:0/3764489736 >> v2:172.21.15.110:3300/0 conn(0x7f1bec171850 msgr2=0x7f1bec17b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:12.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 --2- 172.21.15.90:0/3764489736 >> v2:172.21.15.110:3300/0 conn(0x7f1bec171850 0x7f1bec17b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:12.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 -- 172.21.15.90:0/3764489736 >> v1:172.21.15.110:6789/0 conn(0x7f1bec17b990 legacy=0x7f1bec178e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:12.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 -- 172.21.15.90:0/3764489736 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0634c0 con 0x7f1bec1795a0 2022-07-05T11:46:12.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf131b700 1 --2- 172.21.15.90:0/3764489736 >> v2:172.21.15.110:3300/0 conn(0x7f1bec171850 0x7f1bec17b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:12.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bf1b1c700 1 --2- 172.21.15.90:0/3764489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec1795a0 0x7f1bec0c48e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1bec0e4110 tx=0x7f1be40090f0).ready entity=mon.2 client_cookie=fa4f94c094235409 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:12.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bebfff700 1 -- 172.21.15.90:0/3764489736 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400b520 con 0x7f1bec1795a0 2022-07-05T11:46:12.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bebfff700 1 -- 172.21.15.90:0/3764489736 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be400b680 con 0x7f1bec1795a0 2022-07-05T11:46:12.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.854+0000 7f1bebfff700 1 -- 172.21.15.90:0/3764489736 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400ba00 con 0x7f1bec1795a0 2022-07-05T11:46:12.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 -- 172.21.15.90:0/3764489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec1795a0 msgr2=0x7f1bec0c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:12.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3764489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec1795a0 0x7f1bec0c48e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1bec0e4110 tx=0x7f1be40090f0).stop 2022-07-05T11:46:12.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 -- 172.21.15.90:0/3764489736 shutdown_connections 2022-07-05T11:46:12.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3764489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec1795a0 0x7f1bec0c48e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:12.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3764489736 >> v2:172.21.15.110:3300/0 conn(0x7f1bec171850 0x7f1bec17b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:12.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 -- 172.21.15.90:0/3764489736 >> 172.21.15.90:0/3764489736 conn(0x7f1bec05e470 msgr2=0x7f1bec0f05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:12.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 -- 172.21.15.90:0/3764489736 shutdown_connections 2022-07-05T11:46:12.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.855+0000 7f1bf231d700 1 -- 172.21.15.90:0/3764489736 wait complete. 2022-07-05T11:46:12.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.856+0000 7f1bf231d700 1 Processor -- start 2022-07-05T11:46:12.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.856+0000 7f1bf231d700 1 -- start start 2022-07-05T11:46:12.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.857+0000 7f1bf231d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec171850 0x7f1bec163950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:12.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.857+0000 7f1bf231d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bec1795a0 0x7f1bec18e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:12.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.857+0000 7f1bf231d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bec17b990 0x7f1bec18e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:12.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.857+0000 7f1bf231d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec18de20 con 0x7f1bec1795a0 2022-07-05T11:46:12.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.857+0000 7f1bf231d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0ef8f0 con 0x7f1bec17b990 2022-07-05T11:46:12.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.857+0000 7f1bf231d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0efbd0 con 0x7f1bec171850 2022-07-05T11:46:12.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bec1795a0 0x7f1bec18e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:12.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bec1795a0 0x7f1bec18e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56512/0 (socket says 172.21.15.90:56512) 2022-07-05T11:46:12.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 -- 172.21.15.90:0/3823574061 learned_addr learned my addr 172.21.15.90:0/3823574061 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:12.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf1b1c700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bec17b990 0x7f1bec18e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:12.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf131b700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec171850 0x7f1bec163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:12.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 -- 172.21.15.90:0/3823574061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec171850 msgr2=0x7f1bec163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:12.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec171850 0x7f1bec163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:12.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 -- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bec17b990 msgr2=0x7f1bec18e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:12.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bec17b990 0x7f1bec18e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:12.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 -- 172.21.15.90:0/3823574061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009a20 con 0x7f1bec1795a0 2022-07-05T11:46:12.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf0b1a700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bec1795a0 0x7f1bec18e2b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1be000c4c0 tx=0x7f1be0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:12.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1be97fa700 1 -- 172.21.15.90:0/3823574061 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be000ce10 con 0x7f1bec1795a0 2022-07-05T11:46:12.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1be97fa700 1 -- 172.21.15.90:0/3823574061 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be00072e0 con 0x7f1bec1795a0 2022-07-05T11:46:12.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1be97fa700 1 -- 172.21.15.90:0/3823574061 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be00056e0 con 0x7f1bec1795a0 2022-07-05T11:46:12.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be4009370 con 0x7f1bec1795a0 2022-07-05T11:46:12.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.858+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec18d7d0 con 0x7f1bec1795a0 2022-07-05T11:46:12.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.859+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec06be40 con 0x7f1bec1795a0 2022-07-05T11:46:12.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.860+0000 7f1be97fa700 1 -- 172.21.15.90:0/3823574061 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f1be0010070 con 0x7f1bec1795a0 2022-07-05T11:46:12.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.860+0000 7f1be97fa700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1bcc08ba40 0x7f1bcc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:12.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.860+0000 7f1be97fa700 1 -- 172.21.15.90:0/3823574061 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1be00afd50 con 0x7f1bec1795a0 2022-07-05T11:46:12.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.861+0000 7f1bf131b700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1bcc08ba40 0x7f1bcc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:12.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.861+0000 7f1bf131b700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1bcc08ba40 0x7f1bcc08df00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1bec0eac10 tx=0x7f1bdc00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:12.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:12.864+0000 7f1be97fa700 1 -- 172.21.15.90:0/3823574061 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f1be0080990 con 0x7f1bec1795a0 2022-07-05T11:46:13.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.025+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bec0637a0 con 0x7f1bec1795a0 2022-07-05T11:46:13.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.026+0000 7f1be97fa700 1 -- 172.21.15.90:0/3823574061 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f1be0083fb0 con 0x7f1bec1795a0 2022-07-05T11:46:13.029 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:13.030 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:13.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1bcc08ba40 msgr2=0x7f1bcc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1bcc08ba40 0x7f1bcc08df00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1bec0eac10 tx=0x7f1bdc00b040).stop 2022-07-05T11:46:13.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bec1795a0 msgr2=0x7f1bec18e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bec1795a0 0x7f1bec18e2b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1be000c4c0 tx=0x7f1be0007db0).stop 2022-07-05T11:46:13.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 shutdown_connections 2022-07-05T11:46:13.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1bcc08ba40 0x7f1bcc08df00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bec17b990 0x7f1bec18e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec171850 0x7f1bec163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 --2- 172.21.15.90:0/3823574061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bec1795a0 0x7f1bec18e2b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 >> 172.21.15.90:0/3823574061 conn(0x7f1bec05e470 msgr2=0x7f1bec16d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:13.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 shutdown_connections 2022-07-05T11:46:13.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.028+0000 7f1bf231d700 1 -- 172.21.15.90:0/3823574061 wait complete. 2022-07-05T11:46:13.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-07-05T11:46:03.055092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-07-05T11:46:03.515295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-07-05T11:46:06.613134+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-07-05T11:46:13.043 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:13.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.157+0000 7fd265c72700 1 Processor -- start 2022-07-05T11:46:13.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.157+0000 7fd265c72700 1 -- start start 2022-07-05T11:46:13.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.158+0000 7fd265c72700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd26017bda0 0x7fd2600ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.158+0000 7fd265c72700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600ee170 con 0x7fd260182a30 2022-07-05T11:46:13.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.158+0000 7fd265c72700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26017c3f0 con 0x7fd26017e750 2022-07-05T11:46:13.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.158+0000 7fd265c72700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600ed280 con 0x7fd26017bda0 2022-07-05T11:46:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.158+0000 7fd25f7fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd26017bda0 0x7fd2600ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.158+0000 7fd25effd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd260182a30 0x7fd2600eeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59058/0 (socket says 172.21.15.90:59058) 2022-07-05T11:46:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.158+0000 7fd25effd700 1 -- 172.21.15.90:0/4170808531 learned_addr learned my addr 172.21.15.90:0/4170808531 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.159+0000 7fd25f7fe700 1 -- 172.21.15.90:0/4170808531 >> v1:172.21.15.149:6789/0 conn(0x7fd26017e750 legacy=0x7fd26017ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.159+0000 7fd25f7fe700 1 -- 172.21.15.90:0/4170808531 >> v1:172.21.15.110:6789/0 conn(0x7fd260182a30 legacy=0x7fd2600eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.159+0000 7fd25f7fe700 1 -- 172.21.15.90:0/4170808531 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600ed560 con 0x7fd26017bda0 2022-07-05T11:46:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.159+0000 7fd25f7fe700 1 --2- 172.21.15.90:0/4170808531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017bda0 0x7fd2600ee600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd250009760 tx=0x7fd250009060).ready entity=mon.1 client_cookie=812645dbead2575 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.159+0000 7fd25e7fc700 1 -- 172.21.15.90:0/4170808531 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000b580 con 0x7fd26017bda0 2022-07-05T11:46:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.159+0000 7fd25e7fc700 1 -- 172.21.15.90:0/4170808531 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25000b6e0 con 0x7fd26017bda0 2022-07-05T11:46:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.159+0000 7fd25e7fc700 1 -- 172.21.15.90:0/4170808531 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000ba60 con 0x7fd26017bda0 2022-07-05T11:46:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.160+0000 7fd265c72700 1 -- 172.21.15.90:0/4170808531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017bda0 msgr2=0x7fd2600ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.160+0000 7fd265c72700 1 --2- 172.21.15.90:0/4170808531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017bda0 0x7fd2600ee600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd250009760 tx=0x7fd250009060).stop 2022-07-05T11:46:13.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.160+0000 7fd265c72700 1 -- 172.21.15.90:0/4170808531 shutdown_connections 2022-07-05T11:46:13.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.160+0000 7fd265c72700 1 --2- 172.21.15.90:0/4170808531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017bda0 0x7fd2600ee600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.160+0000 7fd265c72700 1 -- 172.21.15.90:0/4170808531 >> 172.21.15.90:0/4170808531 conn(0x7fd2600f21d0 msgr2=0x7fd260069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:13.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.160+0000 7fd265c72700 1 -- 172.21.15.90:0/4170808531 shutdown_connections 2022-07-05T11:46:13.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.160+0000 7fd265c72700 1 -- 172.21.15.90:0/4170808531 wait complete. 2022-07-05T11:46:13.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.161+0000 7fd265c72700 1 Processor -- start 2022-07-05T11:46:13.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.161+0000 7fd265c72700 1 -- start start 2022-07-05T11:46:13.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd265c72700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd26017bda0 0x7fd26015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd265c72700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017e750 0x7fd260179b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd265c72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd260182a30 0x7fd26017a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd265c72700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26017e420 con 0x7fd26017bda0 2022-07-05T11:46:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd265c72700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd260191fb0 con 0x7fd26017e750 2022-07-05T11:46:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd265c72700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd260179680 con 0x7fd260182a30 2022-07-05T11:46:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd26017bda0 0x7fd26015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd26017bda0 0x7fd26015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56526/0 (socket says 172.21.15.90:56526) 2022-07-05T11:46:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd25f7fe700 1 -- 172.21.15.90:0/3844775437 learned_addr learned my addr 172.21.15.90:0/3844775437 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.162+0000 7fd25effd700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017e750 0x7fd260179b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd25ffff700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd260182a30 0x7fd26017a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd25f7fe700 1 -- 172.21.15.90:0/3844775437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd260182a30 msgr2=0x7fd26017a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd25f7fe700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd260182a30 0x7fd26017a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd25f7fe700 1 -- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017e750 msgr2=0x7fd260179b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd25f7fe700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017e750 0x7fd260179b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd25f7fe700 1 -- 172.21.15.90:0/3844775437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500092a0 con 0x7fd26017bda0 2022-07-05T11:46:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd25f7fe700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd26017bda0 0x7fd26015acd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd250009eb0 tx=0x7fd250017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd2477fe700 1 -- 172.21.15.90:0/3844775437 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000ba60 con 0x7fd26017bda0 2022-07-05T11:46:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd2477fe700 1 -- 172.21.15.90:0/3844775437 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd250000c90 con 0x7fd26017bda0 2022-07-05T11:46:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260191cd0 con 0x7fd26017bda0 2022-07-05T11:46:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd2477fe700 1 -- 172.21.15.90:0/3844775437 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25001b650 con 0x7fd26017bda0 2022-07-05T11:46:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.163+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd260179030 con 0x7fd26017bda0 2022-07-05T11:46:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.164+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26006b1e0 con 0x7fd26017bda0 2022-07-05T11:46:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.165+0000 7fd2477fe700 1 -- 172.21.15.90:0/3844775437 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd25000f070 con 0x7fd26017bda0 2022-07-05T11:46:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.165+0000 7fd2477fe700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd24008ba40 0x7fd24008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.165+0000 7fd2477fe700 1 -- 172.21.15.90:0/3844775437 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd2500b21e0 con 0x7fd26017bda0 2022-07-05T11:46:13.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.166+0000 7fd25effd700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd24008ba40 0x7fd24008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.166+0000 7fd25effd700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd24008ba40 0x7fd24008df00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd260175da0 tx=0x7fd254007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.169+0000 7fd2477fe700 1 -- 172.21.15.90:0/3844775437 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fd250082ea0 con 0x7fd26017bda0 2022-07-05T11:46:13.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.332+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd26006be40 con 0x7fd26017bda0 2022-07-05T11:46:13.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.333+0000 7fd2477fe700 1 -- 172.21.15.90:0/3844775437 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd2500864c0 con 0x7fd26017bda0 2022-07-05T11:46:13.335 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:13.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd24008ba40 msgr2=0x7fd24008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd24008ba40 0x7fd24008df00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd260175da0 tx=0x7fd254007d30).stop 2022-07-05T11:46:13.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd26017bda0 msgr2=0x7fd26015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd26017bda0 0x7fd26015acd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd250009eb0 tx=0x7fd250017000).stop 2022-07-05T11:46:13.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 shutdown_connections 2022-07-05T11:46:13.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd24008ba40 0x7fd24008df00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd260182a30 0x7fd26017a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.334+0000 7fd265c72700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd26017bda0 0x7fd26015acd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.335+0000 7fd265c72700 1 --2- 172.21.15.90:0/3844775437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26017e750 0x7fd260179b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.335+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 >> 172.21.15.90:0/3844775437 conn(0x7fd2600f21d0 msgr2=0x7fd2600f0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:13.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.335+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 shutdown_connections 2022-07-05T11:46:13.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.335+0000 7fd265c72700 1 -- 172.21.15.90:0/3844775437 wait complete. 2022-07-05T11:46:13.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:13.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.462+0000 7f0d2c7c2700 1 Processor -- start 2022-07-05T11:46:13.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.462+0000 7f0d2c7c2700 1 -- start start 2022-07-05T11:46:13.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2c7c2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d2417e030 0x7f0d24068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2c7c2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d24069480 0x7f0d240ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2c7c2700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d24068650 con 0x7f0d24068fd0 2022-07-05T11:46:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2c7c2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d240ec890 con 0x7f0d24069480 2022-07-05T11:46:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2c7c2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d24067d60 con 0x7f0d2417e030 2022-07-05T11:46:13.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d29d5d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0d24068fd0 0x7f0d24181c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49474/0 (socket says 172.21.15.90:49474) 2022-07-05T11:46:13.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d29d5d700 1 -- 172.21.15.90:0/519306827 learned_addr learned my addr 172.21.15.90:0/519306827 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:13.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2ad5f700 1 --2- 172.21.15.90:0/519306827 >> v2:172.21.15.110:3300/0 conn(0x7f0d24069480 0x7f0d240ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/519306827 >> v2:172.21.15.149:3300/0 conn(0x7f0d2417e030 0x7f0d24068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544033444 0 0) 0x7f0d24068650 con 0x7f0d24068fd0 2022-07-05T11:46:13.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d100033f0 con 0x7f0d24068fd0 2022-07-05T11:46:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 319310779 0 0) 0x7f0d100033f0 con 0x7f0d24068fd0 2022-07-05T11:46:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 >> v2:172.21.15.149:3300/0 conn(0x7f0d2417e030 msgr2=0x7f0d24068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 --2- 172.21.15.90:0/519306827 >> v2:172.21.15.149:3300/0 conn(0x7f0d2417e030 0x7f0d24068ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 >> v2:172.21.15.110:3300/0 conn(0x7f0d24069480 msgr2=0x7f0d240ec3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 --2- 172.21.15.90:0/519306827 >> v2:172.21.15.110:3300/0 conn(0x7f0d24069480 0x7f0d240ec3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d240ecab0 con 0x7f0d24068fd0 2022-07-05T11:46:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f0d18001470 con 0x7f0d24068fd0 2022-07-05T11:46:13.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2ad5f700 1 --2- 172.21.15.90:0/519306827 >> v2:172.21.15.110:3300/0 conn(0x7f0d24069480 0x7f0d240ec3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:13.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 >> v1:172.21.15.90:6789/0 conn(0x7f0d24068fd0 legacy=0x7f0d24181c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d10003930 0x7f0d10003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10004690 0x7f0d10004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10005000 0x7f0d1000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240ec890 con 0x7f0d10003930 2022-07-05T11:46:13.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24067d60 con 0x7f0d10004690 2022-07-05T11:46:13.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1000be80 con 0x7f0d10005000 2022-07-05T11:46:13.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.464+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d10003930 0x7f0d10003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d29d5d700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10004690 0x7f0d10004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2ad5f700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10005000 0x7f0d1000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2a55e700 1 -- 172.21.15.90:0/519306827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10005000 msgr2=0x7f0d1000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:13.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10005000 0x7f0d1000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2a55e700 1 -- 172.21.15.90:0/519306827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10004690 msgr2=0x7f0d10004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:13.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10004690 0x7f0d10004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2a55e700 1 -- 172.21.15.90:0/519306827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100033f0 con 0x7f0d10003930 2022-07-05T11:46:13.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2ad5f700 1 -- 172.21.15.90:0/519306827 reap_dead start 2022-07-05T11:46:13.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d29d5d700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10004690 0x7f0d10004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:13.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d10003930 0x7f0d10003d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0d1400e1c0 tx=0x7f0d1400b040).ready entity=mon.0 client_cookie=4c9bfd2d77a6ccd5 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14009ac0 con 0x7f0d10003930 2022-07-05T11:46:13.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400f040 con 0x7f0d10003930 2022-07-05T11:46:13.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2955c700 1 -- 172.21.15.90:0/519306827 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400ec80 con 0x7f0d10003930 2022-07-05T11:46:13.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/519306827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d10003930 msgr2=0x7f0d10003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d10003930 0x7f0d10003d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0d1400e1c0 tx=0x7f0d1400b040).stop 2022-07-05T11:46:13.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/519306827 shutdown_connections 2022-07-05T11:46:13.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/519306827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d10003930 0x7f0d10003d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.465+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/519306827 >> 172.21.15.90:0/519306827 conn(0x7f0d240ef4b0 msgr2=0x7f0d240ef8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:13.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.466+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/519306827 shutdown_connections 2022-07-05T11:46:13.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.466+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/519306827 wait complete. 2022-07-05T11:46:13.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.467+0000 7f0d2c7c2700 1 Processor -- start 2022-07-05T11:46:13.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.467+0000 7f0d2c7c2700 1 -- start start 2022-07-05T11:46:13.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2c7c2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10003930 0x7f0d241713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2c7c2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d241718a0 0x7f0d24175b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2c7c2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24176050 0x7f0d2418fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2c7c2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24177700 con 0x7f0d241718a0 2022-07-05T11:46:13.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2c7c2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24176810 con 0x7f0d24176050 2022-07-05T11:46:13.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2c7c2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24176af0 con 0x7f0d10003930 2022-07-05T11:46:13.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d241718a0 0x7f0d24175b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d241718a0 0x7f0d24175b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56542/0 (socket says 172.21.15.90:56542) 2022-07-05T11:46:13.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 -- 172.21.15.90:0/3816856180 learned_addr learned my addr 172.21.15.90:0/3816856180 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:13.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10003930 0x7f0d241713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2ad5f700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24176050 0x7f0d2418fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 -- 172.21.15.90:0/3816856180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10003930 msgr2=0x7f0d241713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10003930 0x7f0d241713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 -- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24176050 msgr2=0x7f0d2418fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24176050 0x7f0d2418fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 -- 172.21.15.90:0/3816856180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24176dd0 con 0x7f0d241718a0 2022-07-05T11:46:13.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10003930 0x7f0d241713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:13.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d29d5d700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d241718a0 0x7f0d24175b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0d18000fd0 tx=0x7f0d18001440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d227fc700 1 -- 172.21.15.90:0/3816856180 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18010520 con 0x7f0d241718a0 2022-07-05T11:46:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.468+0000 7f0d227fc700 1 -- 172.21.15.90:0/3816856180 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18010680 con 0x7f0d241718a0 2022-07-05T11:46:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.469+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d241770b0 con 0x7f0d241718a0 2022-07-05T11:46:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.469+0000 7f0d227fc700 1 -- 172.21.15.90:0/3816856180 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18010a20 con 0x7f0d241718a0 2022-07-05T11:46:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.469+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d241764b0 con 0x7f0d241718a0 2022-07-05T11:46:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.469+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2418fa90 con 0x7f0d241718a0 2022-07-05T11:46:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.470+0000 7f0d227fc700 1 -- 172.21.15.90:0/3816856180 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f0d18014430 con 0x7f0d241718a0 2022-07-05T11:46:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.471+0000 7f0d227fc700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0d0408ba40 0x7f0d0408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.471+0000 7f0d227fc700 1 -- 172.21.15.90:0/3816856180 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0d180b0450 con 0x7f0d241718a0 2022-07-05T11:46:13.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.471+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0d0408ba40 0x7f0d0408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.471+0000 7f0d2a55e700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0d0408ba40 0x7f0d0408df00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0d1400f010 tx=0x7f0d1401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.474+0000 7f0d227fc700 1 -- 172.21.15.90:0/3816856180 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f0d18081110 con 0x7f0d241718a0 2022-07-05T11:46:13.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.634+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d2406b1e0 con 0x7f0d241718a0 2022-07-05T11:46:13.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.635+0000 7f0d227fc700 1 -- 172.21.15.90:0/3816856180 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d18084730 con 0x7f0d241718a0 2022-07-05T11:46:13.642 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:13.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.636+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0d0408ba40 msgr2=0x7f0d0408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.636+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0d0408ba40 0x7f0d0408df00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0d1400f010 tx=0x7f0d1401a000).stop 2022-07-05T11:46:13.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.636+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d241718a0 msgr2=0x7f0d24175b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.636+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d241718a0 0x7f0d24175b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0d18000fd0 tx=0x7f0d18001440).stop 2022-07-05T11:46:13.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 shutdown_connections 2022-07-05T11:46:13.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0d0408ba40 0x7f0d0408df00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24176050 0x7f0d2418fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d10003930 0x7f0d241713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 --2- 172.21.15.90:0/3816856180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d241718a0 0x7f0d24175b60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 >> 172.21.15.90:0/3816856180 conn(0x7f0d240ef4b0 msgr2=0x7f0d240ed3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:13.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 shutdown_connections 2022-07-05T11:46:13.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.637+0000 7f0d2c7c2700 1 -- 172.21.15.90:0/3816856180 wait complete. 2022-07-05T11:46:13.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-07-05T11:46:13.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.765+0000 7ff87ca6d700 1 Processor -- start 2022-07-05T11:46:13.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.765+0000 7ff87ca6d700 1 -- start start 2022-07-05T11:46:13.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff87ca6d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff8780c46d0 0x7ff878176200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff87ca6d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff878083f60 0x7ff878179e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff87ca6d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87817bf50 con 0x7ff878175e20 2022-07-05T11:46:13.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff87ca6d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8781766f0 con 0x7ff878083f60 2022-07-05T11:46:13.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff87ca6d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87817b060 con 0x7ff8780c46d0 2022-07-05T11:46:13.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff877fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff878083f60 0x7ff878179e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff8777fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff878175e20 0x7ff878083850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49490/0 (socket says 172.21.15.90:49490) 2022-07-05T11:46:13.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.766+0000 7ff8777fe700 1 -- 172.21.15.90:0/2717274875 learned_addr learned my addr 172.21.15.90:0/2717274875 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:13.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff876ffd700 1 --2- 172.21.15.90:0/2717274875 >> v2:172.21.15.110:3300/0 conn(0x7ff8780c46d0 0x7ff878176200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff877fff700 1 -- 172.21.15.90:0/2717274875 >> v2:172.21.15.110:3300/0 conn(0x7ff8780c46d0 msgr2=0x7ff878176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:13.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff877fff700 1 --2- 172.21.15.90:0/2717274875 >> v2:172.21.15.110:3300/0 conn(0x7ff8780c46d0 0x7ff878176200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff877fff700 1 -- 172.21.15.90:0/2717274875 >> v1:172.21.15.90:6789/0 conn(0x7ff878175e20 legacy=0x7ff878083850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff877fff700 1 -- 172.21.15.90:0/2717274875 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87817b340 con 0x7ff878083f60 2022-07-05T11:46:13.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff8767fc700 1 -- 172.21.15.90:0/2717274875 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277284834 0 0) 0x7ff87817bf50 con 0x7ff878175e20 2022-07-05T11:46:13.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff877fff700 1 --2- 172.21.15.90:0/2717274875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878083f60 0x7ff878179e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff878065b30 tx=0x7ff870009060).ready entity=mon.0 client_cookie=128253490a4ac2bd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff8767fc700 1 -- 172.21.15.90:0/2717274875 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000b580 con 0x7ff878083f60 2022-07-05T11:46:13.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff8767fc700 1 -- 172.21.15.90:0/2717274875 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87000b6e0 con 0x7ff878083f60 2022-07-05T11:46:13.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff8767fc700 1 -- 172.21.15.90:0/2717274875 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000ba60 con 0x7ff878083f60 2022-07-05T11:46:13.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2717274875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878083f60 msgr2=0x7ff878179e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2717274875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878083f60 0x7ff878179e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff878065b30 tx=0x7ff870009060).stop 2022-07-05T11:46:13.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2717274875 shutdown_connections 2022-07-05T11:46:13.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2717274875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878083f60 0x7ff878179e00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2717274875 >> v2:172.21.15.110:3300/0 conn(0x7ff8780c46d0 0x7ff878176200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2717274875 >> 172.21.15.90:0/2717274875 conn(0x7ff8780ef350 msgr2=0x7ff8780ef760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:13.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2717274875 shutdown_connections 2022-07-05T11:46:13.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.767+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2717274875 wait complete. 2022-07-05T11:46:13.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.769+0000 7ff87ca6d700 1 Processor -- start 2022-07-05T11:46:13.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.769+0000 7ff87ca6d700 1 -- start start 2022-07-05T11:46:13.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff87ca6d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff878083f60 0x7ff878172df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff87ca6d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8780c46d0 0x7ff8780e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff87ca6d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878175e20 0x7ff8780ea110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff87ca6d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780eb080 con 0x7ff878175e20 2022-07-05T11:46:13.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff87ca6d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780eaac0 con 0x7ff8780c46d0 2022-07-05T11:46:13.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff87ca6d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780eada0 con 0x7ff878083f60 2022-07-05T11:46:13.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878175e20 0x7ff8780ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878175e20 0x7ff8780ea110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56560/0 (socket says 172.21.15.90:56560) 2022-07-05T11:46:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 -- 172.21.15.90:0/2373366923 learned_addr learned my addr 172.21.15.90:0/2373366923 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff876ffd700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8780c46d0 0x7ff8780e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff8777fe700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff878083f60 0x7ff878172df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 -- 172.21.15.90:0/2373366923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff878083f60 msgr2=0x7ff878172df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff878083f60 0x7ff878172df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 -- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8780c46d0 msgr2=0x7ff8780e9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8780c46d0 0x7ff8780e9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 -- 172.21.15.90:0/2373366923 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700092a0 con 0x7ff878175e20 2022-07-05T11:46:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.770+0000 7ff877fff700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878175e20 0x7ff8780ea110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff8780e9ae0 tx=0x7ff870017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.771+0000 7ff85f7fe700 1 -- 172.21.15.90:0/2373366923 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000ba60 con 0x7ff878175e20 2022-07-05T11:46:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.771+0000 7ff85f7fe700 1 -- 172.21.15.90:0/2373366923 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87001b440 con 0x7ff878175e20 2022-07-05T11:46:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.771+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87817e2b0 con 0x7ff878175e20 2022-07-05T11:46:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.771+0000 7ff85f7fe700 1 -- 172.21.15.90:0/2373366923 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87001b7c0 con 0x7ff878175e20 2022-07-05T11:46:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.771+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87817e870 con 0x7ff878175e20 2022-07-05T11:46:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.772+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87817e110 con 0x7ff878175e20 2022-07-05T11:46:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.772+0000 7ff85f7fe700 1 -- 172.21.15.90:0/2373366923 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff87000f070 con 0x7ff878175e20 2022-07-05T11:46:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.773+0000 7ff85f7fe700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff85808ba40 0x7ff85808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.773+0000 7ff85f7fe700 1 -- 172.21.15.90:0/2373366923 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff8700b22e0 con 0x7ff878175e20 2022-07-05T11:46:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.773+0000 7ff8777fe700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff85808ba40 0x7ff85808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.774+0000 7ff8777fe700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff85808ba40 0x7ff85808df00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff868007fd0 tx=0x7ff868009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:13.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.777+0000 7ff85f7fe700 1 -- 172.21.15.90:0/2373366923 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7ff87817e110 con 0x7ff878175e20 2022-07-05T11:46:13.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.935+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff87817e110 con 0x7ff878175e20 2022-07-05T11:46:13.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.935+0000 7ff85f7fe700 1 -- 172.21.15.90:0/2373366923 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8700b2020 con 0x7ff878175e20 2022-07-05T11:46:13.938 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:13.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff85808ba40 msgr2=0x7ff85808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff85808ba40 0x7ff85808df00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff868007fd0 tx=0x7ff868009040).stop 2022-07-05T11:46:13.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878175e20 msgr2=0x7ff8780ea110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:13.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878175e20 0x7ff8780ea110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff8780e9ae0 tx=0x7ff870017000).stop 2022-07-05T11:46:13.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 shutdown_connections 2022-07-05T11:46:13.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff85808ba40 0x7ff85808df00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff878175e20 0x7ff8780ea110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff878083f60 0x7ff878172df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 --2- 172.21.15.90:0/2373366923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8780c46d0 0x7ff8780e9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:13.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 >> 172.21.15.90:0/2373366923 conn(0x7ff8780ef350 msgr2=0x7ff878069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:13.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 shutdown_connections 2022-07-05T11:46:13.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:13.937+0000 7ff87ca6d700 1 -- 172.21.15.90:0/2373366923 wait complete. 2022-07-05T11:46:13.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-07-05T11:46:14.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.065+0000 7f1d26a35700 1 Processor -- start 2022-07-05T11:46:14.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.065+0000 7f1d26a35700 1 -- start start 2022-07-05T11:46:14.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d26a35700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1d20171f80 0x7f1d200ec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d26a35700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2017cb20 con 0x7f1d2017d6c0 2022-07-05T11:46:14.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d26a35700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d20172360 con 0x7f1d200c7330 2022-07-05T11:46:14.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d26a35700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200c7b40 con 0x7f1d20171f80 2022-07-05T11:46:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d1ffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1d20171f80 0x7f1d200ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d24fd2700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1d2017d6c0 0x7f1d2017ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49506/0 (socket says 172.21.15.90:49506) 2022-07-05T11:46:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d24fd2700 1 -- 172.21.15.90:0/3417483154 learned_addr learned my addr 172.21.15.90:0/3417483154 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:14.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d1ffff700 1 -- 172.21.15.90:0/3417483154 >> v1:172.21.15.110:6789/0 conn(0x7f1d200c7330 legacy=0x7f1d2017cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d1ffff700 1 -- 172.21.15.90:0/3417483154 >> v1:172.21.15.90:6789/0 conn(0x7f1d2017d6c0 legacy=0x7f1d2017ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d1ffff700 1 -- 172.21.15.90:0/3417483154 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200c7e20 con 0x7f1d20171f80 2022-07-05T11:46:14.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d1f7fe700 1 -- 172.21.15.90:0/3417483154 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568388456 0 0) 0x7f1d2017cb20 con 0x7f1d2017d6c0 2022-07-05T11:46:14.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.066+0000 7f1d1ffff700 1 --2- 172.21.15.90:0/3417483154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d20171f80 0x7f1d200ec750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1d10009760 tx=0x7f1d10009060).ready entity=mon.0 client_cookie=ad534f9a3bd38f7e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d1f7fe700 1 -- 172.21.15.90:0/3417483154 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10009120 con 0x7f1d20171f80 2022-07-05T11:46:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d1f7fe700 1 -- 172.21.15.90:0/3417483154 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000b580 con 0x7f1d20171f80 2022-07-05T11:46:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d1f7fe700 1 -- 172.21.15.90:0/3417483154 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000b900 con 0x7f1d20171f80 2022-07-05T11:46:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d26a35700 1 -- 172.21.15.90:0/3417483154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d20171f80 msgr2=0x7f1d200ec750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d26a35700 1 --2- 172.21.15.90:0/3417483154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d20171f80 0x7f1d200ec750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1d10009760 tx=0x7f1d10009060).stop 2022-07-05T11:46:14.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d26a35700 1 -- 172.21.15.90:0/3417483154 shutdown_connections 2022-07-05T11:46:14.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d26a35700 1 --2- 172.21.15.90:0/3417483154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d20171f80 0x7f1d200ec750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d26a35700 1 -- 172.21.15.90:0/3417483154 >> 172.21.15.90:0/3417483154 conn(0x7f1d2005d9a0 msgr2=0x7f1d2005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:14.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d26a35700 1 -- 172.21.15.90:0/3417483154 shutdown_connections 2022-07-05T11:46:14.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.067+0000 7f1d26a35700 1 -- 172.21.15.90:0/3417483154 wait complete. 2022-07-05T11:46:14.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.068+0000 7f1d26a35700 1 Processor -- start 2022-07-05T11:46:14.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.068+0000 7f1d26a35700 1 -- start start 2022-07-05T11:46:14.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.069+0000 7f1d26a35700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d200c7330 0x7f1d2016a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.069+0000 7f1d26a35700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d20171f80 0x7f1d20170f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.069+0000 7f1d26a35700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2017d6c0 0x7f1d20171440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.069+0000 7f1d26a35700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200eb020 con 0x7f1d200c7330 2022-07-05T11:46:14.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.069+0000 7f1d26a35700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200629e0 con 0x7f1d2017d6c0 2022-07-05T11:46:14.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.069+0000 7f1d26a35700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200ead40 con 0x7f1d20171f80 2022-07-05T11:46:14.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.069+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d200c7330 0x7f1d2016a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d200c7330 0x7f1d2016a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56568/0 (socket says 172.21.15.90:56568) 2022-07-05T11:46:14.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 -- 172.21.15.90:0/2878032953 learned_addr learned my addr 172.21.15.90:0/2878032953 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:14.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d24fd2700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2017d6c0 0x7f1d20171440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d17fff700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d20171f80 0x7f1d20170f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 -- 172.21.15.90:0/2878032953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d20171f80 msgr2=0x7f1d20170f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d20171f80 0x7f1d20170f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 -- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2017d6c0 msgr2=0x7f1d20171440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2017d6c0 0x7f1d20171440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 -- 172.21.15.90:0/2878032953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100092a0 con 0x7f1d200c7330 2022-07-05T11:46:14.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d24fd2700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2017d6c0 0x7f1d20171440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:14.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1ffff700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d200c7330 0x7f1d2016a120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1d10009eb0 tx=0x7f1d10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1cff9700 1 -- 172.21.15.90:0/2878032953 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10006970 con 0x7f1d200c7330 2022-07-05T11:46:14.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1cff9700 1 -- 172.21.15.90:0/2878032953 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000bcc0 con 0x7f1d200c7330 2022-07-05T11:46:14.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d1cff9700 1 -- 172.21.15.90:0/2878032953 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1001b440 con 0x7f1d200c7330 2022-07-05T11:46:14.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d200620b0 con 0x7f1d200c7330 2022-07-05T11:46:14.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.070+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d20062670 con 0x7f1d200c7330 2022-07-05T11:46:14.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.071+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2006be40 con 0x7f1d200c7330 2022-07-05T11:46:14.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.072+0000 7f1d1cff9700 1 -- 172.21.15.90:0/2878032953 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f1d1002a070 con 0x7f1d200c7330 2022-07-05T11:46:14.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.072+0000 7f1d1cff9700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1d0408ba40 0x7f1d0408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.073+0000 7f1d1cff9700 1 -- 172.21.15.90:0/2878032953 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1d100b1f10 con 0x7f1d200c7330 2022-07-05T11:46:14.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.073+0000 7f1d17fff700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1d0408ba40 0x7f1d0408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.073+0000 7f1d17fff700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1d0408ba40 0x7f1d0408df00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1d2018ee90 tx=0x7f1d08009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.076+0000 7f1d1cff9700 1 -- 172.21.15.90:0/2878032953 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f1d10082bd0 con 0x7f1d200c7330 2022-07-05T11:46:14.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.237+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d200ed1b0 con 0x7f1d200c7330 2022-07-05T11:46:14.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.238+0000 7f1d1cff9700 1 -- 172.21.15.90:0/2878032953 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d10028020 con 0x7f1d200c7330 2022-07-05T11:46:14.246 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:14.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1d0408ba40 msgr2=0x7f1d0408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1d0408ba40 0x7f1d0408df00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1d2018ee90 tx=0x7f1d08009040).stop 2022-07-05T11:46:14.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d200c7330 msgr2=0x7f1d2016a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d200c7330 0x7f1d2016a120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1d10009eb0 tx=0x7f1d10017000).stop 2022-07-05T11:46:14.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 shutdown_connections 2022-07-05T11:46:14.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1d0408ba40 0x7f1d0408df00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2017d6c0 0x7f1d20171440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d200c7330 0x7f1d2016a120 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 --2- 172.21.15.90:0/2878032953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d20171f80 0x7f1d20170f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 >> 172.21.15.90:0/2878032953 conn(0x7f1d2005d9a0 msgr2=0x7f1d2005de20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:14.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.239+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 shutdown_connections 2022-07-05T11:46:14.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.240+0000 7f1d26a35700 1 -- 172.21.15.90:0/2878032953 wait complete. 2022-07-05T11:46:14.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-07-05T11:46:14.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.381+0000 7f44e7365700 1 Processor -- start 2022-07-05T11:46:14.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.381+0000 7f44e7365700 1 -- start start 2022-07-05T11:46:14.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.382+0000 7f44e7365700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44e0178890 0x7f44e0180470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.382+0000 7f44e7365700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e0062e90 con 0x7f44e0180960 2022-07-05T11:46:14.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.382+0000 7f44e7365700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e0063170 con 0x7f44e01784b0 2022-07-05T11:46:14.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.382+0000 7f44e7365700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e0063730 con 0x7f44e0178890 2022-07-05T11:46:14.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e4900700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44e0178890 0x7f44e0180470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e5101700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f44e01784b0 0x7f44e0083f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:45758/0 (socket says 172.21.15.90:45758) 2022-07-05T11:46:14.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e5902700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f44e0180960 0x7f44e0061f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59118/0 (socket says 172.21.15.90:59118) 2022-07-05T11:46:14.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e5101700 1 -- 172.21.15.90:0/880749409 learned_addr learned my addr 172.21.15.90:0/880749409 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:14.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44dffff700 1 -- 172.21.15.90:0/880749409 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734419468 0 0) 0x7f44e0063170 con 0x7f44e01784b0 2022-07-05T11:46:14.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44dffff700 1 -- 172.21.15.90:0/880749409 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44cc0033f0 con 0x7f44e01784b0 2022-07-05T11:46:14.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e4900700 1 -- 172.21.15.90:0/880749409 >> v1:172.21.15.149:6789/0 conn(0x7f44e01784b0 legacy=0x7f44e0083f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e4900700 1 -- 172.21.15.90:0/880749409 >> v1:172.21.15.110:6789/0 conn(0x7f44e0180960 legacy=0x7f44e0061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44dffff700 1 -- 172.21.15.90:0/880749409 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053137975 0 0) 0x7f44e0062e90 con 0x7f44e0180960 2022-07-05T11:46:14.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e4900700 1 -- 172.21.15.90:0/880749409 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0063450 con 0x7f44e0178890 2022-07-05T11:46:14.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44e4900700 1 --2- 172.21.15.90:0/880749409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 0x7f44e0180470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f44d4009760 tx=0x7f44d4009060).ready entity=mon.1 client_cookie=875530a236854b30 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44dffff700 1 -- 172.21.15.90:0/880749409 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40090d0 con 0x7f44e0178890 2022-07-05T11:46:14.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44dffff700 1 -- 172.21.15.90:0/880749409 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400f510 con 0x7f44e0178890 2022-07-05T11:46:14.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.383+0000 7f44dffff700 1 -- 172.21.15.90:0/880749409 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400f890 con 0x7f44e0178890 2022-07-05T11:46:14.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.384+0000 7f44e7365700 1 -- 172.21.15.90:0/880749409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 msgr2=0x7f44e0180470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.384+0000 7f44e7365700 1 --2- 172.21.15.90:0/880749409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 0x7f44e0180470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f44d4009760 tx=0x7f44d4009060).stop 2022-07-05T11:46:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.384+0000 7f44e7365700 1 -- 172.21.15.90:0/880749409 shutdown_connections 2022-07-05T11:46:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.384+0000 7f44e7365700 1 --2- 172.21.15.90:0/880749409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 0x7f44e0180470 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.384+0000 7f44e7365700 1 -- 172.21.15.90:0/880749409 >> 172.21.15.90:0/880749409 conn(0x7f44e00f1680 msgr2=0x7f44e00f1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.384+0000 7f44e7365700 1 -- 172.21.15.90:0/880749409 shutdown_connections 2022-07-05T11:46:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.384+0000 7f44e7365700 1 -- 172.21.15.90:0/880749409 wait complete. 2022-07-05T11:46:14.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.385+0000 7f44e7365700 1 Processor -- start 2022-07-05T11:46:14.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.385+0000 7f44e7365700 1 -- start start 2022-07-05T11:46:14.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.386+0000 7f44e7365700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e01784b0 0x7f44e00f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.386+0000 7f44e7365700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 0x7f44e0192640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.386+0000 7f44e7365700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e0180960 0x7f44e017c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.386+0000 7f44e7365700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0177b10 con 0x7f44e0180960 2022-07-05T11:46:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.386+0000 7f44e7365700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0176c20 con 0x7f44e0178890 2022-07-05T11:46:14.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.386+0000 7f44e7365700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0176f00 con 0x7f44e01784b0 2022-07-05T11:46:14.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.386+0000 7f44e5902700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e0180960 0x7f44e017c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e0180960 0x7f44e017c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56586/0 (socket says 172.21.15.90:56586) 2022-07-05T11:46:14.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 -- 172.21.15.90:0/2443108208 learned_addr learned my addr 172.21.15.90:0/2443108208 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:14.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e4900700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 0x7f44e0192640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5101700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e01784b0 0x7f44e00f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 -- 172.21.15.90:0/2443108208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e01784b0 msgr2=0x7f44e00f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e01784b0 0x7f44e00f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 -- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 msgr2=0x7f44e0192640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 0x7f44e0192640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 -- 172.21.15.90:0/2443108208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d40092a0 con 0x7f44e0180960 2022-07-05T11:46:14.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e5902700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e0180960 0x7f44e017c580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f44d800c460 tx=0x7f44d8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44dd7fa700 1 -- 172.21.15.90:0/2443108208 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800ce10 con 0x7f44e0180960 2022-07-05T11:46:14.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44dd7fa700 1 -- 172.21.15.90:0/2443108208 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d80072e0 con 0x7f44e0180960 2022-07-05T11:46:14.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44dd7fa700 1 -- 172.21.15.90:0/2443108208 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d80056e0 con 0x7f44e0180960 2022-07-05T11:46:14.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e01771e0 con 0x7f44e0180960 2022-07-05T11:46:14.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.387+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e01777a0 con 0x7f44e0180960 2022-07-05T11:46:14.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.388+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e017c2a0 con 0x7f44e0180960 2022-07-05T11:46:14.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.389+0000 7f44dd7fa700 1 -- 172.21.15.90:0/2443108208 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f44d8010070 con 0x7f44e0180960 2022-07-05T11:46:14.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.389+0000 7f44dd7fa700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f44c008ba40 0x7f44c008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.389+0000 7f44dd7fa700 1 -- 172.21.15.90:0/2443108208 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f44d80b02f0 con 0x7f44e0180960 2022-07-05T11:46:14.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.390+0000 7f44e5101700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f44c008ba40 0x7f44c008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.390+0000 7f44e5101700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f44c008ba40 0x7f44c008df00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f44d0005ad0 tx=0x7f44d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.393+0000 7f44dd7fa700 1 -- 172.21.15.90:0/2443108208 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f44d8080f30 con 0x7f44e0180960 2022-07-05T11:46:14.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.552+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f44e017c2a0 con 0x7f44e0180960 2022-07-05T11:46:14.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.552+0000 7f44dd7fa700 1 -- 172.21.15.90:0/2443108208 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f44e017c2a0 con 0x7f44e0180960 2022-07-05T11:46:14.554 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2022-07-05T11:46:14.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f44c008ba40 msgr2=0x7f44c008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f44c008ba40 0x7f44c008df00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f44d0005ad0 tx=0x7f44d0009040).stop 2022-07-05T11:46:14.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e0180960 msgr2=0x7f44e017c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e0180960 0x7f44e017c580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f44d800c460 tx=0x7f44d8007e10).stop 2022-07-05T11:46:14.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 shutdown_connections 2022-07-05T11:46:14.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f44c008ba40 0x7f44c008df00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e0180960 0x7f44e017c580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e01784b0 0x7f44e00f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 --2- 172.21.15.90:0/2443108208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44e0178890 0x7f44e0192640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 >> 172.21.15.90:0/2443108208 conn(0x7f44e00f1680 msgr2=0x7f44e0181a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:14.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 shutdown_connections 2022-07-05T11:46:14.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.554+0000 7f44e7365700 1 -- 172.21.15.90:0/2443108208 wait complete. 2022-07-05T11:46:14.568 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-07-05T11:46:14.569 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:14.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.678+0000 7f9c57d7f700 1 Processor -- start 2022-07-05T11:46:14.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.678+0000 7f9c57d7f700 1 -- start start 2022-07-05T11:46:14.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c57d7f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9c5017da60 0x7f9c5017de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c57d7f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c500c7d00 0x7f9c5017eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c57d7f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500c9090 con 0x7f9c5017f070 2022-07-05T11:46:14.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c57d7f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500c81a0 con 0x7f9c500c7d00 2022-07-05T11:46:14.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c57d7f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500c8480 con 0x7f9c5017da60 2022-07-05T11:46:14.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c5531a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c500c7d00 0x7f9c5017eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c5531a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c500c7d00 0x7f9c5017eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56592/0 (socket says 172.21.15.90:56592) 2022-07-05T11:46:14.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c5531a700 1 -- 172.21.15.90:0/1374647267 learned_addr learned my addr 172.21.15.90:0/1374647267 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:14.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.679+0000 7f9c55b1b700 1 --2- 172.21.15.90:0/1374647267 >> v2:172.21.15.149:3300/0 conn(0x7f9c5017da60 0x7f9c5017de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c5531a700 1 -- 172.21.15.90:0/1374647267 >> v2:172.21.15.149:3300/0 conn(0x7f9c5017da60 msgr2=0x7f9c5017de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:14.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c5531a700 1 --2- 172.21.15.90:0/1374647267 >> v2:172.21.15.149:3300/0 conn(0x7f9c5017da60 0x7f9c5017de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c5531a700 1 -- 172.21.15.90:0/1374647267 >> v1:172.21.15.110:6789/0 conn(0x7f9c5017f070 legacy=0x7f9c500c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c5531a700 1 -- 172.21.15.90:0/1374647267 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500c8760 con 0x7f9c500c7d00 2022-07-05T11:46:14.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c55b1b700 1 --2- 172.21.15.90:0/1374647267 >> v2:172.21.15.149:3300/0 conn(0x7f9c5017da60 0x7f9c5017de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:14.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c5531a700 1 --2- 172.21.15.90:0/1374647267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c500c7d00 0x7f9c5017eb80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f9c40006fd0 tx=0x7f9c400090f0).ready entity=mon.0 client_cookie=a2060df1eee54fb1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c54b19700 1 -- 172.21.15.90:0/1374647267 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000b600 con 0x7f9c500c7d00 2022-07-05T11:46:14.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c54b19700 1 -- 172.21.15.90:0/1374647267 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000b760 con 0x7f9c500c7d00 2022-07-05T11:46:14.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c54b19700 1 -- 172.21.15.90:0/1374647267 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000bae0 con 0x7f9c500c7d00 2022-07-05T11:46:14.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 -- 172.21.15.90:0/1374647267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c500c7d00 msgr2=0x7f9c5017eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/1374647267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c500c7d00 0x7f9c5017eb80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f9c40006fd0 tx=0x7f9c400090f0).stop 2022-07-05T11:46:14.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 -- 172.21.15.90:0/1374647267 shutdown_connections 2022-07-05T11:46:14.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/1374647267 >> v2:172.21.15.149:3300/0 conn(0x7f9c5017da60 0x7f9c5017de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/1374647267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c500c7d00 0x7f9c5017eb80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 -- 172.21.15.90:0/1374647267 >> 172.21.15.90:0/1374647267 conn(0x7f9c500f4b70 msgr2=0x7f9c500f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:14.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 -- 172.21.15.90:0/1374647267 shutdown_connections 2022-07-05T11:46:14.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.680+0000 7f9c57d7f700 1 -- 172.21.15.90:0/1374647267 wait complete. 2022-07-05T11:46:14.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.682+0000 7f9c57d7f700 1 Processor -- start 2022-07-05T11:46:14.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.682+0000 7f9c57d7f700 1 -- start start 2022-07-05T11:46:14.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c57d7f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c500c7d00 0x7f9c501714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c57d7f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c5017da60 0x7f9c5016d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c57d7f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5017f070 0x7f9c5017f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c57d7f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50172c60 con 0x7f9c5017da60 2022-07-05T11:46:14.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c57d7f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5017d3a0 con 0x7f9c500c7d00 2022-07-05T11:46:14.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c57d7f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50171d70 con 0x7f9c5017f070 2022-07-05T11:46:14.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c5017da60 0x7f9c5016d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c5017da60 0x7f9c5016d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56598/0 (socket says 172.21.15.90:56598) 2022-07-05T11:46:14.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 -- 172.21.15.90:0/3858640744 learned_addr learned my addr 172.21.15.90:0/3858640744 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:14.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c55b1b700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c500c7d00 0x7f9c501714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5631c700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5017f070 0x7f9c5017f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 -- 172.21.15.90:0/3858640744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5017f070 msgr2=0x7f9c5017f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5017f070 0x7f9c5017f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 -- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c500c7d00 msgr2=0x7f9c501714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c500c7d00 0x7f9c501714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 -- 172.21.15.90:0/3858640744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c40009370 con 0x7f9c5017da60 2022-07-05T11:46:14.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5631c700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5017f070 0x7f9c5017f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:14.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c5531a700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c5017da60 0x7f9c5016d5d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f9c50088b30 tx=0x7f9c40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c3dffb700 1 -- 172.21.15.90:0/3858640744 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000b8d0 con 0x7f9c5017da60 2022-07-05T11:46:14.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c3dffb700 1 -- 172.21.15.90:0/3858640744 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000ba30 con 0x7f9c5017da60 2022-07-05T11:46:14.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c50172050 con 0x7f9c5017da60 2022-07-05T11:46:14.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.683+0000 7f9c3dffb700 1 -- 172.21.15.90:0/3858640744 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4001b690 con 0x7f9c5017da60 2022-07-05T11:46:14.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.684+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c50172610 con 0x7f9c5017da60 2022-07-05T11:46:14.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.684+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c501804f0 con 0x7f9c5017da60 2022-07-05T11:46:14.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.685+0000 7f9c3dffb700 1 -- 172.21.15.90:0/3858640744 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f9c4000f070 con 0x7f9c5017da60 2022-07-05T11:46:14.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.686+0000 7f9c3dffb700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9c3008ba40 0x7f9c3008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:14.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.686+0000 7f9c3dffb700 1 -- 172.21.15.90:0/3858640744 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f9c400b1e90 con 0x7f9c5017da60 2022-07-05T11:46:14.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.686+0000 7f9c55b1b700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9c3008ba40 0x7f9c3008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:14.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.686+0000 7f9c55b1b700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9c3008ba40 0x7f9c3008df00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9c48007600 tx=0x7f9c48009850).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:14.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.689+0000 7f9c3dffb700 1 -- 172.21.15.90:0/3858640744 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f9c501804f0 con 0x7f9c5017da60 2022-07-05T11:46:14.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.888+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c501804f0 con 0x7f9c5017da60 2022-07-05T11:46:14.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.889+0000 7f9c3dffb700 1 -- 172.21.15.90:0/3858640744 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+10551 (secure 0 0 0) 0x7f9c501804f0 con 0x7f9c5017da60 2022-07-05T11:46:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:14.892 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4340,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4341,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4346,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4362,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:08.970372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-07-05T11:46:14.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9c3008ba40 msgr2=0x7f9c3008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9c3008ba40 0x7f9c3008df00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9c48007600 tx=0x7f9c48009850).stop 2022-07-05T11:46:14.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c5017da60 msgr2=0x7f9c5016d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:14.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c5017da60 0x7f9c5016d5d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f9c50088b30 tx=0x7f9c40017000).stop 2022-07-05T11:46:14.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 shutdown_connections 2022-07-05T11:46:14.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9c3008ba40 0x7f9c3008df00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5017f070 0x7f9c5017f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c500c7d00 0x7f9c501714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 --2- 172.21.15.90:0/3858640744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c5017da60 0x7f9c5016d5d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:14.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 >> 172.21.15.90:0/3858640744 conn(0x7f9c500f4b70 msgr2=0x7f9c500f4380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:14.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 shutdown_connections 2022-07-05T11:46:14.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:14.890+0000 7f9c57d7f700 1 -- 172.21.15.90:0/3858640744 wait complete. 2022-07-05T11:46:14.900 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2022-07-05T11:46:16.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-07-05T11:46:04.574721+0000', 'modified': '2022-07-05T11:46:08.970372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4371}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4371': {'gid': 4371, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/3440068716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 3440068716}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3440068716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2022-07-05T11:46:16.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-07-05T11:46:16.121 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-07-05T11:46:16.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.248+0000 7f89a4a8e700 1 Processor -- start 2022-07-05T11:46:16.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.248+0000 7f89a4a8e700 1 -- start start 2022-07-05T11:46:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f89a4a8e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f89a017da60 0x7f89a017de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f89a4a8e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f89a00c7d00 0x7f89a017eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f89a4a8e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a00c9090 con 0x7f89a017f070 2022-07-05T11:46:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f89a4a8e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a00c81a0 con 0x7f89a00c7d00 2022-07-05T11:46:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f89a4a8e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a00c8480 con 0x7f89a017da60 2022-07-05T11:46:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f89a00c7d00 0x7f89a017eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f89a00c7d00 0x7f89a017eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56606/0 (socket says 172.21.15.90:56606) 2022-07-05T11:46:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 -- 172.21.15.90:0/3445421898 learned_addr learned my addr 172.21.15.90:0/3445421898 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899e59c700 1 --2- 172.21.15.90:0/3445421898 >> v2:172.21.15.149:3300/0 conn(0x7f89a017da60 0x7f89a017de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 -- 172.21.15.90:0/3445421898 >> v2:172.21.15.149:3300/0 conn(0x7f89a017da60 msgr2=0x7f89a017de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 --2- 172.21.15.90:0/3445421898 >> v2:172.21.15.149:3300/0 conn(0x7f89a017da60 0x7f89a017de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 -- 172.21.15.90:0/3445421898 >> v1:172.21.15.149:6789/0 conn(0x7f89a017f070 legacy=0x7f89a00c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 -- 172.21.15.90:0/3445421898 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00c8760 con 0x7f89a00c7d00 2022-07-05T11:46:16.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899dd9b700 1 --2- 172.21.15.90:0/3445421898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a00c7d00 0x7f89a017eb80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8988006fd0 tx=0x7f89880090f0).ready entity=mon.0 client_cookie=691eda9eaccc0163 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:16.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899d59a700 1 -- 172.21.15.90:0/3445421898 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800b580 con 0x7f89a00c7d00 2022-07-05T11:46:16.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899d59a700 1 -- 172.21.15.90:0/3445421898 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898800b6e0 con 0x7f89a00c7d00 2022-07-05T11:46:16.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.250+0000 7f899d59a700 1 -- 172.21.15.90:0/3445421898 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800ba60 con 0x7f89a00c7d00 2022-07-05T11:46:16.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3445421898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a00c7d00 msgr2=0x7f89a017eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3445421898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a00c7d00 0x7f89a017eb80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8988006fd0 tx=0x7f89880090f0).stop 2022-07-05T11:46:16.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3445421898 shutdown_connections 2022-07-05T11:46:16.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3445421898 >> v2:172.21.15.149:3300/0 conn(0x7f89a017da60 0x7f89a017de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3445421898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a00c7d00 0x7f89a017eb80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3445421898 >> 172.21.15.90:0/3445421898 conn(0x7f89a00f4b70 msgr2=0x7f89a00f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3445421898 shutdown_connections 2022-07-05T11:46:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.251+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3445421898 wait complete. 2022-07-05T11:46:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.252+0000 7f89a4a8e700 1 Processor -- start 2022-07-05T11:46:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.252+0000 7f89a4a8e700 1 -- start start 2022-07-05T11:46:16.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f89a4a8e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a00c7d00 0x7f89a0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f89a4a8e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a017da60 0x7f89a016a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f89a4a8e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a017f070 0x7f89a0085c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f89a4a8e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00857c0 con 0x7f89a017f070 2022-07-05T11:46:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f89a4a8e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a0153240 con 0x7f89a00c7d00 2022-07-05T11:46:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f89a4a8e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00848d0 con 0x7f89a017da60 2022-07-05T11:46:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f899ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a017f070 0x7f89a0085c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f899ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a017f070 0x7f89a0085c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56614/0 (socket says 172.21.15.90:56614) 2022-07-05T11:46:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.253+0000 7f899ed9d700 1 -- 172.21.15.90:0/3449135060 learned_addr learned my addr 172.21.15.90:0/3449135060 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899dd9b700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a017da60 0x7f89a016a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899e59c700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a00c7d00 0x7f89a0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899ed9d700 1 -- 172.21.15.90:0/3449135060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a017da60 msgr2=0x7f89a016a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899ed9d700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a017da60 0x7f89a016a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899ed9d700 1 -- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a00c7d00 msgr2=0x7f89a0152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899ed9d700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a00c7d00 0x7f89a0152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899ed9d700 1 -- 172.21.15.90:0/3449135060 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8988009370 con 0x7f89a017f070 2022-07-05T11:46:16.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899e59c700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a00c7d00 0x7f89a0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:16.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f899ed9d700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a017f070 0x7f89a0085c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8998009440 tx=0x7f8998006e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:16.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f89967fc700 1 -- 172.21.15.90:0/3449135060 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998013460 con 0x7f89a017f070 2022-07-05T11:46:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f89967fc700 1 -- 172.21.15.90:0/3449135060 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89980135e0 con 0x7f89a017f070 2022-07-05T11:46:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a0084bb0 con 0x7f89a017f070 2022-07-05T11:46:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f89967fc700 1 -- 172.21.15.90:0/3449135060 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980139a0 con 0x7f89a017f070 2022-07-05T11:46:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.254+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a0085170 con 0x7f89a017f070 2022-07-05T11:46:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.256+0000 7f89967fc700 1 -- 172.21.15.90:0/3449135060 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f899800f070 con 0x7f89a017f070 2022-07-05T11:46:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.256+0000 7f89967fc700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f898408ba10 0x7f898408ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.257+0000 7f89967fc700 1 -- 172.21.15.90:0/3449135060 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f89980b0080 con 0x7f89a017f070 2022-07-05T11:46:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.257+0000 7f899e59c700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f898408ba10 0x7f898408ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.257+0000 7f899e59c700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f898408ba10 0x7f898408ded0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8990007460 tx=0x7f899000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.258+0000 7f89b641ab80 1 Processor -- start 2022-07-05T11:46:16.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.258+0000 7f89b641ab80 1 -- start start 2022-07-05T11:46:16.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6bf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6bfc60 0x55e11e70d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703750 0x55e11e703bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f89b641ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e689280 con 0x55e11e703370 2022-07-05T11:46:16.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f89b641ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e600a50 con 0x55e11e703750 2022-07-05T11:46:16.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f89b641ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e615900 con 0x55e11e6bfc60 2022-07-05T11:46:16.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f899e59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6bf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f899e59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6bf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56618/0 (socket says 172.21.15.90:56618) 2022-07-05T11:46:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.259+0000 7f899e59c700 1 -- 172.21.15.90:0/701806410 learned_addr learned my addr 172.21.15.90:0/701806410 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899dd9b700 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6bfc60 0x55e11e70d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899ed9d700 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703750 0x55e11e703bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899e59c700 1 -- 172.21.15.90:0/701806410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6bfc60 msgr2=0x55e11e70d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899e59c700 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6bfc60 0x55e11e70d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899e59c700 1 -- 172.21.15.90:0/701806410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703750 msgr2=0x55e11e703bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899e59c700 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703750 0x55e11e703bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899e59c700 1 -- 172.21.15.90:0/701806410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e11e447990 con 0x55e11e703370 2022-07-05T11:46:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f899e59c700 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6bf770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f89900147f0 tx=0x7f8990014000).ready entity=mon.0 client_cookie=ed2df8f215b19160 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f897f7fe700 1 -- 172.21.15.90:0/701806410 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990013750 con 0x55e11e703370 2022-07-05T11:46:16.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f897f7fe700 1 -- 172.21.15.90:0/701806410 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8990018070 con 0x55e11e703370 2022-07-05T11:46:16.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.260+0000 7f897f7fe700 1 -- 172.21.15.90:0/701806410 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900138b0 con 0x55e11e703370 2022-07-05T11:46:16.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 -- 172.21.15.90:0/701806410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 msgr2=0x55e11e6bf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6bf770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f89900147f0 tx=0x7f8990014000).stop 2022-07-05T11:46:16.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 -- 172.21.15.90:0/701806410 shutdown_connections 2022-07-05T11:46:16.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703750 0x55e11e703bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6bf770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 --2- 172.21.15.90:0/701806410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6bfc60 0x55e11e70d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 -- 172.21.15.90:0/701806410 >> 172.21.15.90:0/701806410 conn(0x55e11e52e170 msgr2=0x55e11e6c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:16.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 -- 172.21.15.90:0/701806410 shutdown_connections 2022-07-05T11:46:16.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 -- 172.21.15.90:0/701806410 wait complete. 2022-07-05T11:46:16.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.261+0000 7f89b641ab80 1 -- start start 2022-07-05T11:46:16.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.262+0000 7f89b641ab80 1 Processor -- start 2022-07-05T11:46:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e6f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6ff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e703750 0x55e11e7431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e5dd0d0 con 0x55e11e703370 2022-07-05T11:46:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e6ff820 con 0x55e11e6bfc60 2022-07-05T11:46:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e743ec0 con 0x55e11e703750 2022-07-05T11:46:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 10 client.0 ll_register_callbacks cb 0x55e11e683160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6ff330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56626/0 (socket says 172.21.15.90:56626) 2022-07-05T11:46:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 -- 172.21.15.90:0/1602327091 learned_addr learned my addr 172.21.15.90:0/1602327091 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899ed9d700 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e703750 0x55e11e7431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899e59c700 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e6f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 -- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e703750 msgr2=0x55e11e7431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e703750 0x55e11e7431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 -- 172.21.15.90:0/1602327091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 msgr2=0x55e11e6f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e6f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 -- 172.21.15.90:0/1602327091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8990014410 con 0x55e11e703370 2022-07-05T11:46:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f899dd9b700 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6ff330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8988009f50 tx=0x7f8988017000).ready entity=mon.0 client_cookie=391248b8da806e51 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f897cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f897cff9700 1 -- 172.21.15.90:0/1602327091 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898801c630 con 0x55e11e703370 2022-07-05T11:46:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f897cff9700 1 -- 172.21.15.90:0/1602327091 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f898801c790 con 0x55e11e703370 2022-07-05T11:46:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.263+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e11e6bd3f0 con 0x55e11e703370 2022-07-05T11:46:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f897cff9700 1 -- 172.21.15.90:0/1602327091 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f898801cb60 con 0x55e11e703370 2022-07-05T11:46:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 10 client.4569 fetch_fsmap learned FSMap version 7 2022-07-05T11:46:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e11e4b6c80 con 0x55e11e703370 2022-07-05T11:46:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f897cff9700 1 -- 172.21.15.90:0/1602327091 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e11e6bd3f0 con 0x55e11e703370 2022-07-05T11:46:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f897cff9700 1 -- 172.21.15.90:0/1602327091 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f89880098e0 con 0x55e11e703370 2022-07-05T11:46:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 10 client.4569 fetch_fsmap finished waiting for FSMap version 7 2022-07-05T11:46:16.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 10 client.4569 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:16.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 20 client.4569 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:16.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e6c37e0 0x55e11e74e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 4 client.4569 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:16.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e11e60b7a0 con 0x55e11e6c37e0 2022-07-05T11:46:16.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.264+0000 7f899e59c700 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e6c37e0 0x55e11e74e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f897cff9700 10 client.4569 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:16.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f899e59c700 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e6c37e0 0x55e11e74e130 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cda90658711e8287 server_cookie=f8e1968e6144421e in_seq=0 out_seq=0 2022-07-05T11:46:16.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f897cff9700 1 -- 172.21.15.90:0/1602327091 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55e11e60b7a0 con 0x55e11e6c37e0 2022-07-05T11:46:16.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f897cff9700 10 client.4569 handle_command_reply: tid=0 2022-07-05T11:46:16.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f89b641ab80 1 client.4569 shutdown 2022-07-05T11:46:16.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 msgr2=0x55e11e6ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6ff330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8988009f50 tx=0x7f8988017000).stop 2022-07-05T11:46:16.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 shutdown_connections 2022-07-05T11:46:16.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.265+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e6c37e0 0x55e11e74e130 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e703750 0x55e11e7431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f897cff9700 0 client.4569 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:16.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e6f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1602327091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6ff330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 >> 172.21.15.90:0/1602327091 conn(0x55e11e52e170 msgr2=0x55e11e6c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:16.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 shutdown_connections 2022-07-05T11:46:16.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f89b641ab80 1 -- 172.21.15.90:0/1602327091 wait complete. 2022-07-05T11:46:16.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.266+0000 7f89b641ab80 20 client.4569 trim_cache size 0 max 16384 2022-07-05T11:46:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.282+0000 7f89b641ab80 1 Processor -- start 2022-07-05T11:46:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.282+0000 7f89b641ab80 1 -- start start 2022-07-05T11:46:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e734c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 0x55e11e703b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6f8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f89b641ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e736120 con 0x55e11e703370 2022-07-05T11:46:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f89b641ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e70b860 con 0x55e11e6bfc60 2022-07-05T11:46:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f89b641ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e741560 con 0x55e11e6c37e0 2022-07-05T11:46:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56636/0 (socket says 172.21.15.90:56636) 2022-07-05T11:46:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 -- 172.21.15.90:0/3270199909 learned_addr learned my addr 172.21.15.90:0/3270199909 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899e59c700 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e734c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 -- 172.21.15.90:0/3270199909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 msgr2=0x55e11e703b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 0x55e11e703b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 -- 172.21.15.90:0/3270199909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 msgr2=0x55e11e734c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e734c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 -- 172.21.15.90:0/3270199909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e11e484f80 con 0x55e11e703370 2022-07-05T11:46:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899e59c700 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e734c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.283+0000 7f899ed9d700 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6f8350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8998084910 tx=0x7f8998054040).ready entity=mon.0 client_cookie=61b3ac2caf0c36d3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f897ffff700 1 -- 172.21.15.90:0/3270199909 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998057040 con 0x55e11e703370 2022-07-05T11:46:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f897ffff700 1 -- 172.21.15.90:0/3270199909 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8998082d20 con 0x55e11e703370 2022-07-05T11:46:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f897ffff700 1 -- 172.21.15.90:0/3270199909 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998081090 con 0x55e11e703370 2022-07-05T11:46:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 -- 172.21.15.90:0/3270199909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 msgr2=0x55e11e6f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6f8350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8998084910 tx=0x7f8998054040).stop 2022-07-05T11:46:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 -- 172.21.15.90:0/3270199909 shutdown_connections 2022-07-05T11:46:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e703370 0x55e11e6f8350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e6bfc60 0x55e11e734c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 --2- 172.21.15.90:0/3270199909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 0x55e11e703b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 -- 172.21.15.90:0/3270199909 >> 172.21.15.90:0/3270199909 conn(0x55e11e52e170 msgr2=0x55e11e752150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 -- 172.21.15.90:0/3270199909 shutdown_connections 2022-07-05T11:46:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.284+0000 7f89b641ab80 1 -- 172.21.15.90:0/3270199909 wait complete. 2022-07-05T11:46:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.285+0000 7f89b641ab80 1 -- start start 2022-07-05T11:46:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.285+0000 7f89b641ab80 1 Processor -- start 2022-07-05T11:46:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e6bfc60 0x55e11e70afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 0x55e11e705850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f89b641ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703370 0x55e11e797450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f89b641ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e701cc0 con 0x55e11e6bfc60 2022-07-05T11:46:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f89b641ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e703e60 con 0x55e11e703370 2022-07-05T11:46:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f89b641ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11e745940 con 0x55e11e6c37e0 2022-07-05T11:46:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f89b641ab80 10 client.0 ll_register_callbacks cb 0x55e11e683160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f899e59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e6bfc60 0x55e11e70afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f899e59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e6bfc60 0x55e11e70afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56638/0 (socket says 172.21.15.90:56638) 2022-07-05T11:46:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f899e59c700 1 -- 172.21.15.90:0/1701726574 learned_addr learned my addr 172.21.15.90:0/1701726574 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.286+0000 7f899ed9d700 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703370 0x55e11e797450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f899dd9b700 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 0x55e11e705850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f899e59c700 1 -- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 msgr2=0x55e11e705850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f899e59c700 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 0x55e11e705850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f899e59c700 1 -- 172.21.15.90:0/1701726574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703370 msgr2=0x55e11e797450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f899e59c700 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703370 0x55e11e797450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f899e59c700 1 -- 172.21.15.90:0/1701726574 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a0085170 con 0x55e11e6bfc60 2022-07-05T11:46:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f899e59c700 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e6bfc60 0x55e11e70afc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f8990007fd0 tx=0x7f8990018000).ready entity=mon.0 client_cookie=a52eaafb20fe942e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f897cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f897cff9700 1 -- 172.21.15.90:0/1701726574 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990013ce0 con 0x55e11e6bfc60 2022-07-05T11:46:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f897cff9700 1 -- 172.21.15.90:0/1701726574 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f8990013e40 con 0x55e11e6bfc60 2022-07-05T11:46:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8990018070 con 0x55e11e6bfc60 2022-07-05T11:46:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f897cff9700 1 -- 172.21.15.90:0/1701726574 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f899002e800 con 0x55e11e6bfc60 2022-07-05T11:46:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 10 client.4575 fetch_fsmap learned FSMap version 7 2022-07-05T11:46:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e11e72ebb0 con 0x55e11e6bfc60 2022-07-05T11:46:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f897cff9700 1 -- 172.21.15.90:0/1701726574 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8990018070 con 0x55e11e6bfc60 2022-07-05T11:46:16.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f897cff9700 1 -- 172.21.15.90:0/1701726574 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f899002e960 con 0x55e11e6bfc60 2022-07-05T11:46:16.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 10 client.4575 fetch_fsmap finished waiting for FSMap version 7 2022-07-05T11:46:16.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 10 client.4575 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:16.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 20 client.4575 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e703750 0x55e11e79b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 4 client.4575 mds_command: new command op to 4371 tid=0[{"prefix": "status"}] 2022-07-05T11:46:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.287+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e11e602640 con 0x55e11e703750 2022-07-05T11:46:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f899dd9b700 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e703750 0x55e11e79b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f897cff9700 10 client.4575 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f899dd9b700 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e703750 0x55e11e79b700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=517239687e666bd9 server_cookie=e83e66f790be2a67 in_seq=0 out_seq=0 2022-07-05T11:46:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f897cff9700 1 -- 172.21.15.90:0/1701726574 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55e11e602640 con 0x55e11e703750 2022-07-05T11:46:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f897cff9700 10 client.4575 handle_command_reply: tid=0 2022-07-05T11:46:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 client.4575 shutdown 2022-07-05T11:46:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e6bfc60 msgr2=0x55e11e70afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e6bfc60 0x55e11e70afc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f8990007fd0 tx=0x7f8990018000).stop 2022-07-05T11:46:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 shutdown_connections 2022-07-05T11:46:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e11e703750 0x55e11e79b700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e11e703370 0x55e11e797450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e11e6bfc60 0x55e11e70afc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 --2- 172.21.15.90:0/1701726574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e11e6c37e0 0x55e11e705850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f897cff9700 0 client.4575 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 >> 172.21.15.90:0/1701726574 conn(0x55e11e52e170 msgr2=0x55e11e6c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 shutdown_connections 2022-07-05T11:46:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 1 -- 172.21.15.90:0/1701726574 wait complete. 2022-07-05T11:46:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.288+0000 7f89b641ab80 20 client.4575 trim_cache size 0 max 16384 2022-07-05T11:46:16.328 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:16.328 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:16.328 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2022-07-05T11:46:16.328 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4371, 2022-07-05T11:46:16.329 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:16.329 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:16.329 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:16.330 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 11.713244569, 2022-07-05T11:46:16.330 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 7, 2022-07-05T11:46:16.330 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:16.330 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 29, 2022-07-05T11:46:16.331 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 15.977981602 2022-07-05T11:46:16.331 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:16.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f898408ba10 msgr2=0x7f898408ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f898408ba10 0x7f898408ded0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8990007460 tx=0x7f899000b040).stop 2022-07-05T11:46:16.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a017f070 msgr2=0x7f89a0085c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:16.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a017f070 0x7f89a0085c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8998009440 tx=0x7f8998006e70).stop 2022-07-05T11:46:16.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 shutdown_connections 2022-07-05T11:46:16.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f898408ba10 0x7f898408ded0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89a017f070 0x7f89a0085c50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a00c7d00 0x7f89a0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 --2- 172.21.15.90:0/3449135060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a017da60 0x7f89a016a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 >> 172.21.15.90:0/3449135060 conn(0x7f89a00f4b70 msgr2=0x7f89a00c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 shutdown_connections 2022-07-05T11:46:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:16.289+0000 7f89a4a8e700 1 -- 172.21.15.90:0/3449135060 wait complete. 2022-07-05T11:46:16.336 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-07-05T11:46:16.336 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2022-07-05T11:46:16.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T11:46:16.337 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.admin 2022-07-05T11:46:16.353 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2022-07-05T11:46:16.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2022-07-05T11:46:16.419 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-07-05T11:46:16.420 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-07-05T11:46:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-07-05T11:46:16.482 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-07-05T11:46:16.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T11:46:16.484 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2022-07-05T11:46:16.538 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-07-05T11:46:16.539 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id admin --client_fs=cephfs /home/ubuntu/cephtest/mnt.admin 2022-07-05T11:46:16.582 DEBUG:teuthology.orchestra.run.smithi090:> sudo modprobe fuse 2022-07-05T11:46:16.605 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-07-05T11:46:16.606 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-07-05T11:46:16.671 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-07-05T11:46:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-07-05T11:46:16.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T11:46:16.675 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2022-07-05T11:46:16.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi090.stderr:2022-07-05T11:46:16.673+0000 7f30694f1380 -1 init, newargv = 0x55801d39ce60 newargc=15 2022-07-05T11:46:16.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi090.stderr:ceph-fuse[42770]: starting ceph client 2022-07-05T11:46:16.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi090.stderr:ceph-fuse[42770]: starting fuse 2022-07-05T11:46:16.691 INFO:teuthology.orchestra.run.smithi090.stdout:47 2022-07-05T11:46:16.692 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2022-07-05T11:46:16.693 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-07-05T11:46:16.694 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2022-07-05T11:46:16.695 DEBUG:teuthology.orchestra.run.smithi090:> import re 2022-07-05T11:46:16.695 DEBUG:teuthology.orchestra.run.smithi090:> import os 2022-07-05T11:46:16.696 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2022-07-05T11:46:16.697 DEBUG:teuthology.orchestra.run.smithi090:> 2022-07-05T11:46:16.697 DEBUG:teuthology.orchestra.run.smithi090:> def _find_admin_socket(client_name): 2022-07-05T11:46:16.698 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2022-07-05T11:46:16.698 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2022-07-05T11:46:16.699 DEBUG:teuthology.orchestra.run.smithi090:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2022-07-05T11:46:16.700 DEBUG:teuthology.orchestra.run.smithi090:> 2022-07-05T11:46:16.700 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2022-07-05T11:46:16.701 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2022-07-05T11:46:16.701 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2022-07-05T11:46:16.702 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2022-07-05T11:46:16.702 DEBUG:teuthology.orchestra.run.smithi090:> 2022-07-05T11:46:16.703 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2022-07-05T11:46:16.704 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-07-05T11:46:16.704 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2022-07-05T11:46:16.704 DEBUG:teuthology.orchestra.run.smithi090:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-07-05T11:46:16.705 DEBUG:teuthology.orchestra.run.smithi090:> contents = proc_f.read() 2022-07-05T11:46:16.705 DEBUG:teuthology.orchestra.run.smithi090:> if mountpoint in contents: 2022-07-05T11:46:16.706 DEBUG:teuthology.orchestra.run.smithi090:> return f 2022-07-05T11:46:16.706 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-07-05T11:46:16.707 DEBUG:teuthology.orchestra.run.smithi090:> 2022-07-05T11:46:16.707 DEBUG:teuthology.orchestra.run.smithi090:> print(_find_admin_socket("client.admin")) 2022-07-05T11:46:16.711 DEBUG:teuthology.orchestra.run.smithi090:> ' 2022-07-05T11:46:16.811 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.admin.42770.asok 2022-07-05T11:46:16.993 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42770.asok 2022-07-05T11:46:16.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T11:46:16.995 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42770.asok status 2022-07-05T11:46:17.141 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:17.142 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2022-07-05T11:46:17.142 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "494bbf8c4cff5775f04a6a479335587c213bcf08", 2022-07-05T11:46:17.143 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable)", 2022-07-05T11:46:17.143 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "admin", 2022-07-05T11:46:17.144 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2022-07-05T11:46:17.144 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2022-07-05T11:46:17.145 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "42770", 2022-07-05T11:46:17.145 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2022-07-05T11:46:17.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2022-07-05T11:46:17.148 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2022-07-05T11:46:17.148 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2022-07-05T11:46:17.149 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4584, 2022-07-05T11:46:17.149 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2022-07-05T11:46:17.149 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2022-07-05T11:46:17.150 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2022-07-05T11:46:17.150 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4584 2022-07-05T11:46:17.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2022-07-05T11:46:17.152 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2022-07-05T11:46:17.153 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2022-07-05T11:46:17.153 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "192.168.0.1:0", 2022-07-05T11:46:17.154 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 876752885 2022-07-05T11:46:17.154 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:46:17.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2022-07-05T11:46:17.156 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2022-07-05T11:46:17.156 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2022-07-05T11:46:17.157 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "192.168.0.1:0", 2022-07-05T11:46:17.157 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 876752885 2022-07-05T11:46:17.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2022-07-05T11:46:17.158 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.4584 192.168.0.1:0/876752885", 2022-07-05T11:46:17.159 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "192.168.0.1:0/876752885", 2022-07-05T11:46:17.159 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2022-07-05T11:46:17.160 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 7, 2022-07-05T11:46:17.160 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 31, 2022-07-05T11:46:17.160 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2022-07-05T11:46:17.161 INFO:teuthology.orchestra.run.smithi090.stdout: "blocklisted": false, 2022-07-05T11:46:17.161 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2022-07-05T11:46:17.162 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:17.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T11:46:17.166 DEBUG:teuthology.orchestra.run.smithi090:> stat --file-system '--printf=%T 2022-07-05T11:46:17.167 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.admin 2022-07-05T11:46:17.184 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2022-07-05T11:46:17.184 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2022-07-05T11:46:17.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T11:46:17.186 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2022-07-05T11:46:17.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T11:46:17.254 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2022-07-05T11:46:17.360 INFO:teuthology.orchestra.run.smithi090.stdout:# file: . 2022-07-05T11:46:17.361 INFO:teuthology.orchestra.run.smithi090.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2022-07-05T11:46:17.361 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:17.362 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2022-07-05T11:46:17.363 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-07-05T11:46:17.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2022-07-05T11:46:17.395 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi090.stderr:ceph-fuse[42770]: fuse finished with error 0 and tester_r 0 2022-07-05T11:46:17.397 INFO:teuthology.orchestra.run:waiting for 900 2022-07-05T11:46:17.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2022-07-05T11:46:17.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:17.469 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2022-07-05T11:46:17.485 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.635+0000 7fa4bdfef700 1 Processor -- start 2022-07-05T11:46:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.635+0000 7fa4bdfef700 1 -- start start 2022-07-05T11:46:17.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4bdfef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4b817e110 0x7fa4b8067100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4bdfef700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa4b80675f0 0x7fa4b817ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4bdfef700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b8068ca0 con 0x7fa4b817f120 2022-07-05T11:46:17.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4bdfef700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b8067db0 con 0x7fa4b80675f0 2022-07-05T11:46:17.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4bdfef700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b8068090 con 0x7fa4b817e110 2022-07-05T11:46:17.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b6ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa4b80675f0 0x7fa4b817ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b7fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa4b817f120 0x7fa4b817fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49602/0 (socket says 172.21.15.90:49602) 2022-07-05T11:46:17.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b7fff700 1 -- 172.21.15.90:0/3375165892 learned_addr learned my addr 172.21.15.90:0/3375165892 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:17.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b77fe700 1 --2- 172.21.15.90:0/3375165892 >> v2:172.21.15.149:3300/0 conn(0x7fa4b817e110 0x7fa4b8067100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b6ffd700 1 -- 172.21.15.90:0/3375165892 >> v2:172.21.15.149:3300/0 conn(0x7fa4b817e110 msgr2=0x7fa4b8067100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:17.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b6ffd700 1 --2- 172.21.15.90:0/3375165892 >> v2:172.21.15.149:3300/0 conn(0x7fa4b817e110 0x7fa4b8067100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b6ffd700 1 -- 172.21.15.90:0/3375165892 >> v1:172.21.15.90:6789/0 conn(0x7fa4b817f120 legacy=0x7fa4b817fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b67fc700 1 -- 172.21.15.90:0/3375165892 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435509048 0 0) 0x7fa4b8068ca0 con 0x7fa4b817f120 2022-07-05T11:46:17.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b6ffd700 1 -- 172.21.15.90:0/3375165892 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8068370 con 0x7fa4b80675f0 2022-07-05T11:46:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b77fe700 1 --2- 172.21.15.90:0/3375165892 >> v2:172.21.15.149:3300/0 conn(0x7fa4b817e110 0x7fa4b8067100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:17.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b6ffd700 1 --2- 172.21.15.90:0/3375165892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b80675f0 0x7fa4b817ec30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fa4b8065730 tx=0x7fa4ac009060).ready entity=mon.0 client_cookie=947386e2876d48ca server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:17.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b67fc700 1 -- 172.21.15.90:0/3375165892 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00b580 con 0x7fa4b80675f0 2022-07-05T11:46:17.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b67fc700 1 -- 172.21.15.90:0/3375165892 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac00b6e0 con 0x7fa4b80675f0 2022-07-05T11:46:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.637+0000 7fa4b67fc700 1 -- 172.21.15.90:0/3375165892 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00ba60 con 0x7fa4b80675f0 2022-07-05T11:46:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 -- 172.21.15.90:0/3375165892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b80675f0 msgr2=0x7fa4b817ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/3375165892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b80675f0 0x7fa4b817ec30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fa4b8065730 tx=0x7fa4ac009060).stop 2022-07-05T11:46:17.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 -- 172.21.15.90:0/3375165892 shutdown_connections 2022-07-05T11:46:17.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/3375165892 >> v2:172.21.15.149:3300/0 conn(0x7fa4b817e110 0x7fa4b8067100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/3375165892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b80675f0 0x7fa4b817ec30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 -- 172.21.15.90:0/3375165892 >> 172.21.15.90:0/3375165892 conn(0x7fa4b80ee330 msgr2=0x7fa4b80ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:17.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 -- 172.21.15.90:0/3375165892 shutdown_connections 2022-07-05T11:46:17.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.638+0000 7fa4bdfef700 1 -- 172.21.15.90:0/3375165892 wait complete. 2022-07-05T11:46:17.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.639+0000 7fa4bdfef700 1 Processor -- start 2022-07-05T11:46:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.639+0000 7fa4bdfef700 1 -- start start 2022-07-05T11:46:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.640+0000 7fa4bdfef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4b80675f0 0x7fa4b80c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.640+0000 7fa4bdfef700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b817e110 0x7fa4b8190040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.640+0000 7fa4bdfef700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4b817f120 0x7fa4b815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.640+0000 7fa4bdfef700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c8610 con 0x7fa4b817e110 2022-07-05T11:46:17.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.640+0000 7fa4bdfef700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c7720 con 0x7fa4b817f120 2022-07-05T11:46:17.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.640+0000 7fa4bdfef700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c7a00 con 0x7fa4b80675f0 2022-07-05T11:46:17.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b817e110 0x7fa4b8190040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b817e110 0x7fa4b8190040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56668/0 (socket says 172.21.15.90:56668) 2022-07-05T11:46:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 -- 172.21.15.90:0/2093126929 learned_addr learned my addr 172.21.15.90:0/2093126929 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b77fe700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4b80675f0 0x7fa4b80c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 -- 172.21.15.90:0/2093126929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4b80675f0 msgr2=0x7fa4b80c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4b80675f0 0x7fa4b80c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 -- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4b817f120 msgr2=0x7fa4b815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b7fff700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4b817f120 0x7fa4b815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4b817f120 0x7fa4b815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 -- 172.21.15.90:0/2093126929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0092a0 con 0x7fa4b817e110 2022-07-05T11:46:17.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b77fe700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4b80675f0 0x7fa4b80c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:17.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b7fff700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4b817f120 0x7fa4b815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:17.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4b6ffd700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b817e110 0x7fa4b8190040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fa4ac009fd0 tx=0x7fa4ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa49f7fe700 1 -- 172.21.15.90:0/2093126929 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00b850 con 0x7fa4b817e110 2022-07-05T11:46:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa49f7fe700 1 -- 172.21.15.90:0/2093126929 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac00b9b0 con 0x7fa4b817e110 2022-07-05T11:46:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80c7ce0 con 0x7fa4b817e110 2022-07-05T11:46:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa49f7fe700 1 -- 172.21.15.90:0/2093126929 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac01b690 con 0x7fa4b817e110 2022-07-05T11:46:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.641+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80c82a0 con 0x7fa4b817e110 2022-07-05T11:46:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.642+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b806be40 con 0x7fa4b817e110 2022-07-05T11:46:17.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.643+0000 7fa49f7fe700 1 -- 172.21.15.90:0/2093126929 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fa4ac02a070 con 0x7fa4b817e110 2022-07-05T11:46:17.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.643+0000 7fa49f7fe700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa49808ba10 0x7fa49808ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.644+0000 7fa49f7fe700 1 -- 172.21.15.90:0/2093126929 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa4ac0b1eb0 con 0x7fa4b817e110 2022-07-05T11:46:17.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.644+0000 7fa4b77fe700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa49808ba10 0x7fa49808ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.644+0000 7fa4b77fe700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa49808ba10 0x7fa49808ded0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa4a8007640 tx=0x7fa4a8009850).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:17.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.648+0000 7fa49f7fe700 1 -- 172.21.15.90:0/2093126929 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fa4ac082b70 con 0x7fa4b817e110 2022-07-05T11:46:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.810+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4b80c8750 con 0x7fa4b817e110 2022-07-05T11:46:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.811+0000 7fa49f7fe700 1 -- 172.21.15.90:0/2093126929 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7fa4ac028070 con 0x7fa4b817e110 2022-07-05T11:46:17.814 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:17.814 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa49808ba10 msgr2=0x7fa49808ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa49808ba10 0x7fa49808ded0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa4a8007640 tx=0x7fa4a8009850).stop 2022-07-05T11:46:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b817e110 msgr2=0x7fa4b8190040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b817e110 0x7fa4b8190040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fa4ac009fd0 tx=0x7fa4ac017000).stop 2022-07-05T11:46:17.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 shutdown_connections 2022-07-05T11:46:17.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa49808ba10 0x7fa49808ded0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4b817f120 0x7fa4b815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4b80675f0 0x7fa4b80c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 --2- 172.21.15.90:0/2093126929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4b817e110 0x7fa4b8190040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 >> 172.21.15.90:0/2093126929 conn(0x7fa4b80ee330 msgr2=0x7fa4b817e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:17.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 shutdown_connections 2022-07-05T11:46:17.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.813+0000 7fa4bdfef700 1 -- 172.21.15.90:0/2093126929 wait complete. 2022-07-05T11:46:17.827 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:17.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.937+0000 7f3a73fff700 1 Processor -- start 2022-07-05T11:46:17.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.937+0000 7f3a73fff700 1 -- start start 2022-07-05T11:46:17.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a740c45b0 0x7f3a740ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740c3a10 con 0x7f3a7417dd60 2022-07-05T11:46:17.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740f0330 con 0x7f3a7417d980 2022-07-05T11:46:17.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7417f210 con 0x7f3a740c45b0 2022-07-05T11:46:17.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a737fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a740c45b0 0x7f3a740ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a737fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a740c45b0 0x7f3a740ec0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56674/0 (socket says 172.21.15.90:56674) 2022-07-05T11:46:17.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a737fe700 1 -- 172.21.15.90:0/2206904262 learned_addr learned my addr 172.21.15.90:0/2206904262 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a737fe700 1 -- 172.21.15.90:0/2206904262 >> v1:172.21.15.149:6789/0 conn(0x7f3a7417d980 legacy=0x7f3a7417eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a737fe700 1 -- 172.21.15.90:0/2206904262 >> v1:172.21.15.110:6789/0 conn(0x7f3a7417dd60 legacy=0x7f3a740c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a737fe700 1 -- 172.21.15.90:0/2206904262 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740ed380 con 0x7f3a740c45b0 2022-07-05T11:46:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a737fe700 1 --2- 172.21.15.90:0/2206904262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a740c45b0 0x7f3a740ec0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f3a6c009f20 tx=0x7f3a6c009840).ready entity=mon.0 client_cookie=b46b67ff1d48e38 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a727fc700 1 -- 172.21.15.90:0/2206904262 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00e070 con 0x7f3a740c45b0 2022-07-05T11:46:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a727fc700 1 -- 172.21.15.90:0/2206904262 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c00ba80 con 0x7f3a740c45b0 2022-07-05T11:46:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a727fc700 1 -- 172.21.15.90:0/2206904262 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00be00 con 0x7f3a740c45b0 2022-07-05T11:46:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- 172.21.15.90:0/2206904262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a740c45b0 msgr2=0x7f3a740ec0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 --2- 172.21.15.90:0/2206904262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a740c45b0 0x7f3a740ec0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f3a6c009f20 tx=0x7f3a6c009840).stop 2022-07-05T11:46:17.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- 172.21.15.90:0/2206904262 shutdown_connections 2022-07-05T11:46:17.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 --2- 172.21.15.90:0/2206904262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a740c45b0 0x7f3a740ec0b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- 172.21.15.90:0/2206904262 >> 172.21.15.90:0/2206904262 conn(0x7f3a740f1420 msgr2=0x7f3a740f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:17.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- 172.21.15.90:0/2206904262 shutdown_connections 2022-07-05T11:46:17.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.938+0000 7f3a73fff700 1 -- 172.21.15.90:0/2206904262 wait complete. 2022-07-05T11:46:17.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.940+0000 7f3a73fff700 1 Processor -- start 2022-07-05T11:46:17.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.940+0000 7f3a73fff700 1 -- start start 2022-07-05T11:46:17.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a740c45b0 0x7f3a740cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7417d980 0x7f3a7418e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7417dd60 0x7f3a7416f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7418f730 con 0x7f3a7417dd60 2022-07-05T11:46:17.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740cad80 con 0x7f3a740c45b0 2022-07-05T11:46:17.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740cc880 con 0x7f3a7417d980 2022-07-05T11:46:17.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7417dd60 0x7f3a7416f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7417dd60 0x7f3a7416f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56682/0 (socket says 172.21.15.90:56682) 2022-07-05T11:46:17.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 -- 172.21.15.90:0/1226663568 learned_addr learned my addr 172.21.15.90:0/1226663568 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:17.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a6bfff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7417d980 0x7f3a7418e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a72ffd700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a740c45b0 0x7f3a740cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 -- 172.21.15.90:0/1226663568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7417d980 msgr2=0x7f3a7418e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7417d980 0x7f3a7418e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 -- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a740c45b0 msgr2=0x7f3a740cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:17.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a740c45b0 0x7f3a740cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:17.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 -- 172.21.15.90:0/1226663568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c009ae0 con 0x7f3a7417dd60 2022-07-05T11:46:17.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a72ffd700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a740c45b0 0x7f3a740cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:17.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a6bfff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7417d980 0x7f3a7418e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:17.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a737fe700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7417dd60 0x7f3a7416f450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3a740ebac0 tx=0x7f3a6c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:17.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a6affd700 1 -- 172.21.15.90:0/1226663568 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0092e0 con 0x7f3a7417dd60 2022-07-05T11:46:17.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a6affd700 1 -- 172.21.15.90:0/1226663568 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c01e470 con 0x7f3a7417dd60 2022-07-05T11:46:17.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740caa50 con 0x7f3a7417dd60 2022-07-05T11:46:17.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a6affd700 1 -- 172.21.15.90:0/1226663568 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c01e830 con 0x7f3a7417dd60 2022-07-05T11:46:17.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.941+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7418f170 con 0x7f3a7417dd60 2022-07-05T11:46:17.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.942+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a740ca8b0 con 0x7f3a7417dd60 2022-07-05T11:46:17.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.943+0000 7f3a6affd700 1 -- 172.21.15.90:0/1226663568 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3a6c025030 con 0x7f3a7417dd60 2022-07-05T11:46:17.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.943+0000 7f3a6affd700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5808ba40 0x7f3a5808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:17.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.943+0000 7f3a6affd700 1 -- 172.21.15.90:0/1226663568 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3a6c0b2110 con 0x7f3a7417dd60 2022-07-05T11:46:17.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.944+0000 7f3a72ffd700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5808ba40 0x7f3a5808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:17.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.944+0000 7f3a72ffd700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5808ba40 0x7f3a5808df00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f3a640026f0 tx=0x7f3a64009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:17.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:17.948+0000 7f3a6affd700 1 -- 172.21.15.90:0/1226663568 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3a740ca8b0 con 0x7f3a7417dd60 2022-07-05T11:46:18.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.108+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a740ca8b0 con 0x7f3a7417dd60 2022-07-05T11:46:18.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.109+0000 7f3a6affd700 1 -- 172.21.15.90:0/1226663568 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f3a740ca8b0 con 0x7f3a7417dd60 2022-07-05T11:46:18.111 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:18.111 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:18.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5808ba40 msgr2=0x7f3a5808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:18.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5808ba40 0x7f3a5808df00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f3a640026f0 tx=0x7f3a64009040).stop 2022-07-05T11:46:18.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7417dd60 msgr2=0x7f3a7416f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:18.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7417dd60 0x7f3a7416f450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3a740ebac0 tx=0x7f3a6c009840).stop 2022-07-05T11:46:18.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 shutdown_connections 2022-07-05T11:46:18.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5808ba40 0x7f3a5808df00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7417dd60 0x7f3a7416f450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a740c45b0 0x7f3a740cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 --2- 172.21.15.90:0/1226663568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7417d980 0x7f3a7418e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 >> 172.21.15.90:0/1226663568 conn(0x7f3a740f1420 msgr2=0x7f3a7417ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:18.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 shutdown_connections 2022-07-05T11:46:18.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.110+0000 7f3a73fff700 1 -- 172.21.15.90:0/1226663568 wait complete. 2022-07-05T11:46:18.125 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-07-05T11:46:18.206 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:46:18.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:46:18.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:46:18.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.243+0000 7fcf26347700 1 Processor -- start 2022-07-05T11:46:18.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.243+0000 7fcf26347700 1 -- start start 2022-07-05T11:46:18.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf26347700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf200ec750 0x7fcf2017cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf26347700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2017cb20 con 0x7fcf20171f80 2022-07-05T11:46:18.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf26347700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf20172360 con 0x7fcf2017d4a0 2022-07-05T11:46:18.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf26347700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf200c7b40 con 0x7fcf200ec750 2022-07-05T11:46:18.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf248e4700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcf2017d4a0 0x7fcf2017ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:45870/0 (socket says 172.21.15.90:45870) 2022-07-05T11:46:18.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf248e4700 1 -- 172.21.15.90:0/1316220167 learned_addr learned my addr 172.21.15.90:0/1316220167 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:18.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1f7fe700 1 --2- 172.21.15.90:0/1316220167 >> v2:172.21.15.110:3300/0 conn(0x7fcf200ec750 0x7fcf2017cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561180621 0 0) 0x7fcf20172360 con 0x7fcf2017d4a0 2022-07-05T11:46:18.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf0c0033f0 con 0x7fcf2017d4a0 2022-07-05T11:46:18.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 <== mon.2 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615667396 0 0) 0x7fcf0c0033f0 con 0x7fcf2017d4a0 2022-07-05T11:46:18.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 >> v2:172.21.15.110:3300/0 conn(0x7fcf200ec750 msgr2=0x7fcf2017cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:18.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 --2- 172.21.15.90:0/1316220167 >> v2:172.21.15.110:3300/0 conn(0x7fcf200ec750 0x7fcf2017cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 >> v1:172.21.15.110:6789/0 conn(0x7fcf20171f80 legacy=0x7fcf200c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:18.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200c7e20 con 0x7fcf2017d4a0 2022-07-05T11:46:18.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 <== mon.2 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fcf180017f0 con 0x7fcf2017d4a0 2022-07-05T11:46:18.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.244+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 >> v1:172.21.15.149:6789/0 conn(0x7fcf2017d4a0 legacy=0x7fcf2017ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:18.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c003930 0x7fcf0c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c004690 0x7fcf0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf0c005120 0x7fcf0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200c7b40 con 0x7fcf0c004690 2022-07-05T11:46:18.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c00c030 con 0x7fcf0c005120 2022-07-05T11:46:18.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c00c1f0 con 0x7fcf0c003930 2022-07-05T11:46:18.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1f7fe700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c004690 0x7fcf0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1ffff700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c003930 0x7fcf0c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf248e4700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf0c005120 0x7fcf0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1f7fe700 1 -- 172.21.15.90:0/1316220167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c003930 msgr2=0x7fcf0c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:18.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1f7fe700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c003930 0x7fcf0c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1f7fe700 1 -- 172.21.15.90:0/1316220167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf0c005120 msgr2=0x7fcf0c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:18.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1f7fe700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf0c005120 0x7fcf0c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1f7fe700 1 -- 172.21.15.90:0/1316220167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0033f0 con 0x7fcf0c004690 2022-07-05T11:46:18.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf248e4700 1 -- 172.21.15.90:0/1316220167 reap_dead start 2022-07-05T11:46:18.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1f7fe700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c004690 0x7fcf0c004b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fcf10009a80 tx=0x7fcf10009060).ready entity=mon.0 client_cookie=cf6267d44d972624 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:18.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10009430 con 0x7fcf0c004690 2022-07-05T11:46:18.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000e640 con 0x7fcf0c004690 2022-07-05T11:46:18.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.245+0000 7fcf1effd700 1 -- 172.21.15.90:0/1316220167 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000e9c0 con 0x7fcf0c004690 2022-07-05T11:46:18.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.246+0000 7fcf26347700 1 -- 172.21.15.90:0/1316220167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c004690 msgr2=0x7fcf0c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:18.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.246+0000 7fcf26347700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c004690 0x7fcf0c004b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fcf10009a80 tx=0x7fcf10009060).stop 2022-07-05T11:46:18.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.246+0000 7fcf26347700 1 -- 172.21.15.90:0/1316220167 shutdown_connections 2022-07-05T11:46:18.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.246+0000 7fcf26347700 1 --2- 172.21.15.90:0/1316220167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf0c004690 0x7fcf0c004b10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.246+0000 7fcf26347700 1 -- 172.21.15.90:0/1316220167 >> 172.21.15.90:0/1316220167 conn(0x7fcf2005d9a0 msgr2=0x7fcf2005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:18.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.246+0000 7fcf26347700 1 -- 172.21.15.90:0/1316220167 shutdown_connections 2022-07-05T11:46:18.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.246+0000 7fcf26347700 1 -- 172.21.15.90:0/1316220167 wait complete. 2022-07-05T11:46:18.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.247+0000 7fcf26347700 1 Processor -- start 2022-07-05T11:46:18.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.247+0000 7fcf26347700 1 -- start start 2022-07-05T11:46:18.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf26347700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c004690 0x7fcf201614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf26347700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf20165940 0x7fcf20165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf26347700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf2018cc80 0x7fcf2018d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf26347700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201662b0 con 0x7fcf2018cc80 2022-07-05T11:46:18.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf26347700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200e8db0 con 0x7fcf20165940 2022-07-05T11:46:18.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf26347700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201664c0 con 0x7fcf0c004690 2022-07-05T11:46:18.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf248e4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf2018cc80 0x7fcf2018d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf248e4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf2018cc80 0x7fcf2018d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56700/0 (socket says 172.21.15.90:56700) 2022-07-05T11:46:18.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf248e4700 1 -- 172.21.15.90:0/3886048239 learned_addr learned my addr 172.21.15.90:0/3886048239 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:18.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf1ffff700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c004690 0x7fcf201614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.248+0000 7fcf1f7fe700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf20165940 0x7fcf20165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf248e4700 1 -- 172.21.15.90:0/3886048239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c004690 msgr2=0x7fcf201614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:18.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf248e4700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c004690 0x7fcf201614f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf248e4700 1 -- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf20165940 msgr2=0x7fcf20165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:18.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf248e4700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf20165940 0x7fcf20165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:18.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf248e4700 1 -- 172.21.15.90:0/3886048239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf201667a0 con 0x7fcf2018cc80 2022-07-05T11:46:18.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf1ffff700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c004690 0x7fcf201614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:18.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf1f7fe700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf20165940 0x7fcf20165dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:18.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf248e4700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf2018cc80 0x7fcf2018d100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fcf2006a750 tx=0x7fcf200c9c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:18.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf07fff700 1 -- 172.21.15.90:0/3886048239 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800f840 con 0x7fcf2018cc80 2022-07-05T11:46:18.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf07fff700 1 -- 172.21.15.90:0/3886048239 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1800f9a0 con 0x7fcf2018cc80 2022-07-05T11:46:18.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf20166a80 con 0x7fcf2018cc80 2022-07-05T11:46:18.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf07fff700 1 -- 172.21.15.90:0/3886048239 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800fd40 con 0x7fcf2018cc80 2022-07-05T11:46:18.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.249+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf200e8a40 con 0x7fcf2018cc80 2022-07-05T11:46:18.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.250+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20084c50 con 0x7fcf2018cc80 2022-07-05T11:46:18.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.251+0000 7fcf07fff700 1 -- 172.21.15.90:0/3886048239 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fcf1801e030 con 0x7fcf2018cc80 2022-07-05T11:46:18.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.251+0000 7fcf07fff700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcf0008ba10 0x7fcf0008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:18.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.251+0000 7fcf07fff700 1 -- 172.21.15.90:0/3886048239 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fcf180b0cc0 con 0x7fcf2018cc80 2022-07-05T11:46:18.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.251+0000 7fcf1ffff700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcf0008ba10 0x7fcf0008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:18.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.252+0000 7fcf1ffff700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcf0008ba10 0x7fcf0008ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcf14000f60 tx=0x7fcf14009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:18.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.255+0000 7fcf07fff700 1 -- 172.21.15.90:0/3886048239 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fcf18081980 con 0x7fcf2018cc80 2022-07-05T11:46:18.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:18.461+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcf2006be40 con 0x7fcf2018cc80 2022-07-05T11:46:19.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.180+0000 7fcf07fff700 1 -- 172.21.15.90:0/3886048239 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcf1800fea0 con 0x7fcf2018cc80 2022-07-05T11:46:19.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcf0008ba10 msgr2=0x7fcf0008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:19.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcf0008ba10 0x7fcf0008ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcf14000f60 tx=0x7fcf14009040).stop 2022-07-05T11:46:19.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf2018cc80 msgr2=0x7fcf2018d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:19.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf2018cc80 0x7fcf2018d100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fcf2006a750 tx=0x7fcf200c9c60).stop 2022-07-05T11:46:19.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 shutdown_connections 2022-07-05T11:46:19.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcf0008ba10 0x7fcf0008ded0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf2018cc80 0x7fcf2018d100 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0c004690 0x7fcf201614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 --2- 172.21.15.90:0/3886048239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf20165940 0x7fcf20165dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.182+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 >> 172.21.15.90:0/3886048239 conn(0x7fcf2005d9a0 msgr2=0x7fcf2017e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.183+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 shutdown_connections 2022-07-05T11:46:19.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.183+0000 7fcf26347700 1 -- 172.21.15.90:0/3886048239 wait complete. 2022-07-05T11:46:19.199 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2022-07-05T11:46:19.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.325+0000 7f378d3ad700 1 Processor -- start 2022-07-05T11:46:19.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.325+0000 7f378d3ad700 1 -- start start 2022-07-05T11:46:19.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f378d3ad700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3788182a30 0x7f37880eed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f378d3ad700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f378817e750 0x7f378817ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f378d3ad700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37880ee170 con 0x7f378817bda0 2022-07-05T11:46:19.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f378d3ad700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378817c3f0 con 0x7f378817e750 2022-07-05T11:46:19.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f378d3ad700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37880ed280 con 0x7f3788182a30 2022-07-05T11:46:19.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f3786ffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f378817bda0 0x7f37880ee600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49644/0 (socket says 172.21.15.90:49644) 2022-07-05T11:46:19.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f3786ffd700 1 -- 172.21.15.90:0/1059102016 learned_addr learned my addr 172.21.15.90:0/1059102016 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:19.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135729184 0 0) 0x7f37880ee170 con 0x7f378817bda0 2022-07-05T11:46:19.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.326+0000 7f37877fe700 1 --2- 172.21.15.90:0/1059102016 >> v2:172.21.15.110:3300/0 conn(0x7f378817e750 0x7f378817ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37680033f0 con 0x7f378817bda0 2022-07-05T11:46:19.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 --2- 172.21.15.90:0/1059102016 >> v2:172.21.15.149:3300/0 conn(0x7f3788182a30 0x7f37880eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 127123996 0 0) 0x7f37680033f0 con 0x7f378817bda0 2022-07-05T11:46:19.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 >> v2:172.21.15.149:3300/0 conn(0x7f3788182a30 msgr2=0x7f37880eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:19.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 --2- 172.21.15.90:0/1059102016 >> v2:172.21.15.149:3300/0 conn(0x7f3788182a30 0x7f37880eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 >> v2:172.21.15.110:3300/0 conn(0x7f378817e750 msgr2=0x7f378817ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:19.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 --2- 172.21.15.90:0/1059102016 >> v2:172.21.15.110:3300/0 conn(0x7f378817e750 0x7f378817ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880ed560 con 0x7f378817bda0 2022-07-05T11:46:19.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f37780017f0 con 0x7f378817bda0 2022-07-05T11:46:19.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 >> v1:172.21.15.90:6789/0 conn(0x7f378817bda0 legacy=0x7f37880ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:19.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3768003930 0x7f3768003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3768004690 0x7f3768004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768005000 0x7f376800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378817c3f0 con 0x7f3768004690 2022-07-05T11:46:19.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880ed280 con 0x7f3768005000 2022-07-05T11:46:19.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376800bdd0 con 0x7f3768003930 2022-07-05T11:46:19.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3768004690 0x7f3768004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3786ffd700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3768003930 0x7f3768003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37877fe700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768005000 0x7f376800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 -- 172.21.15.90:0/1059102016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3768003930 msgr2=0x7f3768003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:19.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3768003930 0x7f3768003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 -- 172.21.15.90:0/1059102016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768005000 msgr2=0x7f376800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:19.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768005000 0x7f376800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37877fe700 1 -- 172.21.15.90:0/1059102016 reap_dead start 2022-07-05T11:46:19.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 -- 172.21.15.90:0/1059102016 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680033f0 con 0x7f3768004690 2022-07-05T11:46:19.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f37867fc700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3768004690 0x7f3768004b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3770006d80 tx=0x7f3770009060).ready entity=mon.0 client_cookie=c076207c14c7aa8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:19.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770009430 con 0x7f3768004690 2022-07-05T11:46:19.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377000e640 con 0x7f3768004690 2022-07-05T11:46:19.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.327+0000 7f3785ffb700 1 -- 172.21.15.90:0/1059102016 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000e9c0 con 0x7f3768004690 2022-07-05T11:46:19.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.328+0000 7f378d3ad700 1 -- 172.21.15.90:0/1059102016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3768004690 msgr2=0x7f3768004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:19.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.328+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3768004690 0x7f3768004b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3770006d80 tx=0x7f3770009060).stop 2022-07-05T11:46:19.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.328+0000 7f378d3ad700 1 -- 172.21.15.90:0/1059102016 shutdown_connections 2022-07-05T11:46:19.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.328+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1059102016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3768004690 0x7f3768004b10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.328+0000 7f378d3ad700 1 -- 172.21.15.90:0/1059102016 >> 172.21.15.90:0/1059102016 conn(0x7f37880f21d0 msgr2=0x7f3788069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:19.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.328+0000 7f378d3ad700 1 -- 172.21.15.90:0/1059102016 shutdown_connections 2022-07-05T11:46:19.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.328+0000 7f378d3ad700 1 -- 172.21.15.90:0/1059102016 wait complete. 2022-07-05T11:46:19.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.329+0000 7f378d3ad700 1 Processor -- start 2022-07-05T11:46:19.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.329+0000 7f378d3ad700 1 -- start start 2022-07-05T11:46:19.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f378d3ad700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768004690 0x7f3788172570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f378d3ad700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37880643e0 0x7f3788064860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f378d3ad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37880ca670 0x7f37880caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f378d3ad700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880c8480 con 0x7f37880643e0 2022-07-05T11:46:19.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f378d3ad700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880c7590 con 0x7f3768004690 2022-07-05T11:46:19.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f378d3ad700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880c7870 con 0x7f37880ca670 2022-07-05T11:46:19.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f37867fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37880643e0 0x7f3788064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.330+0000 7f37867fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37880643e0 0x7f3788064860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56718/0 (socket says 172.21.15.90:56718) 2022-07-05T11:46:19.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37867fc700 1 -- 172.21.15.90:0/1033016988 learned_addr learned my addr 172.21.15.90:0/1033016988 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:19.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f3786ffd700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768004690 0x7f3788172570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37877fe700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37880ca670 0x7f37880caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37867fc700 1 -- 172.21.15.90:0/1033016988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37880ca670 msgr2=0x7f37880caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:19.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37867fc700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37880ca670 0x7f37880caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37867fc700 1 -- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768004690 msgr2=0x7f3788172570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:19.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37867fc700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768004690 0x7f3788172570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:19.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37867fc700 1 -- 172.21.15.90:0/1033016988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880c7b50 con 0x7f37880643e0 2022-07-05T11:46:19.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f37867fc700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37880643e0 0x7f3788064860 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f377000e4b0 tx=0x7f377001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:19.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f377effd700 1 -- 172.21.15.90:0/1033016988 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000ed70 con 0x7f37880643e0 2022-07-05T11:46:19.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f377effd700 1 -- 172.21.15.90:0/1033016988 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377000eed0 con 0x7f37880643e0 2022-07-05T11:46:19.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37880c7e30 con 0x7f37880643e0 2022-07-05T11:46:19.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f377effd700 1 -- 172.21.15.90:0/1033016988 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000ea00 con 0x7f37880643e0 2022-07-05T11:46:19.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.331+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37880c7150 con 0x7f37880643e0 2022-07-05T11:46:19.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.332+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37880c7340 con 0x7f37880643e0 2022-07-05T11:46:19.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.333+0000 7f377effd700 1 -- 172.21.15.90:0/1033016988 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f377002b020 con 0x7f37880643e0 2022-07-05T11:46:19.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.333+0000 7f377effd700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f376c08ba10 0x7f376c08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:19.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.333+0000 7f377effd700 1 -- 172.21.15.90:0/1033016988 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f37700b2200 con 0x7f37880643e0 2022-07-05T11:46:19.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.334+0000 7f3786ffd700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f376c08ba10 0x7f376c08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:19.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.334+0000 7f3786ffd700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f376c08ba10 0x7f376c08ded0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3778001350 tx=0x7f3778001d90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:19.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.337+0000 7f377effd700 1 -- 172.21.15.90:0/1033016988 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3770082e40 con 0x7f37880643e0 2022-07-05T11:46:19.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:19.537+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f3788083030 con 0x7f37880643e0 2022-07-05T11:46:20.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.342+0000 7f377effd700 1 -- 172.21.15.90:0/1033016988 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3770016020 con 0x7f37880643e0 2022-07-05T11:46:20.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f376c08ba10 msgr2=0x7f376c08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:20.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f376c08ba10 0x7f376c08ded0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3778001350 tx=0x7f3778001d90).stop 2022-07-05T11:46:20.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37880643e0 msgr2=0x7f3788064860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:20.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37880643e0 0x7f3788064860 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f377000e4b0 tx=0x7f377001a000).stop 2022-07-05T11:46:20.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 shutdown_connections 2022-07-05T11:46:20.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f376c08ba10 0x7f376c08ded0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37880ca670 0x7f37880caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3768004690 0x7f3788172570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 --2- 172.21.15.90:0/1033016988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37880643e0 0x7f3788064860 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 >> 172.21.15.90:0/1033016988 conn(0x7f37880f21d0 msgr2=0x7f37880c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:20.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 shutdown_connections 2022-07-05T11:46:20.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.345+0000 7f378d3ad700 1 -- 172.21.15.90:0/1033016988 wait complete. 2022-07-05T11:46:20.363 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2022-07-05T11:46:20.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.484+0000 7f5267a09700 1 Processor -- start 2022-07-05T11:46:20.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.484+0000 7f5267a09700 1 -- start start 2022-07-05T11:46:20.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.485+0000 7f5267a09700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f526017bda0 0x7f52600ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.485+0000 7f5267a09700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600ee170 con 0x7f5260182a30 2022-07-05T11:46:20.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.485+0000 7f5267a09700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526017c3f0 con 0x7f526017e750 2022-07-05T11:46:20.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.485+0000 7f5267a09700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600ed280 con 0x7f526017bda0 2022-07-05T11:46:20.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.485+0000 7f5264fa4700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5260182a30 0x7f52600eeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49664/0 (socket says 172.21.15.90:49664) 2022-07-05T11:46:20.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.485+0000 7f5264fa4700 1 -- 172.21.15.90:0/3033511557 learned_addr learned my addr 172.21.15.90:0/3033511557 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:20.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f52657a5700 1 --2- 172.21.15.90:0/3033511557 >> v2:172.21.15.110:3300/0 conn(0x7f526017bda0 0x7f52600ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936287065 0 0) 0x7f52600ee170 con 0x7f5260182a30 2022-07-05T11:46:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c0033f0 con 0x7f5260182a30 2022-07-05T11:46:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000713032 0 0) 0x7f524c0033f0 con 0x7f5260182a30 2022-07-05T11:46:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 >> v2:172.21.15.110:3300/0 conn(0x7f526017bda0 msgr2=0x7f52600ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 --2- 172.21.15.90:0/3033511557 >> v2:172.21.15.110:3300/0 conn(0x7f526017bda0 0x7f52600ee600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 >> v1:172.21.15.149:6789/0 conn(0x7f526017e750 legacy=0x7f526017ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600ed560 con 0x7f5260182a30 2022-07-05T11:46:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f5254001470 con 0x7f5260182a30 2022-07-05T11:46:20.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 >> v1:172.21.15.90:6789/0 conn(0x7f5260182a30 legacy=0x7f52600eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:20.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f524c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f524c004690 0x7f524c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f524c005000 0x7f524c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600ed280 con 0x7f524c005000 2022-07-05T11:46:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00be50 con 0x7f524c0038e0 2022-07-05T11:46:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00c010 con 0x7f524c004690 2022-07-05T11:46:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f52657a5700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f524c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f5265fa6700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f524c005000 0x7f524c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f5264fa4700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f524c004690 0x7f524c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f52657a5700 1 -- 172.21.15.90:0/3033511557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f524c004690 msgr2=0x7f524c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f52657a5700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f524c004690 0x7f524c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f52657a5700 1 -- 172.21.15.90:0/3033511557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f524c005000 msgr2=0x7f524c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f52657a5700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f524c005000 0x7f524c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f52657a5700 1 -- 172.21.15.90:0/3033511557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0033f0 con 0x7f524c0038e0 2022-07-05T11:46:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f5265fa6700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f524c005000 0x7f524c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.486+0000 7f5265fa6700 1 -- 172.21.15.90:0/3033511557 reap_dead start 2022-07-05T11:46:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f52657a5700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f524c003cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f525000e210 tx=0x7f525000b040).ready entity=mon.1 client_cookie=82115314f687d262 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250009ac0 con 0x7f524c0038e0 2022-07-05T11:46:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000f040 con 0x7f524c0038e0 2022-07-05T11:46:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f525ffff700 1 -- 172.21.15.90:0/3033511557 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000ecd0 con 0x7f524c0038e0 2022-07-05T11:46:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f5267a09700 1 -- 172.21.15.90:0/3033511557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 msgr2=0x7f524c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f5267a09700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f524c003cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f525000e210 tx=0x7f525000b040).stop 2022-07-05T11:46:20.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f5267a09700 1 -- 172.21.15.90:0/3033511557 shutdown_connections 2022-07-05T11:46:20.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f5267a09700 1 --2- 172.21.15.90:0/3033511557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f524c003cc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f5267a09700 1 -- 172.21.15.90:0/3033511557 >> 172.21.15.90:0/3033511557 conn(0x7f52600f21d0 msgr2=0x7f5260069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:20.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f5267a09700 1 -- 172.21.15.90:0/3033511557 shutdown_connections 2022-07-05T11:46:20.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.487+0000 7f5267a09700 1 -- 172.21.15.90:0/3033511557 wait complete. 2022-07-05T11:46:20.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.489+0000 7f5267a09700 1 Processor -- start 2022-07-05T11:46:20.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.489+0000 7f5267a09700 1 -- start start 2022-07-05T11:46:20.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5267a09700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f5260061f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5267a09700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f526017b2f0 0x7f5260173470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5267a09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5260173960 0x7f5260179020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5267a09700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526017ae60 con 0x7f526017b2f0 2022-07-05T11:46:20.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5267a09700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260179f70 con 0x7f524c0038e0 2022-07-05T11:46:20.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5267a09700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526017a250 con 0x7f5260173960 2022-07-05T11:46:20.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f526017b2f0 0x7f5260173470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f526017b2f0 0x7f5260173470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56738/0 (socket says 172.21.15.90:56738) 2022-07-05T11:46:20.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 -- 172.21.15.90:0/1880572850 learned_addr learned my addr 172.21.15.90:0/1880572850 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:20.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f52657a5700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f5260061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5265fa6700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5260173960 0x7f5260179020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 -- 172.21.15.90:0/1880572850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5260173960 msgr2=0x7f5260179020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:20.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5260173960 0x7f5260179020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 -- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 msgr2=0x7f5260061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:20.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f5260061f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:20.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 -- 172.21.15.90:0/1880572850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526017a530 con 0x7f526017b2f0 2022-07-05T11:46:20.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5264fa4700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f526017b2f0 0x7f5260173470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f5254004a10 tx=0x7f5254001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:20.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f525d7fa700 1 -- 172.21.15.90:0/1880572850 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254004e80 con 0x7f526017b2f0 2022-07-05T11:46:20.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f525d7fa700 1 -- 172.21.15.90:0/1880572850 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525400f870 con 0x7f526017b2f0 2022-07-05T11:46:20.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526017a810 con 0x7f526017b2f0 2022-07-05T11:46:20.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.490+0000 7f525d7fa700 1 -- 172.21.15.90:0/1880572850 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400fbf0 con 0x7f526017b2f0 2022-07-05T11:46:20.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.491+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526017b770 con 0x7f526017b2f0 2022-07-05T11:46:20.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.491+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526017afd0 con 0x7f526017b2f0 2022-07-05T11:46:20.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.492+0000 7f525d7fa700 1 -- 172.21.15.90:0/1880572850 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f525401b030 con 0x7f526017b2f0 2022-07-05T11:46:20.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.493+0000 7f525d7fa700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f524008ba70 0x7f524008df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:20.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.493+0000 7f525d7fa700 1 -- 172.21.15.90:0/1880572850 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f52540b0720 con 0x7f526017b2f0 2022-07-05T11:46:20.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.493+0000 7f52657a5700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f524008ba70 0x7f524008df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:20.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.494+0000 7f52657a5700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f524008ba70 0x7f524008df30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f525000afd0 tx=0x7f525001a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:20.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.496+0000 7f525d7fa700 1 -- 172.21.15.90:0/1880572850 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f52540813e0 con 0x7f526017b2f0 2022-07-05T11:46:20.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:20.699+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f526006b1e0 con 0x7f526017b2f0 2022-07-05T11:46:21.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.349+0000 7f525d7fa700 1 -- 172.21.15.90:0/1880572850 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5254019030 con 0x7f526017b2f0 2022-07-05T11:46:21.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f524008ba70 msgr2=0x7f524008df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:21.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f524008ba70 0x7f524008df30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f525000afd0 tx=0x7f525001a000).stop 2022-07-05T11:46:21.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f526017b2f0 msgr2=0x7f5260173470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:21.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f526017b2f0 0x7f5260173470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f5254004a10 tx=0x7f5254001e70).stop 2022-07-05T11:46:21.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 shutdown_connections 2022-07-05T11:46:21.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f524008ba70 0x7f524008df30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5260173960 0x7f5260179020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f524c0038e0 0x7f5260061f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 --2- 172.21.15.90:0/1880572850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f526017b2f0 0x7f5260173470 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 >> 172.21.15.90:0/1880572850 conn(0x7f52600f21d0 msgr2=0x7f5260174690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:21.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 shutdown_connections 2022-07-05T11:46:21.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.351+0000 7f5267a09700 1 -- 172.21.15.90:0/1880572850 wait complete. 2022-07-05T11:46:21.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2022-07-05T11:46:21.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.481+0000 7f56ec180700 1 Processor -- start 2022-07-05T11:46:21.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.481+0000 7f56ec180700 1 -- start start 2022-07-05T11:46:21.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.482+0000 7f56ec180700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56e40ee3c0 0x7f56e40ebaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.482+0000 7f56ec180700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e4068650 con 0x7f56e40691f0 2022-07-05T11:46:21.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.482+0000 7f56ec180700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e4067d60 con 0x7f56e417e030 2022-07-05T11:46:21.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.482+0000 7f56ec180700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e40ecab0 con 0x7f56e40ee3c0 2022-07-05T11:46:21.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e971b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f56e40691f0 0x7f56e40eb390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49686/0 (socket says 172.21.15.90:49686) 2022-07-05T11:46:21.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e971b700 1 -- 172.21.15.90:0/4072964779 learned_addr learned my addr 172.21.15.90:0/4072964779 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:21.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56ea71d700 1 --2- 172.21.15.90:0/4072964779 >> v2:172.21.15.110:3300/0 conn(0x7f56e40ee3c0 0x7f56e40ebaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831358483 0 0) 0x7f56e4068650 con 0x7f56e40691f0 2022-07-05T11:46:21.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d00033f0 con 0x7f56e40691f0 2022-07-05T11:46:21.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220732501 0 0) 0x7f56d00033f0 con 0x7f56e40691f0 2022-07-05T11:46:21.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 >> v2:172.21.15.110:3300/0 conn(0x7f56e40ee3c0 msgr2=0x7f56e40ebaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:21.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 --2- 172.21.15.90:0/4072964779 >> v2:172.21.15.110:3300/0 conn(0x7f56e40ee3c0 0x7f56e40ebaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 >> v1:172.21.15.110:6789/0 conn(0x7f56e417e030 legacy=0x7f56e4068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:21.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4068000 con 0x7f56e40691f0 2022-07-05T11:46:21.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f56d8001470 con 0x7f56e40691f0 2022-07-05T11:46:21.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 >> v1:172.21.15.90:6789/0 conn(0x7f56e40691f0 legacy=0x7f56e40eb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:21.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56d0003930 0x7f56d0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56d0004690 0x7f56d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0005000 0x7f56d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40ecab0 con 0x7f56d0003930 2022-07-05T11:46:21.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d000bfe0 con 0x7f56d0005000 2022-07-05T11:46:21.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d000c1a0 con 0x7f56d0004690 2022-07-05T11:46:21.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56d0003930 0x7f56d0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56ea71d700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0005000 0x7f56d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e971b700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56d0004690 0x7f56d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e9f1c700 1 -- 172.21.15.90:0/4072964779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56d0004690 msgr2=0x7f56d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:21.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56d0004690 0x7f56d0004b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e9f1c700 1 -- 172.21.15.90:0/4072964779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0005000 msgr2=0x7f56d000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:21.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.483+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0005000 0x7f56d000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ea71d700 1 -- 172.21.15.90:0/4072964779 reap_dead start 2022-07-05T11:46:21.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56e9f1c700 1 -- 172.21.15.90:0/4072964779 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d00033f0 con 0x7f56d0003930 2022-07-05T11:46:21.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56d0003930 0x7f56d0003d50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f56d4001e30 tx=0x7f56d4007f30).ready entity=mon.0 client_cookie=b48f2ffff6f6a666 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:21.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4006a20 con 0x7f56d0003930 2022-07-05T11:46:21.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4006b80 con 0x7f56d0003930 2022-07-05T11:46:21.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56e8f1a700 1 -- 172.21.15.90:0/4072964779 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400c5d0 con 0x7f56d0003930 2022-07-05T11:46:21.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ec180700 1 -- 172.21.15.90:0/4072964779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56d0003930 msgr2=0x7f56d0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:21.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ec180700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56d0003930 0x7f56d0003d50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f56d4001e30 tx=0x7f56d4007f30).stop 2022-07-05T11:46:21.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ec180700 1 -- 172.21.15.90:0/4072964779 shutdown_connections 2022-07-05T11:46:21.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ec180700 1 --2- 172.21.15.90:0/4072964779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56d0003930 0x7f56d0003d50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ec180700 1 -- 172.21.15.90:0/4072964779 >> 172.21.15.90:0/4072964779 conn(0x7f56e40ef4b0 msgr2=0x7f56e40ef8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:21.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ec180700 1 -- 172.21.15.90:0/4072964779 shutdown_connections 2022-07-05T11:46:21.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.484+0000 7f56ec180700 1 -- 172.21.15.90:0/4072964779 wait complete. 2022-07-05T11:46:21.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.486+0000 7f56ec180700 1 Processor -- start 2022-07-05T11:46:21.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.486+0000 7f56ec180700 1 -- start start 2022-07-05T11:46:21.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ec180700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0003930 0x7f56e41765d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ec180700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e41922c0 0x7f56e4192740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ec180700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56e41901d0 0x7f56e4190650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ec180700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e417c410 con 0x7f56e41922c0 2022-07-05T11:46:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ec180700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e418fd80 con 0x7f56d0003930 2022-07-05T11:46:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ec180700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e417b5b0 con 0x7f56e41901d0 2022-07-05T11:46:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e41922c0 0x7f56e4192740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e41922c0 0x7f56e4192740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56758/0 (socket says 172.21.15.90:56758) 2022-07-05T11:46:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 -- 172.21.15.90:0/2272152456 learned_addr learned my addr 172.21.15.90:0/2272152456 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ea71d700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56e41901d0 0x7f56e4190650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0003930 0x7f56e41765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 -- 172.21.15.90:0/2272152456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56e41901d0 msgr2=0x7f56e4190650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:21.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56e41901d0 0x7f56e4190650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 -- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0003930 msgr2=0x7f56e41765d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:21.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0003930 0x7f56e41765d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:21.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 -- 172.21.15.90:0/2272152456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e417b890 con 0x7f56e41922c0 2022-07-05T11:46:21.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0003930 0x7f56e41765d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:21.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e971b700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e41922c0 0x7f56e4192740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f56d800d980 tx=0x7f56d8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:21.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e1ffb700 1 -- 172.21.15.90:0/2272152456 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d800de70 con 0x7f56e41922c0 2022-07-05T11:46:21.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e1ffb700 1 -- 172.21.15.90:0/2272152456 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8007170 con 0x7f56e41922c0 2022-07-05T11:46:21.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e417bb70 con 0x7f56e41922c0 2022-07-05T11:46:21.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.487+0000 7f56e1ffb700 1 -- 172.21.15.90:0/2272152456 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8007510 con 0x7f56e41922c0 2022-07-05T11:46:21.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.488+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e417c130 con 0x7f56e41922c0 2022-07-05T11:46:21.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.488+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e406b1e0 con 0x7f56e41922c0 2022-07-05T11:46:21.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.489+0000 7f56e1ffb700 1 -- 172.21.15.90:0/2272152456 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f56d8004ad0 con 0x7f56e41922c0 2022-07-05T11:46:21.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.490+0000 7f56e1ffb700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f56c408ba40 0x7f56c408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:21.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.490+0000 7f56e1ffb700 1 -- 172.21.15.90:0/2272152456 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f56d80b0d70 con 0x7f56e41922c0 2022-07-05T11:46:21.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.490+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f56c408ba40 0x7f56c408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:21.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.491+0000 7f56e9f1c700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f56c408ba40 0x7f56c408df00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f56d4001600 tx=0x7f56d4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:21.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.494+0000 7f56e1ffb700 1 -- 172.21.15.90:0/2272152456 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f56d8081a30 con 0x7f56e41922c0 2022-07-05T11:46:21.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:21.699+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f56e406be40 con 0x7f56e41922c0 2022-07-05T11:46:22.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.354+0000 7f56e1ffb700 1 -- 172.21.15.90:0/2272152456 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f56d8085050 con 0x7f56e41922c0 2022-07-05T11:46:22.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f56c408ba40 msgr2=0x7f56c408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f56c408ba40 0x7f56c408df00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f56d4001600 tx=0x7f56d4016000).stop 2022-07-05T11:46:22.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e41922c0 msgr2=0x7f56e4192740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e41922c0 0x7f56e4192740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f56d800d980 tx=0x7f56d8009040).stop 2022-07-05T11:46:22.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 shutdown_connections 2022-07-05T11:46:22.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f56c408ba40 0x7f56c408df00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56e41901d0 0x7f56e4190650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0003930 0x7f56e41765d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 --2- 172.21.15.90:0/2272152456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e41922c0 0x7f56e4192740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 >> 172.21.15.90:0/2272152456 conn(0x7f56e40ef4b0 msgr2=0x7f56e4084010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:22.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 shutdown_connections 2022-07-05T11:46:22.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.356+0000 7f56ec180700 1 -- 172.21.15.90:0/2272152456 wait complete. 2022-07-05T11:46:22.371 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:22.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.485+0000 7f2e8dc3f700 1 Processor -- start 2022-07-05T11:46:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.485+0000 7f2e8dc3f700 1 -- start start 2022-07-05T11:46:22.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e8dc3f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2e881785a0 0x7f2e880c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e8dc3f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2e881801c0 0x7f2e8817e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e8dc3f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e88178980 con 0x7f2e880c2020 2022-07-05T11:46:22.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e8dc3f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e880c2900 con 0x7f2e881801c0 2022-07-05T11:46:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e8dc3f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e880c2be0 con 0x7f2e881785a0 2022-07-05T11:46:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2e881801c0 0x7f2e8817e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2e881801c0 0x7f2e8817e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56766/0 (socket says 172.21.15.90:56766) 2022-07-05T11:46:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 -- 172.21.15.90:0/2026083496 learned_addr learned my addr 172.21.15.90:0/2026083496 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e877fe700 1 --2- 172.21.15.90:0/2026083496 >> v2:172.21.15.149:3300/0 conn(0x7f2e881785a0 0x7f2e880c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 -- 172.21.15.90:0/2026083496 >> v2:172.21.15.149:3300/0 conn(0x7f2e881785a0 msgr2=0x7f2e880c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 --2- 172.21.15.90:0/2026083496 >> v2:172.21.15.149:3300/0 conn(0x7f2e881785a0 0x7f2e880c1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 -- 172.21.15.90:0/2026083496 >> v1:172.21.15.110:6789/0 conn(0x7f2e880c2020 legacy=0x7f2e8817fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 -- 172.21.15.90:0/2026083496 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880c2ec0 con 0x7f2e881801c0 2022-07-05T11:46:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.486+0000 7f2e87fff700 1 --2- 172.21.15.90:0/2026083496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e8817e5c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2e8805ea20 tx=0x7f2e780090f0).ready entity=mon.0 client_cookie=9e197552ba67d0b5 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e867fc700 1 -- 172.21.15.90:0/2026083496 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800b5a0 con 0x7f2e881801c0 2022-07-05T11:46:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e867fc700 1 -- 172.21.15.90:0/2026083496 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7800b700 con 0x7f2e881801c0 2022-07-05T11:46:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e867fc700 1 -- 172.21.15.90:0/2026083496 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800ba80 con 0x7f2e881801c0 2022-07-05T11:46:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2026083496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 msgr2=0x7f2e8817e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2026083496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e8817e5c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2e8805ea20 tx=0x7f2e780090f0).stop 2022-07-05T11:46:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2026083496 shutdown_connections 2022-07-05T11:46:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2026083496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e8817e5c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2026083496 >> v2:172.21.15.149:3300/0 conn(0x7f2e881785a0 0x7f2e880c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2026083496 >> 172.21.15.90:0/2026083496 conn(0x7f2e880f22f0 msgr2=0x7f2e880ee2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2026083496 shutdown_connections 2022-07-05T11:46:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.487+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2026083496 wait complete. 2022-07-05T11:46:22.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.489+0000 7f2e8dc3f700 1 Processor -- start 2022-07-05T11:46:22.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.489+0000 7f2e8dc3f700 1 -- start start 2022-07-05T11:46:22.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e880c2020 0x7f2e88084080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e881785a0 0x7f2e88170dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e88191b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88192a60 con 0x7f2e881801c0 2022-07-05T11:46:22.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8818e5d0 con 0x7f2e881785a0 2022-07-05T11:46:22.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8818ee30 con 0x7f2e880c2020 2022-07-05T11:46:22.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e88191b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e88191b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56774/0 (socket says 172.21.15.90:56774) 2022-07-05T11:46:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 -- 172.21.15.90:0/2696138635 learned_addr learned my addr 172.21.15.90:0/2696138635 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e86ffd700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e881785a0 0x7f2e88170dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e877fe700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e880c2020 0x7f2e88084080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 -- 172.21.15.90:0/2696138635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e880c2020 msgr2=0x7f2e88084080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e880c2020 0x7f2e88084080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 -- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e881785a0 msgr2=0x7f2e88170dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e881785a0 0x7f2e88170dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 -- 172.21.15.90:0/2696138635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e78009370 con 0x7f2e881801c0 2022-07-05T11:46:22.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e87fff700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e88191b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2e78006df0 tx=0x7f2e78015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:22.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e7f7fe700 1 -- 172.21.15.90:0/2696138635 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800ba80 con 0x7f2e881801c0 2022-07-05T11:46:22.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e7f7fe700 1 -- 172.21.15.90:0/2696138635 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7801b410 con 0x7f2e881801c0 2022-07-05T11:46:22.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e7f7fe700 1 -- 172.21.15.90:0/2696138635 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7801b7b0 con 0x7f2e881801c0 2022-07-05T11:46:22.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8818e820 con 0x7f2e881801c0 2022-07-05T11:46:22.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.490+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e88192780 con 0x7f2e881801c0 2022-07-05T11:46:22.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.491+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8818efc0 con 0x7f2e881801c0 2022-07-05T11:46:22.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.492+0000 7f2e7f7fe700 1 -- 172.21.15.90:0/2696138635 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2e7802b070 con 0x7f2e881801c0 2022-07-05T11:46:22.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.492+0000 7f2e7f7fe700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2e6c08ba40 0x7f2e6c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.493+0000 7f2e7f7fe700 1 -- 172.21.15.90:0/2696138635 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f2e780b2370 con 0x7f2e881801c0 2022-07-05T11:46:22.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.493+0000 7f2e877fe700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2e6c08ba40 0x7f2e6c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.493+0000 7f2e877fe700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2e6c08ba40 0x7f2e6c08df00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2e80007460 tx=0x7f2e8000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:22.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.496+0000 7f2e7f7fe700 1 -- 172.21.15.90:0/2696138635 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f2e78083030 con 0x7f2e881801c0 2022-07-05T11:46:22.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.702+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e8806be40 con 0x7f2e881801c0 2022-07-05T11:46:22.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.703+0000 7f2e7f7fe700 1 -- 172.21.15.90:0/2696138635 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+10607 (secure 0 0 0) 0x7f2e78086650 con 0x7f2e881801c0 2022-07-05T11:46:22.704 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:22.704 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:22.354922+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4371,"mds_1":4362,"mds_2":4346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4340":{"gid":4340,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4341":{"gid":4341,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4344":{"gid":4344,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4346":{"gid":4346,"name":"l","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4362":{"gid":4362,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-07-05T11:46:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2e6c08ba40 msgr2=0x7f2e6c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2e6c08ba40 0x7f2e6c08df00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2e80007460 tx=0x7f2e8000b040).stop 2022-07-05T11:46:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 msgr2=0x7f2e88191b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e88191b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2e78006df0 tx=0x7f2e78015000).stop 2022-07-05T11:46:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 shutdown_connections 2022-07-05T11:46:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2e6c08ba40 0x7f2e6c08df00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e881801c0 0x7f2e88191b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e880c2020 0x7f2e88084080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 --2- 172.21.15.90:0/2696138635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e881785a0 0x7f2e88170dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.704+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 >> 172.21.15.90:0/2696138635 conn(0x7f2e880f22f0 msgr2=0x7f2e880e4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.705+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 shutdown_connections 2022-07-05T11:46:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.705+0000 7f2e8dc3f700 1 -- 172.21.15.90:0/2696138635 wait complete. 2022-07-05T11:46:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2022-07-05T11:46:22.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:22.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.828+0000 7f054e9a6700 1 Processor -- start 2022-07-05T11:46:22.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.828+0000 7f054e9a6700 1 -- start start 2022-07-05T11:46:22.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f054e9a6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f054817e0f0 0x7f054817e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f054e9a6700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054817dc60 con 0x7f054817ea60 2022-07-05T11:46:22.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f054e9a6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054817d960 con 0x7f054817bac0 2022-07-05T11:46:22.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f054e9a6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0548066c30 con 0x7f054817e0f0 2022-07-05T11:46:22.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f054cf43700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f054817ea60 0x7f054817f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49722/0 (socket says 172.21.15.90:49722) 2022-07-05T11:46:22.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f054cf43700 1 -- 172.21.15.90:0/130783748 learned_addr learned my addr 172.21.15.90:0/130783748 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:22.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f053ffff700 1 --2- 172.21.15.90:0/130783748 >> v2:172.21.15.149:3300/0 conn(0x7f054817e0f0 0x7f054817e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334464855 0 0) 0x7f054817dc60 con 0x7f054817ea60 2022-07-05T11:46:22.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.829+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05280033f0 con 0x7f054817ea60 2022-07-05T11:46:22.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063419531 0 0) 0x7f05280033f0 con 0x7f054817ea60 2022-07-05T11:46:22.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 >> v2:172.21.15.149:3300/0 conn(0x7f054817e0f0 msgr2=0x7f054817e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:22.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 --2- 172.21.15.90:0/130783748 >> v2:172.21.15.149:3300/0 conn(0x7f054817e0f0 0x7f054817e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 >> v1:172.21.15.149:6789/0 conn(0x7f054817bac0 legacy=0x7f05480661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548066f10 con 0x7f054817ea60 2022-07-05T11:46:22.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f05400017f0 con 0x7f054817ea60 2022-07-05T11:46:22.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 >> v1:172.21.15.90:6789/0 conn(0x7f054817ea60 legacy=0x7f054817f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05280038e0 0x7f0528003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f0528004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0528005000 0x7f052800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548066c30 con 0x7f0528004690 2022-07-05T11:46:22.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052800bee0 con 0x7f05280038e0 2022-07-05T11:46:22.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052800c0a0 con 0x7f0528005000 2022-07-05T11:46:22.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f053ffff700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f0528004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f054cf43700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0528005000 0x7f052800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f053ffff700 1 -- 172.21.15.90:0/130783748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0528005000 msgr2=0x7f052800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:22.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f053ffff700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0528005000 0x7f052800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f053ffff700 1 -- 172.21.15.90:0/130783748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05280038e0 msgr2=0x7f0528003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:22.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f0547fff700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05280038e0 0x7f0528003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f053ffff700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05280038e0 0x7f0528003cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f054cf43700 1 -- 172.21.15.90:0/130783748 reap_dead start 2022-07-05T11:46:22.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f053ffff700 1 -- 172.21.15.90:0/130783748 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280033f0 con 0x7f0528004690 2022-07-05T11:46:22.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f053ffff700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f0528004b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f0530009a80 tx=0x7f0530009060).ready entity=mon.0 client_cookie=2e0cd370dfe8a433 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:22.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530009430 con 0x7f0528004690 2022-07-05T11:46:22.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053000e640 con 0x7f0528004690 2022-07-05T11:46:22.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.830+0000 7f05477fe700 1 -- 172.21.15.90:0/130783748 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000e9c0 con 0x7f0528004690 2022-07-05T11:46:22.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.831+0000 7f054e9a6700 1 -- 172.21.15.90:0/130783748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 msgr2=0x7f0528004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.831+0000 7f054e9a6700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f0528004b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f0530009a80 tx=0x7f0530009060).stop 2022-07-05T11:46:22.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.831+0000 7f054e9a6700 1 -- 172.21.15.90:0/130783748 shutdown_connections 2022-07-05T11:46:22.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.831+0000 7f054e9a6700 1 --2- 172.21.15.90:0/130783748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f0528004b10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:22.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.831+0000 7f054e9a6700 1 -- 172.21.15.90:0/130783748 >> 172.21.15.90:0/130783748 conn(0x7f05480f2960 msgr2=0x7f05480f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:22.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.831+0000 7f054e9a6700 1 -- 172.21.15.90:0/130783748 shutdown_connections 2022-07-05T11:46:22.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.831+0000 7f054e9a6700 1 -- 172.21.15.90:0/130783748 wait complete. 2022-07-05T11:46:22.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.832+0000 7f054e9a6700 1 Processor -- start 2022-07-05T11:46:22.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.832+0000 7f054e9a6700 1 -- start start 2022-07-05T11:46:22.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f054e9a6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f05480ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f054e9a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05480cadd0 0x7f05481921b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f054e9a6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05481926a0 0x7f05480c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f054e9a6700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c62c0 con 0x7f0528004690 2022-07-05T11:46:22.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f054e9a6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548158430 con 0x7f05481926a0 2022-07-05T11:46:22.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f054e9a6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480eb9a0 con 0x7f05480cadd0 2022-07-05T11:46:22.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f0547fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f05480ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f0547fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f05480ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56790/0 (socket says 172.21.15.90:56790) 2022-07-05T11:46:22.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.833+0000 7f0547fff700 1 -- 172.21.15.90:0/2673544422 learned_addr learned my addr 172.21.15.90:0/2673544422 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:22.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0547fff700 1 -- 172.21.15.90:0/2673544422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05480cadd0 msgr2=0x7f05481921b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0547fff700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05480cadd0 0x7f05481921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:22.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0547fff700 1 -- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05481926a0 msgr2=0x7f05480c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:22.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0547fff700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05481926a0 0x7f05480c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:22.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0547fff700 1 -- 172.21.15.90:0/2673544422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05480ebc80 con 0x7f0528004690 2022-07-05T11:46:22.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0547fff700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f05480ca8e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f053800d500 tx=0x7f0538009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:22.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0544ff9700 1 -- 172.21.15.90:0/2673544422 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380104e0 con 0x7f0528004690 2022-07-05T11:46:22.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0544ff9700 1 -- 172.21.15.90:0/2673544422 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538010640 con 0x7f0528004690 2022-07-05T11:46:22.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05480ebf60 con 0x7f0528004690 2022-07-05T11:46:22.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f0544ff9700 1 -- 172.21.15.90:0/2673544422 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380109e0 con 0x7f0528004690 2022-07-05T11:46:22.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.834+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480ec520 con 0x7f0528004690 2022-07-05T11:46:22.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.835+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054806be40 con 0x7f0528004690 2022-07-05T11:46:22.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.836+0000 7f0544ff9700 1 -- 172.21.15.90:0/2673544422 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f053801a030 con 0x7f0528004690 2022-07-05T11:46:22.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.836+0000 7f0544ff9700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f052c08ba40 0x7f052c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:22.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.836+0000 7f0544ff9700 1 -- 172.21.15.90:0/2673544422 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f05380b0110 con 0x7f0528004690 2022-07-05T11:46:22.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.836+0000 7f053ffff700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f052c08ba40 0x7f052c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:22.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.837+0000 7f053ffff700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f052c08ba40 0x7f052c08df00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f054817ccb0 tx=0x7f053001a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:22.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:22.840+0000 7f0544ff9700 1 -- 172.21.15.90:0/2673544422 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f0538080dd0 con 0x7f0528004690 2022-07-05T11:46:23.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.003+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05480671f0 con 0x7f0528004690 2022-07-05T11:46:23.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.004+0000 7f0544ff9700 1 -- 172.21.15.90:0/2673544422 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f0538018020 con 0x7f0528004690 2022-07-05T11:46:23.005 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:23.005 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:23.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f052c08ba40 msgr2=0x7f052c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f052c08ba40 0x7f052c08df00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f054817ccb0 tx=0x7f053001a000).stop 2022-07-05T11:46:23.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 msgr2=0x7f05480ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f05480ca8e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f053800d500 tx=0x7f0538009040).stop 2022-07-05T11:46:23.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 shutdown_connections 2022-07-05T11:46:23.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f052c08ba40 0x7f052c08df00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05481926a0 0x7f05480c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:23.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0528004690 0x7f05480ca8e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 --2- 172.21.15.90:0/2673544422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05480cadd0 0x7f05481921b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:23.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 >> 172.21.15.90:0/2673544422 conn(0x7f05480f2960 msgr2=0x7f05480661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:23.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 shutdown_connections 2022-07-05T11:46:23.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.006+0000 7f054e9a6700 1 -- 172.21.15.90:0/2673544422 wait complete. 2022-07-05T11:46:23.019 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-07-05T11:46:23.019 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-07-05T11:46:23.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.131+0000 7fba1daf6700 1 Processor -- start 2022-07-05T11:46:23.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.131+0000 7fba1daf6700 1 -- start start 2022-07-05T11:46:23.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.132+0000 7fba1daf6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba1817da60 0x7fba1817de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.132+0000 7fba1daf6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180c9090 con 0x7fba180c9520 2022-07-05T11:46:23.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.132+0000 7fba1daf6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180c81a0 con 0x7fba180c7d00 2022-07-05T11:46:23.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.132+0000 7fba1daf6700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180c8480 con 0x7fba1817da60 2022-07-05T11:46:23.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba177fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba1817da60 0x7fba1817de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba17fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fba180c9520 0x7fba180c99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59338/0 (socket says 172.21.15.90:59338) 2022-07-05T11:46:23.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba177fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba1817da60 0x7fba1817de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:33118/0 (socket says 172.21.15.90:33118) 2022-07-05T11:46:23.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba17fff700 1 -- 172.21.15.90:0/3388515480 learned_addr learned my addr 172.21.15.90:0/3388515480 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:23.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba177fe700 1 -- 172.21.15.90:0/3388515480 >> v1:172.21.15.149:6789/0 conn(0x7fba180c7d00 legacy=0x7fba1817eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba177fe700 1 -- 172.21.15.90:0/3388515480 >> v1:172.21.15.110:6789/0 conn(0x7fba180c9520 legacy=0x7fba180c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba177fe700 1 -- 172.21.15.90:0/3388515480 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180c8760 con 0x7fba1817da60 2022-07-05T11:46:23.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba177fe700 1 --2- 172.21.15.90:0/3388515480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba1817de40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fba08009e60 tx=0x7fba08009780).ready entity=mon.1 client_cookie=d2fbc77853ddbb3d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:23.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba167fc700 1 -- 172.21.15.90:0/3388515480 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800e070 con 0x7fba1817da60 2022-07-05T11:46:23.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba167fc700 1 -- 172.21.15.90:0/3388515480 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0800bc30 con 0x7fba1817da60 2022-07-05T11:46:23.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.133+0000 7fba167fc700 1 -- 172.21.15.90:0/3388515480 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08012410 con 0x7fba1817da60 2022-07-05T11:46:23.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.134+0000 7fba1daf6700 1 -- 172.21.15.90:0/3388515480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 msgr2=0x7fba1817de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.134+0000 7fba1daf6700 1 --2- 172.21.15.90:0/3388515480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba1817de40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fba08009e60 tx=0x7fba08009780).stop 2022-07-05T11:46:23.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.134+0000 7fba1daf6700 1 -- 172.21.15.90:0/3388515480 shutdown_connections 2022-07-05T11:46:23.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.134+0000 7fba1daf6700 1 --2- 172.21.15.90:0/3388515480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba1817de40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.134+0000 7fba1daf6700 1 -- 172.21.15.90:0/3388515480 >> 172.21.15.90:0/3388515480 conn(0x7fba180f4b70 msgr2=0x7fba180f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:23.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.134+0000 7fba1daf6700 1 -- 172.21.15.90:0/3388515480 shutdown_connections 2022-07-05T11:46:23.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.134+0000 7fba1daf6700 1 -- 172.21.15.90:0/3388515480 wait complete. 2022-07-05T11:46:23.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.135+0000 7fba1daf6700 1 Processor -- start 2022-07-05T11:46:23.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.135+0000 7fba1daf6700 1 -- start start 2022-07-05T11:46:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba1daf6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba180c7d00 0x7fba1815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba1daf6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba180c9520 0x7fba1815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba1daf6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba18176380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba1daf6700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18171b10 con 0x7fba180c7d00 2022-07-05T11:46:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba1daf6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18171df0 con 0x7fba1817da60 2022-07-05T11:46:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba1daf6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba181720d0 con 0x7fba180c9520 2022-07-05T11:46:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba177fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba180c7d00 0x7fba1815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba177fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba180c7d00 0x7fba1815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56804/0 (socket says 172.21.15.90:56804) 2022-07-05T11:46:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.136+0000 7fba177fe700 1 -- 172.21.15.90:0/1014051335 learned_addr learned my addr 172.21.15.90:0/1014051335 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba17fff700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba18176380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba16ffd700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba180c9520 0x7fba1815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba177fe700 1 -- 172.21.15.90:0/1014051335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba180c9520 msgr2=0x7fba1815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba177fe700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba180c9520 0x7fba1815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba177fe700 1 -- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 msgr2=0x7fba18176380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba177fe700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba18176380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba177fe700 1 -- 172.21.15.90:0/1014051335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009a20 con 0x7fba180c7d00 2022-07-05T11:46:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba16ffd700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba180c9520 0x7fba1815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba17fff700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba18176380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba177fe700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba180c7d00 0x7fba1815ca60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fba0800b6c0 tx=0x7fba08009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fb9ff7fe700 1 -- 172.21.15.90:0/1014051335 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080063a0 con 0x7fba180c7d00 2022-07-05T11:46:23.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fb9ff7fe700 1 -- 172.21.15.90:0/1014051335 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08006500 con 0x7fba180c7d00 2022-07-05T11:46:23.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba181723b0 con 0x7fba180c7d00 2022-07-05T11:46:23.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fb9ff7fe700 1 -- 172.21.15.90:0/1014051335 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080068a0 con 0x7fba180c7d00 2022-07-05T11:46:23.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.137+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18172970 con 0x7fba180c7d00 2022-07-05T11:46:23.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.138+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1806be40 con 0x7fba180c7d00 2022-07-05T11:46:23.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.139+0000 7fb9ff7fe700 1 -- 172.21.15.90:0/1014051335 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fba08031430 con 0x7fba180c7d00 2022-07-05T11:46:23.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.139+0000 7fb9ff7fe700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb9f808ba40 0x7fb9f808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.139+0000 7fb9ff7fe700 1 -- 172.21.15.90:0/1014051335 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fba080b39c0 con 0x7fba180c7d00 2022-07-05T11:46:23.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.139+0000 7fba16ffd700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb9f808ba40 0x7fb9f808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.140+0000 7fba16ffd700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb9f808ba40 0x7fb9f808df00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fba18177e90 tx=0x7fba0c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:23.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.142+0000 7fb9ff7fe700 1 -- 172.21.15.90:0/1014051335 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fba08084600 con 0x7fba180c7d00 2022-07-05T11:46:23.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.300+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 --> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba18087fa0 con 0x7fb9f808ba40 2022-07-05T11:46:23.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.314+0000 7fb9ff7fe700 1 -- 172.21.15.90:0/1014051335 <== mgr.4105 v2:172.21.15.110:6800/36906 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434424 (secure 0 0 0) 0x7fba18087fa0 con 0x7fb9f808ba40 2022-07-05T11:46:23.325 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:23.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.317+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb9f808ba40 msgr2=0x7fb9f808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.317+0000 7fba1daf6700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb9f808ba40 0x7fb9f808df00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fba18177e90 tx=0x7fba0c009040).stop 2022-07-05T11:46:23.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.317+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba180c7d00 msgr2=0x7fba1815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.317+0000 7fba1daf6700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba180c7d00 0x7fba1815ca60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fba0800b6c0 tx=0x7fba08009780).stop 2022-07-05T11:46:23.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 shutdown_connections 2022-07-05T11:46:23.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb9f808ba40 0x7fb9f808df00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba1817da60 0x7fba18176380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba180c7d00 0x7fba1815ca60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 --2- 172.21.15.90:0/1014051335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba180c9520 0x7fba1815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 >> 172.21.15.90:0/1014051335 conn(0x7fba180f4b70 msgr2=0x7fba180c5010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:23.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 shutdown_connections 2022-07-05T11:46:23.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.318+0000 7fba1daf6700 1 -- 172.21.15.90:0/1014051335 wait complete. 2022-07-05T11:46:23.336 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2022-07-05T11:46:23.337 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2022-07-05T11:46:23.118918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7110,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":64032,"kb_used_data":3968,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":1132398048,"statfs":{"total":1159641169920,"available":1159575601152,"internally_reserved":0,"allocated":4063232,"data_stored":1975122,"data_compressed":167460,"data_compressed_allocated":245760,"data_compressed_original":491520,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4804,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003775"},"pg_stats":[{"pgid":"3.3f","version":"31'6","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360200+0000","last_change":"2022-07-05T11:46:04.211228+0000","last_active":"2022-07-05T11:46:21.360200+0000","last_peered":"2022-07-05T11:46:21.360200+0000","last_clean":"2022-07-05T11:46:21.360200+0000","last_became_active":"2022-07-05T11:46:04.210963+0000","last_became_peered":"2022-07-05T11:46:04.210963+0000","last_unstale":"2022-07-05T11:46:21.360200+0000","last_undegraded":"2022-07-05T11:46:21.360200+0000","last_fullsized":"2022-07-05T11:46:21.360200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029059+0000","last_change":"2022-07-05T11:46:04.590106+0000","last_active":"2022-07-05T11:46:09.029059+0000","last_peered":"2022-07-05T11:46:09.029059+0000","last_clean":"2022-07-05T11:46:09.029059+0000","last_became_active":"2022-07-05T11:46:04.589807+0000","last_became_peered":"2022-07-05T11:46:04.589807+0000","last_unstale":"2022-07-05T11:46:09.029059+0000","last_undegraded":"2022-07-05T11:46:09.029059+0000","last_fullsized":"2022-07-05T11:46:09.029059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.408147+0000","last_change":"2022-07-05T11:46:04.202921+0000","last_active":"2022-07-05T11:46:10.408147+0000","last_peered":"2022-07-05T11:46:10.408147+0000","last_clean":"2022-07-05T11:46:10.408147+0000","last_became_active":"2022-07-05T11:46:04.202631+0000","last_became_peered":"2022-07-05T11:46:04.202631+0000","last_unstale":"2022-07-05T11:46:10.408147+0000","last_undegraded":"2022-07-05T11:46:10.408147+0000","last_fullsized":"2022-07-05T11:46:10.408147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028341+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.028341+0000","last_peered":"2022-07-05T11:46:09.028341+0000","last_clean":"2022-07-05T11:46:09.028341+0000","last_became_active":"2022-07-05T11:46:04.595253+0000","last_became_peered":"2022-07-05T11:46:04.595253+0000","last_unstale":"2022-07-05T11:46:09.028341+0000","last_undegraded":"2022-07-05T11:46:09.028341+0000","last_fullsized":"2022-07-05T11:46:09.028341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360892+0000","last_change":"2022-07-05T11:46:04.211131+0000","last_active":"2022-07-05T11:46:21.360892+0000","last_peered":"2022-07-05T11:46:21.360892+0000","last_clean":"2022-07-05T11:46:21.360892+0000","last_became_active":"2022-07-05T11:46:04.210828+0000","last_became_peered":"2022-07-05T11:46:04.210828+0000","last_unstale":"2022-07-05T11:46:21.360892+0000","last_undegraded":"2022-07-05T11:46:21.360892+0000","last_fullsized":"2022-07-05T11:46:21.360892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012401+0000","last_change":"2022-07-05T11:46:04.592905+0000","last_active":"2022-07-05T11:46:09.012401+0000","last_peered":"2022-07-05T11:46:09.012401+0000","last_clean":"2022-07-05T11:46:09.012401+0000","last_became_active":"2022-07-05T11:46:04.592593+0000","last_became_peered":"2022-07-05T11:46:04.592593+0000","last_unstale":"2022-07-05T11:46:09.012401+0000","last_undegraded":"2022-07-05T11:46:09.012401+0000","last_fullsized":"2022-07-05T11:46:09.012401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012779+0000","last_change":"2022-07-05T11:46:04.209903+0000","last_active":"2022-07-05T11:46:09.012779+0000","last_peered":"2022-07-05T11:46:09.012779+0000","last_clean":"2022-07-05T11:46:09.012779+0000","last_became_active":"2022-07-05T11:46:04.204575+0000","last_became_peered":"2022-07-05T11:46:04.204575+0000","last_unstale":"2022-07-05T11:46:09.012779+0000","last_undegraded":"2022-07-05T11:46:09.012779+0000","last_fullsized":"2022-07-05T11:46:09.012779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974869+0000","last_change":"2022-07-05T11:46:04.595822+0000","last_active":"2022-07-05T11:46:08.974869+0000","last_peered":"2022-07-05T11:46:08.974869+0000","last_clean":"2022-07-05T11:46:08.974869+0000","last_became_active":"2022-07-05T11:46:04.595306+0000","last_became_peered":"2022-07-05T11:46:04.595306+0000","last_unstale":"2022-07-05T11:46:08.974869+0000","last_undegraded":"2022-07-05T11:46:08.974869+0000","last_fullsized":"2022-07-05T11:46:08.974869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"25'1","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029038+0000","last_change":"2022-07-05T11:46:04.202298+0000","last_active":"2022-07-05T11:46:09.029038+0000","last_peered":"2022-07-05T11:46:09.029038+0000","last_clean":"2022-07-05T11:46:09.029038+0000","last_became_active":"2022-07-05T11:46:04.202010+0000","last_became_peered":"2022-07-05T11:46:04.202010+0000","last_unstale":"2022-07-05T11:46:09.029038+0000","last_undegraded":"2022-07-05T11:46:09.029038+0000","last_fullsized":"2022-07-05T11:46:09.029038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029758+0000","last_change":"2022-07-05T11:46:04.590970+0000","last_active":"2022-07-05T11:46:09.029758+0000","last_peered":"2022-07-05T11:46:09.029758+0000","last_clean":"2022-07-05T11:46:09.029758+0000","last_became_active":"2022-07-05T11:46:04.590714+0000","last_became_peered":"2022-07-05T11:46:04.590714+0000","last_unstale":"2022-07-05T11:46:09.029758+0000","last_undegraded":"2022-07-05T11:46:09.029758+0000","last_fullsized":"2022-07-05T11:46:09.029758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029235+0000","last_change":"2022-07-05T11:46:04.204607+0000","last_active":"2022-07-05T11:46:09.029235+0000","last_peered":"2022-07-05T11:46:09.029235+0000","last_clean":"2022-07-05T11:46:09.029235+0000","last_became_active":"2022-07-05T11:46:04.204287+0000","last_became_peered":"2022-07-05T11:46:04.204287+0000","last_unstale":"2022-07-05T11:46:09.029235+0000","last_undegraded":"2022-07-05T11:46:09.029235+0000","last_fullsized":"2022-07-05T11:46:09.029235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012802+0000","last_change":"2022-07-05T11:46:04.606655+0000","last_active":"2022-07-05T11:46:09.012802+0000","last_peered":"2022-07-05T11:46:09.012802+0000","last_clean":"2022-07-05T11:46:09.012802+0000","last_became_active":"2022-07-05T11:46:04.606370+0000","last_became_peered":"2022-07-05T11:46:04.606370+0000","last_unstale":"2022-07-05T11:46:09.012802+0000","last_undegraded":"2022-07-05T11:46:09.012802+0000","last_fullsized":"2022-07-05T11:46:09.012802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360703+0000","last_change":"2022-07-05T11:46:04.206427+0000","last_active":"2022-07-05T11:46:21.360703+0000","last_peered":"2022-07-05T11:46:21.360703+0000","last_clean":"2022-07-05T11:46:21.360703+0000","last_became_active":"2022-07-05T11:46:04.206192+0000","last_became_peered":"2022-07-05T11:46:04.206192+0000","last_unstale":"2022-07-05T11:46:21.360703+0000","last_undegraded":"2022-07-05T11:46:21.360703+0000","last_fullsized":"2022-07-05T11:46:21.360703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028587+0000","last_change":"2022-07-05T11:46:04.599321+0000","last_active":"2022-07-05T11:46:09.028587+0000","last_peered":"2022-07-05T11:46:09.028587+0000","last_clean":"2022-07-05T11:46:09.028587+0000","last_became_active":"2022-07-05T11:46:04.597626+0000","last_became_peered":"2022-07-05T11:46:04.597626+0000","last_unstale":"2022-07-05T11:46:09.028587+0000","last_undegraded":"2022-07-05T11:46:09.028587+0000","last_fullsized":"2022-07-05T11:46:09.028587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407177+0000","last_change":"2022-07-05T11:46:04.204458+0000","last_active":"2022-07-05T11:46:10.407177+0000","last_peered":"2022-07-05T11:46:10.407177+0000","last_clean":"2022-07-05T11:46:10.407177+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:10.407177+0000","last_undegraded":"2022-07-05T11:46:10.407177+0000","last_fullsized":"2022-07-05T11:46:10.407177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028708+0000","last_change":"2022-07-05T11:46:04.598830+0000","last_active":"2022-07-05T11:46:09.028708+0000","last_peered":"2022-07-05T11:46:09.028708+0000","last_clean":"2022-07-05T11:46:09.028708+0000","last_became_active":"2022-07-05T11:46:04.597158+0000","last_became_peered":"2022-07-05T11:46:04.597158+0000","last_unstale":"2022-07-05T11:46:09.028708+0000","last_undegraded":"2022-07-05T11:46:09.028708+0000","last_fullsized":"2022-07-05T11:46:09.028708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029721+0000","last_change":"2022-07-05T11:46:04.207355+0000","last_active":"2022-07-05T11:46:09.029721+0000","last_peered":"2022-07-05T11:46:09.029721+0000","last_clean":"2022-07-05T11:46:09.029721+0000","last_became_active":"2022-07-05T11:46:04.207059+0000","last_became_peered":"2022-07-05T11:46:04.207059+0000","last_unstale":"2022-07-05T11:46:09.029721+0000","last_undegraded":"2022-07-05T11:46:09.029721+0000","last_fullsized":"2022-07-05T11:46:09.029721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012425+0000","last_change":"2022-07-05T11:46:04.595782+0000","last_active":"2022-07-05T11:46:09.012425+0000","last_peered":"2022-07-05T11:46:09.012425+0000","last_clean":"2022-07-05T11:46:09.012425+0000","last_became_active":"2022-07-05T11:46:04.595530+0000","last_became_peered":"2022-07-05T11:46:04.595530+0000","last_unstale":"2022-07-05T11:46:09.012425+0000","last_undegraded":"2022-07-05T11:46:09.012425+0000","last_fullsized":"2022-07-05T11:46:09.012425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.351876+0000","last_change":"2022-07-05T11:46:04.210209+0000","last_active":"2022-07-05T11:46:20.351876+0000","last_peered":"2022-07-05T11:46:20.351876+0000","last_clean":"2022-07-05T11:46:20.351876+0000","last_became_active":"2022-07-05T11:46:04.209883+0000","last_became_peered":"2022-07-05T11:46:04.209883+0000","last_unstale":"2022-07-05T11:46:20.351876+0000","last_undegraded":"2022-07-05T11:46:20.351876+0000","last_fullsized":"2022-07-05T11:46:20.351876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028150+0000","last_change":"2022-07-05T11:46:04.600375+0000","last_active":"2022-07-05T11:46:09.028150+0000","last_peered":"2022-07-05T11:46:09.028150+0000","last_clean":"2022-07-05T11:46:09.028150+0000","last_became_active":"2022-07-05T11:46:04.600101+0000","last_became_peered":"2022-07-05T11:46:04.600101+0000","last_unstale":"2022-07-05T11:46:09.028150+0000","last_undegraded":"2022-07-05T11:46:09.028150+0000","last_fullsized":"2022-07-05T11:46:09.028150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030246+0000","last_change":"2022-07-05T11:46:04.204891+0000","last_active":"2022-07-05T11:46:09.030246+0000","last_peered":"2022-07-05T11:46:09.030246+0000","last_clean":"2022-07-05T11:46:09.030246+0000","last_became_active":"2022-07-05T11:46:04.204619+0000","last_became_peered":"2022-07-05T11:46:04.204619+0000","last_unstale":"2022-07-05T11:46:09.030246+0000","last_undegraded":"2022-07-05T11:46:09.030246+0000","last_fullsized":"2022-07-05T11:46:09.030246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028234+0000","last_change":"2022-07-05T11:46:04.600335+0000","last_active":"2022-07-05T11:46:09.028234+0000","last_peered":"2022-07-05T11:46:09.028234+0000","last_clean":"2022-07-05T11:46:09.028234+0000","last_became_active":"2022-07-05T11:46:04.600026+0000","last_became_peered":"2022-07-05T11:46:04.600026+0000","last_unstale":"2022-07-05T11:46:09.028234+0000","last_undegraded":"2022-07-05T11:46:09.028234+0000","last_fullsized":"2022-07-05T11:46:09.028234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352620+0000","last_change":"2022-07-05T11:46:04.210563+0000","last_active":"2022-07-05T11:46:20.352620+0000","last_peered":"2022-07-05T11:46:20.352620+0000","last_clean":"2022-07-05T11:46:20.352620+0000","last_became_active":"2022-07-05T11:46:04.210264+0000","last_became_peered":"2022-07-05T11:46:04.210264+0000","last_unstale":"2022-07-05T11:46:20.352620+0000","last_undegraded":"2022-07-05T11:46:20.352620+0000","last_fullsized":"2022-07-05T11:46:20.352620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3070,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975654+0000","last_change":"2022-07-05T11:46:04.596566+0000","last_active":"2022-07-05T11:46:08.975654+0000","last_peered":"2022-07-05T11:46:08.975654+0000","last_clean":"2022-07-05T11:46:08.975654+0000","last_became_active":"2022-07-05T11:46:04.596385+0000","last_became_peered":"2022-07-05T11:46:04.596385+0000","last_unstale":"2022-07-05T11:46:08.975654+0000","last_undegraded":"2022-07-05T11:46:08.975654+0000","last_fullsized":"2022-07-05T11:46:08.975654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359717+0000","last_change":"2022-07-05T11:46:04.205836+0000","last_active":"2022-07-05T11:46:21.359717+0000","last_peered":"2022-07-05T11:46:21.359717+0000","last_clean":"2022-07-05T11:46:21.359717+0000","last_became_active":"2022-07-05T11:46:04.205522+0000","last_became_peered":"2022-07-05T11:46:04.205522+0000","last_unstale":"2022-07-05T11:46:21.359717+0000","last_undegraded":"2022-07-05T11:46:21.359717+0000","last_fullsized":"2022-07-05T11:46:21.359717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027942+0000","last_change":"2022-07-05T11:46:04.600047+0000","last_active":"2022-07-05T11:46:09.027942+0000","last_peered":"2022-07-05T11:46:09.027942+0000","last_clean":"2022-07-05T11:46:09.027942+0000","last_became_active":"2022-07-05T11:46:04.599735+0000","last_became_peered":"2022-07-05T11:46:04.599735+0000","last_unstale":"2022-07-05T11:46:09.027942+0000","last_undegraded":"2022-07-05T11:46:09.027942+0000","last_fullsized":"2022-07-05T11:46:09.027942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027527+0000","last_change":"2022-07-05T11:46:04.204754+0000","last_active":"2022-07-05T11:46:09.027527+0000","last_peered":"2022-07-05T11:46:09.027527+0000","last_clean":"2022-07-05T11:46:09.027527+0000","last_became_active":"2022-07-05T11:46:04.204466+0000","last_became_peered":"2022-07-05T11:46:04.204466+0000","last_unstale":"2022-07-05T11:46:09.027527+0000","last_undegraded":"2022-07-05T11:46:09.027527+0000","last_fullsized":"2022-07-05T11:46:09.027527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012900+0000","last_change":"2022-07-05T11:46:04.594552+0000","last_active":"2022-07-05T11:46:09.012900+0000","last_peered":"2022-07-05T11:46:09.012900+0000","last_clean":"2022-07-05T11:46:09.012900+0000","last_became_active":"2022-07-05T11:46:04.594285+0000","last_became_peered":"2022-07-05T11:46:04.594285+0000","last_unstale":"2022-07-05T11:46:09.012900+0000","last_undegraded":"2022-07-05T11:46:09.012900+0000","last_fullsized":"2022-07-05T11:46:09.012900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027421+0000","last_change":"2022-07-05T11:46:04.206416+0000","last_active":"2022-07-05T11:46:09.027421+0000","last_peered":"2022-07-05T11:46:09.027421+0000","last_clean":"2022-07-05T11:46:09.027421+0000","last_became_active":"2022-07-05T11:46:04.206118+0000","last_became_peered":"2022-07-05T11:46:04.206118+0000","last_unstale":"2022-07-05T11:46:09.027421+0000","last_undegraded":"2022-07-05T11:46:09.027421+0000","last_fullsized":"2022-07-05T11:46:09.027421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975854+0000","last_change":"2022-07-05T11:46:04.596814+0000","last_active":"2022-07-05T11:46:08.975854+0000","last_peered":"2022-07-05T11:46:08.975854+0000","last_clean":"2022-07-05T11:46:08.975854+0000","last_became_active":"2022-07-05T11:46:04.596492+0000","last_became_peered":"2022-07-05T11:46:04.596492+0000","last_unstale":"2022-07-05T11:46:08.975854+0000","last_undegraded":"2022-07-05T11:46:08.975854+0000","last_fullsized":"2022-07-05T11:46:08.975854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'10","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359628+0000","last_change":"2022-07-05T11:46:04.208748+0000","last_active":"2022-07-05T11:46:21.359628+0000","last_peered":"2022-07-05T11:46:21.359628+0000","last_clean":"2022-07-05T11:46:21.359628+0000","last_became_active":"2022-07-05T11:46:04.208440+0000","last_became_peered":"2022-07-05T11:46:04.208440+0000","last_unstale":"2022-07-05T11:46:21.359628+0000","last_undegraded":"2022-07-05T11:46:21.359628+0000","last_fullsized":"2022-07-05T11:46:21.359628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974079+0000","last_change":"2022-07-05T11:46:04.592371+0000","last_active":"2022-07-05T11:46:08.974079+0000","last_peered":"2022-07-05T11:46:08.974079+0000","last_clean":"2022-07-05T11:46:08.974079+0000","last_became_active":"2022-07-05T11:46:04.592201+0000","last_became_peered":"2022-07-05T11:46:04.592201+0000","last_unstale":"2022-07-05T11:46:08.974079+0000","last_undegraded":"2022-07-05T11:46:08.974079+0000","last_fullsized":"2022-07-05T11:46:08.974079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976173+0000","last_change":"2022-07-05T11:46:04.211261+0000","last_active":"2022-07-05T11:46:08.976173+0000","last_peered":"2022-07-05T11:46:08.976173+0000","last_clean":"2022-07-05T11:46:08.976173+0000","last_became_active":"2022-07-05T11:46:04.211004+0000","last_became_peered":"2022-07-05T11:46:04.211004+0000","last_unstale":"2022-07-05T11:46:08.976173+0000","last_undegraded":"2022-07-05T11:46:08.976173+0000","last_fullsized":"2022-07-05T11:46:08.976173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974789+0000","last_change":"2022-07-05T11:46:04.597787+0000","last_active":"2022-07-05T11:46:08.974789+0000","last_peered":"2022-07-05T11:46:08.974789+0000","last_clean":"2022-07-05T11:46:08.974789+0000","last_became_active":"2022-07-05T11:46:04.597433+0000","last_became_peered":"2022-07-05T11:46:04.597433+0000","last_unstale":"2022-07-05T11:46:08.974789+0000","last_undegraded":"2022-07-05T11:46:08.974789+0000","last_fullsized":"2022-07-05T11:46:08.974789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974038+0000","last_change":"2022-07-05T11:46:04.211347+0000","last_active":"2022-07-05T11:46:08.974038+0000","last_peered":"2022-07-05T11:46:08.974038+0000","last_clean":"2022-07-05T11:46:08.974038+0000","last_became_active":"2022-07-05T11:46:04.211045+0000","last_became_peered":"2022-07-05T11:46:04.211045+0000","last_unstale":"2022-07-05T11:46:08.974038+0000","last_undegraded":"2022-07-05T11:46:08.974038+0000","last_fullsized":"2022-07-05T11:46:08.974038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973840+0000","last_change":"2022-07-05T11:46:04.587177+0000","last_active":"2022-07-05T11:46:08.973840+0000","last_peered":"2022-07-05T11:46:08.973840+0000","last_clean":"2022-07-05T11:46:08.973840+0000","last_became_active":"2022-07-05T11:46:04.586915+0000","last_became_peered":"2022-07-05T11:46:04.586915+0000","last_unstale":"2022-07-05T11:46:08.973840+0000","last_undegraded":"2022-07-05T11:46:08.973840+0000","last_fullsized":"2022-07-05T11:46:08.973840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028039+0000","last_change":"2022-07-05T11:46:04.213135+0000","last_active":"2022-07-05T11:46:09.028039+0000","last_peered":"2022-07-05T11:46:09.028039+0000","last_clean":"2022-07-05T11:46:09.028039+0000","last_became_active":"2022-07-05T11:46:04.212877+0000","last_became_peered":"2022-07-05T11:46:04.212877+0000","last_unstale":"2022-07-05T11:46:09.028039+0000","last_undegraded":"2022-07-05T11:46:09.028039+0000","last_fullsized":"2022-07-05T11:46:09.028039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975178+0000","last_change":"2022-07-05T11:46:04.598414+0000","last_active":"2022-07-05T11:46:08.975178+0000","last_peered":"2022-07-05T11:46:08.975178+0000","last_clean":"2022-07-05T11:46:08.975178+0000","last_became_active":"2022-07-05T11:46:04.595082+0000","last_became_peered":"2022-07-05T11:46:04.595082+0000","last_unstale":"2022-07-05T11:46:08.975178+0000","last_undegraded":"2022-07-05T11:46:08.975178+0000","last_fullsized":"2022-07-05T11:46:08.975178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360249+0000","last_change":"2022-07-05T11:46:04.208533+0000","last_active":"2022-07-05T11:46:21.360249+0000","last_peered":"2022-07-05T11:46:21.360249+0000","last_clean":"2022-07-05T11:46:21.360249+0000","last_became_active":"2022-07-05T11:46:04.208198+0000","last_became_peered":"2022-07-05T11:46:04.208198+0000","last_unstale":"2022-07-05T11:46:21.360249+0000","last_undegraded":"2022-07-05T11:46:21.360249+0000","last_fullsized":"2022-07-05T11:46:21.360249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029685+0000","last_change":"2022-07-05T11:46:04.590329+0000","last_active":"2022-07-05T11:46:09.029685+0000","last_peered":"2022-07-05T11:46:09.029685+0000","last_clean":"2022-07-05T11:46:09.029685+0000","last_became_active":"2022-07-05T11:46:04.590046+0000","last_became_peered":"2022-07-05T11:46:04.590046+0000","last_unstale":"2022-07-05T11:46:09.029685+0000","last_undegraded":"2022-07-05T11:46:09.029685+0000","last_fullsized":"2022-07-05T11:46:09.029685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352181+0000","last_change":"2022-07-05T11:46:04.207526+0000","last_active":"2022-07-05T11:46:20.352181+0000","last_peered":"2022-07-05T11:46:20.352181+0000","last_clean":"2022-07-05T11:46:20.352181+0000","last_became_active":"2022-07-05T11:46:04.207209+0000","last_became_peered":"2022-07-05T11:46:04.207209+0000","last_unstale":"2022-07-05T11:46:20.352181+0000","last_undegraded":"2022-07-05T11:46:20.352181+0000","last_fullsized":"2022-07-05T11:46:20.352181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029663+0000","last_change":"2022-07-05T11:46:04.590203+0000","last_active":"2022-07-05T11:46:09.029663+0000","last_peered":"2022-07-05T11:46:09.029663+0000","last_clean":"2022-07-05T11:46:09.029663+0000","last_became_active":"2022-07-05T11:46:04.589893+0000","last_became_peered":"2022-07-05T11:46:04.589893+0000","last_unstale":"2022-07-05T11:46:09.029663+0000","last_undegraded":"2022-07-05T11:46:09.029663+0000","last_fullsized":"2022-07-05T11:46:09.029663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028304+0000","last_change":"2022-07-05T11:46:04.207726+0000","last_active":"2022-07-05T11:46:09.028304+0000","last_peered":"2022-07-05T11:46:09.028304+0000","last_clean":"2022-07-05T11:46:09.028304+0000","last_became_active":"2022-07-05T11:46:04.207398+0000","last_became_peered":"2022-07-05T11:46:04.207398+0000","last_unstale":"2022-07-05T11:46:09.028304+0000","last_undegraded":"2022-07-05T11:46:09.028304+0000","last_fullsized":"2022-07-05T11:46:09.028304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028460+0000","last_change":"2022-07-05T11:46:04.598660+0000","last_active":"2022-07-05T11:46:09.028460+0000","last_peered":"2022-07-05T11:46:09.028460+0000","last_clean":"2022-07-05T11:46:09.028460+0000","last_became_active":"2022-07-05T11:46:04.598419+0000","last_became_peered":"2022-07-05T11:46:04.598419+0000","last_unstale":"2022-07-05T11:46:09.028460+0000","last_undegraded":"2022-07-05T11:46:09.028460+0000","last_fullsized":"2022-07-05T11:46:09.028460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028769+0000","last_change":"2022-07-05T11:46:04.214164+0000","last_active":"2022-07-05T11:46:09.028769+0000","last_peered":"2022-07-05T11:46:09.028769+0000","last_clean":"2022-07-05T11:46:09.028769+0000","last_became_active":"2022-07-05T11:46:04.213794+0000","last_became_peered":"2022-07-05T11:46:04.213794+0000","last_unstale":"2022-07-05T11:46:09.028769+0000","last_undegraded":"2022-07-05T11:46:09.028769+0000","last_fullsized":"2022-07-05T11:46:09.028769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.599315+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.599091+0000","last_became_peered":"2022-07-05T11:46:04.599091+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353175+0000","last_change":"2022-07-05T11:46:04.208200+0000","last_active":"2022-07-05T11:46:20.353175+0000","last_peered":"2022-07-05T11:46:20.353175+0000","last_clean":"2022-07-05T11:46:20.353175+0000","last_became_active":"2022-07-05T11:46:04.207891+0000","last_became_peered":"2022-07-05T11:46:04.207891+0000","last_unstale":"2022-07-05T11:46:20.353175+0000","last_undegraded":"2022-07-05T11:46:20.353175+0000","last_fullsized":"2022-07-05T11:46:20.353175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028740+0000","last_change":"2022-07-05T11:46:04.594011+0000","last_active":"2022-07-05T11:46:09.028740+0000","last_peered":"2022-07-05T11:46:09.028740+0000","last_clean":"2022-07-05T11:46:09.028740+0000","last_became_active":"2022-07-05T11:46:04.593800+0000","last_became_peered":"2022-07-05T11:46:04.593800+0000","last_unstale":"2022-07-05T11:46:09.028740+0000","last_undegraded":"2022-07-05T11:46:09.028740+0000","last_fullsized":"2022-07-05T11:46:09.028740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353238+0000","last_change":"2022-07-05T11:46:04.206715+0000","last_active":"2022-07-05T11:46:20.353238+0000","last_peered":"2022-07-05T11:46:20.353238+0000","last_clean":"2022-07-05T11:46:20.353238+0000","last_became_active":"2022-07-05T11:46:04.206230+0000","last_became_peered":"2022-07-05T11:46:04.206230+0000","last_unstale":"2022-07-05T11:46:20.353238+0000","last_undegraded":"2022-07-05T11:46:20.353238+0000","last_fullsized":"2022-07-05T11:46:20.353238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029238+0000","last_change":"2022-07-05T11:46:04.590527+0000","last_active":"2022-07-05T11:46:09.029238+0000","last_peered":"2022-07-05T11:46:09.029238+0000","last_clean":"2022-07-05T11:46:09.029238+0000","last_became_active":"2022-07-05T11:46:04.589992+0000","last_became_peered":"2022-07-05T11:46:04.589992+0000","last_unstale":"2022-07-05T11:46:09.029238+0000","last_undegraded":"2022-07-05T11:46:09.029238+0000","last_fullsized":"2022-07-05T11:46:09.029238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317357+0000","last_change":"2022-07-05T11:46:04.209943+0000","last_active":"2022-07-05T11:46:10.317357+0000","last_peered":"2022-07-05T11:46:10.317357+0000","last_clean":"2022-07-05T11:46:10.317357+0000","last_became_active":"2022-07-05T11:46:04.209640+0000","last_became_peered":"2022-07-05T11:46:04.209640+0000","last_unstale":"2022-07-05T11:46:10.317357+0000","last_undegraded":"2022-07-05T11:46:10.317357+0000","last_fullsized":"2022-07-05T11:46:10.317357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028615+0000","last_change":"2022-07-05T11:46:04.593997+0000","last_active":"2022-07-05T11:46:09.028615+0000","last_peered":"2022-07-05T11:46:09.028615+0000","last_clean":"2022-07-05T11:46:09.028615+0000","last_became_active":"2022-07-05T11:46:04.593708+0000","last_became_peered":"2022-07-05T11:46:04.593708+0000","last_unstale":"2022-07-05T11:46:09.028615+0000","last_undegraded":"2022-07-05T11:46:09.028615+0000","last_fullsized":"2022-07-05T11:46:09.028615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.982599+0000","last_change":"2022-07-05T11:46:04.203818+0000","last_active":"2022-07-05T11:46:09.982599+0000","last_peered":"2022-07-05T11:46:09.982599+0000","last_clean":"2022-07-05T11:46:09.982599+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:09.982599+0000","last_undegraded":"2022-07-05T11:46:09.982599+0000","last_fullsized":"2022-07-05T11:46:09.982599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975098+0000","last_change":"2022-07-05T11:46:04.598669+0000","last_active":"2022-07-05T11:46:08.975098+0000","last_peered":"2022-07-05T11:46:08.975098+0000","last_clean":"2022-07-05T11:46:08.975098+0000","last_became_active":"2022-07-05T11:46:04.598400+0000","last_became_peered":"2022-07-05T11:46:04.598400+0000","last_unstale":"2022-07-05T11:46:08.975098+0000","last_undegraded":"2022-07-05T11:46:08.975098+0000","last_fullsized":"2022-07-05T11:46:08.975098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028775+0000","last_change":"2022-07-05T11:46:04.212247+0000","last_active":"2022-07-05T11:46:09.028775+0000","last_peered":"2022-07-05T11:46:09.028775+0000","last_clean":"2022-07-05T11:46:09.028775+0000","last_became_active":"2022-07-05T11:46:04.211958+0000","last_became_peered":"2022-07-05T11:46:04.211958+0000","last_unstale":"2022-07-05T11:46:09.028775+0000","last_undegraded":"2022-07-05T11:46:09.028775+0000","last_fullsized":"2022-07-05T11:46:09.028775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029158+0000","last_change":"2022-07-05T11:46:04.599477+0000","last_active":"2022-07-05T11:46:09.029158+0000","last_peered":"2022-07-05T11:46:09.029158+0000","last_clean":"2022-07-05T11:46:09.029158+0000","last_became_active":"2022-07-05T11:46:04.599214+0000","last_became_peered":"2022-07-05T11:46:04.599214+0000","last_unstale":"2022-07-05T11:46:09.029158+0000","last_undegraded":"2022-07-05T11:46:09.029158+0000","last_fullsized":"2022-07-05T11:46:09.029158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027608+0000","last_change":"2022-07-05T11:46:04.209196+0000","last_active":"2022-07-05T11:46:09.027608+0000","last_peered":"2022-07-05T11:46:09.027608+0000","last_clean":"2022-07-05T11:46:09.027608+0000","last_became_active":"2022-07-05T11:46:04.208918+0000","last_became_peered":"2022-07-05T11:46:04.208918+0000","last_unstale":"2022-07-05T11:46:09.027608+0000","last_undegraded":"2022-07-05T11:46:09.027608+0000","last_fullsized":"2022-07-05T11:46:09.027608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975167+0000","last_change":"2022-07-05T11:46:04.594414+0000","last_active":"2022-07-05T11:46:08.975167+0000","last_peered":"2022-07-05T11:46:08.975167+0000","last_clean":"2022-07-05T11:46:08.975167+0000","last_became_active":"2022-07-05T11:46:04.594114+0000","last_became_peered":"2022-07-05T11:46:04.594114+0000","last_unstale":"2022-07-05T11:46:08.975167+0000","last_undegraded":"2022-07-05T11:46:08.975167+0000","last_fullsized":"2022-07-05T11:46:08.975167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027763+0000","last_change":"2022-07-05T11:46:04.215006+0000","last_active":"2022-07-05T11:46:09.027763+0000","last_peered":"2022-07-05T11:46:09.027763+0000","last_clean":"2022-07-05T11:46:09.027763+0000","last_became_active":"2022-07-05T11:46:04.214585+0000","last_became_peered":"2022-07-05T11:46:04.214585+0000","last_unstale":"2022-07-05T11:46:09.027763+0000","last_undegraded":"2022-07-05T11:46:09.027763+0000","last_fullsized":"2022-07-05T11:46:09.027763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030101+0000","last_change":"2022-07-05T11:46:04.601912+0000","last_active":"2022-07-05T11:46:09.030101+0000","last_peered":"2022-07-05T11:46:09.030101+0000","last_clean":"2022-07-05T11:46:09.030101+0000","last_became_active":"2022-07-05T11:46:04.601605+0000","last_became_peered":"2022-07-05T11:46:04.601605+0000","last_unstale":"2022-07-05T11:46:09.030101+0000","last_undegraded":"2022-07-05T11:46:09.030101+0000","last_fullsized":"2022-07-05T11:46:09.030101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317065+0000","last_change":"2022-07-05T11:46:04.208064+0000","last_active":"2022-07-05T11:46:10.317065+0000","last_peered":"2022-07-05T11:46:10.317065+0000","last_clean":"2022-07-05T11:46:10.317065+0000","last_became_active":"2022-07-05T11:46:04.207845+0000","last_became_peered":"2022-07-05T11:46:04.207845+0000","last_unstale":"2022-07-05T11:46:10.317065+0000","last_undegraded":"2022-07-05T11:46:10.317065+0000","last_fullsized":"2022-07-05T11:46:10.317065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030056+0000","last_change":"2022-07-05T11:46:04.589990+0000","last_active":"2022-07-05T11:46:09.030056+0000","last_peered":"2022-07-05T11:46:09.030056+0000","last_clean":"2022-07-05T11:46:09.030056+0000","last_became_active":"2022-07-05T11:46:04.589734+0000","last_became_peered":"2022-07-05T11:46:04.589734+0000","last_unstale":"2022-07-05T11:46:09.030056+0000","last_undegraded":"2022-07-05T11:46:09.030056+0000","last_fullsized":"2022-07-05T11:46:09.030056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974955+0000","last_change":"2022-07-05T11:46:04.208275+0000","last_active":"2022-07-05T11:46:08.974955+0000","last_peered":"2022-07-05T11:46:08.974955+0000","last_clean":"2022-07-05T11:46:08.974955+0000","last_became_active":"2022-07-05T11:46:04.208001+0000","last_became_peered":"2022-07-05T11:46:04.208001+0000","last_unstale":"2022-07-05T11:46:08.974955+0000","last_undegraded":"2022-07-05T11:46:08.974955+0000","last_fullsized":"2022-07-05T11:46:08.974955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028628+0000","last_change":"2022-07-05T11:46:04.597446+0000","last_active":"2022-07-05T11:46:09.028628+0000","last_peered":"2022-07-05T11:46:09.028628+0000","last_clean":"2022-07-05T11:46:09.028628+0000","last_became_active":"2022-07-05T11:46:04.596828+0000","last_became_peered":"2022-07-05T11:46:04.596828+0000","last_unstale":"2022-07-05T11:46:09.028628+0000","last_undegraded":"2022-07-05T11:46:09.028628+0000","last_fullsized":"2022-07-05T11:46:09.028628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360630+0000","last_change":"2022-07-05T11:46:04.211080+0000","last_active":"2022-07-05T11:46:21.360630+0000","last_peered":"2022-07-05T11:46:21.360630+0000","last_clean":"2022-07-05T11:46:21.360630+0000","last_became_active":"2022-07-05T11:46:04.210805+0000","last_became_peered":"2022-07-05T11:46:04.210805+0000","last_unstale":"2022-07-05T11:46:21.360630+0000","last_undegraded":"2022-07-05T11:46:21.360630+0000","last_fullsized":"2022-07-05T11:46:21.360630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012330+0000","last_change":"2022-07-05T11:46:04.594116+0000","last_active":"2022-07-05T11:46:09.012330+0000","last_peered":"2022-07-05T11:46:09.012330+0000","last_clean":"2022-07-05T11:46:09.012330+0000","last_became_active":"2022-07-05T11:46:04.593716+0000","last_became_peered":"2022-07-05T11:46:04.593716+0000","last_unstale":"2022-07-05T11:46:09.012330+0000","last_undegraded":"2022-07-05T11:46:09.012330+0000","last_fullsized":"2022-07-05T11:46:09.012330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017611+0000","last_change":"2022-07-05T11:46:09.014114+0000","last_active":"2022-07-05T11:46:09.017611+0000","last_peered":"2022-07-05T11:46:09.017611+0000","last_clean":"2022-07-05T11:46:09.017611+0000","last_became_active":"2022-07-05T11:46:09.013707+0000","last_became_peered":"2022-07-05T11:46:09.013707+0000","last_unstale":"2022-07-05T11:46:09.017611+0000","last_undegraded":"2022-07-05T11:46:09.017611+0000","last_fullsized":"2022-07-05T11:46:09.017611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029324+0000","last_change":"2022-07-05T11:46:04.213375+0000","last_active":"2022-07-05T11:46:09.029324+0000","last_peered":"2022-07-05T11:46:09.029324+0000","last_clean":"2022-07-05T11:46:09.029324+0000","last_became_active":"2022-07-05T11:46:04.213094+0000","last_became_peered":"2022-07-05T11:46:04.213094+0000","last_unstale":"2022-07-05T11:46:09.029324+0000","last_undegraded":"2022-07-05T11:46:09.029324+0000","last_fullsized":"2022-07-05T11:46:09.029324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027648+0000","last_change":"2022-07-05T11:46:04.599779+0000","last_active":"2022-07-05T11:46:09.027648+0000","last_peered":"2022-07-05T11:46:09.027648+0000","last_clean":"2022-07-05T11:46:09.027648+0000","last_became_active":"2022-07-05T11:46:04.597330+0000","last_became_peered":"2022-07-05T11:46:04.597330+0000","last_unstale":"2022-07-05T11:46:09.027648+0000","last_undegraded":"2022-07-05T11:46:09.027648+0000","last_fullsized":"2022-07-05T11:46:09.027648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012222+0000","last_change":"2022-07-05T11:46:08.615050+0000","last_active":"2022-07-05T11:46:09.012222+0000","last_peered":"2022-07-05T11:46:09.012222+0000","last_clean":"2022-07-05T11:46:09.012222+0000","last_became_active":"2022-07-05T11:46:08.614715+0000","last_became_peered":"2022-07-05T11:46:08.614715+0000","last_unstale":"2022-07-05T11:46:09.012222+0000","last_undegraded":"2022-07-05T11:46:09.012222+0000","last_fullsized":"2022-07-05T11:46:09.012222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975318+0000","last_change":"2022-07-05T11:46:04.206835+0000","last_active":"2022-07-05T11:46:08.975318+0000","last_peered":"2022-07-05T11:46:08.975318+0000","last_clean":"2022-07-05T11:46:08.975318+0000","last_became_active":"2022-07-05T11:46:04.206389+0000","last_became_peered":"2022-07-05T11:46:04.206389+0000","last_unstale":"2022-07-05T11:46:08.975318+0000","last_undegraded":"2022-07-05T11:46:08.975318+0000","last_fullsized":"2022-07-05T11:46:08.975318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012352+0000","last_change":"2022-07-05T11:46:04.595704+0000","last_active":"2022-07-05T11:46:09.012352+0000","last_peered":"2022-07-05T11:46:09.012352+0000","last_clean":"2022-07-05T11:46:09.012352+0000","last_became_active":"2022-07-05T11:46:04.594581+0000","last_became_peered":"2022-07-05T11:46:04.594581+0000","last_unstale":"2022-07-05T11:46:09.012352+0000","last_undegraded":"2022-07-05T11:46:09.012352+0000","last_fullsized":"2022-07-05T11:46:09.012352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028313+0000","last_change":"2022-07-05T11:46:08.618434+0000","last_active":"2022-07-05T11:46:09.028313+0000","last_peered":"2022-07-05T11:46:09.028313+0000","last_clean":"2022-07-05T11:46:09.028313+0000","last_became_active":"2022-07-05T11:46:08.618022+0000","last_became_peered":"2022-07-05T11:46:08.618022+0000","last_unstale":"2022-07-05T11:46:09.028313+0000","last_undegraded":"2022-07-05T11:46:09.028313+0000","last_fullsized":"2022-07-05T11:46:09.028313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029453+0000","last_change":"2022-07-05T11:46:04.213103+0000","last_active":"2022-07-05T11:46:09.029453+0000","last_peered":"2022-07-05T11:46:09.029453+0000","last_clean":"2022-07-05T11:46:09.029453+0000","last_became_active":"2022-07-05T11:46:04.211627+0000","last_became_peered":"2022-07-05T11:46:04.211627+0000","last_unstale":"2022-07-05T11:46:09.029453+0000","last_undegraded":"2022-07-05T11:46:09.029453+0000","last_fullsized":"2022-07-05T11:46:09.029453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012463+0000","last_change":"2022-07-05T11:46:04.593912+0000","last_active":"2022-07-05T11:46:09.012463+0000","last_peered":"2022-07-05T11:46:09.012463+0000","last_clean":"2022-07-05T11:46:09.012463+0000","last_became_active":"2022-07-05T11:46:04.593631+0000","last_became_peered":"2022-07-05T11:46:04.593631+0000","last_unstale":"2022-07-05T11:46:09.012463+0000","last_undegraded":"2022-07-05T11:46:09.012463+0000","last_fullsized":"2022-07-05T11:46:09.012463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028223+0000","last_change":"2022-07-05T11:46:09.013932+0000","last_active":"2022-07-05T11:46:09.028223+0000","last_peered":"2022-07-05T11:46:09.028223+0000","last_clean":"2022-07-05T11:46:09.028223+0000","last_became_active":"2022-07-05T11:46:09.013609+0000","last_became_peered":"2022-07-05T11:46:09.013609+0000","last_unstale":"2022-07-05T11:46:09.028223+0000","last_undegraded":"2022-07-05T11:46:09.028223+0000","last_fullsized":"2022-07-05T11:46:09.028223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028226+0000","last_change":"2022-07-05T11:46:09.016568+0000","last_active":"2022-07-05T11:46:09.028226+0000","last_peered":"2022-07-05T11:46:09.028226+0000","last_clean":"2022-07-05T11:46:09.028226+0000","last_became_active":"2022-07-05T11:46:09.016162+0000","last_became_peered":"2022-07-05T11:46:09.016162+0000","last_unstale":"2022-07-05T11:46:09.028226+0000","last_undegraded":"2022-07-05T11:46:09.028226+0000","last_fullsized":"2022-07-05T11:46:09.028226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353595+0000","last_change":"2022-07-05T11:46:04.208656+0000","last_active":"2022-07-05T11:46:20.353595+0000","last_peered":"2022-07-05T11:46:20.353595+0000","last_clean":"2022-07-05T11:46:20.353595+0000","last_became_active":"2022-07-05T11:46:04.208394+0000","last_became_peered":"2022-07-05T11:46:04.208394+0000","last_unstale":"2022-07-05T11:46:20.353595+0000","last_undegraded":"2022-07-05T11:46:20.353595+0000","last_fullsized":"2022-07-05T11:46:20.353595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027906+0000","last_change":"2022-07-05T11:46:04.600156+0000","last_active":"2022-07-05T11:46:09.027906+0000","last_peered":"2022-07-05T11:46:09.027906+0000","last_clean":"2022-07-05T11:46:09.027906+0000","last_became_active":"2022-07-05T11:46:04.599836+0000","last_became_peered":"2022-07-05T11:46:04.599836+0000","last_unstale":"2022-07-05T11:46:09.027906+0000","last_undegraded":"2022-07-05T11:46:09.027906+0000","last_fullsized":"2022-07-05T11:46:09.027906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027863+0000","last_change":"2022-07-05T11:46:04.599555+0000","last_active":"2022-07-05T11:46:09.027863+0000","last_peered":"2022-07-05T11:46:09.027863+0000","last_clean":"2022-07-05T11:46:09.027863+0000","last_became_active":"2022-07-05T11:46:04.597036+0000","last_became_peered":"2022-07-05T11:46:04.597036+0000","last_unstale":"2022-07-05T11:46:09.027863+0000","last_undegraded":"2022-07-05T11:46:09.027863+0000","last_fullsized":"2022-07-05T11:46:09.027863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.357392+0000","last_change":"2022-07-05T11:46:04.215037+0000","last_active":"2022-07-05T11:46:21.357392+0000","last_peered":"2022-07-05T11:46:21.357392+0000","last_clean":"2022-07-05T11:46:21.357392+0000","last_became_active":"2022-07-05T11:46:04.214699+0000","last_became_peered":"2022-07-05T11:46:04.214699+0000","last_unstale":"2022-07-05T11:46:21.357392+0000","last_undegraded":"2022-07-05T11:46:21.357392+0000","last_fullsized":"2022-07-05T11:46:21.357392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012966+0000","last_change":"2022-07-05T11:46:00.405416+0000","last_active":"2022-07-05T11:46:09.012966+0000","last_peered":"2022-07-05T11:46:09.012966+0000","last_clean":"2022-07-05T11:46:09.012966+0000","last_became_active":"2022-07-05T11:46:00.405179+0000","last_became_peered":"2022-07-05T11:46:00.405179+0000","last_unstale":"2022-07-05T11:46:09.012966+0000","last_undegraded":"2022-07-05T11:46:09.012966+0000","last_fullsized":"2022-07-05T11:46:09.012966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027570+0000","last_change":"2022-07-05T11:46:08.616541+0000","last_active":"2022-07-05T11:46:09.027570+0000","last_peered":"2022-07-05T11:46:09.027570+0000","last_clean":"2022-07-05T11:46:09.027570+0000","last_became_active":"2022-07-05T11:46:08.616124+0000","last_became_peered":"2022-07-05T11:46:08.616124+0000","last_unstale":"2022-07-05T11:46:09.027570+0000","last_undegraded":"2022-07-05T11:46:09.027570+0000","last_fullsized":"2022-07-05T11:46:09.027570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028425+0000","last_change":"2022-07-05T11:46:04.584095+0000","last_active":"2022-07-05T11:46:09.028425+0000","last_peered":"2022-07-05T11:46:09.028425+0000","last_clean":"2022-07-05T11:46:09.028425+0000","last_became_active":"2022-07-05T11:46:04.583806+0000","last_became_peered":"2022-07-05T11:46:04.583806+0000","last_unstale":"2022-07-05T11:46:09.028425+0000","last_undegraded":"2022-07-05T11:46:09.028425+0000","last_fullsized":"2022-07-05T11:46:09.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974096+0000","last_change":"2022-07-05T11:46:00.174377+0000","last_active":"2022-07-05T11:46:08.974096+0000","last_peered":"2022-07-05T11:46:08.974096+0000","last_clean":"2022-07-05T11:46:08.974096+0000","last_became_active":"2022-07-05T11:46:00.174041+0000","last_became_peered":"2022-07-05T11:46:00.174041+0000","last_unstale":"2022-07-05T11:46:08.974096+0000","last_undegraded":"2022-07-05T11:46:08.974096+0000","last_fullsized":"2022-07-05T11:46:08.974096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029651+0000","last_change":"2022-07-05T11:46:04.201186+0000","last_active":"2022-07-05T11:46:09.029651+0000","last_peered":"2022-07-05T11:46:09.029651+0000","last_clean":"2022-07-05T11:46:09.029651+0000","last_became_active":"2022-07-05T11:46:04.200331+0000","last_became_peered":"2022-07-05T11:46:04.200331+0000","last_unstale":"2022-07-05T11:46:09.029651+0000","last_undegraded":"2022-07-05T11:46:09.029651+0000","last_fullsized":"2022-07-05T11:46:09.029651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012267+0000","last_change":"2022-07-05T11:46:08.617187+0000","last_active":"2022-07-05T11:46:09.012267+0000","last_peered":"2022-07-05T11:46:09.012267+0000","last_clean":"2022-07-05T11:46:09.012267+0000","last_became_active":"2022-07-05T11:46:08.616787+0000","last_became_peered":"2022-07-05T11:46:08.616787+0000","last_unstale":"2022-07-05T11:46:09.012267+0000","last_undegraded":"2022-07-05T11:46:09.012267+0000","last_fullsized":"2022-07-05T11:46:09.012267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974758+0000","last_change":"2022-07-05T11:46:04.595606+0000","last_active":"2022-07-05T11:46:08.974758+0000","last_peered":"2022-07-05T11:46:08.974758+0000","last_clean":"2022-07-05T11:46:08.974758+0000","last_became_active":"2022-07-05T11:46:04.594962+0000","last_became_peered":"2022-07-05T11:46:04.594962+0000","last_unstale":"2022-07-05T11:46:08.974758+0000","last_undegraded":"2022-07-05T11:46:08.974758+0000","last_fullsized":"2022-07-05T11:46:08.974758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028691+0000","last_change":"2022-07-05T11:46:04.208492+0000","last_active":"2022-07-05T11:46:09.028691+0000","last_peered":"2022-07-05T11:46:09.028691+0000","last_clean":"2022-07-05T11:46:09.028691+0000","last_became_active":"2022-07-05T11:46:04.208135+0000","last_became_peered":"2022-07-05T11:46:04.208135+0000","last_unstale":"2022-07-05T11:46:09.028691+0000","last_undegraded":"2022-07-05T11:46:09.028691+0000","last_fullsized":"2022-07-05T11:46:09.028691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028400+0000","last_change":"2022-07-05T11:46:01.122048+0000","last_active":"2022-07-05T11:46:09.028400+0000","last_peered":"2022-07-05T11:46:09.028400+0000","last_clean":"2022-07-05T11:46:09.028400+0000","last_became_active":"2022-07-05T11:46:01.121724+0000","last_became_peered":"2022-07-05T11:46:01.121724+0000","last_unstale":"2022-07-05T11:46:09.028400+0000","last_undegraded":"2022-07-05T11:46:09.028400+0000","last_fullsized":"2022-07-05T11:46:09.028400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029610+0000","last_change":"2022-07-05T11:46:08.614936+0000","last_active":"2022-07-05T11:46:09.029610+0000","last_peered":"2022-07-05T11:46:09.029610+0000","last_clean":"2022-07-05T11:46:09.029610+0000","last_became_active":"2022-07-05T11:46:08.613212+0000","last_became_peered":"2022-07-05T11:46:08.613212+0000","last_unstale":"2022-07-05T11:46:09.029610+0000","last_undegraded":"2022-07-05T11:46:09.029610+0000","last_fullsized":"2022-07-05T11:46:09.029610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358743+0000","last_change":"2022-07-05T11:46:04.207235+0000","last_active":"2022-07-05T11:46:21.358743+0000","last_peered":"2022-07-05T11:46:21.358743+0000","last_clean":"2022-07-05T11:46:21.358743+0000","last_became_active":"2022-07-05T11:46:04.206912+0000","last_became_peered":"2022-07-05T11:46:04.206912+0000","last_unstale":"2022-07-05T11:46:21.358743+0000","last_undegraded":"2022-07-05T11:46:21.358743+0000","last_fullsized":"2022-07-05T11:46:21.358743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027868+0000","last_change":"2022-07-05T11:46:00.387606+0000","last_active":"2022-07-05T11:46:09.027868+0000","last_peered":"2022-07-05T11:46:09.027868+0000","last_clean":"2022-07-05T11:46:09.027868+0000","last_became_active":"2022-07-05T11:46:00.387285+0000","last_became_peered":"2022-07-05T11:46:00.387285+0000","last_unstale":"2022-07-05T11:46:09.027868+0000","last_undegraded":"2022-07-05T11:46:09.027868+0000","last_fullsized":"2022-07-05T11:46:09.027868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975087+0000","last_change":"2022-07-05T11:46:04.597434+0000","last_active":"2022-07-05T11:46:08.975087+0000","last_peered":"2022-07-05T11:46:08.975087+0000","last_clean":"2022-07-05T11:46:08.975087+0000","last_became_active":"2022-07-05T11:46:04.596283+0000","last_became_peered":"2022-07-05T11:46:04.596283+0000","last_unstale":"2022-07-05T11:46:08.975087+0000","last_undegraded":"2022-07-05T11:46:08.975087+0000","last_fullsized":"2022-07-05T11:46:08.975087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030525+0000","last_change":"2022-07-05T11:46:08.618008+0000","last_active":"2022-07-05T11:46:09.030525+0000","last_peered":"2022-07-05T11:46:09.030525+0000","last_clean":"2022-07-05T11:46:09.030525+0000","last_became_active":"2022-07-05T11:46:08.617640+0000","last_became_peered":"2022-07-05T11:46:08.617640+0000","last_unstale":"2022-07-05T11:46:09.030525+0000","last_undegraded":"2022-07-05T11:46:09.030525+0000","last_fullsized":"2022-07-05T11:46:09.030525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407205+0000","last_change":"2022-07-05T11:46:04.205557+0000","last_active":"2022-07-05T11:46:10.407205+0000","last_peered":"2022-07-05T11:46:10.407205+0000","last_clean":"2022-07-05T11:46:10.407205+0000","last_became_active":"2022-07-05T11:46:04.203760+0000","last_became_peered":"2022-07-05T11:46:04.203760+0000","last_unstale":"2022-07-05T11:46:10.407205+0000","last_undegraded":"2022-07-05T11:46:10.407205+0000","last_fullsized":"2022-07-05T11:46:10.407205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027789+0000","last_change":"2022-07-05T11:45:58.489958+0000","last_active":"2022-07-05T11:46:09.027789+0000","last_peered":"2022-07-05T11:46:09.027789+0000","last_clean":"2022-07-05T11:46:09.027789+0000","last_became_active":"2022-07-05T11:45:58.489710+0000","last_became_peered":"2022-07-05T11:45:58.489710+0000","last_unstale":"2022-07-05T11:46:09.027789+0000","last_undegraded":"2022-07-05T11:46:09.027789+0000","last_fullsized":"2022-07-05T11:46:09.027789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_clean_scrub_stamp":"2022-07-05T11:45:57.143009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012518+0000","last_change":"2022-07-05T11:46:01.154008+0000","last_active":"2022-07-05T11:46:09.012518+0000","last_peered":"2022-07-05T11:46:09.012518+0000","last_clean":"2022-07-05T11:46:09.012518+0000","last_became_active":"2022-07-05T11:46:01.153653+0000","last_became_peered":"2022-07-05T11:46:01.153653+0000","last_unstale":"2022-07-05T11:46:09.012518+0000","last_undegraded":"2022-07-05T11:46:09.012518+0000","last_fullsized":"2022-07-05T11:46:09.012518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029959+0000","last_change":"2022-07-05T11:46:04.597444+0000","last_active":"2022-07-05T11:46:09.029959+0000","last_peered":"2022-07-05T11:46:09.029959+0000","last_clean":"2022-07-05T11:46:09.029959+0000","last_became_active":"2022-07-05T11:46:04.597199+0000","last_became_peered":"2022-07-05T11:46:04.597199+0000","last_unstale":"2022-07-05T11:46:09.029959+0000","last_undegraded":"2022-07-05T11:46:09.029959+0000","last_fullsized":"2022-07-05T11:46:09.029959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028215+0000","last_change":"2022-07-05T11:46:09.017084+0000","last_active":"2022-07-05T11:46:09.028215+0000","last_peered":"2022-07-05T11:46:09.028215+0000","last_clean":"2022-07-05T11:46:09.028215+0000","last_became_active":"2022-07-05T11:46:09.016658+0000","last_became_peered":"2022-07-05T11:46:09.016658+0000","last_unstale":"2022-07-05T11:46:09.028215+0000","last_undegraded":"2022-07-05T11:46:09.028215+0000","last_fullsized":"2022-07-05T11:46:09.028215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358568+0000","last_change":"2022-07-05T11:46:04.209767+0000","last_active":"2022-07-05T11:46:21.358568+0000","last_peered":"2022-07-05T11:46:21.358568+0000","last_clean":"2022-07-05T11:46:21.358568+0000","last_became_active":"2022-07-05T11:46:04.209524+0000","last_became_peered":"2022-07-05T11:46:04.209524+0000","last_unstale":"2022-07-05T11:46:21.358568+0000","last_undegraded":"2022-07-05T11:46:21.358568+0000","last_fullsized":"2022-07-05T11:46:21.358568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028541+0000","last_change":"2022-07-05T11:46:01.118061+0000","last_active":"2022-07-05T11:46:09.028541+0000","last_peered":"2022-07-05T11:46:09.028541+0000","last_clean":"2022-07-05T11:46:09.028541+0000","last_became_active":"2022-07-05T11:46:01.117762+0000","last_became_peered":"2022-07-05T11:46:01.117762+0000","last_unstale":"2022-07-05T11:46:09.028541+0000","last_undegraded":"2022-07-05T11:46:09.028541+0000","last_fullsized":"2022-07-05T11:46:09.028541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028916+0000","last_change":"2022-07-05T11:46:04.594377+0000","last_active":"2022-07-05T11:46:09.028916+0000","last_peered":"2022-07-05T11:46:09.028916+0000","last_clean":"2022-07-05T11:46:09.028916+0000","last_became_active":"2022-07-05T11:46:04.594103+0000","last_became_peered":"2022-07-05T11:46:04.594103+0000","last_unstale":"2022-07-05T11:46:09.028916+0000","last_undegraded":"2022-07-05T11:46:09.028916+0000","last_fullsized":"2022-07-05T11:46:09.028916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017137+0000","last_change":"2022-07-05T11:46:09.014687+0000","last_active":"2022-07-05T11:46:09.017137+0000","last_peered":"2022-07-05T11:46:09.017137+0000","last_clean":"2022-07-05T11:46:09.017137+0000","last_became_active":"2022-07-05T11:46:09.014298+0000","last_became_peered":"2022-07-05T11:46:09.014298+0000","last_unstale":"2022-07-05T11:46:09.017137+0000","last_undegraded":"2022-07-05T11:46:09.017137+0000","last_fullsized":"2022-07-05T11:46:09.017137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028627+0000","last_change":"2022-07-05T11:46:04.593068+0000","last_active":"2022-07-05T11:46:09.028627+0000","last_peered":"2022-07-05T11:46:09.028627+0000","last_clean":"2022-07-05T11:46:09.028627+0000","last_became_active":"2022-07-05T11:46:04.592770+0000","last_became_peered":"2022-07-05T11:46:04.592770+0000","last_unstale":"2022-07-05T11:46:09.028627+0000","last_undegraded":"2022-07-05T11:46:09.028627+0000","last_fullsized":"2022-07-05T11:46:09.028627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352860+0000","last_change":"2022-07-05T11:46:04.205846+0000","last_active":"2022-07-05T11:46:20.352860+0000","last_peered":"2022-07-05T11:46:20.352860+0000","last_clean":"2022-07-05T11:46:20.352860+0000","last_became_active":"2022-07-05T11:46:04.205358+0000","last_became_peered":"2022-07-05T11:46:04.205358+0000","last_unstale":"2022-07-05T11:46:20.352860+0000","last_undegraded":"2022-07-05T11:46:20.352860+0000","last_fullsized":"2022-07-05T11:46:20.352860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028856+0000","last_change":"2022-07-05T11:46:00.171709+0000","last_active":"2022-07-05T11:46:09.028856+0000","last_peered":"2022-07-05T11:46:09.028856+0000","last_clean":"2022-07-05T11:46:09.028856+0000","last_became_active":"2022-07-05T11:46:00.171328+0000","last_became_peered":"2022-07-05T11:46:00.171328+0000","last_unstale":"2022-07-05T11:46:09.028856+0000","last_undegraded":"2022-07-05T11:46:09.028856+0000","last_fullsized":"2022-07-05T11:46:09.028856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017640+0000","last_change":"2022-07-05T11:46:09.015332+0000","last_active":"2022-07-05T11:46:09.017640+0000","last_peered":"2022-07-05T11:46:09.017640+0000","last_clean":"2022-07-05T11:46:09.017640+0000","last_became_active":"2022-07-05T11:46:09.013688+0000","last_became_peered":"2022-07-05T11:46:09.013688+0000","last_unstale":"2022-07-05T11:46:09.017640+0000","last_undegraded":"2022-07-05T11:46:09.017640+0000","last_fullsized":"2022-07-05T11:46:09.017640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028419+0000","last_change":"2022-07-05T11:46:04.600986+0000","last_active":"2022-07-05T11:46:09.028419+0000","last_peered":"2022-07-05T11:46:09.028419+0000","last_clean":"2022-07-05T11:46:09.028419+0000","last_became_active":"2022-07-05T11:46:04.600619+0000","last_became_peered":"2022-07-05T11:46:04.600619+0000","last_unstale":"2022-07-05T11:46:09.028419+0000","last_undegraded":"2022-07-05T11:46:09.028419+0000","last_fullsized":"2022-07-05T11:46:09.028419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030201+0000","last_change":"2022-07-05T11:46:04.201044+0000","last_active":"2022-07-05T11:46:09.030201+0000","last_peered":"2022-07-05T11:46:09.030201+0000","last_clean":"2022-07-05T11:46:09.030201+0000","last_became_active":"2022-07-05T11:46:04.200743+0000","last_became_peered":"2022-07-05T11:46:04.200743+0000","last_unstale":"2022-07-05T11:46:09.030201+0000","last_undegraded":"2022-07-05T11:46:09.030201+0000","last_fullsized":"2022-07-05T11:46:09.030201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974024+0000","last_change":"2022-07-05T11:46:00.406891+0000","last_active":"2022-07-05T11:46:08.974024+0000","last_peered":"2022-07-05T11:46:08.974024+0000","last_clean":"2022-07-05T11:46:08.974024+0000","last_became_active":"2022-07-05T11:46:00.406555+0000","last_became_peered":"2022-07-05T11:46:00.406555+0000","last_unstale":"2022-07-05T11:46:08.974024+0000","last_undegraded":"2022-07-05T11:46:08.974024+0000","last_fullsized":"2022-07-05T11:46:08.974024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027228+0000","last_change":"2022-07-05T11:46:09.014076+0000","last_active":"2022-07-05T11:46:09.027228+0000","last_peered":"2022-07-05T11:46:09.027228+0000","last_clean":"2022-07-05T11:46:09.027228+0000","last_became_active":"2022-07-05T11:46:09.013674+0000","last_became_peered":"2022-07-05T11:46:09.013674+0000","last_unstale":"2022-07-05T11:46:09.027228+0000","last_undegraded":"2022-07-05T11:46:09.027228+0000","last_fullsized":"2022-07-05T11:46:09.027228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974896+0000","last_change":"2022-07-05T11:46:04.204890+0000","last_active":"2022-07-05T11:46:08.974896+0000","last_peered":"2022-07-05T11:46:08.974896+0000","last_clean":"2022-07-05T11:46:08.974896+0000","last_became_active":"2022-07-05T11:46:04.204615+0000","last_became_peered":"2022-07-05T11:46:04.204615+0000","last_unstale":"2022-07-05T11:46:08.974896+0000","last_undegraded":"2022-07-05T11:46:08.974896+0000","last_fullsized":"2022-07-05T11:46:08.974896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974109+0000","last_change":"2022-07-05T11:46:04.592359+0000","last_active":"2022-07-05T11:46:08.974109+0000","last_peered":"2022-07-05T11:46:08.974109+0000","last_clean":"2022-07-05T11:46:08.974109+0000","last_became_active":"2022-07-05T11:46:04.592112+0000","last_became_peered":"2022-07-05T11:46:04.592112+0000","last_unstale":"2022-07-05T11:46:08.974109+0000","last_undegraded":"2022-07-05T11:46:08.974109+0000","last_fullsized":"2022-07-05T11:46:08.974109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027403+0000","last_change":"2022-07-05T11:46:09.016814+0000","last_active":"2022-07-05T11:46:09.027403+0000","last_peered":"2022-07-05T11:46:09.027403+0000","last_clean":"2022-07-05T11:46:09.027403+0000","last_became_active":"2022-07-05T11:46:09.016282+0000","last_became_peered":"2022-07-05T11:46:09.016282+0000","last_unstale":"2022-07-05T11:46:09.027403+0000","last_undegraded":"2022-07-05T11:46:09.027403+0000","last_fullsized":"2022-07-05T11:46:09.027403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353211+0000","last_change":"2022-07-05T11:46:04.199484+0000","last_active":"2022-07-05T11:46:20.353211+0000","last_peered":"2022-07-05T11:46:20.353211+0000","last_clean":"2022-07-05T11:46:20.353211+0000","last_became_active":"2022-07-05T11:46:04.199190+0000","last_became_peered":"2022-07-05T11:46:04.199190+0000","last_unstale":"2022-07-05T11:46:20.353211+0000","last_undegraded":"2022-07-05T11:46:20.353211+0000","last_fullsized":"2022-07-05T11:46:20.353211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012845+0000","last_change":"2022-07-05T11:46:04.594175+0000","last_active":"2022-07-05T11:46:09.012845+0000","last_peered":"2022-07-05T11:46:09.012845+0000","last_clean":"2022-07-05T11:46:09.012845+0000","last_became_active":"2022-07-05T11:46:04.593700+0000","last_became_peered":"2022-07-05T11:46:04.593700+0000","last_unstale":"2022-07-05T11:46:09.012845+0000","last_undegraded":"2022-07-05T11:46:09.012845+0000","last_fullsized":"2022-07-05T11:46:09.012845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013139+0000","last_change":"2022-07-05T11:46:08.614509+0000","last_active":"2022-07-05T11:46:09.013139+0000","last_peered":"2022-07-05T11:46:09.013139+0000","last_clean":"2022-07-05T11:46:09.013139+0000","last_became_active":"2022-07-05T11:46:08.613935+0000","last_became_peered":"2022-07-05T11:46:08.613935+0000","last_unstale":"2022-07-05T11:46:09.013139+0000","last_undegraded":"2022-07-05T11:46:09.013139+0000","last_fullsized":"2022-07-05T11:46:09.013139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028943+0000","last_change":"2022-07-05T11:46:04.210344+0000","last_active":"2022-07-05T11:46:09.028943+0000","last_peered":"2022-07-05T11:46:09.028943+0000","last_clean":"2022-07-05T11:46:09.028943+0000","last_became_active":"2022-07-05T11:46:04.210054+0000","last_became_peered":"2022-07-05T11:46:04.210054+0000","last_unstale":"2022-07-05T11:46:09.028943+0000","last_undegraded":"2022-07-05T11:46:09.028943+0000","last_fullsized":"2022-07-05T11:46:09.028943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013018+0000","last_change":"2022-07-05T11:46:04.601851+0000","last_active":"2022-07-05T11:46:09.013018+0000","last_peered":"2022-07-05T11:46:09.013018+0000","last_clean":"2022-07-05T11:46:09.013018+0000","last_became_active":"2022-07-05T11:46:04.601528+0000","last_became_peered":"2022-07-05T11:46:04.601528+0000","last_unstale":"2022-07-05T11:46:09.013018+0000","last_undegraded":"2022-07-05T11:46:09.013018+0000","last_fullsized":"2022-07-05T11:46:09.013018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029283+0000","last_change":"2022-07-05T11:46:08.613389+0000","last_active":"2022-07-05T11:46:09.029283+0000","last_peered":"2022-07-05T11:46:09.029283+0000","last_clean":"2022-07-05T11:46:09.029283+0000","last_became_active":"2022-07-05T11:46:08.612988+0000","last_became_peered":"2022-07-05T11:46:08.612988+0000","last_unstale":"2022-07-05T11:46:09.029283+0000","last_undegraded":"2022-07-05T11:46:09.029283+0000","last_fullsized":"2022-07-05T11:46:09.029283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028447+0000","last_change":"2022-07-05T11:46:04.203173+0000","last_active":"2022-07-05T11:46:09.028447+0000","last_peered":"2022-07-05T11:46:09.028447+0000","last_clean":"2022-07-05T11:46:09.028447+0000","last_became_active":"2022-07-05T11:46:04.202879+0000","last_became_peered":"2022-07-05T11:46:04.202879+0000","last_unstale":"2022-07-05T11:46:09.028447+0000","last_undegraded":"2022-07-05T11:46:09.028447+0000","last_fullsized":"2022-07-05T11:46:09.028447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013005+0000","last_change":"2022-07-05T11:46:04.593203+0000","last_active":"2022-07-05T11:46:09.013005+0000","last_peered":"2022-07-05T11:46:09.013005+0000","last_clean":"2022-07-05T11:46:09.013005+0000","last_became_active":"2022-07-05T11:46:04.592953+0000","last_became_peered":"2022-07-05T11:46:04.592953+0000","last_unstale":"2022-07-05T11:46:09.013005+0000","last_undegraded":"2022-07-05T11:46:09.013005+0000","last_fullsized":"2022-07-05T11:46:09.013005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975419+0000","last_change":"2022-07-05T11:46:08.617348+0000","last_active":"2022-07-05T11:46:08.975419+0000","last_peered":"2022-07-05T11:46:08.975419+0000","last_clean":"2022-07-05T11:46:08.975419+0000","last_became_active":"2022-07-05T11:46:08.616964+0000","last_became_peered":"2022-07-05T11:46:08.616964+0000","last_unstale":"2022-07-05T11:46:08.975419+0000","last_undegraded":"2022-07-05T11:46:08.975419+0000","last_fullsized":"2022-07-05T11:46:08.975419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.213520+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.213132+0000","last_became_peered":"2022-07-05T11:46:04.213132+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027579+0000","last_change":"2022-07-05T11:46:04.589449+0000","last_active":"2022-07-05T11:46:09.027579+0000","last_peered":"2022-07-05T11:46:09.027579+0000","last_clean":"2022-07-05T11:46:09.027579+0000","last_became_active":"2022-07-05T11:46:04.589174+0000","last_became_peered":"2022-07-05T11:46:04.589174+0000","last_unstale":"2022-07-05T11:46:09.027579+0000","last_undegraded":"2022-07-05T11:46:09.027579+0000","last_fullsized":"2022-07-05T11:46:09.027579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027455+0000","last_change":"2022-07-05T11:46:08.617763+0000","last_active":"2022-07-05T11:46:09.027455+0000","last_peered":"2022-07-05T11:46:09.027455+0000","last_clean":"2022-07-05T11:46:09.027455+0000","last_became_active":"2022-07-05T11:46:08.617423+0000","last_became_peered":"2022-07-05T11:46:08.617423+0000","last_unstale":"2022-07-05T11:46:09.027455+0000","last_undegraded":"2022-07-05T11:46:09.027455+0000","last_fullsized":"2022-07-05T11:46:09.027455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030147+0000","last_change":"2022-07-05T11:46:04.211055+0000","last_active":"2022-07-05T11:46:09.030147+0000","last_peered":"2022-07-05T11:46:09.030147+0000","last_clean":"2022-07-05T11:46:09.030147+0000","last_became_active":"2022-07-05T11:46:04.210609+0000","last_became_peered":"2022-07-05T11:46:04.210609+0000","last_unstale":"2022-07-05T11:46:09.030147+0000","last_undegraded":"2022-07-05T11:46:09.030147+0000","last_fullsized":"2022-07-05T11:46:09.030147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028195+0000","last_change":"2022-07-05T11:46:04.583067+0000","last_active":"2022-07-05T11:46:09.028195+0000","last_peered":"2022-07-05T11:46:09.028195+0000","last_clean":"2022-07-05T11:46:09.028195+0000","last_became_active":"2022-07-05T11:46:04.582776+0000","last_became_peered":"2022-07-05T11:46:04.582776+0000","last_unstale":"2022-07-05T11:46:09.028195+0000","last_undegraded":"2022-07-05T11:46:09.028195+0000","last_fullsized":"2022-07-05T11:46:09.028195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975477+0000","last_change":"2022-07-05T11:46:08.619668+0000","last_active":"2022-07-05T11:46:08.975477+0000","last_peered":"2022-07-05T11:46:08.975477+0000","last_clean":"2022-07-05T11:46:08.975477+0000","last_became_active":"2022-07-05T11:46:08.619010+0000","last_became_peered":"2022-07-05T11:46:08.619010+0000","last_unstale":"2022-07-05T11:46:08.975477+0000","last_undegraded":"2022-07-05T11:46:08.975477+0000","last_fullsized":"2022-07-05T11:46:08.975477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975957+0000","last_change":"2022-07-05T11:46:04.202962+0000","last_active":"2022-07-05T11:46:08.975957+0000","last_peered":"2022-07-05T11:46:08.975957+0000","last_clean":"2022-07-05T11:46:08.975957+0000","last_became_active":"2022-07-05T11:46:04.202639+0000","last_became_peered":"2022-07-05T11:46:04.202639+0000","last_unstale":"2022-07-05T11:46:08.975957+0000","last_undegraded":"2022-07-05T11:46:08.975957+0000","last_fullsized":"2022-07-05T11:46:08.975957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975054+0000","last_change":"2022-07-05T11:46:04.595796+0000","last_active":"2022-07-05T11:46:08.975054+0000","last_peered":"2022-07-05T11:46:08.975054+0000","last_clean":"2022-07-05T11:46:08.975054+0000","last_became_active":"2022-07-05T11:46:04.595457+0000","last_became_peered":"2022-07-05T11:46:04.595457+0000","last_unstale":"2022-07-05T11:46:08.975054+0000","last_undegraded":"2022-07-05T11:46:08.975054+0000","last_fullsized":"2022-07-05T11:46:08.975054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027470+0000","last_change":"2022-07-05T11:46:08.617306+0000","last_active":"2022-07-05T11:46:09.027470+0000","last_peered":"2022-07-05T11:46:09.027470+0000","last_clean":"2022-07-05T11:46:09.027470+0000","last_became_active":"2022-07-05T11:46:08.616927+0000","last_became_peered":"2022-07-05T11:46:08.616927+0000","last_unstale":"2022-07-05T11:46:09.027470+0000","last_undegraded":"2022-07-05T11:46:09.027470+0000","last_fullsized":"2022-07-05T11:46:09.027470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030413+0000","last_change":"2022-07-05T11:46:04.205780+0000","last_active":"2022-07-05T11:46:09.030413+0000","last_peered":"2022-07-05T11:46:09.030413+0000","last_clean":"2022-07-05T11:46:09.030413+0000","last_became_active":"2022-07-05T11:46:04.205486+0000","last_became_peered":"2022-07-05T11:46:04.205486+0000","last_unstale":"2022-07-05T11:46:09.030413+0000","last_undegraded":"2022-07-05T11:46:09.030413+0000","last_fullsized":"2022-07-05T11:46:09.030413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974611+0000","last_change":"2022-07-05T11:46:04.606819+0000","last_active":"2022-07-05T11:46:08.974611+0000","last_peered":"2022-07-05T11:46:08.974611+0000","last_clean":"2022-07-05T11:46:08.974611+0000","last_became_active":"2022-07-05T11:46:04.606484+0000","last_became_peered":"2022-07-05T11:46:04.606484+0000","last_unstale":"2022-07-05T11:46:08.974611+0000","last_undegraded":"2022-07-05T11:46:08.974611+0000","last_fullsized":"2022-07-05T11:46:08.974611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028555+0000","last_change":"2022-07-05T11:46:08.617224+0000","last_active":"2022-07-05T11:46:09.028555+0000","last_peered":"2022-07-05T11:46:09.028555+0000","last_clean":"2022-07-05T11:46:09.028555+0000","last_became_active":"2022-07-05T11:46:08.616821+0000","last_became_peered":"2022-07-05T11:46:08.616821+0000","last_unstale":"2022-07-05T11:46:09.028555+0000","last_undegraded":"2022-07-05T11:46:09.028555+0000","last_fullsized":"2022-07-05T11:46:09.028555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.170891+0000","last_change":"2022-07-05T11:46:04.204034+0000","last_active":"2022-07-05T11:46:10.170891+0000","last_peered":"2022-07-05T11:46:10.170891+0000","last_clean":"2022-07-05T11:46:10.170891+0000","last_became_active":"2022-07-05T11:46:04.203694+0000","last_became_peered":"2022-07-05T11:46:04.203694+0000","last_unstale":"2022-07-05T11:46:10.170891+0000","last_undegraded":"2022-07-05T11:46:10.170891+0000","last_fullsized":"2022-07-05T11:46:10.170891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974125+0000","last_change":"2022-07-05T11:46:04.593441+0000","last_active":"2022-07-05T11:46:08.974125+0000","last_peered":"2022-07-05T11:46:08.974125+0000","last_clean":"2022-07-05T11:46:08.974125+0000","last_became_active":"2022-07-05T11:46:04.593175+0000","last_became_peered":"2022-07-05T11:46:04.593175+0000","last_unstale":"2022-07-05T11:46:08.974125+0000","last_undegraded":"2022-07-05T11:46:08.974125+0000","last_fullsized":"2022-07-05T11:46:08.974125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028366+0000","last_change":"2022-07-05T11:46:09.016544+0000","last_active":"2022-07-05T11:46:09.028366+0000","last_peered":"2022-07-05T11:46:09.028366+0000","last_clean":"2022-07-05T11:46:09.028366+0000","last_became_active":"2022-07-05T11:46:09.016045+0000","last_became_peered":"2022-07-05T11:46:09.016045+0000","last_unstale":"2022-07-05T11:46:09.028366+0000","last_undegraded":"2022-07-05T11:46:09.028366+0000","last_fullsized":"2022-07-05T11:46:09.028366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358969+0000","last_change":"2022-07-05T11:46:04.207209+0000","last_active":"2022-07-05T11:46:21.358969+0000","last_peered":"2022-07-05T11:46:21.358969+0000","last_clean":"2022-07-05T11:46:21.358969+0000","last_became_active":"2022-07-05T11:46:04.206333+0000","last_became_peered":"2022-07-05T11:46:04.206333+0000","last_unstale":"2022-07-05T11:46:21.358969+0000","last_undegraded":"2022-07-05T11:46:21.358969+0000","last_fullsized":"2022-07-05T11:46:21.358969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029985+0000","last_change":"2022-07-05T11:46:04.591635+0000","last_active":"2022-07-05T11:46:09.029985+0000","last_peered":"2022-07-05T11:46:09.029985+0000","last_clean":"2022-07-05T11:46:09.029985+0000","last_became_active":"2022-07-05T11:46:04.591370+0000","last_became_peered":"2022-07-05T11:46:04.591370+0000","last_unstale":"2022-07-05T11:46:09.029985+0000","last_undegraded":"2022-07-05T11:46:09.029985+0000","last_fullsized":"2022-07-05T11:46:09.029985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029798+0000","last_change":"2022-07-05T11:46:08.617287+0000","last_active":"2022-07-05T11:46:09.029798+0000","last_peered":"2022-07-05T11:46:09.029798+0000","last_clean":"2022-07-05T11:46:09.029798+0000","last_became_active":"2022-07-05T11:46:08.616929+0000","last_became_peered":"2022-07-05T11:46:08.616929+0000","last_unstale":"2022-07-05T11:46:09.029798+0000","last_undegraded":"2022-07-05T11:46:09.029798+0000","last_fullsized":"2022-07-05T11:46:09.029798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352160+0000","last_change":"2022-07-05T11:46:04.207520+0000","last_active":"2022-07-05T11:46:20.352160+0000","last_peered":"2022-07-05T11:46:20.352160+0000","last_clean":"2022-07-05T11:46:20.352160+0000","last_became_active":"2022-07-05T11:46:04.207167+0000","last_became_peered":"2022-07-05T11:46:04.207167+0000","last_unstale":"2022-07-05T11:46:20.352160+0000","last_undegraded":"2022-07-05T11:46:20.352160+0000","last_fullsized":"2022-07-05T11:46:20.352160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975400+0000","last_change":"2022-07-05T11:46:04.606473+0000","last_active":"2022-07-05T11:46:08.975400+0000","last_peered":"2022-07-05T11:46:08.975400+0000","last_clean":"2022-07-05T11:46:08.975400+0000","last_became_active":"2022-07-05T11:46:04.606183+0000","last_became_peered":"2022-07-05T11:46:04.606183+0000","last_unstale":"2022-07-05T11:46:08.975400+0000","last_undegraded":"2022-07-05T11:46:08.975400+0000","last_fullsized":"2022-07-05T11:46:08.975400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029169+0000","last_change":"2022-07-05T11:46:08.615322+0000","last_active":"2022-07-05T11:46:09.029169+0000","last_peered":"2022-07-05T11:46:09.029169+0000","last_clean":"2022-07-05T11:46:09.029169+0000","last_became_active":"2022-07-05T11:46:08.614916+0000","last_became_peered":"2022-07-05T11:46:08.614916+0000","last_unstale":"2022-07-05T11:46:09.029169+0000","last_undegraded":"2022-07-05T11:46:09.029169+0000","last_fullsized":"2022-07-05T11:46:09.029169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352313+0000","last_change":"2022-07-05T11:46:04.207417+0000","last_active":"2022-07-05T11:46:20.352313+0000","last_peered":"2022-07-05T11:46:20.352313+0000","last_clean":"2022-07-05T11:46:20.352313+0000","last_became_active":"2022-07-05T11:46:04.207078+0000","last_became_peered":"2022-07-05T11:46:04.207078+0000","last_unstale":"2022-07-05T11:46:20.352313+0000","last_undegraded":"2022-07-05T11:46:20.352313+0000","last_fullsized":"2022-07-05T11:46:20.352313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976049+0000","last_change":"2022-07-05T11:46:04.597152+0000","last_active":"2022-07-05T11:46:08.976049+0000","last_peered":"2022-07-05T11:46:08.976049+0000","last_clean":"2022-07-05T11:46:08.976049+0000","last_became_active":"2022-07-05T11:46:04.596847+0000","last_became_peered":"2022-07-05T11:46:04.596847+0000","last_unstale":"2022-07-05T11:46:08.976049+0000","last_undegraded":"2022-07-05T11:46:08.976049+0000","last_fullsized":"2022-07-05T11:46:08.976049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029455+0000","last_change":"2022-07-05T11:46:08.615281+0000","last_active":"2022-07-05T11:46:09.029455+0000","last_peered":"2022-07-05T11:46:09.029455+0000","last_clean":"2022-07-05T11:46:09.029455+0000","last_became_active":"2022-07-05T11:46:08.614859+0000","last_became_peered":"2022-07-05T11:46:08.614859+0000","last_unstale":"2022-07-05T11:46:09.029455+0000","last_undegraded":"2022-07-05T11:46:09.029455+0000","last_fullsized":"2022-07-05T11:46:09.029455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029554+0000","last_change":"2022-07-05T11:46:04.209548+0000","last_active":"2022-07-05T11:46:09.029554+0000","last_peered":"2022-07-05T11:46:09.029554+0000","last_clean":"2022-07-05T11:46:09.029554+0000","last_became_active":"2022-07-05T11:46:04.209278+0000","last_became_peered":"2022-07-05T11:46:04.209278+0000","last_unstale":"2022-07-05T11:46:09.029554+0000","last_undegraded":"2022-07-05T11:46:09.029554+0000","last_fullsized":"2022-07-05T11:46:09.029554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012545+0000","last_change":"2022-07-05T11:46:04.601803+0000","last_active":"2022-07-05T11:46:09.012545+0000","last_peered":"2022-07-05T11:46:09.012545+0000","last_clean":"2022-07-05T11:46:09.012545+0000","last_became_active":"2022-07-05T11:46:04.601475+0000","last_became_peered":"2022-07-05T11:46:04.601475+0000","last_unstale":"2022-07-05T11:46:09.012545+0000","last_undegraded":"2022-07-05T11:46:09.012545+0000","last_fullsized":"2022-07-05T11:46:09.012545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028752+0000","last_change":"2022-07-05T11:46:08.617939+0000","last_active":"2022-07-05T11:46:09.028752+0000","last_peered":"2022-07-05T11:46:09.028752+0000","last_clean":"2022-07-05T11:46:09.028752+0000","last_became_active":"2022-07-05T11:46:08.617538+0000","last_became_peered":"2022-07-05T11:46:08.617538+0000","last_unstale":"2022-07-05T11:46:09.028752+0000","last_undegraded":"2022-07-05T11:46:09.028752+0000","last_fullsized":"2022-07-05T11:46:09.028752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.322288+0000","last_change":"2022-07-05T11:46:04.199561+0000","last_active":"2022-07-05T11:46:10.322288+0000","last_peered":"2022-07-05T11:46:10.322288+0000","last_clean":"2022-07-05T11:46:10.322288+0000","last_became_active":"2022-07-05T11:46:04.199232+0000","last_became_peered":"2022-07-05T11:46:04.199232+0000","last_unstale":"2022-07-05T11:46:10.322288+0000","last_undegraded":"2022-07-05T11:46:10.322288+0000","last_fullsized":"2022-07-05T11:46:10.322288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973881+0000","last_change":"2022-07-05T11:46:04.601813+0000","last_active":"2022-07-05T11:46:08.973881+0000","last_peered":"2022-07-05T11:46:08.973881+0000","last_clean":"2022-07-05T11:46:08.973881+0000","last_became_active":"2022-07-05T11:46:04.601595+0000","last_became_peered":"2022-07-05T11:46:04.601595+0000","last_unstale":"2022-07-05T11:46:08.973881+0000","last_undegraded":"2022-07-05T11:46:08.973881+0000","last_fullsized":"2022-07-05T11:46:08.973881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975282+0000","last_change":"2022-07-05T11:46:08.621246+0000","last_active":"2022-07-05T11:46:08.975282+0000","last_peered":"2022-07-05T11:46:08.975282+0000","last_clean":"2022-07-05T11:46:08.975282+0000","last_became_active":"2022-07-05T11:46:08.620839+0000","last_became_peered":"2022-07-05T11:46:08.620839+0000","last_unstale":"2022-07-05T11:46:08.975282+0000","last_undegraded":"2022-07-05T11:46:08.975282+0000","last_fullsized":"2022-07-05T11:46:08.975282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029752+0000","last_change":"2022-07-05T11:46:04.204062+0000","last_active":"2022-07-05T11:46:09.029752+0000","last_peered":"2022-07-05T11:46:09.029752+0000","last_clean":"2022-07-05T11:46:09.029752+0000","last_became_active":"2022-07-05T11:46:04.203763+0000","last_became_peered":"2022-07-05T11:46:04.203763+0000","last_unstale":"2022-07-05T11:46:09.029752+0000","last_undegraded":"2022-07-05T11:46:09.029752+0000","last_fullsized":"2022-07-05T11:46:09.029752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029094+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.029094+0000","last_peered":"2022-07-05T11:46:09.029094+0000","last_clean":"2022-07-05T11:46:09.029094+0000","last_became_active":"2022-07-05T11:46:04.595288+0000","last_became_peered":"2022-07-05T11:46:04.595288+0000","last_unstale":"2022-07-05T11:46:09.029094+0000","last_undegraded":"2022-07-05T11:46:09.029094+0000","last_fullsized":"2022-07-05T11:46:09.029094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027709+0000","last_change":"2022-07-05T11:46:08.617183+0000","last_active":"2022-07-05T11:46:09.027709+0000","last_peered":"2022-07-05T11:46:09.027709+0000","last_clean":"2022-07-05T11:46:09.027709+0000","last_became_active":"2022-07-05T11:46:08.616762+0000","last_became_peered":"2022-07-05T11:46:08.616762+0000","last_unstale":"2022-07-05T11:46:09.027709+0000","last_undegraded":"2022-07-05T11:46:09.027709+0000","last_fullsized":"2022-07-05T11:46:09.027709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353314+0000","last_change":"2022-07-05T11:46:04.206938+0000","last_active":"2022-07-05T11:46:20.353314+0000","last_peered":"2022-07-05T11:46:20.353314+0000","last_clean":"2022-07-05T11:46:20.353314+0000","last_became_active":"2022-07-05T11:46:04.206676+0000","last_became_peered":"2022-07-05T11:46:04.206676+0000","last_unstale":"2022-07-05T11:46:20.353314+0000","last_undegraded":"2022-07-05T11:46:20.353314+0000","last_fullsized":"2022-07-05T11:46:20.353314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973848+0000","last_change":"2022-07-05T11:46:04.589404+0000","last_active":"2022-07-05T11:46:08.973848+0000","last_peered":"2022-07-05T11:46:08.973848+0000","last_clean":"2022-07-05T11:46:08.973848+0000","last_became_active":"2022-07-05T11:46:04.589158+0000","last_became_peered":"2022-07-05T11:46:04.589158+0000","last_unstale":"2022-07-05T11:46:08.973848+0000","last_undegraded":"2022-07-05T11:46:08.973848+0000","last_fullsized":"2022-07-05T11:46:08.973848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028490+0000","last_change":"2022-07-05T11:46:08.619220+0000","last_active":"2022-07-05T11:46:09.028490+0000","last_peered":"2022-07-05T11:46:09.028490+0000","last_clean":"2022-07-05T11:46:09.028490+0000","last_became_active":"2022-07-05T11:46:08.618815+0000","last_became_peered":"2022-07-05T11:46:08.618815+0000","last_unstale":"2022-07-05T11:46:09.028490+0000","last_undegraded":"2022-07-05T11:46:09.028490+0000","last_fullsized":"2022-07-05T11:46:09.028490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974161+0000","last_change":"2022-07-05T11:46:08.617688+0000","last_active":"2022-07-05T11:46:08.974161+0000","last_peered":"2022-07-05T11:46:08.974161+0000","last_clean":"2022-07-05T11:46:08.974161+0000","last_became_active":"2022-07-05T11:46:08.617331+0000","last_became_peered":"2022-07-05T11:46:08.617331+0000","last_unstale":"2022-07-05T11:46:08.974161+0000","last_undegraded":"2022-07-05T11:46:08.974161+0000","last_fullsized":"2022-07-05T11:46:08.974161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029067+0000","last_change":"2022-07-05T11:46:04.199672+0000","last_active":"2022-07-05T11:46:09.029067+0000","last_peered":"2022-07-05T11:46:09.029067+0000","last_clean":"2022-07-05T11:46:09.029067+0000","last_became_active":"2022-07-05T11:46:04.199366+0000","last_became_peered":"2022-07-05T11:46:04.199366+0000","last_unstale":"2022-07-05T11:46:09.029067+0000","last_undegraded":"2022-07-05T11:46:09.029067+0000","last_fullsized":"2022-07-05T11:46:09.029067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976202+0000","last_change":"2022-07-05T11:46:04.598274+0000","last_active":"2022-07-05T11:46:08.976202+0000","last_peered":"2022-07-05T11:46:08.976202+0000","last_clean":"2022-07-05T11:46:08.976202+0000","last_became_active":"2022-07-05T11:46:04.597995+0000","last_became_peered":"2022-07-05T11:46:04.597995+0000","last_unstale":"2022-07-05T11:46:08.976202+0000","last_undegraded":"2022-07-05T11:46:08.976202+0000","last_fullsized":"2022-07-05T11:46:08.976202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030310+0000","last_change":"2022-07-05T11:46:08.612501+0000","last_active":"2022-07-05T11:46:09.030310+0000","last_peered":"2022-07-05T11:46:09.030310+0000","last_clean":"2022-07-05T11:46:09.030310+0000","last_became_active":"2022-07-05T11:46:08.611956+0000","last_became_peered":"2022-07-05T11:46:08.611956+0000","last_unstale":"2022-07-05T11:46:09.030310+0000","last_undegraded":"2022-07-05T11:46:09.030310+0000","last_fullsized":"2022-07-05T11:46:09.030310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973916+0000","last_change":"2022-07-05T11:46:04.212557+0000","last_active":"2022-07-05T11:46:08.973916+0000","last_peered":"2022-07-05T11:46:08.973916+0000","last_clean":"2022-07-05T11:46:08.973916+0000","last_became_active":"2022-07-05T11:46:04.212259+0000","last_became_peered":"2022-07-05T11:46:04.212259+0000","last_unstale":"2022-07-05T11:46:08.973916+0000","last_undegraded":"2022-07-05T11:46:08.973916+0000","last_fullsized":"2022-07-05T11:46:08.973916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028001+0000","last_change":"2022-07-05T11:46:04.593690+0000","last_active":"2022-07-05T11:46:09.028001+0000","last_peered":"2022-07-05T11:46:09.028001+0000","last_clean":"2022-07-05T11:46:09.028001+0000","last_became_active":"2022-07-05T11:46:04.593427+0000","last_became_peered":"2022-07-05T11:46:04.593427+0000","last_unstale":"2022-07-05T11:46:09.028001+0000","last_undegraded":"2022-07-05T11:46:09.028001+0000","last_fullsized":"2022-07-05T11:46:09.028001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028319+0000","last_change":"2022-07-05T11:46:04.204419+0000","last_active":"2022-07-05T11:46:09.028319+0000","last_peered":"2022-07-05T11:46:09.028319+0000","last_clean":"2022-07-05T11:46:09.028319+0000","last_became_active":"2022-07-05T11:46:04.204078+0000","last_became_peered":"2022-07-05T11:46:04.204078+0000","last_unstale":"2022-07-05T11:46:09.028319+0000","last_undegraded":"2022-07-05T11:46:09.028319+0000","last_fullsized":"2022-07-05T11:46:09.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028300+0000","last_change":"2022-07-05T11:46:04.600858+0000","last_active":"2022-07-05T11:46:09.028300+0000","last_peered":"2022-07-05T11:46:09.028300+0000","last_clean":"2022-07-05T11:46:09.028300+0000","last_became_active":"2022-07-05T11:46:04.600564+0000","last_became_peered":"2022-07-05T11:46:04.600564+0000","last_unstale":"2022-07-05T11:46:09.028300+0000","last_undegraded":"2022-07-05T11:46:09.028300+0000","last_fullsized":"2022-07-05T11:46:09.028300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017952+0000","last_change":"2022-07-05T11:46:09.017127+0000","last_active":"2022-07-05T11:46:09.017952+0000","last_peered":"2022-07-05T11:46:09.017952+0000","last_clean":"2022-07-05T11:46:09.017952+0000","last_became_active":"2022-07-05T11:46:09.016451+0000","last_became_peered":"2022-07-05T11:46:09.016451+0000","last_unstale":"2022-07-05T11:46:09.017952+0000","last_undegraded":"2022-07-05T11:46:09.017952+0000","last_fullsized":"2022-07-05T11:46:09.017952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7110,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":14254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164889,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":166627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164957,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163613,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":164755,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444038,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163647,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163717,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":3,"up_from":17,"seq":73014444038,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5404,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366436,"statfs":{"total":96636764160,"available":96631230464,"internally_reserved":0,"allocated":348160,"data_stored":167325,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366500,"statfs":{"total":96636764160,"available":96631296000,"internally_reserved":0,"allocated":348160,"data_stored":164851,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-07-05T11:46:23.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-07-05T11:46:23.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.481+0000 7fdef3a8e700 1 Processor -- start 2022-07-05T11:46:23.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.481+0000 7fdef3a8e700 1 -- start start 2022-07-05T11:46:23.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.482+0000 7fdef3a8e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdeec17f550 0x7fdeec084580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.482+0000 7fdef3a8e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec17e4b0 con 0x7fdeec17d020 2022-07-05T11:46:23.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.482+0000 7fdef3a8e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec17d5c0 con 0x7fdeec171eb0 2022-07-05T11:46:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.482+0000 7fdef3a8e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec17d8a0 con 0x7fdeec17f550 2022-07-05T11:46:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef1029700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fdeec17d020 0x7fdeec17ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49754/0 (socket says 172.21.15.90:49754) 2022-07-05T11:46:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef1029700 1 -- 172.21.15.90:0/1281916657 learned_addr learned my addr 172.21.15.90:0/1281916657 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef202b700 1 --2- 172.21.15.90:0/1281916657 >> v2:172.21.15.149:3300/0 conn(0x7fdeec17f550 0x7fdeec084580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770648888 0 0) 0x7fdeec17e4b0 con 0x7fdeec17d020 2022-07-05T11:46:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded80033f0 con 0x7fdeec17d020 2022-07-05T11:46:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677180978 0 0) 0x7fdeec17d5c0 con 0x7fdeec171eb0 2022-07-05T11:46:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeec17e4b0 con 0x7fdeec171eb0 2022-07-05T11:46:23.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2998076083 0 0) 0x7fded80033f0 con 0x7fdeec17d020 2022-07-05T11:46:23.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef202b700 1 -- 172.21.15.90:0/1281916657 >> v1:172.21.15.110:6789/0 conn(0x7fdeec171eb0 legacy=0x7fdeec17c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef202b700 1 -- 172.21.15.90:0/1281916657 >> v1:172.21.15.90:6789/0 conn(0x7fdeec17d020 legacy=0x7fdeec17ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef202b700 1 -- 172.21.15.90:0/1281916657 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec17db80 con 0x7fdeec17f550 2022-07-05T11:46:23.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef202b700 1 --2- 172.21.15.90:0/1281916657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec17f550 0x7fdeec084580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fdee4009760 tx=0x7fdee4009060).ready entity=mon.2 client_cookie=9929f26cbd304329 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:23.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0001470 con 0x7fdeec17f550 2022-07-05T11:46:23.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee4011400 con 0x7fdeec17f550 2022-07-05T11:46:23.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.483+0000 7fdef0828700 1 -- 172.21.15.90:0/1281916657 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4011780 con 0x7fdeec17f550 2022-07-05T11:46:23.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.484+0000 7fdef3a8e700 1 -- 172.21.15.90:0/1281916657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec17f550 msgr2=0x7fdeec084580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.484+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/1281916657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec17f550 0x7fdeec084580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fdee4009760 tx=0x7fdee4009060).stop 2022-07-05T11:46:23.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.484+0000 7fdef3a8e700 1 -- 172.21.15.90:0/1281916657 shutdown_connections 2022-07-05T11:46:23.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.484+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/1281916657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec17f550 0x7fdeec084580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.484+0000 7fdef3a8e700 1 -- 172.21.15.90:0/1281916657 >> 172.21.15.90:0/1281916657 conn(0x7fdeec0ee330 msgr2=0x7fdeec0ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:23.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.484+0000 7fdef3a8e700 1 -- 172.21.15.90:0/1281916657 shutdown_connections 2022-07-05T11:46:23.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.484+0000 7fdef3a8e700 1 -- 172.21.15.90:0/1281916657 wait complete. 2022-07-05T11:46:23.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.485+0000 7fdef3a8e700 1 Processor -- start 2022-07-05T11:46:23.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.485+0000 7fdef3a8e700 1 -- start start 2022-07-05T11:46:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef3a8e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec171eb0 0x7fdeec169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef3a8e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdeec17d020 0x7fdeec174460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef3a8e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec17f550 0x7fdeec062b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef3a8e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec175460 con 0x7fdeec17d020 2022-07-05T11:46:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef3a8e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec062700 con 0x7fdeec17f550 2022-07-05T11:46:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef3a8e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec174ea0 con 0x7fdeec171eb0 2022-07-05T11:46:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef1029700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdeec17d020 0x7fdeec174460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef1029700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdeec17d020 0x7fdeec174460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56822/0 (socket says 172.21.15.90:56822) 2022-07-05T11:46:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.486+0000 7fdef1029700 1 -- 172.21.15.90:0/317029073 learned_addr learned my addr 172.21.15.90:0/317029073 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef182a700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec171eb0 0x7fdeec169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef202b700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec17f550 0x7fdeec062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef1029700 1 -- 172.21.15.90:0/317029073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec171eb0 msgr2=0x7fdeec169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef1029700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec171eb0 0x7fdeec169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef1029700 1 -- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec17f550 msgr2=0x7fdeec062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef1029700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec17f550 0x7fdeec062b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef1029700 1 -- 172.21.15.90:0/317029073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee40092a0 con 0x7fdeec17d020 2022-07-05T11:46:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef1029700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdeec17d020 0x7fdeec174460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fdee000c5f0 tx=0x7fdee00019e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdee9ffb700 1 -- 172.21.15.90:0/317029073 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0007170 con 0x7fdeec17d020 2022-07-05T11:46:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdee9ffb700 1 -- 172.21.15.90:0/317029073 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00072f0 con 0x7fdeec17d020 2022-07-05T11:46:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec175180 con 0x7fdeec17d020 2022-07-05T11:46:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdee9ffb700 1 -- 172.21.15.90:0/317029073 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00048c0 con 0x7fdeec17d020 2022-07-05T11:46:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.487+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec062390 con 0x7fdeec17d020 2022-07-05T11:46:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.488+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec061f10 con 0x7fdeec17d020 2022-07-05T11:46:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.489+0000 7fdee9ffb700 1 -- 172.21.15.90:0/317029073 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fdee0004c30 con 0x7fdeec17d020 2022-07-05T11:46:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.489+0000 7fdee9ffb700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdecc08ba70 0x7fdecc08df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.489+0000 7fdee9ffb700 1 -- 172.21.15.90:0/317029073 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fdee00b04a0 con 0x7fdeec17d020 2022-07-05T11:46:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.489+0000 7fdef182a700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdecc08ba70 0x7fdecc08df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.490+0000 7fdef182a700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdecc08ba70 0x7fdecc08df30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fdedc000f80 tx=0x7fdedc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.493+0000 7fdee9ffb700 1 -- 172.21.15.90:0/317029073 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fdeec061f10 con 0x7fdeec17d020 2022-07-05T11:46:23.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.651+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 --> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdeec061f10 con 0x7fdecc08ba70 2022-07-05T11:46:23.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.664+0000 7fdee9ffb700 1 -- 172.21.15.90:0/317029073 <== mgr.4105 v2:172.21.15.110:6800/36906 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434424 (secure 0 0 0) 0x7fdeec061f10 con 0x7fdecc08ba70 2022-07-05T11:46:23.675 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:23.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdecc08ba70 msgr2=0x7fdecc08df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdecc08ba70 0x7fdecc08df30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fdedc000f80 tx=0x7fdedc009040).stop 2022-07-05T11:46:23.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdeec17d020 msgr2=0x7fdeec174460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:23.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdeec17d020 0x7fdeec174460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fdee000c5f0 tx=0x7fdee00019e0).stop 2022-07-05T11:46:23.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 shutdown_connections 2022-07-05T11:46:23.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdecc08ba70 0x7fdecc08df30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdeec17f550 0x7fdeec062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdeec171eb0 0x7fdeec169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 --2- 172.21.15.90:0/317029073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdeec17d020 0x7fdeec174460 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:23.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 >> 172.21.15.90:0/317029073 conn(0x7fdeec0ee330 msgr2=0x7fdeec179ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:23.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 shutdown_connections 2022-07-05T11:46:23.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.668+0000 7fdef3a8e700 1 -- 172.21.15.90:0/317029073 wait complete. 2022-07-05T11:46:23.689 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2022-07-05T11:46:23.690 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2022-07-05T11:46:23.118918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7110,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":64032,"kb_used_data":3968,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":1132398048,"statfs":{"total":1159641169920,"available":1159575601152,"internally_reserved":0,"allocated":4063232,"data_stored":1975122,"data_compressed":167460,"data_compressed_allocated":245760,"data_compressed_original":491520,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4804,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003775"},"pg_stats":[{"pgid":"3.3f","version":"31'6","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360200+0000","last_change":"2022-07-05T11:46:04.211228+0000","last_active":"2022-07-05T11:46:21.360200+0000","last_peered":"2022-07-05T11:46:21.360200+0000","last_clean":"2022-07-05T11:46:21.360200+0000","last_became_active":"2022-07-05T11:46:04.210963+0000","last_became_peered":"2022-07-05T11:46:04.210963+0000","last_unstale":"2022-07-05T11:46:21.360200+0000","last_undegraded":"2022-07-05T11:46:21.360200+0000","last_fullsized":"2022-07-05T11:46:21.360200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029059+0000","last_change":"2022-07-05T11:46:04.590106+0000","last_active":"2022-07-05T11:46:09.029059+0000","last_peered":"2022-07-05T11:46:09.029059+0000","last_clean":"2022-07-05T11:46:09.029059+0000","last_became_active":"2022-07-05T11:46:04.589807+0000","last_became_peered":"2022-07-05T11:46:04.589807+0000","last_unstale":"2022-07-05T11:46:09.029059+0000","last_undegraded":"2022-07-05T11:46:09.029059+0000","last_fullsized":"2022-07-05T11:46:09.029059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.408147+0000","last_change":"2022-07-05T11:46:04.202921+0000","last_active":"2022-07-05T11:46:10.408147+0000","last_peered":"2022-07-05T11:46:10.408147+0000","last_clean":"2022-07-05T11:46:10.408147+0000","last_became_active":"2022-07-05T11:46:04.202631+0000","last_became_peered":"2022-07-05T11:46:04.202631+0000","last_unstale":"2022-07-05T11:46:10.408147+0000","last_undegraded":"2022-07-05T11:46:10.408147+0000","last_fullsized":"2022-07-05T11:46:10.408147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028341+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.028341+0000","last_peered":"2022-07-05T11:46:09.028341+0000","last_clean":"2022-07-05T11:46:09.028341+0000","last_became_active":"2022-07-05T11:46:04.595253+0000","last_became_peered":"2022-07-05T11:46:04.595253+0000","last_unstale":"2022-07-05T11:46:09.028341+0000","last_undegraded":"2022-07-05T11:46:09.028341+0000","last_fullsized":"2022-07-05T11:46:09.028341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360892+0000","last_change":"2022-07-05T11:46:04.211131+0000","last_active":"2022-07-05T11:46:21.360892+0000","last_peered":"2022-07-05T11:46:21.360892+0000","last_clean":"2022-07-05T11:46:21.360892+0000","last_became_active":"2022-07-05T11:46:04.210828+0000","last_became_peered":"2022-07-05T11:46:04.210828+0000","last_unstale":"2022-07-05T11:46:21.360892+0000","last_undegraded":"2022-07-05T11:46:21.360892+0000","last_fullsized":"2022-07-05T11:46:21.360892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012401+0000","last_change":"2022-07-05T11:46:04.592905+0000","last_active":"2022-07-05T11:46:09.012401+0000","last_peered":"2022-07-05T11:46:09.012401+0000","last_clean":"2022-07-05T11:46:09.012401+0000","last_became_active":"2022-07-05T11:46:04.592593+0000","last_became_peered":"2022-07-05T11:46:04.592593+0000","last_unstale":"2022-07-05T11:46:09.012401+0000","last_undegraded":"2022-07-05T11:46:09.012401+0000","last_fullsized":"2022-07-05T11:46:09.012401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012779+0000","last_change":"2022-07-05T11:46:04.209903+0000","last_active":"2022-07-05T11:46:09.012779+0000","last_peered":"2022-07-05T11:46:09.012779+0000","last_clean":"2022-07-05T11:46:09.012779+0000","last_became_active":"2022-07-05T11:46:04.204575+0000","last_became_peered":"2022-07-05T11:46:04.204575+0000","last_unstale":"2022-07-05T11:46:09.012779+0000","last_undegraded":"2022-07-05T11:46:09.012779+0000","last_fullsized":"2022-07-05T11:46:09.012779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974869+0000","last_change":"2022-07-05T11:46:04.595822+0000","last_active":"2022-07-05T11:46:08.974869+0000","last_peered":"2022-07-05T11:46:08.974869+0000","last_clean":"2022-07-05T11:46:08.974869+0000","last_became_active":"2022-07-05T11:46:04.595306+0000","last_became_peered":"2022-07-05T11:46:04.595306+0000","last_unstale":"2022-07-05T11:46:08.974869+0000","last_undegraded":"2022-07-05T11:46:08.974869+0000","last_fullsized":"2022-07-05T11:46:08.974869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"25'1","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029038+0000","last_change":"2022-07-05T11:46:04.202298+0000","last_active":"2022-07-05T11:46:09.029038+0000","last_peered":"2022-07-05T11:46:09.029038+0000","last_clean":"2022-07-05T11:46:09.029038+0000","last_became_active":"2022-07-05T11:46:04.202010+0000","last_became_peered":"2022-07-05T11:46:04.202010+0000","last_unstale":"2022-07-05T11:46:09.029038+0000","last_undegraded":"2022-07-05T11:46:09.029038+0000","last_fullsized":"2022-07-05T11:46:09.029038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029758+0000","last_change":"2022-07-05T11:46:04.590970+0000","last_active":"2022-07-05T11:46:09.029758+0000","last_peered":"2022-07-05T11:46:09.029758+0000","last_clean":"2022-07-05T11:46:09.029758+0000","last_became_active":"2022-07-05T11:46:04.590714+0000","last_became_peered":"2022-07-05T11:46:04.590714+0000","last_unstale":"2022-07-05T11:46:09.029758+0000","last_undegraded":"2022-07-05T11:46:09.029758+0000","last_fullsized":"2022-07-05T11:46:09.029758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029235+0000","last_change":"2022-07-05T11:46:04.204607+0000","last_active":"2022-07-05T11:46:09.029235+0000","last_peered":"2022-07-05T11:46:09.029235+0000","last_clean":"2022-07-05T11:46:09.029235+0000","last_became_active":"2022-07-05T11:46:04.204287+0000","last_became_peered":"2022-07-05T11:46:04.204287+0000","last_unstale":"2022-07-05T11:46:09.029235+0000","last_undegraded":"2022-07-05T11:46:09.029235+0000","last_fullsized":"2022-07-05T11:46:09.029235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012802+0000","last_change":"2022-07-05T11:46:04.606655+0000","last_active":"2022-07-05T11:46:09.012802+0000","last_peered":"2022-07-05T11:46:09.012802+0000","last_clean":"2022-07-05T11:46:09.012802+0000","last_became_active":"2022-07-05T11:46:04.606370+0000","last_became_peered":"2022-07-05T11:46:04.606370+0000","last_unstale":"2022-07-05T11:46:09.012802+0000","last_undegraded":"2022-07-05T11:46:09.012802+0000","last_fullsized":"2022-07-05T11:46:09.012802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360703+0000","last_change":"2022-07-05T11:46:04.206427+0000","last_active":"2022-07-05T11:46:21.360703+0000","last_peered":"2022-07-05T11:46:21.360703+0000","last_clean":"2022-07-05T11:46:21.360703+0000","last_became_active":"2022-07-05T11:46:04.206192+0000","last_became_peered":"2022-07-05T11:46:04.206192+0000","last_unstale":"2022-07-05T11:46:21.360703+0000","last_undegraded":"2022-07-05T11:46:21.360703+0000","last_fullsized":"2022-07-05T11:46:21.360703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028587+0000","last_change":"2022-07-05T11:46:04.599321+0000","last_active":"2022-07-05T11:46:09.028587+0000","last_peered":"2022-07-05T11:46:09.028587+0000","last_clean":"2022-07-05T11:46:09.028587+0000","last_became_active":"2022-07-05T11:46:04.597626+0000","last_became_peered":"2022-07-05T11:46:04.597626+0000","last_unstale":"2022-07-05T11:46:09.028587+0000","last_undegraded":"2022-07-05T11:46:09.028587+0000","last_fullsized":"2022-07-05T11:46:09.028587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407177+0000","last_change":"2022-07-05T11:46:04.204458+0000","last_active":"2022-07-05T11:46:10.407177+0000","last_peered":"2022-07-05T11:46:10.407177+0000","last_clean":"2022-07-05T11:46:10.407177+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:10.407177+0000","last_undegraded":"2022-07-05T11:46:10.407177+0000","last_fullsized":"2022-07-05T11:46:10.407177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028708+0000","last_change":"2022-07-05T11:46:04.598830+0000","last_active":"2022-07-05T11:46:09.028708+0000","last_peered":"2022-07-05T11:46:09.028708+0000","last_clean":"2022-07-05T11:46:09.028708+0000","last_became_active":"2022-07-05T11:46:04.597158+0000","last_became_peered":"2022-07-05T11:46:04.597158+0000","last_unstale":"2022-07-05T11:46:09.028708+0000","last_undegraded":"2022-07-05T11:46:09.028708+0000","last_fullsized":"2022-07-05T11:46:09.028708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029721+0000","last_change":"2022-07-05T11:46:04.207355+0000","last_active":"2022-07-05T11:46:09.029721+0000","last_peered":"2022-07-05T11:46:09.029721+0000","last_clean":"2022-07-05T11:46:09.029721+0000","last_became_active":"2022-07-05T11:46:04.207059+0000","last_became_peered":"2022-07-05T11:46:04.207059+0000","last_unstale":"2022-07-05T11:46:09.029721+0000","last_undegraded":"2022-07-05T11:46:09.029721+0000","last_fullsized":"2022-07-05T11:46:09.029721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012425+0000","last_change":"2022-07-05T11:46:04.595782+0000","last_active":"2022-07-05T11:46:09.012425+0000","last_peered":"2022-07-05T11:46:09.012425+0000","last_clean":"2022-07-05T11:46:09.012425+0000","last_became_active":"2022-07-05T11:46:04.595530+0000","last_became_peered":"2022-07-05T11:46:04.595530+0000","last_unstale":"2022-07-05T11:46:09.012425+0000","last_undegraded":"2022-07-05T11:46:09.012425+0000","last_fullsized":"2022-07-05T11:46:09.012425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.351876+0000","last_change":"2022-07-05T11:46:04.210209+0000","last_active":"2022-07-05T11:46:20.351876+0000","last_peered":"2022-07-05T11:46:20.351876+0000","last_clean":"2022-07-05T11:46:20.351876+0000","last_became_active":"2022-07-05T11:46:04.209883+0000","last_became_peered":"2022-07-05T11:46:04.209883+0000","last_unstale":"2022-07-05T11:46:20.351876+0000","last_undegraded":"2022-07-05T11:46:20.351876+0000","last_fullsized":"2022-07-05T11:46:20.351876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028150+0000","last_change":"2022-07-05T11:46:04.600375+0000","last_active":"2022-07-05T11:46:09.028150+0000","last_peered":"2022-07-05T11:46:09.028150+0000","last_clean":"2022-07-05T11:46:09.028150+0000","last_became_active":"2022-07-05T11:46:04.600101+0000","last_became_peered":"2022-07-05T11:46:04.600101+0000","last_unstale":"2022-07-05T11:46:09.028150+0000","last_undegraded":"2022-07-05T11:46:09.028150+0000","last_fullsized":"2022-07-05T11:46:09.028150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030246+0000","last_change":"2022-07-05T11:46:04.204891+0000","last_active":"2022-07-05T11:46:09.030246+0000","last_peered":"2022-07-05T11:46:09.030246+0000","last_clean":"2022-07-05T11:46:09.030246+0000","last_became_active":"2022-07-05T11:46:04.204619+0000","last_became_peered":"2022-07-05T11:46:04.204619+0000","last_unstale":"2022-07-05T11:46:09.030246+0000","last_undegraded":"2022-07-05T11:46:09.030246+0000","last_fullsized":"2022-07-05T11:46:09.030246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028234+0000","last_change":"2022-07-05T11:46:04.600335+0000","last_active":"2022-07-05T11:46:09.028234+0000","last_peered":"2022-07-05T11:46:09.028234+0000","last_clean":"2022-07-05T11:46:09.028234+0000","last_became_active":"2022-07-05T11:46:04.600026+0000","last_became_peered":"2022-07-05T11:46:04.600026+0000","last_unstale":"2022-07-05T11:46:09.028234+0000","last_undegraded":"2022-07-05T11:46:09.028234+0000","last_fullsized":"2022-07-05T11:46:09.028234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352620+0000","last_change":"2022-07-05T11:46:04.210563+0000","last_active":"2022-07-05T11:46:20.352620+0000","last_peered":"2022-07-05T11:46:20.352620+0000","last_clean":"2022-07-05T11:46:20.352620+0000","last_became_active":"2022-07-05T11:46:04.210264+0000","last_became_peered":"2022-07-05T11:46:04.210264+0000","last_unstale":"2022-07-05T11:46:20.352620+0000","last_undegraded":"2022-07-05T11:46:20.352620+0000","last_fullsized":"2022-07-05T11:46:20.352620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3070,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975654+0000","last_change":"2022-07-05T11:46:04.596566+0000","last_active":"2022-07-05T11:46:08.975654+0000","last_peered":"2022-07-05T11:46:08.975654+0000","last_clean":"2022-07-05T11:46:08.975654+0000","last_became_active":"2022-07-05T11:46:04.596385+0000","last_became_peered":"2022-07-05T11:46:04.596385+0000","last_unstale":"2022-07-05T11:46:08.975654+0000","last_undegraded":"2022-07-05T11:46:08.975654+0000","last_fullsized":"2022-07-05T11:46:08.975654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359717+0000","last_change":"2022-07-05T11:46:04.205836+0000","last_active":"2022-07-05T11:46:21.359717+0000","last_peered":"2022-07-05T11:46:21.359717+0000","last_clean":"2022-07-05T11:46:21.359717+0000","last_became_active":"2022-07-05T11:46:04.205522+0000","last_became_peered":"2022-07-05T11:46:04.205522+0000","last_unstale":"2022-07-05T11:46:21.359717+0000","last_undegraded":"2022-07-05T11:46:21.359717+0000","last_fullsized":"2022-07-05T11:46:21.359717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027942+0000","last_change":"2022-07-05T11:46:04.600047+0000","last_active":"2022-07-05T11:46:09.027942+0000","last_peered":"2022-07-05T11:46:09.027942+0000","last_clean":"2022-07-05T11:46:09.027942+0000","last_became_active":"2022-07-05T11:46:04.599735+0000","last_became_peered":"2022-07-05T11:46:04.599735+0000","last_unstale":"2022-07-05T11:46:09.027942+0000","last_undegraded":"2022-07-05T11:46:09.027942+0000","last_fullsized":"2022-07-05T11:46:09.027942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027527+0000","last_change":"2022-07-05T11:46:04.204754+0000","last_active":"2022-07-05T11:46:09.027527+0000","last_peered":"2022-07-05T11:46:09.027527+0000","last_clean":"2022-07-05T11:46:09.027527+0000","last_became_active":"2022-07-05T11:46:04.204466+0000","last_became_peered":"2022-07-05T11:46:04.204466+0000","last_unstale":"2022-07-05T11:46:09.027527+0000","last_undegraded":"2022-07-05T11:46:09.027527+0000","last_fullsized":"2022-07-05T11:46:09.027527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012900+0000","last_change":"2022-07-05T11:46:04.594552+0000","last_active":"2022-07-05T11:46:09.012900+0000","last_peered":"2022-07-05T11:46:09.012900+0000","last_clean":"2022-07-05T11:46:09.012900+0000","last_became_active":"2022-07-05T11:46:04.594285+0000","last_became_peered":"2022-07-05T11:46:04.594285+0000","last_unstale":"2022-07-05T11:46:09.012900+0000","last_undegraded":"2022-07-05T11:46:09.012900+0000","last_fullsized":"2022-07-05T11:46:09.012900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027421+0000","last_change":"2022-07-05T11:46:04.206416+0000","last_active":"2022-07-05T11:46:09.027421+0000","last_peered":"2022-07-05T11:46:09.027421+0000","last_clean":"2022-07-05T11:46:09.027421+0000","last_became_active":"2022-07-05T11:46:04.206118+0000","last_became_peered":"2022-07-05T11:46:04.206118+0000","last_unstale":"2022-07-05T11:46:09.027421+0000","last_undegraded":"2022-07-05T11:46:09.027421+0000","last_fullsized":"2022-07-05T11:46:09.027421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975854+0000","last_change":"2022-07-05T11:46:04.596814+0000","last_active":"2022-07-05T11:46:08.975854+0000","last_peered":"2022-07-05T11:46:08.975854+0000","last_clean":"2022-07-05T11:46:08.975854+0000","last_became_active":"2022-07-05T11:46:04.596492+0000","last_became_peered":"2022-07-05T11:46:04.596492+0000","last_unstale":"2022-07-05T11:46:08.975854+0000","last_undegraded":"2022-07-05T11:46:08.975854+0000","last_fullsized":"2022-07-05T11:46:08.975854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'10","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359628+0000","last_change":"2022-07-05T11:46:04.208748+0000","last_active":"2022-07-05T11:46:21.359628+0000","last_peered":"2022-07-05T11:46:21.359628+0000","last_clean":"2022-07-05T11:46:21.359628+0000","last_became_active":"2022-07-05T11:46:04.208440+0000","last_became_peered":"2022-07-05T11:46:04.208440+0000","last_unstale":"2022-07-05T11:46:21.359628+0000","last_undegraded":"2022-07-05T11:46:21.359628+0000","last_fullsized":"2022-07-05T11:46:21.359628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974079+0000","last_change":"2022-07-05T11:46:04.592371+0000","last_active":"2022-07-05T11:46:08.974079+0000","last_peered":"2022-07-05T11:46:08.974079+0000","last_clean":"2022-07-05T11:46:08.974079+0000","last_became_active":"2022-07-05T11:46:04.592201+0000","last_became_peered":"2022-07-05T11:46:04.592201+0000","last_unstale":"2022-07-05T11:46:08.974079+0000","last_undegraded":"2022-07-05T11:46:08.974079+0000","last_fullsized":"2022-07-05T11:46:08.974079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976173+0000","last_change":"2022-07-05T11:46:04.211261+0000","last_active":"2022-07-05T11:46:08.976173+0000","last_peered":"2022-07-05T11:46:08.976173+0000","last_clean":"2022-07-05T11:46:08.976173+0000","last_became_active":"2022-07-05T11:46:04.211004+0000","last_became_peered":"2022-07-05T11:46:04.211004+0000","last_unstale":"2022-07-05T11:46:08.976173+0000","last_undegraded":"2022-07-05T11:46:08.976173+0000","last_fullsized":"2022-07-05T11:46:08.976173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974789+0000","last_change":"2022-07-05T11:46:04.597787+0000","last_active":"2022-07-05T11:46:08.974789+0000","last_peered":"2022-07-05T11:46:08.974789+0000","last_clean":"2022-07-05T11:46:08.974789+0000","last_became_active":"2022-07-05T11:46:04.597433+0000","last_became_peered":"2022-07-05T11:46:04.597433+0000","last_unstale":"2022-07-05T11:46:08.974789+0000","last_undegraded":"2022-07-05T11:46:08.974789+0000","last_fullsized":"2022-07-05T11:46:08.974789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974038+0000","last_change":"2022-07-05T11:46:04.211347+0000","last_active":"2022-07-05T11:46:08.974038+0000","last_peered":"2022-07-05T11:46:08.974038+0000","last_clean":"2022-07-05T11:46:08.974038+0000","last_became_active":"2022-07-05T11:46:04.211045+0000","last_became_peered":"2022-07-05T11:46:04.211045+0000","last_unstale":"2022-07-05T11:46:08.974038+0000","last_undegraded":"2022-07-05T11:46:08.974038+0000","last_fullsized":"2022-07-05T11:46:08.974038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973840+0000","last_change":"2022-07-05T11:46:04.587177+0000","last_active":"2022-07-05T11:46:08.973840+0000","last_peered":"2022-07-05T11:46:08.973840+0000","last_clean":"2022-07-05T11:46:08.973840+0000","last_became_active":"2022-07-05T11:46:04.586915+0000","last_became_peered":"2022-07-05T11:46:04.586915+0000","last_unstale":"2022-07-05T11:46:08.973840+0000","last_undegraded":"2022-07-05T11:46:08.973840+0000","last_fullsized":"2022-07-05T11:46:08.973840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028039+0000","last_change":"2022-07-05T11:46:04.213135+0000","last_active":"2022-07-05T11:46:09.028039+0000","last_peered":"2022-07-05T11:46:09.028039+0000","last_clean":"2022-07-05T11:46:09.028039+0000","last_became_active":"2022-07-05T11:46:04.212877+0000","last_became_peered":"2022-07-05T11:46:04.212877+0000","last_unstale":"2022-07-05T11:46:09.028039+0000","last_undegraded":"2022-07-05T11:46:09.028039+0000","last_fullsized":"2022-07-05T11:46:09.028039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975178+0000","last_change":"2022-07-05T11:46:04.598414+0000","last_active":"2022-07-05T11:46:08.975178+0000","last_peered":"2022-07-05T11:46:08.975178+0000","last_clean":"2022-07-05T11:46:08.975178+0000","last_became_active":"2022-07-05T11:46:04.595082+0000","last_became_peered":"2022-07-05T11:46:04.595082+0000","last_unstale":"2022-07-05T11:46:08.975178+0000","last_undegraded":"2022-07-05T11:46:08.975178+0000","last_fullsized":"2022-07-05T11:46:08.975178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360249+0000","last_change":"2022-07-05T11:46:04.208533+0000","last_active":"2022-07-05T11:46:21.360249+0000","last_peered":"2022-07-05T11:46:21.360249+0000","last_clean":"2022-07-05T11:46:21.360249+0000","last_became_active":"2022-07-05T11:46:04.208198+0000","last_became_peered":"2022-07-05T11:46:04.208198+0000","last_unstale":"2022-07-05T11:46:21.360249+0000","last_undegraded":"2022-07-05T11:46:21.360249+0000","last_fullsized":"2022-07-05T11:46:21.360249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029685+0000","last_change":"2022-07-05T11:46:04.590329+0000","last_active":"2022-07-05T11:46:09.029685+0000","last_peered":"2022-07-05T11:46:09.029685+0000","last_clean":"2022-07-05T11:46:09.029685+0000","last_became_active":"2022-07-05T11:46:04.590046+0000","last_became_peered":"2022-07-05T11:46:04.590046+0000","last_unstale":"2022-07-05T11:46:09.029685+0000","last_undegraded":"2022-07-05T11:46:09.029685+0000","last_fullsized":"2022-07-05T11:46:09.029685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352181+0000","last_change":"2022-07-05T11:46:04.207526+0000","last_active":"2022-07-05T11:46:20.352181+0000","last_peered":"2022-07-05T11:46:20.352181+0000","last_clean":"2022-07-05T11:46:20.352181+0000","last_became_active":"2022-07-05T11:46:04.207209+0000","last_became_peered":"2022-07-05T11:46:04.207209+0000","last_unstale":"2022-07-05T11:46:20.352181+0000","last_undegraded":"2022-07-05T11:46:20.352181+0000","last_fullsized":"2022-07-05T11:46:20.352181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029663+0000","last_change":"2022-07-05T11:46:04.590203+0000","last_active":"2022-07-05T11:46:09.029663+0000","last_peered":"2022-07-05T11:46:09.029663+0000","last_clean":"2022-07-05T11:46:09.029663+0000","last_became_active":"2022-07-05T11:46:04.589893+0000","last_became_peered":"2022-07-05T11:46:04.589893+0000","last_unstale":"2022-07-05T11:46:09.029663+0000","last_undegraded":"2022-07-05T11:46:09.029663+0000","last_fullsized":"2022-07-05T11:46:09.029663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028304+0000","last_change":"2022-07-05T11:46:04.207726+0000","last_active":"2022-07-05T11:46:09.028304+0000","last_peered":"2022-07-05T11:46:09.028304+0000","last_clean":"2022-07-05T11:46:09.028304+0000","last_became_active":"2022-07-05T11:46:04.207398+0000","last_became_peered":"2022-07-05T11:46:04.207398+0000","last_unstale":"2022-07-05T11:46:09.028304+0000","last_undegraded":"2022-07-05T11:46:09.028304+0000","last_fullsized":"2022-07-05T11:46:09.028304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028460+0000","last_change":"2022-07-05T11:46:04.598660+0000","last_active":"2022-07-05T11:46:09.028460+0000","last_peered":"2022-07-05T11:46:09.028460+0000","last_clean":"2022-07-05T11:46:09.028460+0000","last_became_active":"2022-07-05T11:46:04.598419+0000","last_became_peered":"2022-07-05T11:46:04.598419+0000","last_unstale":"2022-07-05T11:46:09.028460+0000","last_undegraded":"2022-07-05T11:46:09.028460+0000","last_fullsized":"2022-07-05T11:46:09.028460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028769+0000","last_change":"2022-07-05T11:46:04.214164+0000","last_active":"2022-07-05T11:46:09.028769+0000","last_peered":"2022-07-05T11:46:09.028769+0000","last_clean":"2022-07-05T11:46:09.028769+0000","last_became_active":"2022-07-05T11:46:04.213794+0000","last_became_peered":"2022-07-05T11:46:04.213794+0000","last_unstale":"2022-07-05T11:46:09.028769+0000","last_undegraded":"2022-07-05T11:46:09.028769+0000","last_fullsized":"2022-07-05T11:46:09.028769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.599315+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.599091+0000","last_became_peered":"2022-07-05T11:46:04.599091+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353175+0000","last_change":"2022-07-05T11:46:04.208200+0000","last_active":"2022-07-05T11:46:20.353175+0000","last_peered":"2022-07-05T11:46:20.353175+0000","last_clean":"2022-07-05T11:46:20.353175+0000","last_became_active":"2022-07-05T11:46:04.207891+0000","last_became_peered":"2022-07-05T11:46:04.207891+0000","last_unstale":"2022-07-05T11:46:20.353175+0000","last_undegraded":"2022-07-05T11:46:20.353175+0000","last_fullsized":"2022-07-05T11:46:20.353175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028740+0000","last_change":"2022-07-05T11:46:04.594011+0000","last_active":"2022-07-05T11:46:09.028740+0000","last_peered":"2022-07-05T11:46:09.028740+0000","last_clean":"2022-07-05T11:46:09.028740+0000","last_became_active":"2022-07-05T11:46:04.593800+0000","last_became_peered":"2022-07-05T11:46:04.593800+0000","last_unstale":"2022-07-05T11:46:09.028740+0000","last_undegraded":"2022-07-05T11:46:09.028740+0000","last_fullsized":"2022-07-05T11:46:09.028740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353238+0000","last_change":"2022-07-05T11:46:04.206715+0000","last_active":"2022-07-05T11:46:20.353238+0000","last_peered":"2022-07-05T11:46:20.353238+0000","last_clean":"2022-07-05T11:46:20.353238+0000","last_became_active":"2022-07-05T11:46:04.206230+0000","last_became_peered":"2022-07-05T11:46:04.206230+0000","last_unstale":"2022-07-05T11:46:20.353238+0000","last_undegraded":"2022-07-05T11:46:20.353238+0000","last_fullsized":"2022-07-05T11:46:20.353238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029238+0000","last_change":"2022-07-05T11:46:04.590527+0000","last_active":"2022-07-05T11:46:09.029238+0000","last_peered":"2022-07-05T11:46:09.029238+0000","last_clean":"2022-07-05T11:46:09.029238+0000","last_became_active":"2022-07-05T11:46:04.589992+0000","last_became_peered":"2022-07-05T11:46:04.589992+0000","last_unstale":"2022-07-05T11:46:09.029238+0000","last_undegraded":"2022-07-05T11:46:09.029238+0000","last_fullsized":"2022-07-05T11:46:09.029238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317357+0000","last_change":"2022-07-05T11:46:04.209943+0000","last_active":"2022-07-05T11:46:10.317357+0000","last_peered":"2022-07-05T11:46:10.317357+0000","last_clean":"2022-07-05T11:46:10.317357+0000","last_became_active":"2022-07-05T11:46:04.209640+0000","last_became_peered":"2022-07-05T11:46:04.209640+0000","last_unstale":"2022-07-05T11:46:10.317357+0000","last_undegraded":"2022-07-05T11:46:10.317357+0000","last_fullsized":"2022-07-05T11:46:10.317357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028615+0000","last_change":"2022-07-05T11:46:04.593997+0000","last_active":"2022-07-05T11:46:09.028615+0000","last_peered":"2022-07-05T11:46:09.028615+0000","last_clean":"2022-07-05T11:46:09.028615+0000","last_became_active":"2022-07-05T11:46:04.593708+0000","last_became_peered":"2022-07-05T11:46:04.593708+0000","last_unstale":"2022-07-05T11:46:09.028615+0000","last_undegraded":"2022-07-05T11:46:09.028615+0000","last_fullsized":"2022-07-05T11:46:09.028615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.982599+0000","last_change":"2022-07-05T11:46:04.203818+0000","last_active":"2022-07-05T11:46:09.982599+0000","last_peered":"2022-07-05T11:46:09.982599+0000","last_clean":"2022-07-05T11:46:09.982599+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:09.982599+0000","last_undegraded":"2022-07-05T11:46:09.982599+0000","last_fullsized":"2022-07-05T11:46:09.982599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975098+0000","last_change":"2022-07-05T11:46:04.598669+0000","last_active":"2022-07-05T11:46:08.975098+0000","last_peered":"2022-07-05T11:46:08.975098+0000","last_clean":"2022-07-05T11:46:08.975098+0000","last_became_active":"2022-07-05T11:46:04.598400+0000","last_became_peered":"2022-07-05T11:46:04.598400+0000","last_unstale":"2022-07-05T11:46:08.975098+0000","last_undegraded":"2022-07-05T11:46:08.975098+0000","last_fullsized":"2022-07-05T11:46:08.975098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028775+0000","last_change":"2022-07-05T11:46:04.212247+0000","last_active":"2022-07-05T11:46:09.028775+0000","last_peered":"2022-07-05T11:46:09.028775+0000","last_clean":"2022-07-05T11:46:09.028775+0000","last_became_active":"2022-07-05T11:46:04.211958+0000","last_became_peered":"2022-07-05T11:46:04.211958+0000","last_unstale":"2022-07-05T11:46:09.028775+0000","last_undegraded":"2022-07-05T11:46:09.028775+0000","last_fullsized":"2022-07-05T11:46:09.028775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029158+0000","last_change":"2022-07-05T11:46:04.599477+0000","last_active":"2022-07-05T11:46:09.029158+0000","last_peered":"2022-07-05T11:46:09.029158+0000","last_clean":"2022-07-05T11:46:09.029158+0000","last_became_active":"2022-07-05T11:46:04.599214+0000","last_became_peered":"2022-07-05T11:46:04.599214+0000","last_unstale":"2022-07-05T11:46:09.029158+0000","last_undegraded":"2022-07-05T11:46:09.029158+0000","last_fullsized":"2022-07-05T11:46:09.029158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027608+0000","last_change":"2022-07-05T11:46:04.209196+0000","last_active":"2022-07-05T11:46:09.027608+0000","last_peered":"2022-07-05T11:46:09.027608+0000","last_clean":"2022-07-05T11:46:09.027608+0000","last_became_active":"2022-07-05T11:46:04.208918+0000","last_became_peered":"2022-07-05T11:46:04.208918+0000","last_unstale":"2022-07-05T11:46:09.027608+0000","last_undegraded":"2022-07-05T11:46:09.027608+0000","last_fullsized":"2022-07-05T11:46:09.027608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975167+0000","last_change":"2022-07-05T11:46:04.594414+0000","last_active":"2022-07-05T11:46:08.975167+0000","last_peered":"2022-07-05T11:46:08.975167+0000","last_clean":"2022-07-05T11:46:08.975167+0000","last_became_active":"2022-07-05T11:46:04.594114+0000","last_became_peered":"2022-07-05T11:46:04.594114+0000","last_unstale":"2022-07-05T11:46:08.975167+0000","last_undegraded":"2022-07-05T11:46:08.975167+0000","last_fullsized":"2022-07-05T11:46:08.975167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027763+0000","last_change":"2022-07-05T11:46:04.215006+0000","last_active":"2022-07-05T11:46:09.027763+0000","last_peered":"2022-07-05T11:46:09.027763+0000","last_clean":"2022-07-05T11:46:09.027763+0000","last_became_active":"2022-07-05T11:46:04.214585+0000","last_became_peered":"2022-07-05T11:46:04.214585+0000","last_unstale":"2022-07-05T11:46:09.027763+0000","last_undegraded":"2022-07-05T11:46:09.027763+0000","last_fullsized":"2022-07-05T11:46:09.027763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030101+0000","last_change":"2022-07-05T11:46:04.601912+0000","last_active":"2022-07-05T11:46:09.030101+0000","last_peered":"2022-07-05T11:46:09.030101+0000","last_clean":"2022-07-05T11:46:09.030101+0000","last_became_active":"2022-07-05T11:46:04.601605+0000","last_became_peered":"2022-07-05T11:46:04.601605+0000","last_unstale":"2022-07-05T11:46:09.030101+0000","last_undegraded":"2022-07-05T11:46:09.030101+0000","last_fullsized":"2022-07-05T11:46:09.030101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317065+0000","last_change":"2022-07-05T11:46:04.208064+0000","last_active":"2022-07-05T11:46:10.317065+0000","last_peered":"2022-07-05T11:46:10.317065+0000","last_clean":"2022-07-05T11:46:10.317065+0000","last_became_active":"2022-07-05T11:46:04.207845+0000","last_became_peered":"2022-07-05T11:46:04.207845+0000","last_unstale":"2022-07-05T11:46:10.317065+0000","last_undegraded":"2022-07-05T11:46:10.317065+0000","last_fullsized":"2022-07-05T11:46:10.317065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030056+0000","last_change":"2022-07-05T11:46:04.589990+0000","last_active":"2022-07-05T11:46:09.030056+0000","last_peered":"2022-07-05T11:46:09.030056+0000","last_clean":"2022-07-05T11:46:09.030056+0000","last_became_active":"2022-07-05T11:46:04.589734+0000","last_became_peered":"2022-07-05T11:46:04.589734+0000","last_unstale":"2022-07-05T11:46:09.030056+0000","last_undegraded":"2022-07-05T11:46:09.030056+0000","last_fullsized":"2022-07-05T11:46:09.030056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974955+0000","last_change":"2022-07-05T11:46:04.208275+0000","last_active":"2022-07-05T11:46:08.974955+0000","last_peered":"2022-07-05T11:46:08.974955+0000","last_clean":"2022-07-05T11:46:08.974955+0000","last_became_active":"2022-07-05T11:46:04.208001+0000","last_became_peered":"2022-07-05T11:46:04.208001+0000","last_unstale":"2022-07-05T11:46:08.974955+0000","last_undegraded":"2022-07-05T11:46:08.974955+0000","last_fullsized":"2022-07-05T11:46:08.974955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028628+0000","last_change":"2022-07-05T11:46:04.597446+0000","last_active":"2022-07-05T11:46:09.028628+0000","last_peered":"2022-07-05T11:46:09.028628+0000","last_clean":"2022-07-05T11:46:09.028628+0000","last_became_active":"2022-07-05T11:46:04.596828+0000","last_became_peered":"2022-07-05T11:46:04.596828+0000","last_unstale":"2022-07-05T11:46:09.028628+0000","last_undegraded":"2022-07-05T11:46:09.028628+0000","last_fullsized":"2022-07-05T11:46:09.028628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360630+0000","last_change":"2022-07-05T11:46:04.211080+0000","last_active":"2022-07-05T11:46:21.360630+0000","last_peered":"2022-07-05T11:46:21.360630+0000","last_clean":"2022-07-05T11:46:21.360630+0000","last_became_active":"2022-07-05T11:46:04.210805+0000","last_became_peered":"2022-07-05T11:46:04.210805+0000","last_unstale":"2022-07-05T11:46:21.360630+0000","last_undegraded":"2022-07-05T11:46:21.360630+0000","last_fullsized":"2022-07-05T11:46:21.360630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012330+0000","last_change":"2022-07-05T11:46:04.594116+0000","last_active":"2022-07-05T11:46:09.012330+0000","last_peered":"2022-07-05T11:46:09.012330+0000","last_clean":"2022-07-05T11:46:09.012330+0000","last_became_active":"2022-07-05T11:46:04.593716+0000","last_became_peered":"2022-07-05T11:46:04.593716+0000","last_unstale":"2022-07-05T11:46:09.012330+0000","last_undegraded":"2022-07-05T11:46:09.012330+0000","last_fullsized":"2022-07-05T11:46:09.012330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017611+0000","last_change":"2022-07-05T11:46:09.014114+0000","last_active":"2022-07-05T11:46:09.017611+0000","last_peered":"2022-07-05T11:46:09.017611+0000","last_clean":"2022-07-05T11:46:09.017611+0000","last_became_active":"2022-07-05T11:46:09.013707+0000","last_became_peered":"2022-07-05T11:46:09.013707+0000","last_unstale":"2022-07-05T11:46:09.017611+0000","last_undegraded":"2022-07-05T11:46:09.017611+0000","last_fullsized":"2022-07-05T11:46:09.017611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029324+0000","last_change":"2022-07-05T11:46:04.213375+0000","last_active":"2022-07-05T11:46:09.029324+0000","last_peered":"2022-07-05T11:46:09.029324+0000","last_clean":"2022-07-05T11:46:09.029324+0000","last_became_active":"2022-07-05T11:46:04.213094+0000","last_became_peered":"2022-07-05T11:46:04.213094+0000","last_unstale":"2022-07-05T11:46:09.029324+0000","last_undegraded":"2022-07-05T11:46:09.029324+0000","last_fullsized":"2022-07-05T11:46:09.029324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027648+0000","last_change":"2022-07-05T11:46:04.599779+0000","last_active":"2022-07-05T11:46:09.027648+0000","last_peered":"2022-07-05T11:46:09.027648+0000","last_clean":"2022-07-05T11:46:09.027648+0000","last_became_active":"2022-07-05T11:46:04.597330+0000","last_became_peered":"2022-07-05T11:46:04.597330+0000","last_unstale":"2022-07-05T11:46:09.027648+0000","last_undegraded":"2022-07-05T11:46:09.027648+0000","last_fullsized":"2022-07-05T11:46:09.027648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012222+0000","last_change":"2022-07-05T11:46:08.615050+0000","last_active":"2022-07-05T11:46:09.012222+0000","last_peered":"2022-07-05T11:46:09.012222+0000","last_clean":"2022-07-05T11:46:09.012222+0000","last_became_active":"2022-07-05T11:46:08.614715+0000","last_became_peered":"2022-07-05T11:46:08.614715+0000","last_unstale":"2022-07-05T11:46:09.012222+0000","last_undegraded":"2022-07-05T11:46:09.012222+0000","last_fullsized":"2022-07-05T11:46:09.012222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975318+0000","last_change":"2022-07-05T11:46:04.206835+0000","last_active":"2022-07-05T11:46:08.975318+0000","last_peered":"2022-07-05T11:46:08.975318+0000","last_clean":"2022-07-05T11:46:08.975318+0000","last_became_active":"2022-07-05T11:46:04.206389+0000","last_became_peered":"2022-07-05T11:46:04.206389+0000","last_unstale":"2022-07-05T11:46:08.975318+0000","last_undegraded":"2022-07-05T11:46:08.975318+0000","last_fullsized":"2022-07-05T11:46:08.975318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012352+0000","last_change":"2022-07-05T11:46:04.595704+0000","last_active":"2022-07-05T11:46:09.012352+0000","last_peered":"2022-07-05T11:46:09.012352+0000","last_clean":"2022-07-05T11:46:09.012352+0000","last_became_active":"2022-07-05T11:46:04.594581+0000","last_became_peered":"2022-07-05T11:46:04.594581+0000","last_unstale":"2022-07-05T11:46:09.012352+0000","last_undegraded":"2022-07-05T11:46:09.012352+0000","last_fullsized":"2022-07-05T11:46:09.012352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028313+0000","last_change":"2022-07-05T11:46:08.618434+0000","last_active":"2022-07-05T11:46:09.028313+0000","last_peered":"2022-07-05T11:46:09.028313+0000","last_clean":"2022-07-05T11:46:09.028313+0000","last_became_active":"2022-07-05T11:46:08.618022+0000","last_became_peered":"2022-07-05T11:46:08.618022+0000","last_unstale":"2022-07-05T11:46:09.028313+0000","last_undegraded":"2022-07-05T11:46:09.028313+0000","last_fullsized":"2022-07-05T11:46:09.028313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029453+0000","last_change":"2022-07-05T11:46:04.213103+0000","last_active":"2022-07-05T11:46:09.029453+0000","last_peered":"2022-07-05T11:46:09.029453+0000","last_clean":"2022-07-05T11:46:09.029453+0000","last_became_active":"2022-07-05T11:46:04.211627+0000","last_became_peered":"2022-07-05T11:46:04.211627+0000","last_unstale":"2022-07-05T11:46:09.029453+0000","last_undegraded":"2022-07-05T11:46:09.029453+0000","last_fullsized":"2022-07-05T11:46:09.029453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012463+0000","last_change":"2022-07-05T11:46:04.593912+0000","last_active":"2022-07-05T11:46:09.012463+0000","last_peered":"2022-07-05T11:46:09.012463+0000","last_clean":"2022-07-05T11:46:09.012463+0000","last_became_active":"2022-07-05T11:46:04.593631+0000","last_became_peered":"2022-07-05T11:46:04.593631+0000","last_unstale":"2022-07-05T11:46:09.012463+0000","last_undegraded":"2022-07-05T11:46:09.012463+0000","last_fullsized":"2022-07-05T11:46:09.012463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028223+0000","last_change":"2022-07-05T11:46:09.013932+0000","last_active":"2022-07-05T11:46:09.028223+0000","last_peered":"2022-07-05T11:46:09.028223+0000","last_clean":"2022-07-05T11:46:09.028223+0000","last_became_active":"2022-07-05T11:46:09.013609+0000","last_became_peered":"2022-07-05T11:46:09.013609+0000","last_unstale":"2022-07-05T11:46:09.028223+0000","last_undegraded":"2022-07-05T11:46:09.028223+0000","last_fullsized":"2022-07-05T11:46:09.028223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028226+0000","last_change":"2022-07-05T11:46:09.016568+0000","last_active":"2022-07-05T11:46:09.028226+0000","last_peered":"2022-07-05T11:46:09.028226+0000","last_clean":"2022-07-05T11:46:09.028226+0000","last_became_active":"2022-07-05T11:46:09.016162+0000","last_became_peered":"2022-07-05T11:46:09.016162+0000","last_unstale":"2022-07-05T11:46:09.028226+0000","last_undegraded":"2022-07-05T11:46:09.028226+0000","last_fullsized":"2022-07-05T11:46:09.028226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353595+0000","last_change":"2022-07-05T11:46:04.208656+0000","last_active":"2022-07-05T11:46:20.353595+0000","last_peered":"2022-07-05T11:46:20.353595+0000","last_clean":"2022-07-05T11:46:20.353595+0000","last_became_active":"2022-07-05T11:46:04.208394+0000","last_became_peered":"2022-07-05T11:46:04.208394+0000","last_unstale":"2022-07-05T11:46:20.353595+0000","last_undegraded":"2022-07-05T11:46:20.353595+0000","last_fullsized":"2022-07-05T11:46:20.353595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027906+0000","last_change":"2022-07-05T11:46:04.600156+0000","last_active":"2022-07-05T11:46:09.027906+0000","last_peered":"2022-07-05T11:46:09.027906+0000","last_clean":"2022-07-05T11:46:09.027906+0000","last_became_active":"2022-07-05T11:46:04.599836+0000","last_became_peered":"2022-07-05T11:46:04.599836+0000","last_unstale":"2022-07-05T11:46:09.027906+0000","last_undegraded":"2022-07-05T11:46:09.027906+0000","last_fullsized":"2022-07-05T11:46:09.027906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027863+0000","last_change":"2022-07-05T11:46:04.599555+0000","last_active":"2022-07-05T11:46:09.027863+0000","last_peered":"2022-07-05T11:46:09.027863+0000","last_clean":"2022-07-05T11:46:09.027863+0000","last_became_active":"2022-07-05T11:46:04.597036+0000","last_became_peered":"2022-07-05T11:46:04.597036+0000","last_unstale":"2022-07-05T11:46:09.027863+0000","last_undegraded":"2022-07-05T11:46:09.027863+0000","last_fullsized":"2022-07-05T11:46:09.027863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.357392+0000","last_change":"2022-07-05T11:46:04.215037+0000","last_active":"2022-07-05T11:46:21.357392+0000","last_peered":"2022-07-05T11:46:21.357392+0000","last_clean":"2022-07-05T11:46:21.357392+0000","last_became_active":"2022-07-05T11:46:04.214699+0000","last_became_peered":"2022-07-05T11:46:04.214699+0000","last_unstale":"2022-07-05T11:46:21.357392+0000","last_undegraded":"2022-07-05T11:46:21.357392+0000","last_fullsized":"2022-07-05T11:46:21.357392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012966+0000","last_change":"2022-07-05T11:46:00.405416+0000","last_active":"2022-07-05T11:46:09.012966+0000","last_peered":"2022-07-05T11:46:09.012966+0000","last_clean":"2022-07-05T11:46:09.012966+0000","last_became_active":"2022-07-05T11:46:00.405179+0000","last_became_peered":"2022-07-05T11:46:00.405179+0000","last_unstale":"2022-07-05T11:46:09.012966+0000","last_undegraded":"2022-07-05T11:46:09.012966+0000","last_fullsized":"2022-07-05T11:46:09.012966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027570+0000","last_change":"2022-07-05T11:46:08.616541+0000","last_active":"2022-07-05T11:46:09.027570+0000","last_peered":"2022-07-05T11:46:09.027570+0000","last_clean":"2022-07-05T11:46:09.027570+0000","last_became_active":"2022-07-05T11:46:08.616124+0000","last_became_peered":"2022-07-05T11:46:08.616124+0000","last_unstale":"2022-07-05T11:46:09.027570+0000","last_undegraded":"2022-07-05T11:46:09.027570+0000","last_fullsized":"2022-07-05T11:46:09.027570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028425+0000","last_change":"2022-07-05T11:46:04.584095+0000","last_active":"2022-07-05T11:46:09.028425+0000","last_peered":"2022-07-05T11:46:09.028425+0000","last_clean":"2022-07-05T11:46:09.028425+0000","last_became_active":"2022-07-05T11:46:04.583806+0000","last_became_peered":"2022-07-05T11:46:04.583806+0000","last_unstale":"2022-07-05T11:46:09.028425+0000","last_undegraded":"2022-07-05T11:46:09.028425+0000","last_fullsized":"2022-07-05T11:46:09.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974096+0000","last_change":"2022-07-05T11:46:00.174377+0000","last_active":"2022-07-05T11:46:08.974096+0000","last_peered":"2022-07-05T11:46:08.974096+0000","last_clean":"2022-07-05T11:46:08.974096+0000","last_became_active":"2022-07-05T11:46:00.174041+0000","last_became_peered":"2022-07-05T11:46:00.174041+0000","last_unstale":"2022-07-05T11:46:08.974096+0000","last_undegraded":"2022-07-05T11:46:08.974096+0000","last_fullsized":"2022-07-05T11:46:08.974096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029651+0000","last_change":"2022-07-05T11:46:04.201186+0000","last_active":"2022-07-05T11:46:09.029651+0000","last_peered":"2022-07-05T11:46:09.029651+0000","last_clean":"2022-07-05T11:46:09.029651+0000","last_became_active":"2022-07-05T11:46:04.200331+0000","last_became_peered":"2022-07-05T11:46:04.200331+0000","last_unstale":"2022-07-05T11:46:09.029651+0000","last_undegraded":"2022-07-05T11:46:09.029651+0000","last_fullsized":"2022-07-05T11:46:09.029651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012267+0000","last_change":"2022-07-05T11:46:08.617187+0000","last_active":"2022-07-05T11:46:09.012267+0000","last_peered":"2022-07-05T11:46:09.012267+0000","last_clean":"2022-07-05T11:46:09.012267+0000","last_became_active":"2022-07-05T11:46:08.616787+0000","last_became_peered":"2022-07-05T11:46:08.616787+0000","last_unstale":"2022-07-05T11:46:09.012267+0000","last_undegraded":"2022-07-05T11:46:09.012267+0000","last_fullsized":"2022-07-05T11:46:09.012267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974758+0000","last_change":"2022-07-05T11:46:04.595606+0000","last_active":"2022-07-05T11:46:08.974758+0000","last_peered":"2022-07-05T11:46:08.974758+0000","last_clean":"2022-07-05T11:46:08.974758+0000","last_became_active":"2022-07-05T11:46:04.594962+0000","last_became_peered":"2022-07-05T11:46:04.594962+0000","last_unstale":"2022-07-05T11:46:08.974758+0000","last_undegraded":"2022-07-05T11:46:08.974758+0000","last_fullsized":"2022-07-05T11:46:08.974758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028691+0000","last_change":"2022-07-05T11:46:04.208492+0000","last_active":"2022-07-05T11:46:09.028691+0000","last_peered":"2022-07-05T11:46:09.028691+0000","last_clean":"2022-07-05T11:46:09.028691+0000","last_became_active":"2022-07-05T11:46:04.208135+0000","last_became_peered":"2022-07-05T11:46:04.208135+0000","last_unstale":"2022-07-05T11:46:09.028691+0000","last_undegraded":"2022-07-05T11:46:09.028691+0000","last_fullsized":"2022-07-05T11:46:09.028691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028400+0000","last_change":"2022-07-05T11:46:01.122048+0000","last_active":"2022-07-05T11:46:09.028400+0000","last_peered":"2022-07-05T11:46:09.028400+0000","last_clean":"2022-07-05T11:46:09.028400+0000","last_became_active":"2022-07-05T11:46:01.121724+0000","last_became_peered":"2022-07-05T11:46:01.121724+0000","last_unstale":"2022-07-05T11:46:09.028400+0000","last_undegraded":"2022-07-05T11:46:09.028400+0000","last_fullsized":"2022-07-05T11:46:09.028400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029610+0000","last_change":"2022-07-05T11:46:08.614936+0000","last_active":"2022-07-05T11:46:09.029610+0000","last_peered":"2022-07-05T11:46:09.029610+0000","last_clean":"2022-07-05T11:46:09.029610+0000","last_became_active":"2022-07-05T11:46:08.613212+0000","last_became_peered":"2022-07-05T11:46:08.613212+0000","last_unstale":"2022-07-05T11:46:09.029610+0000","last_undegraded":"2022-07-05T11:46:09.029610+0000","last_fullsized":"2022-07-05T11:46:09.029610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358743+0000","last_change":"2022-07-05T11:46:04.207235+0000","last_active":"2022-07-05T11:46:21.358743+0000","last_peered":"2022-07-05T11:46:21.358743+0000","last_clean":"2022-07-05T11:46:21.358743+0000","last_became_active":"2022-07-05T11:46:04.206912+0000","last_became_peered":"2022-07-05T11:46:04.206912+0000","last_unstale":"2022-07-05T11:46:21.358743+0000","last_undegraded":"2022-07-05T11:46:21.358743+0000","last_fullsized":"2022-07-05T11:46:21.358743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027868+0000","last_change":"2022-07-05T11:46:00.387606+0000","last_active":"2022-07-05T11:46:09.027868+0000","last_peered":"2022-07-05T11:46:09.027868+0000","last_clean":"2022-07-05T11:46:09.027868+0000","last_became_active":"2022-07-05T11:46:00.387285+0000","last_became_peered":"2022-07-05T11:46:00.387285+0000","last_unstale":"2022-07-05T11:46:09.027868+0000","last_undegraded":"2022-07-05T11:46:09.027868+0000","last_fullsized":"2022-07-05T11:46:09.027868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975087+0000","last_change":"2022-07-05T11:46:04.597434+0000","last_active":"2022-07-05T11:46:08.975087+0000","last_peered":"2022-07-05T11:46:08.975087+0000","last_clean":"2022-07-05T11:46:08.975087+0000","last_became_active":"2022-07-05T11:46:04.596283+0000","last_became_peered":"2022-07-05T11:46:04.596283+0000","last_unstale":"2022-07-05T11:46:08.975087+0000","last_undegraded":"2022-07-05T11:46:08.975087+0000","last_fullsized":"2022-07-05T11:46:08.975087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030525+0000","last_change":"2022-07-05T11:46:08.618008+0000","last_active":"2022-07-05T11:46:09.030525+0000","last_peered":"2022-07-05T11:46:09.030525+0000","last_clean":"2022-07-05T11:46:09.030525+0000","last_became_active":"2022-07-05T11:46:08.617640+0000","last_became_peered":"2022-07-05T11:46:08.617640+0000","last_unstale":"2022-07-05T11:46:09.030525+0000","last_undegraded":"2022-07-05T11:46:09.030525+0000","last_fullsized":"2022-07-05T11:46:09.030525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407205+0000","last_change":"2022-07-05T11:46:04.205557+0000","last_active":"2022-07-05T11:46:10.407205+0000","last_peered":"2022-07-05T11:46:10.407205+0000","last_clean":"2022-07-05T11:46:10.407205+0000","last_became_active":"2022-07-05T11:46:04.203760+0000","last_became_peered":"2022-07-05T11:46:04.203760+0000","last_unstale":"2022-07-05T11:46:10.407205+0000","last_undegraded":"2022-07-05T11:46:10.407205+0000","last_fullsized":"2022-07-05T11:46:10.407205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027789+0000","last_change":"2022-07-05T11:45:58.489958+0000","last_active":"2022-07-05T11:46:09.027789+0000","last_peered":"2022-07-05T11:46:09.027789+0000","last_clean":"2022-07-05T11:46:09.027789+0000","last_became_active":"2022-07-05T11:45:58.489710+0000","last_became_peered":"2022-07-05T11:45:58.489710+0000","last_unstale":"2022-07-05T11:46:09.027789+0000","last_undegraded":"2022-07-05T11:46:09.027789+0000","last_fullsized":"2022-07-05T11:46:09.027789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_clean_scrub_stamp":"2022-07-05T11:45:57.143009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012518+0000","last_change":"2022-07-05T11:46:01.154008+0000","last_active":"2022-07-05T11:46:09.012518+0000","last_peered":"2022-07-05T11:46:09.012518+0000","last_clean":"2022-07-05T11:46:09.012518+0000","last_became_active":"2022-07-05T11:46:01.153653+0000","last_became_peered":"2022-07-05T11:46:01.153653+0000","last_unstale":"2022-07-05T11:46:09.012518+0000","last_undegraded":"2022-07-05T11:46:09.012518+0000","last_fullsized":"2022-07-05T11:46:09.012518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029959+0000","last_change":"2022-07-05T11:46:04.597444+0000","last_active":"2022-07-05T11:46:09.029959+0000","last_peered":"2022-07-05T11:46:09.029959+0000","last_clean":"2022-07-05T11:46:09.029959+0000","last_became_active":"2022-07-05T11:46:04.597199+0000","last_became_peered":"2022-07-05T11:46:04.597199+0000","last_unstale":"2022-07-05T11:46:09.029959+0000","last_undegraded":"2022-07-05T11:46:09.029959+0000","last_fullsized":"2022-07-05T11:46:09.029959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028215+0000","last_change":"2022-07-05T11:46:09.017084+0000","last_active":"2022-07-05T11:46:09.028215+0000","last_peered":"2022-07-05T11:46:09.028215+0000","last_clean":"2022-07-05T11:46:09.028215+0000","last_became_active":"2022-07-05T11:46:09.016658+0000","last_became_peered":"2022-07-05T11:46:09.016658+0000","last_unstale":"2022-07-05T11:46:09.028215+0000","last_undegraded":"2022-07-05T11:46:09.028215+0000","last_fullsized":"2022-07-05T11:46:09.028215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358568+0000","last_change":"2022-07-05T11:46:04.209767+0000","last_active":"2022-07-05T11:46:21.358568+0000","last_peered":"2022-07-05T11:46:21.358568+0000","last_clean":"2022-07-05T11:46:21.358568+0000","last_became_active":"2022-07-05T11:46:04.209524+0000","last_became_peered":"2022-07-05T11:46:04.209524+0000","last_unstale":"2022-07-05T11:46:21.358568+0000","last_undegraded":"2022-07-05T11:46:21.358568+0000","last_fullsized":"2022-07-05T11:46:21.358568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028541+0000","last_change":"2022-07-05T11:46:01.118061+0000","last_active":"2022-07-05T11:46:09.028541+0000","last_peered":"2022-07-05T11:46:09.028541+0000","last_clean":"2022-07-05T11:46:09.028541+0000","last_became_active":"2022-07-05T11:46:01.117762+0000","last_became_peered":"2022-07-05T11:46:01.117762+0000","last_unstale":"2022-07-05T11:46:09.028541+0000","last_undegraded":"2022-07-05T11:46:09.028541+0000","last_fullsized":"2022-07-05T11:46:09.028541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028916+0000","last_change":"2022-07-05T11:46:04.594377+0000","last_active":"2022-07-05T11:46:09.028916+0000","last_peered":"2022-07-05T11:46:09.028916+0000","last_clean":"2022-07-05T11:46:09.028916+0000","last_became_active":"2022-07-05T11:46:04.594103+0000","last_became_peered":"2022-07-05T11:46:04.594103+0000","last_unstale":"2022-07-05T11:46:09.028916+0000","last_undegraded":"2022-07-05T11:46:09.028916+0000","last_fullsized":"2022-07-05T11:46:09.028916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017137+0000","last_change":"2022-07-05T11:46:09.014687+0000","last_active":"2022-07-05T11:46:09.017137+0000","last_peered":"2022-07-05T11:46:09.017137+0000","last_clean":"2022-07-05T11:46:09.017137+0000","last_became_active":"2022-07-05T11:46:09.014298+0000","last_became_peered":"2022-07-05T11:46:09.014298+0000","last_unstale":"2022-07-05T11:46:09.017137+0000","last_undegraded":"2022-07-05T11:46:09.017137+0000","last_fullsized":"2022-07-05T11:46:09.017137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028627+0000","last_change":"2022-07-05T11:46:04.593068+0000","last_active":"2022-07-05T11:46:09.028627+0000","last_peered":"2022-07-05T11:46:09.028627+0000","last_clean":"2022-07-05T11:46:09.028627+0000","last_became_active":"2022-07-05T11:46:04.592770+0000","last_became_peered":"2022-07-05T11:46:04.592770+0000","last_unstale":"2022-07-05T11:46:09.028627+0000","last_undegraded":"2022-07-05T11:46:09.028627+0000","last_fullsized":"2022-07-05T11:46:09.028627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352860+0000","last_change":"2022-07-05T11:46:04.205846+0000","last_active":"2022-07-05T11:46:20.352860+0000","last_peered":"2022-07-05T11:46:20.352860+0000","last_clean":"2022-07-05T11:46:20.352860+0000","last_became_active":"2022-07-05T11:46:04.205358+0000","last_became_peered":"2022-07-05T11:46:04.205358+0000","last_unstale":"2022-07-05T11:46:20.352860+0000","last_undegraded":"2022-07-05T11:46:20.352860+0000","last_fullsized":"2022-07-05T11:46:20.352860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028856+0000","last_change":"2022-07-05T11:46:00.171709+0000","last_active":"2022-07-05T11:46:09.028856+0000","last_peered":"2022-07-05T11:46:09.028856+0000","last_clean":"2022-07-05T11:46:09.028856+0000","last_became_active":"2022-07-05T11:46:00.171328+0000","last_became_peered":"2022-07-05T11:46:00.171328+0000","last_unstale":"2022-07-05T11:46:09.028856+0000","last_undegraded":"2022-07-05T11:46:09.028856+0000","last_fullsized":"2022-07-05T11:46:09.028856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017640+0000","last_change":"2022-07-05T11:46:09.015332+0000","last_active":"2022-07-05T11:46:09.017640+0000","last_peered":"2022-07-05T11:46:09.017640+0000","last_clean":"2022-07-05T11:46:09.017640+0000","last_became_active":"2022-07-05T11:46:09.013688+0000","last_became_peered":"2022-07-05T11:46:09.013688+0000","last_unstale":"2022-07-05T11:46:09.017640+0000","last_undegraded":"2022-07-05T11:46:09.017640+0000","last_fullsized":"2022-07-05T11:46:09.017640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028419+0000","last_change":"2022-07-05T11:46:04.600986+0000","last_active":"2022-07-05T11:46:09.028419+0000","last_peered":"2022-07-05T11:46:09.028419+0000","last_clean":"2022-07-05T11:46:09.028419+0000","last_became_active":"2022-07-05T11:46:04.600619+0000","last_became_peered":"2022-07-05T11:46:04.600619+0000","last_unstale":"2022-07-05T11:46:09.028419+0000","last_undegraded":"2022-07-05T11:46:09.028419+0000","last_fullsized":"2022-07-05T11:46:09.028419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030201+0000","last_change":"2022-07-05T11:46:04.201044+0000","last_active":"2022-07-05T11:46:09.030201+0000","last_peered":"2022-07-05T11:46:09.030201+0000","last_clean":"2022-07-05T11:46:09.030201+0000","last_became_active":"2022-07-05T11:46:04.200743+0000","last_became_peered":"2022-07-05T11:46:04.200743+0000","last_unstale":"2022-07-05T11:46:09.030201+0000","last_undegraded":"2022-07-05T11:46:09.030201+0000","last_fullsized":"2022-07-05T11:46:09.030201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974024+0000","last_change":"2022-07-05T11:46:00.406891+0000","last_active":"2022-07-05T11:46:08.974024+0000","last_peered":"2022-07-05T11:46:08.974024+0000","last_clean":"2022-07-05T11:46:08.974024+0000","last_became_active":"2022-07-05T11:46:00.406555+0000","last_became_peered":"2022-07-05T11:46:00.406555+0000","last_unstale":"2022-07-05T11:46:08.974024+0000","last_undegraded":"2022-07-05T11:46:08.974024+0000","last_fullsized":"2022-07-05T11:46:08.974024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027228+0000","last_change":"2022-07-05T11:46:09.014076+0000","last_active":"2022-07-05T11:46:09.027228+0000","last_peered":"2022-07-05T11:46:09.027228+0000","last_clean":"2022-07-05T11:46:09.027228+0000","last_became_active":"2022-07-05T11:46:09.013674+0000","last_became_peered":"2022-07-05T11:46:09.013674+0000","last_unstale":"2022-07-05T11:46:09.027228+0000","last_undegraded":"2022-07-05T11:46:09.027228+0000","last_fullsized":"2022-07-05T11:46:09.027228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974896+0000","last_change":"2022-07-05T11:46:04.204890+0000","last_active":"2022-07-05T11:46:08.974896+0000","last_peered":"2022-07-05T11:46:08.974896+0000","last_clean":"2022-07-05T11:46:08.974896+0000","last_became_active":"2022-07-05T11:46:04.204615+0000","last_became_peered":"2022-07-05T11:46:04.204615+0000","last_unstale":"2022-07-05T11:46:08.974896+0000","last_undegraded":"2022-07-05T11:46:08.974896+0000","last_fullsized":"2022-07-05T11:46:08.974896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974109+0000","last_change":"2022-07-05T11:46:04.592359+0000","last_active":"2022-07-05T11:46:08.974109+0000","last_peered":"2022-07-05T11:46:08.974109+0000","last_clean":"2022-07-05T11:46:08.974109+0000","last_became_active":"2022-07-05T11:46:04.592112+0000","last_became_peered":"2022-07-05T11:46:04.592112+0000","last_unstale":"2022-07-05T11:46:08.974109+0000","last_undegraded":"2022-07-05T11:46:08.974109+0000","last_fullsized":"2022-07-05T11:46:08.974109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027403+0000","last_change":"2022-07-05T11:46:09.016814+0000","last_active":"2022-07-05T11:46:09.027403+0000","last_peered":"2022-07-05T11:46:09.027403+0000","last_clean":"2022-07-05T11:46:09.027403+0000","last_became_active":"2022-07-05T11:46:09.016282+0000","last_became_peered":"2022-07-05T11:46:09.016282+0000","last_unstale":"2022-07-05T11:46:09.027403+0000","last_undegraded":"2022-07-05T11:46:09.027403+0000","last_fullsized":"2022-07-05T11:46:09.027403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353211+0000","last_change":"2022-07-05T11:46:04.199484+0000","last_active":"2022-07-05T11:46:20.353211+0000","last_peered":"2022-07-05T11:46:20.353211+0000","last_clean":"2022-07-05T11:46:20.353211+0000","last_became_active":"2022-07-05T11:46:04.199190+0000","last_became_peered":"2022-07-05T11:46:04.199190+0000","last_unstale":"2022-07-05T11:46:20.353211+0000","last_undegraded":"2022-07-05T11:46:20.353211+0000","last_fullsized":"2022-07-05T11:46:20.353211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012845+0000","last_change":"2022-07-05T11:46:04.594175+0000","last_active":"2022-07-05T11:46:09.012845+0000","last_peered":"2022-07-05T11:46:09.012845+0000","last_clean":"2022-07-05T11:46:09.012845+0000","last_became_active":"2022-07-05T11:46:04.593700+0000","last_became_peered":"2022-07-05T11:46:04.593700+0000","last_unstale":"2022-07-05T11:46:09.012845+0000","last_undegraded":"2022-07-05T11:46:09.012845+0000","last_fullsized":"2022-07-05T11:46:09.012845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013139+0000","last_change":"2022-07-05T11:46:08.614509+0000","last_active":"2022-07-05T11:46:09.013139+0000","last_peered":"2022-07-05T11:46:09.013139+0000","last_clean":"2022-07-05T11:46:09.013139+0000","last_became_active":"2022-07-05T11:46:08.613935+0000","last_became_peered":"2022-07-05T11:46:08.613935+0000","last_unstale":"2022-07-05T11:46:09.013139+0000","last_undegraded":"2022-07-05T11:46:09.013139+0000","last_fullsized":"2022-07-05T11:46:09.013139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028943+0000","last_change":"2022-07-05T11:46:04.210344+0000","last_active":"2022-07-05T11:46:09.028943+0000","last_peered":"2022-07-05T11:46:09.028943+0000","last_clean":"2022-07-05T11:46:09.028943+0000","last_became_active":"2022-07-05T11:46:04.210054+0000","last_became_peered":"2022-07-05T11:46:04.210054+0000","last_unstale":"2022-07-05T11:46:09.028943+0000","last_undegraded":"2022-07-05T11:46:09.028943+0000","last_fullsized":"2022-07-05T11:46:09.028943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013018+0000","last_change":"2022-07-05T11:46:04.601851+0000","last_active":"2022-07-05T11:46:09.013018+0000","last_peered":"2022-07-05T11:46:09.013018+0000","last_clean":"2022-07-05T11:46:09.013018+0000","last_became_active":"2022-07-05T11:46:04.601528+0000","last_became_peered":"2022-07-05T11:46:04.601528+0000","last_unstale":"2022-07-05T11:46:09.013018+0000","last_undegraded":"2022-07-05T11:46:09.013018+0000","last_fullsized":"2022-07-05T11:46:09.013018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029283+0000","last_change":"2022-07-05T11:46:08.613389+0000","last_active":"2022-07-05T11:46:09.029283+0000","last_peered":"2022-07-05T11:46:09.029283+0000","last_clean":"2022-07-05T11:46:09.029283+0000","last_became_active":"2022-07-05T11:46:08.612988+0000","last_became_peered":"2022-07-05T11:46:08.612988+0000","last_unstale":"2022-07-05T11:46:09.029283+0000","last_undegraded":"2022-07-05T11:46:09.029283+0000","last_fullsized":"2022-07-05T11:46:09.029283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028447+0000","last_change":"2022-07-05T11:46:04.203173+0000","last_active":"2022-07-05T11:46:09.028447+0000","last_peered":"2022-07-05T11:46:09.028447+0000","last_clean":"2022-07-05T11:46:09.028447+0000","last_became_active":"2022-07-05T11:46:04.202879+0000","last_became_peered":"2022-07-05T11:46:04.202879+0000","last_unstale":"2022-07-05T11:46:09.028447+0000","last_undegraded":"2022-07-05T11:46:09.028447+0000","last_fullsized":"2022-07-05T11:46:09.028447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013005+0000","last_change":"2022-07-05T11:46:04.593203+0000","last_active":"2022-07-05T11:46:09.013005+0000","last_peered":"2022-07-05T11:46:09.013005+0000","last_clean":"2022-07-05T11:46:09.013005+0000","last_became_active":"2022-07-05T11:46:04.592953+0000","last_became_peered":"2022-07-05T11:46:04.592953+0000","last_unstale":"2022-07-05T11:46:09.013005+0000","last_undegraded":"2022-07-05T11:46:09.013005+0000","last_fullsized":"2022-07-05T11:46:09.013005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975419+0000","last_change":"2022-07-05T11:46:08.617348+0000","last_active":"2022-07-05T11:46:08.975419+0000","last_peered":"2022-07-05T11:46:08.975419+0000","last_clean":"2022-07-05T11:46:08.975419+0000","last_became_active":"2022-07-05T11:46:08.616964+0000","last_became_peered":"2022-07-05T11:46:08.616964+0000","last_unstale":"2022-07-05T11:46:08.975419+0000","last_undegraded":"2022-07-05T11:46:08.975419+0000","last_fullsized":"2022-07-05T11:46:08.975419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.213520+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.213132+0000","last_became_peered":"2022-07-05T11:46:04.213132+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027579+0000","last_change":"2022-07-05T11:46:04.589449+0000","last_active":"2022-07-05T11:46:09.027579+0000","last_peered":"2022-07-05T11:46:09.027579+0000","last_clean":"2022-07-05T11:46:09.027579+0000","last_became_active":"2022-07-05T11:46:04.589174+0000","last_became_peered":"2022-07-05T11:46:04.589174+0000","last_unstale":"2022-07-05T11:46:09.027579+0000","last_undegraded":"2022-07-05T11:46:09.027579+0000","last_fullsized":"2022-07-05T11:46:09.027579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027455+0000","last_change":"2022-07-05T11:46:08.617763+0000","last_active":"2022-07-05T11:46:09.027455+0000","last_peered":"2022-07-05T11:46:09.027455+0000","last_clean":"2022-07-05T11:46:09.027455+0000","last_became_active":"2022-07-05T11:46:08.617423+0000","last_became_peered":"2022-07-05T11:46:08.617423+0000","last_unstale":"2022-07-05T11:46:09.027455+0000","last_undegraded":"2022-07-05T11:46:09.027455+0000","last_fullsized":"2022-07-05T11:46:09.027455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030147+0000","last_change":"2022-07-05T11:46:04.211055+0000","last_active":"2022-07-05T11:46:09.030147+0000","last_peered":"2022-07-05T11:46:09.030147+0000","last_clean":"2022-07-05T11:46:09.030147+0000","last_became_active":"2022-07-05T11:46:04.210609+0000","last_became_peered":"2022-07-05T11:46:04.210609+0000","last_unstale":"2022-07-05T11:46:09.030147+0000","last_undegraded":"2022-07-05T11:46:09.030147+0000","last_fullsized":"2022-07-05T11:46:09.030147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028195+0000","last_change":"2022-07-05T11:46:04.583067+0000","last_active":"2022-07-05T11:46:09.028195+0000","last_peered":"2022-07-05T11:46:09.028195+0000","last_clean":"2022-07-05T11:46:09.028195+0000","last_became_active":"2022-07-05T11:46:04.582776+0000","last_became_peered":"2022-07-05T11:46:04.582776+0000","last_unstale":"2022-07-05T11:46:09.028195+0000","last_undegraded":"2022-07-05T11:46:09.028195+0000","last_fullsized":"2022-07-05T11:46:09.028195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975477+0000","last_change":"2022-07-05T11:46:08.619668+0000","last_active":"2022-07-05T11:46:08.975477+0000","last_peered":"2022-07-05T11:46:08.975477+0000","last_clean":"2022-07-05T11:46:08.975477+0000","last_became_active":"2022-07-05T11:46:08.619010+0000","last_became_peered":"2022-07-05T11:46:08.619010+0000","last_unstale":"2022-07-05T11:46:08.975477+0000","last_undegraded":"2022-07-05T11:46:08.975477+0000","last_fullsized":"2022-07-05T11:46:08.975477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975957+0000","last_change":"2022-07-05T11:46:04.202962+0000","last_active":"2022-07-05T11:46:08.975957+0000","last_peered":"2022-07-05T11:46:08.975957+0000","last_clean":"2022-07-05T11:46:08.975957+0000","last_became_active":"2022-07-05T11:46:04.202639+0000","last_became_peered":"2022-07-05T11:46:04.202639+0000","last_unstale":"2022-07-05T11:46:08.975957+0000","last_undegraded":"2022-07-05T11:46:08.975957+0000","last_fullsized":"2022-07-05T11:46:08.975957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975054+0000","last_change":"2022-07-05T11:46:04.595796+0000","last_active":"2022-07-05T11:46:08.975054+0000","last_peered":"2022-07-05T11:46:08.975054+0000","last_clean":"2022-07-05T11:46:08.975054+0000","last_became_active":"2022-07-05T11:46:04.595457+0000","last_became_peered":"2022-07-05T11:46:04.595457+0000","last_unstale":"2022-07-05T11:46:08.975054+0000","last_undegraded":"2022-07-05T11:46:08.975054+0000","last_fullsized":"2022-07-05T11:46:08.975054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027470+0000","last_change":"2022-07-05T11:46:08.617306+0000","last_active":"2022-07-05T11:46:09.027470+0000","last_peered":"2022-07-05T11:46:09.027470+0000","last_clean":"2022-07-05T11:46:09.027470+0000","last_became_active":"2022-07-05T11:46:08.616927+0000","last_became_peered":"2022-07-05T11:46:08.616927+0000","last_unstale":"2022-07-05T11:46:09.027470+0000","last_undegraded":"2022-07-05T11:46:09.027470+0000","last_fullsized":"2022-07-05T11:46:09.027470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030413+0000","last_change":"2022-07-05T11:46:04.205780+0000","last_active":"2022-07-05T11:46:09.030413+0000","last_peered":"2022-07-05T11:46:09.030413+0000","last_clean":"2022-07-05T11:46:09.030413+0000","last_became_active":"2022-07-05T11:46:04.205486+0000","last_became_peered":"2022-07-05T11:46:04.205486+0000","last_unstale":"2022-07-05T11:46:09.030413+0000","last_undegraded":"2022-07-05T11:46:09.030413+0000","last_fullsized":"2022-07-05T11:46:09.030413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974611+0000","last_change":"2022-07-05T11:46:04.606819+0000","last_active":"2022-07-05T11:46:08.974611+0000","last_peered":"2022-07-05T11:46:08.974611+0000","last_clean":"2022-07-05T11:46:08.974611+0000","last_became_active":"2022-07-05T11:46:04.606484+0000","last_became_peered":"2022-07-05T11:46:04.606484+0000","last_unstale":"2022-07-05T11:46:08.974611+0000","last_undegraded":"2022-07-05T11:46:08.974611+0000","last_fullsized":"2022-07-05T11:46:08.974611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028555+0000","last_change":"2022-07-05T11:46:08.617224+0000","last_active":"2022-07-05T11:46:09.028555+0000","last_peered":"2022-07-05T11:46:09.028555+0000","last_clean":"2022-07-05T11:46:09.028555+0000","last_became_active":"2022-07-05T11:46:08.616821+0000","last_became_peered":"2022-07-05T11:46:08.616821+0000","last_unstale":"2022-07-05T11:46:09.028555+0000","last_undegraded":"2022-07-05T11:46:09.028555+0000","last_fullsized":"2022-07-05T11:46:09.028555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.170891+0000","last_change":"2022-07-05T11:46:04.204034+0000","last_active":"2022-07-05T11:46:10.170891+0000","last_peered":"2022-07-05T11:46:10.170891+0000","last_clean":"2022-07-05T11:46:10.170891+0000","last_became_active":"2022-07-05T11:46:04.203694+0000","last_became_peered":"2022-07-05T11:46:04.203694+0000","last_unstale":"2022-07-05T11:46:10.170891+0000","last_undegraded":"2022-07-05T11:46:10.170891+0000","last_fullsized":"2022-07-05T11:46:10.170891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974125+0000","last_change":"2022-07-05T11:46:04.593441+0000","last_active":"2022-07-05T11:46:08.974125+0000","last_peered":"2022-07-05T11:46:08.974125+0000","last_clean":"2022-07-05T11:46:08.974125+0000","last_became_active":"2022-07-05T11:46:04.593175+0000","last_became_peered":"2022-07-05T11:46:04.593175+0000","last_unstale":"2022-07-05T11:46:08.974125+0000","last_undegraded":"2022-07-05T11:46:08.974125+0000","last_fullsized":"2022-07-05T11:46:08.974125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028366+0000","last_change":"2022-07-05T11:46:09.016544+0000","last_active":"2022-07-05T11:46:09.028366+0000","last_peered":"2022-07-05T11:46:09.028366+0000","last_clean":"2022-07-05T11:46:09.028366+0000","last_became_active":"2022-07-05T11:46:09.016045+0000","last_became_peered":"2022-07-05T11:46:09.016045+0000","last_unstale":"2022-07-05T11:46:09.028366+0000","last_undegraded":"2022-07-05T11:46:09.028366+0000","last_fullsized":"2022-07-05T11:46:09.028366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358969+0000","last_change":"2022-07-05T11:46:04.207209+0000","last_active":"2022-07-05T11:46:21.358969+0000","last_peered":"2022-07-05T11:46:21.358969+0000","last_clean":"2022-07-05T11:46:21.358969+0000","last_became_active":"2022-07-05T11:46:04.206333+0000","last_became_peered":"2022-07-05T11:46:04.206333+0000","last_unstale":"2022-07-05T11:46:21.358969+0000","last_undegraded":"2022-07-05T11:46:21.358969+0000","last_fullsized":"2022-07-05T11:46:21.358969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029985+0000","last_change":"2022-07-05T11:46:04.591635+0000","last_active":"2022-07-05T11:46:09.029985+0000","last_peered":"2022-07-05T11:46:09.029985+0000","last_clean":"2022-07-05T11:46:09.029985+0000","last_became_active":"2022-07-05T11:46:04.591370+0000","last_became_peered":"2022-07-05T11:46:04.591370+0000","last_unstale":"2022-07-05T11:46:09.029985+0000","last_undegraded":"2022-07-05T11:46:09.029985+0000","last_fullsized":"2022-07-05T11:46:09.029985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029798+0000","last_change":"2022-07-05T11:46:08.617287+0000","last_active":"2022-07-05T11:46:09.029798+0000","last_peered":"2022-07-05T11:46:09.029798+0000","last_clean":"2022-07-05T11:46:09.029798+0000","last_became_active":"2022-07-05T11:46:08.616929+0000","last_became_peered":"2022-07-05T11:46:08.616929+0000","last_unstale":"2022-07-05T11:46:09.029798+0000","last_undegraded":"2022-07-05T11:46:09.029798+0000","last_fullsized":"2022-07-05T11:46:09.029798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352160+0000","last_change":"2022-07-05T11:46:04.207520+0000","last_active":"2022-07-05T11:46:20.352160+0000","last_peered":"2022-07-05T11:46:20.352160+0000","last_clean":"2022-07-05T11:46:20.352160+0000","last_became_active":"2022-07-05T11:46:04.207167+0000","last_became_peered":"2022-07-05T11:46:04.207167+0000","last_unstale":"2022-07-05T11:46:20.352160+0000","last_undegraded":"2022-07-05T11:46:20.352160+0000","last_fullsized":"2022-07-05T11:46:20.352160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975400+0000","last_change":"2022-07-05T11:46:04.606473+0000","last_active":"2022-07-05T11:46:08.975400+0000","last_peered":"2022-07-05T11:46:08.975400+0000","last_clean":"2022-07-05T11:46:08.975400+0000","last_became_active":"2022-07-05T11:46:04.606183+0000","last_became_peered":"2022-07-05T11:46:04.606183+0000","last_unstale":"2022-07-05T11:46:08.975400+0000","last_undegraded":"2022-07-05T11:46:08.975400+0000","last_fullsized":"2022-07-05T11:46:08.975400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029169+0000","last_change":"2022-07-05T11:46:08.615322+0000","last_active":"2022-07-05T11:46:09.029169+0000","last_peered":"2022-07-05T11:46:09.029169+0000","last_clean":"2022-07-05T11:46:09.029169+0000","last_became_active":"2022-07-05T11:46:08.614916+0000","last_became_peered":"2022-07-05T11:46:08.614916+0000","last_unstale":"2022-07-05T11:46:09.029169+0000","last_undegraded":"2022-07-05T11:46:09.029169+0000","last_fullsized":"2022-07-05T11:46:09.029169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352313+0000","last_change":"2022-07-05T11:46:04.207417+0000","last_active":"2022-07-05T11:46:20.352313+0000","last_peered":"2022-07-05T11:46:20.352313+0000","last_clean":"2022-07-05T11:46:20.352313+0000","last_became_active":"2022-07-05T11:46:04.207078+0000","last_became_peered":"2022-07-05T11:46:04.207078+0000","last_unstale":"2022-07-05T11:46:20.352313+0000","last_undegraded":"2022-07-05T11:46:20.352313+0000","last_fullsized":"2022-07-05T11:46:20.352313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976049+0000","last_change":"2022-07-05T11:46:04.597152+0000","last_active":"2022-07-05T11:46:08.976049+0000","last_peered":"2022-07-05T11:46:08.976049+0000","last_clean":"2022-07-05T11:46:08.976049+0000","last_became_active":"2022-07-05T11:46:04.596847+0000","last_became_peered":"2022-07-05T11:46:04.596847+0000","last_unstale":"2022-07-05T11:46:08.976049+0000","last_undegraded":"2022-07-05T11:46:08.976049+0000","last_fullsized":"2022-07-05T11:46:08.976049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029455+0000","last_change":"2022-07-05T11:46:08.615281+0000","last_active":"2022-07-05T11:46:09.029455+0000","last_peered":"2022-07-05T11:46:09.029455+0000","last_clean":"2022-07-05T11:46:09.029455+0000","last_became_active":"2022-07-05T11:46:08.614859+0000","last_became_peered":"2022-07-05T11:46:08.614859+0000","last_unstale":"2022-07-05T11:46:09.029455+0000","last_undegraded":"2022-07-05T11:46:09.029455+0000","last_fullsized":"2022-07-05T11:46:09.029455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029554+0000","last_change":"2022-07-05T11:46:04.209548+0000","last_active":"2022-07-05T11:46:09.029554+0000","last_peered":"2022-07-05T11:46:09.029554+0000","last_clean":"2022-07-05T11:46:09.029554+0000","last_became_active":"2022-07-05T11:46:04.209278+0000","last_became_peered":"2022-07-05T11:46:04.209278+0000","last_unstale":"2022-07-05T11:46:09.029554+0000","last_undegraded":"2022-07-05T11:46:09.029554+0000","last_fullsized":"2022-07-05T11:46:09.029554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012545+0000","last_change":"2022-07-05T11:46:04.601803+0000","last_active":"2022-07-05T11:46:09.012545+0000","last_peered":"2022-07-05T11:46:09.012545+0000","last_clean":"2022-07-05T11:46:09.012545+0000","last_became_active":"2022-07-05T11:46:04.601475+0000","last_became_peered":"2022-07-05T11:46:04.601475+0000","last_unstale":"2022-07-05T11:46:09.012545+0000","last_undegraded":"2022-07-05T11:46:09.012545+0000","last_fullsized":"2022-07-05T11:46:09.012545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028752+0000","last_change":"2022-07-05T11:46:08.617939+0000","last_active":"2022-07-05T11:46:09.028752+0000","last_peered":"2022-07-05T11:46:09.028752+0000","last_clean":"2022-07-05T11:46:09.028752+0000","last_became_active":"2022-07-05T11:46:08.617538+0000","last_became_peered":"2022-07-05T11:46:08.617538+0000","last_unstale":"2022-07-05T11:46:09.028752+0000","last_undegraded":"2022-07-05T11:46:09.028752+0000","last_fullsized":"2022-07-05T11:46:09.028752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.322288+0000","last_change":"2022-07-05T11:46:04.199561+0000","last_active":"2022-07-05T11:46:10.322288+0000","last_peered":"2022-07-05T11:46:10.322288+0000","last_clean":"2022-07-05T11:46:10.322288+0000","last_became_active":"2022-07-05T11:46:04.199232+0000","last_became_peered":"2022-07-05T11:46:04.199232+0000","last_unstale":"2022-07-05T11:46:10.322288+0000","last_undegraded":"2022-07-05T11:46:10.322288+0000","last_fullsized":"2022-07-05T11:46:10.322288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973881+0000","last_change":"2022-07-05T11:46:04.601813+0000","last_active":"2022-07-05T11:46:08.973881+0000","last_peered":"2022-07-05T11:46:08.973881+0000","last_clean":"2022-07-05T11:46:08.973881+0000","last_became_active":"2022-07-05T11:46:04.601595+0000","last_became_peered":"2022-07-05T11:46:04.601595+0000","last_unstale":"2022-07-05T11:46:08.973881+0000","last_undegraded":"2022-07-05T11:46:08.973881+0000","last_fullsized":"2022-07-05T11:46:08.973881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975282+0000","last_change":"2022-07-05T11:46:08.621246+0000","last_active":"2022-07-05T11:46:08.975282+0000","last_peered":"2022-07-05T11:46:08.975282+0000","last_clean":"2022-07-05T11:46:08.975282+0000","last_became_active":"2022-07-05T11:46:08.620839+0000","last_became_peered":"2022-07-05T11:46:08.620839+0000","last_unstale":"2022-07-05T11:46:08.975282+0000","last_undegraded":"2022-07-05T11:46:08.975282+0000","last_fullsized":"2022-07-05T11:46:08.975282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029752+0000","last_change":"2022-07-05T11:46:04.204062+0000","last_active":"2022-07-05T11:46:09.029752+0000","last_peered":"2022-07-05T11:46:09.029752+0000","last_clean":"2022-07-05T11:46:09.029752+0000","last_became_active":"2022-07-05T11:46:04.203763+0000","last_became_peered":"2022-07-05T11:46:04.203763+0000","last_unstale":"2022-07-05T11:46:09.029752+0000","last_undegraded":"2022-07-05T11:46:09.029752+0000","last_fullsized":"2022-07-05T11:46:09.029752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029094+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.029094+0000","last_peered":"2022-07-05T11:46:09.029094+0000","last_clean":"2022-07-05T11:46:09.029094+0000","last_became_active":"2022-07-05T11:46:04.595288+0000","last_became_peered":"2022-07-05T11:46:04.595288+0000","last_unstale":"2022-07-05T11:46:09.029094+0000","last_undegraded":"2022-07-05T11:46:09.029094+0000","last_fullsized":"2022-07-05T11:46:09.029094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027709+0000","last_change":"2022-07-05T11:46:08.617183+0000","last_active":"2022-07-05T11:46:09.027709+0000","last_peered":"2022-07-05T11:46:09.027709+0000","last_clean":"2022-07-05T11:46:09.027709+0000","last_became_active":"2022-07-05T11:46:08.616762+0000","last_became_peered":"2022-07-05T11:46:08.616762+0000","last_unstale":"2022-07-05T11:46:09.027709+0000","last_undegraded":"2022-07-05T11:46:09.027709+0000","last_fullsized":"2022-07-05T11:46:09.027709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353314+0000","last_change":"2022-07-05T11:46:04.206938+0000","last_active":"2022-07-05T11:46:20.353314+0000","last_peered":"2022-07-05T11:46:20.353314+0000","last_clean":"2022-07-05T11:46:20.353314+0000","last_became_active":"2022-07-05T11:46:04.206676+0000","last_became_peered":"2022-07-05T11:46:04.206676+0000","last_unstale":"2022-07-05T11:46:20.353314+0000","last_undegraded":"2022-07-05T11:46:20.353314+0000","last_fullsized":"2022-07-05T11:46:20.353314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973848+0000","last_change":"2022-07-05T11:46:04.589404+0000","last_active":"2022-07-05T11:46:08.973848+0000","last_peered":"2022-07-05T11:46:08.973848+0000","last_clean":"2022-07-05T11:46:08.973848+0000","last_became_active":"2022-07-05T11:46:04.589158+0000","last_became_peered":"2022-07-05T11:46:04.589158+0000","last_unstale":"2022-07-05T11:46:08.973848+0000","last_undegraded":"2022-07-05T11:46:08.973848+0000","last_fullsized":"2022-07-05T11:46:08.973848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028490+0000","last_change":"2022-07-05T11:46:08.619220+0000","last_active":"2022-07-05T11:46:09.028490+0000","last_peered":"2022-07-05T11:46:09.028490+0000","last_clean":"2022-07-05T11:46:09.028490+0000","last_became_active":"2022-07-05T11:46:08.618815+0000","last_became_peered":"2022-07-05T11:46:08.618815+0000","last_unstale":"2022-07-05T11:46:09.028490+0000","last_undegraded":"2022-07-05T11:46:09.028490+0000","last_fullsized":"2022-07-05T11:46:09.028490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974161+0000","last_change":"2022-07-05T11:46:08.617688+0000","last_active":"2022-07-05T11:46:08.974161+0000","last_peered":"2022-07-05T11:46:08.974161+0000","last_clean":"2022-07-05T11:46:08.974161+0000","last_became_active":"2022-07-05T11:46:08.617331+0000","last_became_peered":"2022-07-05T11:46:08.617331+0000","last_unstale":"2022-07-05T11:46:08.974161+0000","last_undegraded":"2022-07-05T11:46:08.974161+0000","last_fullsized":"2022-07-05T11:46:08.974161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029067+0000","last_change":"2022-07-05T11:46:04.199672+0000","last_active":"2022-07-05T11:46:09.029067+0000","last_peered":"2022-07-05T11:46:09.029067+0000","last_clean":"2022-07-05T11:46:09.029067+0000","last_became_active":"2022-07-05T11:46:04.199366+0000","last_became_peered":"2022-07-05T11:46:04.199366+0000","last_unstale":"2022-07-05T11:46:09.029067+0000","last_undegraded":"2022-07-05T11:46:09.029067+0000","last_fullsized":"2022-07-05T11:46:09.029067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976202+0000","last_change":"2022-07-05T11:46:04.598274+0000","last_active":"2022-07-05T11:46:08.976202+0000","last_peered":"2022-07-05T11:46:08.976202+0000","last_clean":"2022-07-05T11:46:08.976202+0000","last_became_active":"2022-07-05T11:46:04.597995+0000","last_became_peered":"2022-07-05T11:46:04.597995+0000","last_unstale":"2022-07-05T11:46:08.976202+0000","last_undegraded":"2022-07-05T11:46:08.976202+0000","last_fullsized":"2022-07-05T11:46:08.976202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030310+0000","last_change":"2022-07-05T11:46:08.612501+0000","last_active":"2022-07-05T11:46:09.030310+0000","last_peered":"2022-07-05T11:46:09.030310+0000","last_clean":"2022-07-05T11:46:09.030310+0000","last_became_active":"2022-07-05T11:46:08.611956+0000","last_became_peered":"2022-07-05T11:46:08.611956+0000","last_unstale":"2022-07-05T11:46:09.030310+0000","last_undegraded":"2022-07-05T11:46:09.030310+0000","last_fullsized":"2022-07-05T11:46:09.030310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973916+0000","last_change":"2022-07-05T11:46:04.212557+0000","last_active":"2022-07-05T11:46:08.973916+0000","last_peered":"2022-07-05T11:46:08.973916+0000","last_clean":"2022-07-05T11:46:08.973916+0000","last_became_active":"2022-07-05T11:46:04.212259+0000","last_became_peered":"2022-07-05T11:46:04.212259+0000","last_unstale":"2022-07-05T11:46:08.973916+0000","last_undegraded":"2022-07-05T11:46:08.973916+0000","last_fullsized":"2022-07-05T11:46:08.973916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028001+0000","last_change":"2022-07-05T11:46:04.593690+0000","last_active":"2022-07-05T11:46:09.028001+0000","last_peered":"2022-07-05T11:46:09.028001+0000","last_clean":"2022-07-05T11:46:09.028001+0000","last_became_active":"2022-07-05T11:46:04.593427+0000","last_became_peered":"2022-07-05T11:46:04.593427+0000","last_unstale":"2022-07-05T11:46:09.028001+0000","last_undegraded":"2022-07-05T11:46:09.028001+0000","last_fullsized":"2022-07-05T11:46:09.028001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028319+0000","last_change":"2022-07-05T11:46:04.204419+0000","last_active":"2022-07-05T11:46:09.028319+0000","last_peered":"2022-07-05T11:46:09.028319+0000","last_clean":"2022-07-05T11:46:09.028319+0000","last_became_active":"2022-07-05T11:46:04.204078+0000","last_became_peered":"2022-07-05T11:46:04.204078+0000","last_unstale":"2022-07-05T11:46:09.028319+0000","last_undegraded":"2022-07-05T11:46:09.028319+0000","last_fullsized":"2022-07-05T11:46:09.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028300+0000","last_change":"2022-07-05T11:46:04.600858+0000","last_active":"2022-07-05T11:46:09.028300+0000","last_peered":"2022-07-05T11:46:09.028300+0000","last_clean":"2022-07-05T11:46:09.028300+0000","last_became_active":"2022-07-05T11:46:04.600564+0000","last_became_peered":"2022-07-05T11:46:04.600564+0000","last_unstale":"2022-07-05T11:46:09.028300+0000","last_undegraded":"2022-07-05T11:46:09.028300+0000","last_fullsized":"2022-07-05T11:46:09.028300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017952+0000","last_change":"2022-07-05T11:46:09.017127+0000","last_active":"2022-07-05T11:46:09.017952+0000","last_peered":"2022-07-05T11:46:09.017952+0000","last_clean":"2022-07-05T11:46:09.017952+0000","last_became_active":"2022-07-05T11:46:09.016451+0000","last_became_peered":"2022-07-05T11:46:09.016451+0000","last_unstale":"2022-07-05T11:46:09.017952+0000","last_undegraded":"2022-07-05T11:46:09.017952+0000","last_fullsized":"2022-07-05T11:46:09.017952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7110,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":14254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164889,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":166627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164957,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163613,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":164755,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444038,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163647,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163717,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":3,"up_from":17,"seq":73014444038,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5404,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366436,"statfs":{"total":96636764160,"available":96631230464,"internally_reserved":0,"allocated":348160,"data_stored":167325,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366500,"statfs":{"total":96636764160,"available":96631296000,"internally_reserved":0,"allocated":348160,"data_stored":164851,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-07-05T11:46:23.776 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-07-05T11:46:23.776 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-07-05T11:46:23.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-07-05T11:46:23.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-07-05T11:46:23.778 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-07-05T11:46:23.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.888+0000 7f3a77bbc700 1 Processor -- start 2022-07-05T11:46:24.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.888+0000 7f3a77bbc700 1 -- start start 2022-07-05T11:46:24.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.889+0000 7f3a77bbc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a7017de40 0x7f3a700c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.889+0000 7f3a77bbc700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a700c9090 con 0x7f3a7017da60 2022-07-05T11:46:24.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.889+0000 7f3a77bbc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a700ca120 con 0x7f3a700c7d00 2022-07-05T11:46:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.889+0000 7f3a77bbc700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a700c81a0 con 0x7f3a7017de40 2022-07-05T11:46:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a76159700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a7017de40 0x7f3a700c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a76159700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a7017de40 0x7f3a700c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56830/0 (socket says 172.21.15.90:56830) 2022-07-05T11:46:24.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a76159700 1 -- 172.21.15.90:0/1425099910 learned_addr learned my addr 172.21.15.90:0/1425099910 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:24.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a76159700 1 -- 172.21.15.90:0/1425099910 >> v1:172.21.15.149:6789/0 conn(0x7f3a700c7d00 legacy=0x7f3a700c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a76159700 1 -- 172.21.15.90:0/1425099910 >> v1:172.21.15.110:6789/0 conn(0x7f3a7017da60 legacy=0x7f3a7017eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a76159700 1 -- 172.21.15.90:0/1425099910 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700c8480 con 0x7f3a7017de40 2022-07-05T11:46:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a76159700 1 --2- 172.21.15.90:0/1425099910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017de40 0x7f3a700c9c30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3a68006fd0 tx=0x7f3a680090f0).ready entity=mon.0 client_cookie=8e4d951ad5bc4851 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a74956700 1 -- 172.21.15.90:0/1425099910 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800b600 con 0x7f3a7017de40 2022-07-05T11:46:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a74956700 1 -- 172.21.15.90:0/1425099910 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6800b760 con 0x7f3a7017de40 2022-07-05T11:46:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.890+0000 7f3a74956700 1 -- 172.21.15.90:0/1425099910 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800bae0 con 0x7f3a7017de40 2022-07-05T11:46:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.891+0000 7f3a77bbc700 1 -- 172.21.15.90:0/1425099910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017de40 msgr2=0x7f3a700c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.891+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/1425099910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017de40 0x7f3a700c9c30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3a68006fd0 tx=0x7f3a680090f0).stop 2022-07-05T11:46:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.891+0000 7f3a77bbc700 1 -- 172.21.15.90:0/1425099910 shutdown_connections 2022-07-05T11:46:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.891+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/1425099910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017de40 0x7f3a700c9c30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.891+0000 7f3a77bbc700 1 -- 172.21.15.90:0/1425099910 >> 172.21.15.90:0/1425099910 conn(0x7f3a700f4b70 msgr2=0x7f3a700f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.891+0000 7f3a77bbc700 1 -- 172.21.15.90:0/1425099910 shutdown_connections 2022-07-05T11:46:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.891+0000 7f3a77bbc700 1 -- 172.21.15.90:0/1425099910 wait complete. 2022-07-05T11:46:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.892+0000 7f3a77bbc700 1 Processor -- start 2022-07-05T11:46:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.892+0000 7f3a77bbc700 1 -- start start 2022-07-05T11:46:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a77bbc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700c7d00 0x7f3a70169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a77bbc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017da60 0x7f3a70176530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a77bbc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7017de40 0x7f3a70176a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a77bbc700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a701778c0 con 0x7f3a7017da60 2022-07-05T11:46:24.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a77bbc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70175ec0 con 0x7f3a700c7d00 2022-07-05T11:46:24.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a77bbc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700ca580 con 0x7f3a7017de40 2022-07-05T11:46:24.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a75157700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017da60 0x7f3a70176530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a75157700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017da60 0x7f3a70176530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56834/0 (socket says 172.21.15.90:56834) 2022-07-05T11:46:24.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a75157700 1 -- 172.21.15.90:0/205132854 learned_addr learned my addr 172.21.15.90:0/205132854 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:24.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a75958700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700c7d00 0x7f3a70169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.893+0000 7f3a76159700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7017de40 0x7f3a70176a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a75157700 1 -- 172.21.15.90:0/205132854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7017de40 msgr2=0x7f3a70176a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a75157700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7017de40 0x7f3a70176a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a75157700 1 -- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700c7d00 msgr2=0x7f3a70169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a75157700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700c7d00 0x7f3a70169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a75157700 1 -- 172.21.15.90:0/205132854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009370 con 0x7f3a7017da60 2022-07-05T11:46:24.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a75958700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700c7d00 0x7f3a70169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:24.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a75157700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017da60 0x7f3a70176530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3a6400c440 tx=0x7f3a64007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a6dffb700 1 -- 172.21.15.90:0/205132854 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64007020 con 0x7f3a7017da60 2022-07-05T11:46:24.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a6dffb700 1 -- 172.21.15.90:0/205132854 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64007180 con 0x7f3a7017da60 2022-07-05T11:46:24.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a6dffb700 1 -- 172.21.15.90:0/205132854 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64007540 con 0x7f3a7017da60 2022-07-05T11:46:24.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a70177020 con 0x7f3a7017da60 2022-07-05T11:46:24.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.894+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a701775e0 con 0x7f3a7017da60 2022-07-05T11:46:24.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.895+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7006be40 con 0x7f3a7017da60 2022-07-05T11:46:24.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.896+0000 7f3a6dffb700 1 -- 172.21.15.90:0/205132854 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3a64010070 con 0x7f3a7017da60 2022-07-05T11:46:24.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.896+0000 7f3a6dffb700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5008ba40 0x7f3a5008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.896+0000 7f3a6dffb700 1 -- 172.21.15.90:0/205132854 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3a640afaf0 con 0x7f3a7017da60 2022-07-05T11:46:24.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.896+0000 7f3a75958700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5008ba40 0x7f3a5008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.897+0000 7f3a75958700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5008ba40 0x7f3a5008df00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3a60001e50 tx=0x7f3a60009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:23.900+0000 7f3a6dffb700 1 -- 172.21.15.90:0/205132854 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3a640807b0 con 0x7f3a7017da60 2022-07-05T11:46:24.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.103+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3a700c5280 con 0x7f3a7017da60 2022-07-05T11:46:24.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.106+0000 7f3a6dffb700 1 -- 172.21.15.90:0/205132854 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+221095 (secure 0 0 0) 0x7f3a64083dd0 con 0x7f3a7017da60 2022-07-05T11:46:24.112 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:24.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5008ba40 msgr2=0x7f3a5008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5008ba40 0x7f3a5008df00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3a60001e50 tx=0x7f3a60009040).stop 2022-07-05T11:46:24.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017da60 msgr2=0x7f3a70176530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017da60 0x7f3a70176530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3a6400c440 tx=0x7f3a64007e00).stop 2022-07-05T11:46:24.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 shutdown_connections 2022-07-05T11:46:24.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3a5008ba40 0x7f3a5008df00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a7017de40 0x7f3a70176a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700c7d00 0x7f3a70169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 --2- 172.21.15.90:0/205132854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a7017da60 0x7f3a70176530 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 >> 172.21.15.90:0/205132854 conn(0x7f3a700f4b70 msgr2=0x7f3a7016e240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 shutdown_connections 2022-07-05T11:46:24.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.109+0000 7f3a77bbc700 1 -- 172.21.15.90:0/205132854 wait complete. 2022-07-05T11:46:24.123 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":4,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36906},{"type":"v1","addr":"172.21.15.110:6801","nonce":36906}]},"active_addr":"172.21.15.110:6801/36906","active_change":"2022-07-05T11:45:49.104364+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4109,"name":"z","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3046980870}]},{"addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2996983684}]}]}} 2022-07-05T11:46:24.130 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-07-05T11:46:24.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-07-05T11:46:24.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.273+0000 7f80f9f55700 1 Processor -- start 2022-07-05T11:46:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.273+0000 7f80f9f55700 1 -- start start 2022-07-05T11:46:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.274+0000 7f80f9f55700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80f4084b20 0x7f80f4066070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.274+0000 7f80f9f55700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f4084fd0 con 0x7f80f4172ef0 2022-07-05T11:46:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.274+0000 7f80f9f55700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f417f370 con 0x7f80f40ec230 2022-07-05T11:46:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.274+0000 7f80f9f55700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f417e480 con 0x7f80f4084b20 2022-07-05T11:46:24.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.274+0000 7f80f3fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80f4084b20 0x7f80f4066070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.274+0000 7f80f37fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f80f4172ef0 0x7f80f417da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49780/0 (socket says 172.21.15.90:49780) 2022-07-05T11:46:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.274+0000 7f80f37fe700 1 -- 172.21.15.90:0/1661069787 learned_addr learned my addr 172.21.15.90:0/1661069787 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f3fff700 1 -- 172.21.15.90:0/1661069787 >> v1:172.21.15.110:6789/0 conn(0x7f80f40ec230 legacy=0x7f80f40ec6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f3fff700 1 -- 172.21.15.90:0/1661069787 >> v1:172.21.15.90:6789/0 conn(0x7f80f4172ef0 legacy=0x7f80f417da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f3fff700 1 -- 172.21.15.90:0/1661069787 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f417e760 con 0x7f80f4084b20 2022-07-05T11:46:24.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f3fff700 1 --2- 172.21.15.90:0/1661069787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4084b20 0x7f80f4066070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f80ec009760 tx=0x7f80ec009060).ready entity=mon.0 client_cookie=25b30144ff6556ea server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f27fc700 1 -- 172.21.15.90:0/1661069787 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00b520 con 0x7f80f4084b20 2022-07-05T11:46:24.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f27fc700 1 -- 172.21.15.90:0/1661069787 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec00b680 con 0x7f80f4084b20 2022-07-05T11:46:24.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f27fc700 1 -- 172.21.15.90:0/1661069787 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00ba00 con 0x7f80f4084b20 2022-07-05T11:46:24.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f9f55700 1 -- 172.21.15.90:0/1661069787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4084b20 msgr2=0x7f80f4066070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f9f55700 1 --2- 172.21.15.90:0/1661069787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4084b20 0x7f80f4066070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f80ec009760 tx=0x7f80ec009060).stop 2022-07-05T11:46:24.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f9f55700 1 -- 172.21.15.90:0/1661069787 shutdown_connections 2022-07-05T11:46:24.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f9f55700 1 --2- 172.21.15.90:0/1661069787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4084b20 0x7f80f4066070 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f9f55700 1 -- 172.21.15.90:0/1661069787 >> 172.21.15.90:0/1661069787 conn(0x7f80f40ee330 msgr2=0x7f80f40ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f9f55700 1 -- 172.21.15.90:0/1661069787 shutdown_connections 2022-07-05T11:46:24.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.275+0000 7f80f9f55700 1 -- 172.21.15.90:0/1661069787 wait complete. 2022-07-05T11:46:24.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.277+0000 7f80f9f55700 1 Processor -- start 2022-07-05T11:46:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.277+0000 7f80f9f55700 1 -- start start 2022-07-05T11:46:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f9f55700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f4084b20 0x7f80f4155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f9f55700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f40ec230 0x7f80f40c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f9f55700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4172ef0 0x7f80f40c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f9f55700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40c7490 con 0x7f80f4172ef0 2022-07-05T11:46:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f9f55700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40c8590 con 0x7f80f4084b20 2022-07-05T11:46:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f9f55700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40c9400 con 0x7f80f40ec230 2022-07-05T11:46:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4172ef0 0x7f80f40c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4172ef0 0x7f80f40c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56846/0 (socket says 172.21.15.90:56846) 2022-07-05T11:46:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 -- 172.21.15.90:0/2182048916 learned_addr learned my addr 172.21.15.90:0/2182048916 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f37fe700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f4084b20 0x7f80f4155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f2ffd700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f40ec230 0x7f80f40c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 -- 172.21.15.90:0/2182048916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f40ec230 msgr2=0x7f80f40c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f40ec230 0x7f80f40c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 -- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f4084b20 msgr2=0x7f80f4155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f4084b20 0x7f80f4155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 -- 172.21.15.90:0/2182048916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0092a0 con 0x7f80f4172ef0 2022-07-05T11:46:24.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.278+0000 7f80f3fff700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4172ef0 0x7f80f40c8f10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f80f40856d0 tx=0x7f80ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.279+0000 7f80db7fe700 1 -- 172.21.15.90:0/2182048916 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00ba00 con 0x7f80f4172ef0 2022-07-05T11:46:24.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.279+0000 7f80db7fe700 1 -- 172.21.15.90:0/2182048916 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec01b410 con 0x7f80f4172ef0 2022-07-05T11:46:24.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.279+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f40c76a0 con 0x7f80f4172ef0 2022-07-05T11:46:24.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.279+0000 7f80db7fe700 1 -- 172.21.15.90:0/2182048916 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec01b790 con 0x7f80f4172ef0 2022-07-05T11:46:24.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.279+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f40c7c60 con 0x7f80f4172ef0 2022-07-05T11:46:24.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.279+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f406be40 con 0x7f80f4172ef0 2022-07-05T11:46:24.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.280+0000 7f80db7fe700 1 -- 172.21.15.90:0/2182048916 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f80ec00f070 con 0x7f80f4172ef0 2022-07-05T11:46:24.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.281+0000 7f80db7fe700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f80d408ba40 0x7f80d408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.281+0000 7f80db7fe700 1 -- 172.21.15.90:0/2182048916 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f80ec0b2b00 con 0x7f80f4172ef0 2022-07-05T11:46:24.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.281+0000 7f80f37fe700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f80d408ba40 0x7f80d408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.281+0000 7f80f37fe700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f80d408ba40 0x7f80d408df00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f80e4001d20 tx=0x7f80e4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.284+0000 7f80db7fe700 1 -- 172.21.15.90:0/2182048916 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f80ec0837c0 con 0x7f80f4172ef0 2022-07-05T11:46:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.450+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80f40c86d0 con 0x7f80f4172ef0 2022-07-05T11:46:24.452 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.451+0000 7f80db7fe700 1 -- 172.21.15.90:0/2182048916 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f80ec086de0 con 0x7f80f4172ef0 2022-07-05T11:46:24.452 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:24.453 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:24.454 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.452+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f80d408ba40 msgr2=0x7f80d408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.454 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.452+0000 7f80f9f55700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f80d408ba40 0x7f80d408df00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f80e4001d20 tx=0x7f80e4009040).stop 2022-07-05T11:46:24.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.452+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4172ef0 msgr2=0x7f80f40c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.452+0000 7f80f9f55700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4172ef0 0x7f80f40c8f10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f80f40856d0 tx=0x7f80ec017000).stop 2022-07-05T11:46:24.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 shutdown_connections 2022-07-05T11:46:24.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f80d408ba40 0x7f80d408df00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.458 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80f4172ef0 0x7f80f40c8f10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.459 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f4084b20 0x7f80f4155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.459 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 --2- 172.21.15.90:0/2182048916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f40ec230 0x7f80f40c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 >> 172.21.15.90:0/2182048916 conn(0x7f80f40ee330 msgr2=0x7f80f40ec6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 shutdown_connections 2022-07-05T11:46:24.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.453+0000 7f80f9f55700 1 -- 172.21.15.90:0/2182048916 wait complete. 2022-07-05T11:46:24.466 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-07-05T11:46:24.466 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:24.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.578+0000 7f170276d700 1 Processor -- start 2022-07-05T11:46:24.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.578+0000 7f170276d700 1 -- start start 2022-07-05T11:46:24.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f170276d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16fc17da60 0x7f16fc17de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f170276d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f16fc0c9520 0x7f16fc0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f170276d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc0c9090 con 0x7f16fc0c7d00 2022-07-05T11:46:24.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f170276d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0c81a0 con 0x7f16fc0c9520 2022-07-05T11:46:24.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f170276d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0c8480 con 0x7f16fc17da60 2022-07-05T11:46:24.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f1700d0a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f16fc0c9520 0x7f16fc0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f1700d0a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f16fc0c9520 0x7f16fc0c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56854/0 (socket says 172.21.15.90:56854) 2022-07-05T11:46:24.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f1700d0a700 1 -- 172.21.15.90:0/2886983131 learned_addr learned my addr 172.21.15.90:0/2886983131 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:24.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.579+0000 7f16fbfff700 1 --2- 172.21.15.90:0/2886983131 >> v2:172.21.15.149:3300/0 conn(0x7f16fc17da60 0x7f16fc17de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f1700d0a700 1 -- 172.21.15.90:0/2886983131 >> v2:172.21.15.149:3300/0 conn(0x7f16fc17da60 msgr2=0x7f16fc17de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:24.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f1700d0a700 1 --2- 172.21.15.90:0/2886983131 >> v2:172.21.15.149:3300/0 conn(0x7f16fc17da60 0x7f16fc17de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f1700d0a700 1 -- 172.21.15.90:0/2886983131 >> v1:172.21.15.149:6789/0 conn(0x7f16fc0c7d00 legacy=0x7f16fc17eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:24.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f1700d0a700 1 -- 172.21.15.90:0/2886983131 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0c8760 con 0x7f16fc0c9520 2022-07-05T11:46:24.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f1700d0a700 1 --2- 172.21.15.90:0/2886983131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc0c9520 0x7f16fc0c99b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f16fc064870 tx=0x7f16f4009840).ready entity=mon.0 client_cookie=5d18d5399e4bb6dc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f16faffd700 1 -- 172.21.15.90:0/2886983131 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400e070 con 0x7f16fc0c9520 2022-07-05T11:46:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f16faffd700 1 -- 172.21.15.90:0/2886983131 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f400ba10 con 0x7f16fc0c9520 2022-07-05T11:46:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f16faffd700 1 -- 172.21.15.90:0/2886983131 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400bd90 con 0x7f16fc0c9520 2022-07-05T11:46:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 -- 172.21.15.90:0/2886983131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc0c9520 msgr2=0x7f16fc0c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 --2- 172.21.15.90:0/2886983131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc0c9520 0x7f16fc0c99b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f16fc064870 tx=0x7f16f4009840).stop 2022-07-05T11:46:24.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 -- 172.21.15.90:0/2886983131 shutdown_connections 2022-07-05T11:46:24.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 --2- 172.21.15.90:0/2886983131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc0c9520 0x7f16fc0c99b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 --2- 172.21.15.90:0/2886983131 >> v2:172.21.15.149:3300/0 conn(0x7f16fc17da60 0x7f16fc17de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 -- 172.21.15.90:0/2886983131 >> 172.21.15.90:0/2886983131 conn(0x7f16fc0f4b70 msgr2=0x7f16fc0f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 -- 172.21.15.90:0/2886983131 shutdown_connections 2022-07-05T11:46:24.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.580+0000 7f170276d700 1 -- 172.21.15.90:0/2886983131 wait complete. 2022-07-05T11:46:24.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.582+0000 7f170276d700 1 Processor -- start 2022-07-05T11:46:24.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.582+0000 7f170276d700 1 -- start start 2022-07-05T11:46:24.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f170276d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16fc0c7d00 0x7f16fc16dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f170276d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc0c9520 0x7f16fc16e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f170276d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc17da60 0x7f16fc1721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f170276d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc177440 con 0x7f16fc17da60 2022-07-05T11:46:24.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f170276d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc176550 con 0x7f16fc0c7d00 2022-07-05T11:46:24.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f170276d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc176830 con 0x7f16fc0c9520 2022-07-05T11:46:24.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc17da60 0x7f16fc1721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc17da60 0x7f16fc1721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56862/0 (socket says 172.21.15.90:56862) 2022-07-05T11:46:24.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 -- 172.21.15.90:0/3873237915 learned_addr learned my addr 172.21.15.90:0/3873237915 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:24.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f16fbfff700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16fc0c7d00 0x7f16fc16dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f16fb7fe700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc0c9520 0x7f16fc16e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 -- 172.21.15.90:0/3873237915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc0c9520 msgr2=0x7f16fc16e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc0c9520 0x7f16fc16e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 -- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16fc0c7d00 msgr2=0x7f16fc16dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16fc0c7d00 0x7f16fc16dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f1700d0a700 1 -- 172.21.15.90:0/3873237915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f4009ae0 con 0x7f16fc17da60 2022-07-05T11:46:24.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.583+0000 7f16fb7fe700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc0c9520 0x7f16fc16e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:24.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.584+0000 7f1700d0a700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc17da60 0x7f16fc1721b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f16f4009540 tx=0x7f16f4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.584+0000 7f16e3fff700 1 -- 172.21.15.90:0/3873237915 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4013de0 con 0x7f16fc17da60 2022-07-05T11:46:24.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.584+0000 7f16e3fff700 1 -- 172.21.15.90:0/3873237915 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f401c400 con 0x7f16fc17da60 2022-07-05T11:46:24.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.584+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc176b10 con 0x7f16fc17da60 2022-07-05T11:46:24.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.584+0000 7f16e3fff700 1 -- 172.21.15.90:0/3873237915 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f401c7a0 con 0x7f16fc17da60 2022-07-05T11:46:24.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.584+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc1770d0 con 0x7f16fc17da60 2022-07-05T11:46:24.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.585+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc1775b0 con 0x7f16fc17da60 2022-07-05T11:46:24.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.585+0000 7f16e3fff700 1 -- 172.21.15.90:0/3873237915 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f16f401cb90 con 0x7f16fc17da60 2022-07-05T11:46:24.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.586+0000 7f16e3fff700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16dc08ba40 0x7f16dc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.586+0000 7f16e3fff700 1 -- 172.21.15.90:0/3873237915 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f16f40b23a0 con 0x7f16fc17da60 2022-07-05T11:46:24.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.586+0000 7f16fbfff700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16dc08ba40 0x7f16dc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.587+0000 7f16fbfff700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16dc08ba40 0x7f16dc08df00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f16ec00bbc0 tx=0x7f16ec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.590+0000 7f16e3fff700 1 -- 172.21.15.90:0/3873237915 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f16f4083060 con 0x7f16fc17da60 2022-07-05T11:46:24.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.753+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16fc177580 con 0x7f16fc17da60 2022-07-05T11:46:24.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.754+0000 7f16e3fff700 1 -- 172.21.15.90:0/3873237915 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f16f4086680 con 0x7f16fc17da60 2022-07-05T11:46:24.755 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:24.756 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:24.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16dc08ba40 msgr2=0x7f16dc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16dc08ba40 0x7f16dc08df00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f16ec00bbc0 tx=0x7f16ec008040).stop 2022-07-05T11:46:24.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc17da60 msgr2=0x7f16fc1721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc17da60 0x7f16fc1721b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f16f4009540 tx=0x7f16f4009840).stop 2022-07-05T11:46:24.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 shutdown_connections 2022-07-05T11:46:24.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16dc08ba40 0x7f16dc08df00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16fc17da60 0x7f16fc1721b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16fc0c7d00 0x7f16fc16dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 --2- 172.21.15.90:0/3873237915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc0c9520 0x7f16fc16e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 >> 172.21.15.90:0/3873237915 conn(0x7f16fc0f4b70 msgr2=0x7f16fc0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 shutdown_connections 2022-07-05T11:46:24.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.756+0000 7f170276d700 1 -- 172.21.15.90:0/3873237915 wait complete. 2022-07-05T11:46:24.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-07-05T11:46:24.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.883+0000 7fccffe3f700 1 Processor -- start 2022-07-05T11:46:24.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.884+0000 7fccffe3f700 1 -- start start 2022-07-05T11:46:24.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccffe3f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fccf81719f0 0x7fccf80ec490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccffe3f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fccf8171dd0 0x7fccf80ec980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccffe3f700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf817d630 con 0x7fccf80ece70 2022-07-05T11:46:24.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccffe3f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf817d910 con 0x7fccf8171dd0 2022-07-05T11:46:24.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccffe3f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf817dbf0 con 0x7fccf81719f0 2022-07-05T11:46:24.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfd3da700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fccf8171dd0 0x7fccf80ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfe3dc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fccf80ece70 0x7fccf817c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49808/0 (socket says 172.21.15.90:49808) 2022-07-05T11:46:24.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfe3dc700 1 -- 172.21.15.90:0/2005659276 learned_addr learned my addr 172.21.15.90:0/2005659276 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:24.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfdbdb700 1 --2- 172.21.15.90:0/2005659276 >> v2:172.21.15.149:3300/0 conn(0x7fccf81719f0 0x7fccf80ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfd3da700 1 -- 172.21.15.90:0/2005659276 >> v2:172.21.15.149:3300/0 conn(0x7fccf81719f0 msgr2=0x7fccf80ec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:24.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfd3da700 1 --2- 172.21.15.90:0/2005659276 >> v2:172.21.15.149:3300/0 conn(0x7fccf81719f0 0x7fccf80ec490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfd3da700 1 -- 172.21.15.90:0/2005659276 >> v1:172.21.15.90:6789/0 conn(0x7fccf80ece70 legacy=0x7fccf817c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfd3da700 1 -- 172.21.15.90:0/2005659276 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf817ded0 con 0x7fccf8171dd0 2022-07-05T11:46:24.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfcbd9700 1 -- 172.21.15.90:0/2005659276 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331025838 0 0) 0x7fccf817d630 con 0x7fccf80ece70 2022-07-05T11:46:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfdbdb700 1 --2- 172.21.15.90:0/2005659276 >> v2:172.21.15.149:3300/0 conn(0x7fccf81719f0 0x7fccf80ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfd3da700 1 --2- 172.21.15.90:0/2005659276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf8171dd0 0x7fccf80ec980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fccf8066a80 tx=0x7fccec00b300).ready entity=mon.0 client_cookie=99fd4ddc2212c0bd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfcbd9700 1 -- 172.21.15.90:0/2005659276 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00da70 con 0x7fccf8171dd0 2022-07-05T11:46:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfcbd9700 1 -- 172.21.15.90:0/2005659276 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec00dbd0 con 0x7fccf8171dd0 2022-07-05T11:46:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.885+0000 7fccfcbd9700 1 -- 172.21.15.90:0/2005659276 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec010470 con 0x7fccf8171dd0 2022-07-05T11:46:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 -- 172.21.15.90:0/2005659276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf8171dd0 msgr2=0x7fccf80ec980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 --2- 172.21.15.90:0/2005659276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf8171dd0 0x7fccf80ec980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fccf8066a80 tx=0x7fccec00b300).stop 2022-07-05T11:46:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 -- 172.21.15.90:0/2005659276 shutdown_connections 2022-07-05T11:46:24.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 --2- 172.21.15.90:0/2005659276 >> v2:172.21.15.149:3300/0 conn(0x7fccf81719f0 0x7fccf80ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 --2- 172.21.15.90:0/2005659276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf8171dd0 0x7fccf80ec980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 -- 172.21.15.90:0/2005659276 >> 172.21.15.90:0/2005659276 conn(0x7fccf805e440 msgr2=0x7fccf80f1860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 -- 172.21.15.90:0/2005659276 shutdown_connections 2022-07-05T11:46:24.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.886+0000 7fccffe3f700 1 -- 172.21.15.90:0/2005659276 wait complete. 2022-07-05T11:46:24.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.887+0000 7fccffe3f700 1 Processor -- start 2022-07-05T11:46:24.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.888+0000 7fccffe3f700 1 -- start start 2022-07-05T11:46:24.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.888+0000 7fccffe3f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf80ece70 0x7fccf81663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.888+0000 7fccffe3f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccf81719f0 0x7fccf81668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccffe3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf8171dd0 0x7fccf8190130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccffe3f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8190e50 con 0x7fccf80ece70 2022-07-05T11:46:24.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccffe3f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8191130 con 0x7fccf81719f0 2022-07-05T11:46:24.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccffe3f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8191410 con 0x7fccf8171dd0 2022-07-05T11:46:24.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf80ece70 0x7fccf81663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf80ece70 0x7fccf81663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56870/0 (socket says 172.21.15.90:56870) 2022-07-05T11:46:24.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 -- 172.21.15.90:0/356911392 learned_addr learned my addr 172.21.15.90:0/356911392 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:24.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfe3dc700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf8171dd0 0x7fccf8190130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfd3da700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccf81719f0 0x7fccf81668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 -- 172.21.15.90:0/356911392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf8171dd0 msgr2=0x7fccf8190130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf8171dd0 0x7fccf8190130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 -- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccf81719f0 msgr2=0x7fccf81668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccf81719f0 0x7fccf81668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 -- 172.21.15.90:0/356911392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec00b540 con 0x7fccf80ece70 2022-07-05T11:46:24.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfe3dc700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf8171dd0 0x7fccf8190130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:24.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccfdbdb700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf80ece70 0x7fccf81663f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fcce800d1d0 tx=0x7fcce8009a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800de70 con 0x7fccf80ece70 2022-07-05T11:46:24.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce800f040 con 0x7fccf80ece70 2022-07-05T11:46:24.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf81916f0 con 0x7fccf80ece70 2022-07-05T11:46:24.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8013600 con 0x7fccf80ece70 2022-07-05T11:46:24.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.889+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf8190620 con 0x7fccf80ece70 2022-07-05T11:46:24.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.890+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccf80f1650 con 0x7fccf80ece70 2022-07-05T11:46:24.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.891+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fcce80139f0 con 0x7fccf80ece70 2022-07-05T11:46:24.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.891+0000 7fccf5ffb700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fccd808ba40 0x7fccd808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fcce80b12e0 con 0x7fccf80ece70 2022-07-05T11:46:24.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccfd3da700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fccd808ba40 0x7fccd808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccf5ffb700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:6808/37452,v1:172.21.15.90:6809/37452] conn(0x7fccd8097420 0x7fccd80998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:24.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 --> [v2:172.21.15.90:6808/37452,v1:172.21.15.90:6809/37452] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccd8099f40 con 0x7fccd8097420 2022-07-05T11:46:24.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce80b3840 con 0x7fccf80ece70 2022-07-05T11:46:24.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccfe3dc700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:6808/37452,v1:172.21.15.90:6809/37452] conn(0x7fccd8097420 0x7fccd80998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:24.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccfe3dc700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:6808/37452,v1:172.21.15.90:6809/37452] conn(0x7fccd8097420 0x7fccd80998c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.892+0000 7fccfd3da700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fccd808ba40 0x7fccd808df00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fccf81721b0 tx=0x7fccec00b300).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:24.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.893+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== osd.0 v2:172.21.15.90:6808/37452 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fccd8099f40 con 0x7fccd8097420 2022-07-05T11:46:24.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.906+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 --> [v2:172.21.15.90:6808/37452,v1:172.21.15.90:6809/37452] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccf8191d40 con 0x7fccd8097420 2022-07-05T11:46:24.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccf5ffb700 1 -- 172.21.15.90:0/356911392 <== osd.0 v2:172.21.15.90:6808/37452 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fccf8191d40 con 0x7fccd8097420 2022-07-05T11:46:24.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:6808/37452,v1:172.21.15.90:6809/37452] conn(0x7fccd8097420 msgr2=0x7fccd80998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:6808/37452,v1:172.21.15.90:6809/37452] conn(0x7fccd8097420 0x7fccd80998c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:24.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fccd808ba40 msgr2=0x7fccd808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fccd808ba40 0x7fccd808df00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fccf81721b0 tx=0x7fccec00b300).stop 2022-07-05T11:46:24.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf80ece70 msgr2=0x7fccf81663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:24.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 --2- 172.21.15.90:0/356911392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccf80ece70 0x7fccf81663f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fcce800d1d0 tx=0x7fcce8009a90).stop 2022-07-05T11:46:24.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccfe3dc700 1 -- 172.21.15.90:0/356911392 reap_dead start 2022-07-05T11:46:24.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 shutdown_connections 2022-07-05T11:46:24.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 >> 172.21.15.90:0/356911392 conn(0x7fccf805e440 msgr2=0x7fccf8084840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:24.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 shutdown_connections 2022-07-05T11:46:24.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:24.907+0000 7fccffe3f700 1 -- 172.21.15.90:0/356911392 wait complete. 2022-07-05T11:46:24.919 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:24.920 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-07-05T11:46:25.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.032+0000 7fc434780700 1 Processor -- start 2022-07-05T11:46:25.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.032+0000 7fc434780700 1 -- start start 2022-07-05T11:46:25.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc434780700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c084f00 con 0x7fc42c171dd0 2022-07-05T11:46:25.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc434780700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c17d630 con 0x7fc42c0c3640 2022-07-05T11:46:25.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc434780700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c17d910 con 0x7fc42c1719f0 2022-07-05T11:46:25.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc431d1b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc42c171dd0 0x7fc42c0ecba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49822/0 (socket says 172.21.15.90:49822) 2022-07-05T11:46:25.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc431d1b700 1 -- 172.21.15.90:0/587098496 learned_addr learned my addr 172.21.15.90:0/587098496 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:25.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824272588 0 0) 0x7fc42c084f00 con 0x7fc42c171dd0 2022-07-05T11:46:25.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4140033f0 con 0x7fc42c171dd0 2022-07-05T11:46:25.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442966261 0 0) 0x7fc42c17d630 con 0x7fc42c0c3640 2022-07-05T11:46:25.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc42c084f00 con 0x7fc42c0c3640 2022-07-05T11:46:25.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438863464 0 0) 0x7fc42c17d910 con 0x7fc42c1719f0 2022-07-05T11:46:25.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc42c17d630 con 0x7fc42c1719f0 2022-07-05T11:46:25.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3108095998 0 0) 0x7fc4140033f0 con 0x7fc42c171dd0 2022-07-05T11:46:25.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 >> v1:172.21.15.149:6789/0 conn(0x7fc42c1719f0 legacy=0x7fc42c0ec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 >> v1:172.21.15.110:6789/0 conn(0x7fc42c0c3640 legacy=0x7fc42c0847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c17dbf0 con 0x7fc42c171dd0 2022-07-05T11:46:25.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fc41c001470 con 0x7fc42c171dd0 2022-07-05T11:46:25.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 >> v1:172.21.15.90:6789/0 conn(0x7fc42c171dd0 legacy=0x7fc42c0ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc414003c80 0x7fc414004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc414004b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc414005180 0x7fc41400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41400c0d0 con 0x7fc4140046e0 2022-07-05T11:46:25.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41400c240 con 0x7fc414003c80 2022-07-05T11:46:25.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41400c400 con 0x7fc414005180 2022-07-05T11:46:25.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.034+0000 7fc431d1b700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc414004b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc43251c700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc414003c80 0x7fc414004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc432d1d700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc414005180 0x7fc41400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc431d1b700 1 -- 172.21.15.90:0/587098496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc414005180 msgr2=0x7fc41400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc431d1b700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc414005180 0x7fc41400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc431d1b700 1 -- 172.21.15.90:0/587098496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc414003c80 msgr2=0x7fc414004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc431d1b700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc414003c80 0x7fc414004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc431d1b700 1 -- 172.21.15.90:0/587098496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140033f0 con 0x7fc4140046e0 2022-07-05T11:46:25.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc432d1d700 1 -- 172.21.15.90:0/587098496 reap_dead start 2022-07-05T11:46:25.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc431d1b700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc414004b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc42c1721b0 tx=0x7fc41c001e10).ready entity=mon.0 client_cookie=737d7fc41aa9f95d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00c9a0 con 0x7fc4140046e0 2022-07-05T11:46:25.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c00cb00 con 0x7fc4140046e0 2022-07-05T11:46:25.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc43151a700 1 -- 172.21.15.90:0/587098496 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0070d0 con 0x7fc4140046e0 2022-07-05T11:46:25.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc434780700 1 -- 172.21.15.90:0/587098496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 msgr2=0x7fc414004b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.035+0000 7fc434780700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc414004b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc42c1721b0 tx=0x7fc41c001e10).stop 2022-07-05T11:46:25.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.036+0000 7fc434780700 1 -- 172.21.15.90:0/587098496 shutdown_connections 2022-07-05T11:46:25.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.036+0000 7fc434780700 1 --2- 172.21.15.90:0/587098496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc414004b60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.036+0000 7fc434780700 1 -- 172.21.15.90:0/587098496 >> 172.21.15.90:0/587098496 conn(0x7fc42c05e440 msgr2=0x7fc42c0f1860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.036+0000 7fc434780700 1 -- 172.21.15.90:0/587098496 shutdown_connections 2022-07-05T11:46:25.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.036+0000 7fc434780700 1 -- 172.21.15.90:0/587098496 wait complete. 2022-07-05T11:46:25.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.037+0000 7fc434780700 1 Processor -- start 2022-07-05T11:46:25.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.037+0000 7fc434780700 1 -- start start 2022-07-05T11:46:25.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc434780700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc42c17cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc434780700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc42c14c5f0 0x7fc42c0eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc434780700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc42c160790 0x7fc42c160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc434780700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c165c70 con 0x7fc4140046e0 2022-07-05T11:46:25.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc434780700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c1657e0 con 0x7fc42c14c5f0 2022-07-05T11:46:25.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc434780700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c1648f0 con 0x7fc42c160790 2022-07-05T11:46:25.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc42c17cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc42c17cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56892/0 (socket says 172.21.15.90:56892) 2022-07-05T11:46:25.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 -- 172.21.15.90:0/1447932700 learned_addr learned my addr 172.21.15.90:0/1447932700 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc431d1b700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc42c14c5f0 0x7fc42c0eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc432d1d700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc42c160790 0x7fc42c160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 -- 172.21.15.90:0/1447932700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc42c160790 msgr2=0x7fc42c160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc42c160790 0x7fc42c160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 -- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc42c14c5f0 msgr2=0x7fc42c0eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc42c14c5f0 0x7fc42c0eea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 -- 172.21.15.90:0/1447932700 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c164bd0 con 0x7fc4140046e0 2022-07-05T11:46:25.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.038+0000 7fc43251c700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc42c17cdd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc428002a20 tx=0x7fc428007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.039+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280033d0 con 0x7fc4140046e0 2022-07-05T11:46:25.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.039+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800f870 con 0x7fc4140046e0 2022-07-05T11:46:25.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.039+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c164eb0 con 0x7fc4140046e0 2022-07-05T11:46:25.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.039+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800fc30 con 0x7fc4140046e0 2022-07-05T11:46:25.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.039+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c165470 con 0x7fc4140046e0 2022-07-05T11:46:25.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.039+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc42c0f1600 con 0x7fc4140046e0 2022-07-05T11:46:25.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc42801b030 con 0x7fc4140046e0 2022-07-05T11:46:25.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc41a7fc700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc40c08ba40 0x7fc40c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc4280b0df0 con 0x7fc4140046e0 2022-07-05T11:46:25.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc431d1b700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc40c08ba40 0x7fc40c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc41a7fc700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6810/37187,v1:172.21.15.110:6811/37187] conn(0x7fc40c097420 0x7fc40c0998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 --> [v2:172.21.15.110:6810/37187,v1:172.21.15.110:6811/37187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc40c099f40 con 0x7fc40c097420 2022-07-05T11:46:25.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4280b1160 con 0x7fc4140046e0 2022-07-05T11:46:25.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.041+0000 7fc432d1d700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6810/37187,v1:172.21.15.110:6811/37187] conn(0x7fc40c097420 0x7fc40c0998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.042+0000 7fc431d1b700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc40c08ba40 0x7fc40c08df00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fc41c001e70 tx=0x7fc41c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.042+0000 7fc432d1d700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6810/37187,v1:172.21.15.110:6811/37187] conn(0x7fc40c097420 0x7fc40c0998c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.042+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== osd.1 v2:172.21.15.110:6810/37187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc40c099f40 con 0x7fc40c097420 2022-07-05T11:46:25.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 --> [v2:172.21.15.110:6810/37187,v1:172.21.15.110:6811/37187] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc42c06be40 con 0x7fc40c097420 2022-07-05T11:46:25.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc41a7fc700 1 -- 172.21.15.90:0/1447932700 <== osd.1 v2:172.21.15.110:6810/37187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc42c06be40 con 0x7fc40c097420 2022-07-05T11:46:25.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6810/37187,v1:172.21.15.110:6811/37187] conn(0x7fc40c097420 msgr2=0x7fc40c0998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6810/37187,v1:172.21.15.110:6811/37187] conn(0x7fc40c097420 0x7fc40c0998c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc40c08ba40 msgr2=0x7fc40c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc40c08ba40 0x7fc40c08df00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fc41c001e70 tx=0x7fc41c015000).stop 2022-07-05T11:46:25.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 msgr2=0x7fc42c17cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 --2- 172.21.15.90:0/1447932700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4140046e0 0x7fc42c17cdd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc428002a20 tx=0x7fc428007bb0).stop 2022-07-05T11:46:25.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc432d1d700 1 -- 172.21.15.90:0/1447932700 reap_dead start 2022-07-05T11:46:25.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 shutdown_connections 2022-07-05T11:46:25.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.057+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 >> 172.21.15.90:0/1447932700 conn(0x7fc42c05e440 msgr2=0x7fc42c0edc20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.058+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 shutdown_connections 2022-07-05T11:46:25.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.058+0000 7fc434780700 1 -- 172.21.15.90:0/1447932700 wait complete. 2022-07-05T11:46:25.069 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:25.070 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-07-05T11:46:25.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.182+0000 7f5f46f48700 1 Processor -- start 2022-07-05T11:46:25.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.182+0000 7f5f46f48700 1 -- start start 2022-07-05T11:46:25.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f46f48700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f401782d0 0x7f5f4017fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f46f48700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400854c0 con 0x7f5f401786b0 2022-07-05T11:46:25.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f46f48700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f40086060 con 0x7f5f4017f0e0 2022-07-05T11:46:25.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f46f48700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f40178b40 con 0x7f5f401782d0 2022-07-05T11:46:25.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f44ce4700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f401782d0 0x7f5f4017fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f454e5700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5f401786b0 0x7f5f400ed300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59440/0 (socket says 172.21.15.90:59440) 2022-07-05T11:46:25.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f44ce4700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f401782d0 0x7f5f4017fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:33222/0 (socket says 172.21.15.90:33222) 2022-07-05T11:46:25.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f454e5700 1 -- 172.21.15.90:0/1144524260 learned_addr learned my addr 172.21.15.90:0/1144524260 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:25.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f3f7fe700 1 -- 172.21.15.90:0/1144524260 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313558476 0 0) 0x7f5f40086060 con 0x7f5f4017f0e0 2022-07-05T11:46:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f44ce4700 1 -- 172.21.15.90:0/1144524260 >> v1:172.21.15.149:6789/0 conn(0x7f5f4017f0e0 legacy=0x7f5f40085950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f44ce4700 1 -- 172.21.15.90:0/1144524260 >> v1:172.21.15.110:6789/0 conn(0x7f5f401786b0 legacy=0x7f5f400ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.183+0000 7f5f44ce4700 1 -- 172.21.15.90:0/1144524260 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400845d0 con 0x7f5f401782d0 2022-07-05T11:46:25.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f44ce4700 1 --2- 172.21.15.90:0/1144524260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401782d0 0x7f5f4017fa70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5f30009760 tx=0x7f5f30009060).ready entity=mon.1 client_cookie=f9e7e5a9e792755 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f3f7fe700 1 -- 172.21.15.90:0/1144524260 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000b580 con 0x7f5f401782d0 2022-07-05T11:46:25.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f3f7fe700 1 -- 172.21.15.90:0/1144524260 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000b6e0 con 0x7f5f401782d0 2022-07-05T11:46:25.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f3f7fe700 1 -- 172.21.15.90:0/1144524260 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000ba60 con 0x7f5f401782d0 2022-07-05T11:46:25.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f46f48700 1 -- 172.21.15.90:0/1144524260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401782d0 msgr2=0x7f5f4017fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f46f48700 1 --2- 172.21.15.90:0/1144524260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401782d0 0x7f5f4017fa70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5f30009760 tx=0x7f5f30009060).stop 2022-07-05T11:46:25.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f46f48700 1 -- 172.21.15.90:0/1144524260 shutdown_connections 2022-07-05T11:46:25.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f46f48700 1 --2- 172.21.15.90:0/1144524260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401782d0 0x7f5f4017fa70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f46f48700 1 -- 172.21.15.90:0/1144524260 >> 172.21.15.90:0/1144524260 conn(0x7f5f400f2960 msgr2=0x7f5f400f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f46f48700 1 -- 172.21.15.90:0/1144524260 shutdown_connections 2022-07-05T11:46:25.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.184+0000 7f5f46f48700 1 -- 172.21.15.90:0/1144524260 wait complete. 2022-07-05T11:46:25.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.186+0000 7f5f46f48700 1 Processor -- start 2022-07-05T11:46:25.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.186+0000 7f5f46f48700 1 -- start start 2022-07-05T11:46:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f46f48700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f401782d0 0x7f5f400f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f46f48700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401786b0 0x7f5f4016ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f46f48700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f4017f0e0 0x7f5f4016f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f46f48700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400eb890 con 0x7f5f4017f0e0 2022-07-05T11:46:25.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f46f48700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400ea6c0 con 0x7f5f401786b0 2022-07-05T11:46:25.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f46f48700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400ea9a0 con 0x7f5f401782d0 2022-07-05T11:46:25.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f4017f0e0 0x7f5f4016f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f4017f0e0 0x7f5f4016f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56908/0 (socket says 172.21.15.90:56908) 2022-07-05T11:46:25.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 -- 172.21.15.90:0/1511184354 learned_addr learned my addr 172.21.15.90:0/1511184354 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f3ffff700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401786b0 0x7f5f4016ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f44ce4700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f401782d0 0x7f5f400f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 -- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f401782d0 msgr2=0x7f5f400f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f401782d0 0x7f5f400f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 -- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401786b0 msgr2=0x7f5f4016ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f401786b0 0x7f5f4016ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 -- 172.21.15.90:0/1511184354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f300092a0 con 0x7f5f4017f0e0 2022-07-05T11:46:25.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.187+0000 7f5f454e5700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f4017f0e0 0x7f5f4016f480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f5f3800c790 tx=0x7f5f380015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.188+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38005d30 con 0x7f5f4017f0e0 2022-07-05T11:46:25.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.188+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38005e90 con 0x7f5f4017f0e0 2022-07-05T11:46:25.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.188+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f400eac80 con 0x7f5f4017f0e0 2022-07-05T11:46:25.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.188+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38007320 con 0x7f5f4017f0e0 2022-07-05T11:46:25.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.188+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f400eb240 con 0x7f5f4017f0e0 2022-07-05T11:46:25.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.188+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f4006be40 con 0x7f5f4017f0e0 2022-07-05T11:46:25.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.190+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f5f38010030 con 0x7f5f4017f0e0 2022-07-05T11:46:25.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.190+0000 7f5f3cff9700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f2008ba40 0x7f5f2008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.190+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f5f380b0fc0 con 0x7f5f4017f0e0 2022-07-05T11:46:25.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.190+0000 7f5f44ce4700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f2008ba40 0x7f5f2008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.190+0000 7f5f3cff9700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:6802/37786,v1:172.21.15.149:6805/37786] conn(0x7f5f20097420 0x7f5f200998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.190+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 --> [v2:172.21.15.149:6802/37786,v1:172.21.15.149:6805/37786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f20099f40 con 0x7f5f20097420 2022-07-05T11:46:25.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.190+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f380b12d0 con 0x7f5f4017f0e0 2022-07-05T11:46:25.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.191+0000 7f5f44ce4700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f2008ba40 0x7f5f2008df00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5f3000b340 tx=0x7f5f30017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.191+0000 7f5f3ffff700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:6802/37786,v1:172.21.15.149:6805/37786] conn(0x7f5f20097420 0x7f5f200998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.191+0000 7f5f3ffff700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:6802/37786,v1:172.21.15.149:6805/37786] conn(0x7f5f20097420 0x7f5f200998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.192+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== osd.2 v2:172.21.15.149:6802/37786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f5f20099f40 con 0x7f5f20097420 2022-07-05T11:46:25.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.205+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 --> [v2:172.21.15.149:6802/37786,v1:172.21.15.149:6805/37786] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f400848b0 con 0x7f5f20097420 2022-07-05T11:46:25.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f3cff9700 1 -- 172.21.15.90:0/1511184354 <== osd.2 v2:172.21.15.149:6802/37786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5f400848b0 con 0x7f5f20097420 2022-07-05T11:46:25.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:6802/37786,v1:172.21.15.149:6805/37786] conn(0x7f5f20097420 msgr2=0x7f5f200998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.149:6802/37786,v1:172.21.15.149:6805/37786] conn(0x7f5f20097420 0x7f5f200998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f2008ba40 msgr2=0x7f5f2008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f2008ba40 0x7f5f2008df00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5f3000b340 tx=0x7f5f30017000).stop 2022-07-05T11:46:25.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f4017f0e0 msgr2=0x7f5f4016f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 --2- 172.21.15.90:0/1511184354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f4017f0e0 0x7f5f4016f480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f5f3800c790 tx=0x7f5f380015e0).stop 2022-07-05T11:46:25.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f454e5700 1 -- 172.21.15.90:0/1511184354 reap_dead start 2022-07-05T11:46:25.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 shutdown_connections 2022-07-05T11:46:25.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 >> 172.21.15.90:0/1511184354 conn(0x7f5f400f2960 msgr2=0x7f5f400f0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 shutdown_connections 2022-07-05T11:46:25.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.206+0000 7f5f46f48700 1 -- 172.21.15.90:0/1511184354 wait complete. 2022-07-05T11:46:25.219 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:25.220 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-07-05T11:46:25.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.332+0000 7f5a4b9cf700 1 Processor -- start 2022-07-05T11:46:25.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.332+0000 7f5a4b9cf700 1 -- start start 2022-07-05T11:46:25.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.333+0000 7f5a4b9cf700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a4417da60 0x7f5a4417de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.333+0000 7f5a4b9cf700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440c9090 con 0x7f5a440c7d00 2022-07-05T11:46:25.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a4b9cf700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440c81a0 con 0x7f5a440c9520 2022-07-05T11:46:25.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a4b9cf700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440c8480 con 0x7f5a4417da60 2022-07-05T11:46:25.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a48f6a700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5a440c7d00 0x7f5a4417eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49860/0 (socket says 172.21.15.90:49860) 2022-07-05T11:46:25.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a48f6a700 1 -- 172.21.15.90:0/2088604453 learned_addr learned my addr 172.21.15.90:0/2088604453 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:25.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a4976b700 1 --2- 172.21.15.90:0/2088604453 >> v2:172.21.15.110:3300/0 conn(0x7f5a4417da60 0x7f5a4417de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166185460 0 0) 0x7f5a440c9090 con 0x7f5a440c7d00 2022-07-05T11:46:25.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a2c0033f0 con 0x7f5a440c7d00 2022-07-05T11:46:25.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 602690030 0 0) 0x7f5a2c0033f0 con 0x7f5a440c7d00 2022-07-05T11:46:25.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 >> v2:172.21.15.110:3300/0 conn(0x7f5a4417da60 msgr2=0x7f5a4417de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 --2- 172.21.15.90:0/2088604453 >> v2:172.21.15.110:3300/0 conn(0x7f5a4417da60 0x7f5a4417de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 >> v1:172.21.15.110:6789/0 conn(0x7f5a440c9520 legacy=0x7f5a440c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440c8760 con 0x7f5a440c7d00 2022-07-05T11:46:25.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f5a34001470 con 0x7f5a440c7d00 2022-07-05T11:46:25.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 >> v1:172.21.15.90:6789/0 conn(0x7f5a440c7d00 legacy=0x7f5a4417eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a2c003930 0x7f5a2c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a2c004690 0x7f5a2c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a2c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440c8480 con 0x7f5a2c005000 2022-07-05T11:46:25.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c00bf30 con 0x7f5a2c003930 2022-07-05T11:46:25.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c00c0f0 con 0x7f5a2c004690 2022-07-05T11:46:25.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a2c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.334+0000 7f5a4976b700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a2c003930 0x7f5a2c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a48f6a700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a2c004690 0x7f5a2c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a49f6c700 1 -- 172.21.15.90:0/2088604453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a2c004690 msgr2=0x7f5a2c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a2c004690 0x7f5a2c004b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a49f6c700 1 -- 172.21.15.90:0/2088604453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a2c003930 msgr2=0x7f5a2c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a2c003930 0x7f5a2c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a49f6c700 1 -- 172.21.15.90:0/2088604453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0033f0 con 0x7f5a2c005000 2022-07-05T11:46:25.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a4976b700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a2c003930 0x7f5a2c003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:25.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a49f6c700 1 -- 172.21.15.90:0/2088604453 reap_dead start 2022-07-05T11:46:25.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a2c00b8e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5a3c001e30 tx=0x7f5a3c007f30).ready entity=mon.0 client_cookie=df1e22d5ea8d0936 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c006a20 con 0x7f5a2c005000 2022-07-05T11:46:25.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c006b80 con 0x7f5a2c005000 2022-07-05T11:46:25.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a33fff700 1 -- 172.21.15.90:0/2088604453 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00c5d0 con 0x7f5a2c005000 2022-07-05T11:46:25.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/2088604453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 msgr2=0x7f5a2c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.335+0000 7f5a4b9cf700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a2c00b8e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5a3c001e30 tx=0x7f5a3c007f30).stop 2022-07-05T11:46:25.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.336+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/2088604453 shutdown_connections 2022-07-05T11:46:25.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.336+0000 7f5a4b9cf700 1 --2- 172.21.15.90:0/2088604453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a2c00b8e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.336+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/2088604453 >> 172.21.15.90:0/2088604453 conn(0x7f5a440f4b70 msgr2=0x7f5a440f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.336+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/2088604453 shutdown_connections 2022-07-05T11:46:25.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.336+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/2088604453 wait complete. 2022-07-05T11:46:25.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.337+0000 7f5a4b9cf700 1 Processor -- start 2022-07-05T11:46:25.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.337+0000 7f5a4b9cf700 1 -- start start 2022-07-05T11:46:25.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4b9cf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a44087c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4b9cf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a44192080 0x7f5a441737c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4b9cf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a44173cb0 0x7f5a4417ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4b9cf700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44174130 con 0x7f5a2c005000 2022-07-05T11:46:25.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4b9cf700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4417a850 con 0x7f5a44173cb0 2022-07-05T11:46:25.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4b9cf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44184500 con 0x7f5a44192080 2022-07-05T11:46:25.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4976b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a44087c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4976b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a44087c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56930/0 (socket says 172.21.15.90:56930) 2022-07-05T11:46:25.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a4976b700 1 -- 172.21.15.90:0/720239364 learned_addr learned my addr 172.21.15.90:0/720239364 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a44173cb0 0x7f5a4417ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.338+0000 7f5a48f6a700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a44192080 0x7f5a441737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4976b700 1 -- 172.21.15.90:0/720239364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a44192080 msgr2=0x7f5a441737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4976b700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a44192080 0x7f5a441737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4976b700 1 -- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a44173cb0 msgr2=0x7f5a4417ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4976b700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a44173cb0 0x7f5a4417ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4976b700 1 -- 172.21.15.90:0/720239364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a441847e0 con 0x7f5a2c005000 2022-07-05T11:46:25.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a44173cb0 0x7f5a4417ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:25.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4976b700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a44087c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f5a40011b70 tx=0x7f5a40009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000fa10 con 0x7f5a2c005000 2022-07-05T11:46:25.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000fb70 con 0x7f5a2c005000 2022-07-05T11:46:25.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40014440 con 0x7f5a2c005000 2022-07-05T11:46:25.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a44179f20 con 0x7f5a2c005000 2022-07-05T11:46:25.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.339+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4417a4e0 con 0x7f5a2c005000 2022-07-05T11:46:25.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.340+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a4406be40 con 0x7f5a2c005000 2022-07-05T11:46:25.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.340+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f5a40024070 con 0x7f5a2c005000 2022-07-05T11:46:25.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a317fa700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5a2408ba40 0x7f5a2408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f5a400b1880 con 0x7f5a2c005000 2022-07-05T11:46:25.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a48f6a700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5a2408ba40 0x7f5a2408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a317fa700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:6800/37449,v1:172.21.15.90:6801/37449] conn(0x7f5a24097420 0x7f5a240998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 --> [v2:172.21.15.90:6800/37449,v1:172.21.15.90:6801/37449] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a24099f40 con 0x7f5a24097420 2022-07-05T11:46:25.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a400b1bf0 con 0x7f5a2c005000 2022-07-05T11:46:25.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:6800/37449,v1:172.21.15.90:6801/37449] conn(0x7f5a24097420 0x7f5a240998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.341+0000 7f5a48f6a700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5a2408ba40 0x7f5a2408df00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5a34001ed0 tx=0x7f5a34009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.342+0000 7f5a49f6c700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:6800/37449,v1:172.21.15.90:6801/37449] conn(0x7f5a24097420 0x7f5a240998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.342+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== osd.3 v2:172.21.15.90:6800/37449 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f5a24099f40 con 0x7f5a24097420 2022-07-05T11:46:25.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.356+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 --> [v2:172.21.15.90:6800/37449,v1:172.21.15.90:6801/37449] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a440c8a40 con 0x7f5a24097420 2022-07-05T11:46:25.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.356+0000 7f5a317fa700 1 -- 172.21.15.90:0/720239364 <== osd.3 v2:172.21.15.90:6800/37449 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a440c8a40 con 0x7f5a24097420 2022-07-05T11:46:25.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:6800/37449,v1:172.21.15.90:6801/37449] conn(0x7f5a24097420 msgr2=0x7f5a240998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:6800/37449,v1:172.21.15.90:6801/37449] conn(0x7f5a24097420 0x7f5a240998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5a2408ba40 msgr2=0x7f5a2408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5a2408ba40 0x7f5a2408df00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5a34001ed0 tx=0x7f5a34009040).stop 2022-07-05T11:46:25.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 msgr2=0x7f5a44087c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 --2- 172.21.15.90:0/720239364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a2c005000 0x7f5a44087c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f5a40011b70 tx=0x7f5a40009060).stop 2022-07-05T11:46:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a49f6c700 1 -- 172.21.15.90:0/720239364 reap_dead start 2022-07-05T11:46:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 shutdown_connections 2022-07-05T11:46:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 >> 172.21.15.90:0/720239364 conn(0x7f5a440f4b70 msgr2=0x7f5a44176d20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 shutdown_connections 2022-07-05T11:46:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.357+0000 7f5a4b9cf700 1 -- 172.21.15.90:0/720239364 wait complete. 2022-07-05T11:46:25.372 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:25.373 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-07-05T11:46:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.483+0000 7fecddc3b700 1 Processor -- start 2022-07-05T11:46:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.483+0000 7fecddc3b700 1 -- start start 2022-07-05T11:46:25.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.484+0000 7fecddc3b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fecd817da60 0x7fecd817de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.484+0000 7fecddc3b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fecd80c7d00 0x7fecd817eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.484+0000 7fecddc3b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80c9090 con 0x7fecd817f070 2022-07-05T11:46:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.484+0000 7fecddc3b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80c81a0 con 0x7fecd817da60 2022-07-05T11:46:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.484+0000 7fecddc3b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80c8480 con 0x7fecd80c7d00 2022-07-05T11:46:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fecd817da60 0x7fecd817de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fecd817da60 0x7fecd817de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56938/0 (socket says 172.21.15.90:56938) 2022-07-05T11:46:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 -- 172.21.15.90:0/4019896575 learned_addr learned my addr 172.21.15.90:0/4019896575 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 -- 172.21.15.90:0/4019896575 >> v2:172.21.15.110:3300/0 conn(0x7fecd80c7d00 msgr2=0x7fecd817eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd6ffd700 1 --2- 172.21.15.90:0/4019896575 >> v2:172.21.15.110:3300/0 conn(0x7fecd80c7d00 0x7fecd817eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 --2- 172.21.15.90:0/4019896575 >> v2:172.21.15.110:3300/0 conn(0x7fecd80c7d00 0x7fecd817eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 -- 172.21.15.90:0/4019896575 >> v1:172.21.15.149:6789/0 conn(0x7fecd817f070 legacy=0x7fecd80c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 -- 172.21.15.90:0/4019896575 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80c8760 con 0x7fecd817da60 2022-07-05T11:46:25.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd77fe700 1 --2- 172.21.15.90:0/4019896575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd817da60 0x7fecd817de40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fecc8009f20 tx=0x7fecc8009840).ready entity=mon.0 client_cookie=760d1df3d62045de server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd67fc700 1 -- 172.21.15.90:0/4019896575 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800e070 con 0x7fecd817da60 2022-07-05T11:46:25.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd67fc700 1 -- 172.21.15.90:0/4019896575 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc800ba40 con 0x7fecd817da60 2022-07-05T11:46:25.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.485+0000 7fecd67fc700 1 -- 172.21.15.90:0/4019896575 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800bdc0 con 0x7fecd817da60 2022-07-05T11:46:25.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 -- 172.21.15.90:0/4019896575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd817da60 msgr2=0x7fecd817de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 --2- 172.21.15.90:0/4019896575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd817da60 0x7fecd817de40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fecc8009f20 tx=0x7fecc8009840).stop 2022-07-05T11:46:25.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 -- 172.21.15.90:0/4019896575 shutdown_connections 2022-07-05T11:46:25.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 --2- 172.21.15.90:0/4019896575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd817da60 0x7fecd817de40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 --2- 172.21.15.90:0/4019896575 >> v2:172.21.15.110:3300/0 conn(0x7fecd80c7d00 0x7fecd817eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 -- 172.21.15.90:0/4019896575 >> 172.21.15.90:0/4019896575 conn(0x7fecd80f4b70 msgr2=0x7fecd80f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 -- 172.21.15.90:0/4019896575 shutdown_connections 2022-07-05T11:46:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.486+0000 7fecddc3b700 1 -- 172.21.15.90:0/4019896575 wait complete. 2022-07-05T11:46:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.487+0000 7fecddc3b700 1 Processor -- start 2022-07-05T11:46:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.487+0000 7fecddc3b700 1 -- start start 2022-07-05T11:46:25.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecddc3b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd80c7d00 0x7fecd818f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecddc3b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd817da60 0x7fecd8157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecddc3b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd817f070 0x7fecd8158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecddc3b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd818f630 con 0x7fecd80c7d00 2022-07-05T11:46:25.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecddc3b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd818e570 con 0x7fecd817f070 2022-07-05T11:46:25.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecddc3b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd818d680 con 0x7fecd817da60 2022-07-05T11:46:25.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecd77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd80c7d00 0x7fecd818f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecd77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd80c7d00 0x7fecd818f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56944/0 (socket says 172.21.15.90:56944) 2022-07-05T11:46:25.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.488+0000 7fecd77fe700 1 -- 172.21.15.90:0/927556191 learned_addr learned my addr 172.21.15.90:0/927556191 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd6ffd700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd817da60 0x7fecd8157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd7fff700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd817f070 0x7fecd8158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd77fe700 1 -- 172.21.15.90:0/927556191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd817da60 msgr2=0x7fecd8157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd77fe700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd817da60 0x7fecd8157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd77fe700 1 -- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd817f070 msgr2=0x7fecd8158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd77fe700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd817f070 0x7fecd8158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd77fe700 1 -- 172.21.15.90:0/927556191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009ae0 con 0x7fecd80c7d00 2022-07-05T11:46:25.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd7fff700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecd817f070 0x7fecd8158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:25.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecd77fe700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd80c7d00 0x7fecd818f140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fecc800c010 tx=0x7fecc8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800bdc0 con 0x7fecd80c7d00 2022-07-05T11:46:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc801c400 con 0x7fecd80c7d00 2022-07-05T11:46:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc801c7a0 con 0x7fecd80c7d00 2022-07-05T11:46:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd818d960 con 0x7fecd80c7d00 2022-07-05T11:46:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.489+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd818df20 con 0x7fecd80c7d00 2022-07-05T11:46:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.490+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecd8084900 con 0x7fecd80c7d00 2022-07-05T11:46:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.491+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fecc801cb90 con 0x7fecd80c7d00 2022-07-05T11:46:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.491+0000 7fecbf7fe700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fecb808ba40 0x7fecb808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.491+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fecc80b2f50 con 0x7fecd80c7d00 2022-07-05T11:46:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.491+0000 7fecbf7fe700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6802/37188,v1:172.21.15.110:6803/37188] conn(0x7fecb8097420 0x7fecb80998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.491+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 --> [v2:172.21.15.110:6802/37188,v1:172.21.15.110:6803/37188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecb8099f40 con 0x7fecb8097420 2022-07-05T11:46:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.491+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc80b32c0 con 0x7fecd80c7d00 2022-07-05T11:46:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.492+0000 7fecd6ffd700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fecb808ba40 0x7fecb808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.492+0000 7fecd7fff700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6802/37188,v1:172.21.15.110:6803/37188] conn(0x7fecb8097420 0x7fecb80998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.492+0000 7fecd6ffd700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fecb808ba40 0x7fecb808df00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fecd8064f50 tx=0x7feccc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.492+0000 7fecd7fff700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6802/37188,v1:172.21.15.110:6803/37188] conn(0x7fecb8097420 0x7fecb80998c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.493+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== osd.4 v2:172.21.15.110:6802/37188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fecb8099f40 con 0x7fecb8097420 2022-07-05T11:46:25.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 --> [v2:172.21.15.110:6802/37188,v1:172.21.15.110:6803/37188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecd806be40 con 0x7fecb8097420 2022-07-05T11:46:25.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecbf7fe700 1 -- 172.21.15.90:0/927556191 <== osd.4 v2:172.21.15.110:6802/37188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecd806be40 con 0x7fecb8097420 2022-07-05T11:46:25.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6802/37188,v1:172.21.15.110:6803/37188] conn(0x7fecb8097420 msgr2=0x7fecb80998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecddc3b700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6802/37188,v1:172.21.15.110:6803/37188] conn(0x7fecb8097420 0x7fecb80998c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fecb808ba40 msgr2=0x7fecb808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecddc3b700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fecb808ba40 0x7fecb808df00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fecd8064f50 tx=0x7feccc008040).stop 2022-07-05T11:46:25.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd80c7d00 msgr2=0x7fecd818f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecddc3b700 1 --2- 172.21.15.90:0/927556191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecd80c7d00 0x7fecd818f140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fecc800c010 tx=0x7fecc8009840).stop 2022-07-05T11:46:25.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.507+0000 7fecd7fff700 1 -- 172.21.15.90:0/927556191 reap_dead start 2022-07-05T11:46:25.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.508+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 shutdown_connections 2022-07-05T11:46:25.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.508+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 >> 172.21.15.90:0/927556191 conn(0x7fecd80f4b70 msgr2=0x7fecd80c4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.508+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 shutdown_connections 2022-07-05T11:46:25.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.508+0000 7fecddc3b700 1 -- 172.21.15.90:0/927556191 wait complete. 2022-07-05T11:46:25.520 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:25.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-07-05T11:46:25.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.634+0000 7fe9474ef700 1 Processor -- start 2022-07-05T11:46:25.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.634+0000 7fe9474ef700 1 -- start start 2022-07-05T11:46:25.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.635+0000 7fe9474ef700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe9400ee270 0x7fe940084ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.635+0000 7fe9474ef700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9400ee6c0 con 0x7fe94017b750 2022-07-05T11:46:25.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.635+0000 7fe9474ef700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe940083710 con 0x7fe94017bb30 2022-07-05T11:46:25.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.635+0000 7fe9474ef700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400839f0 con 0x7fe9400ee270 2022-07-05T11:46:25.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.635+0000 7fe946cee700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe9400ee270 0x7fe940084ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.635+0000 7fe9464ed700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe94017b750 0x7fe9400edb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49894/0 (socket says 172.21.15.90:49894) 2022-07-05T11:46:25.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.635+0000 7fe9464ed700 1 -- 172.21.15.90:0/1876439979 learned_addr learned my addr 172.21.15.90:0/1876439979 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:25.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe946cee700 1 -- 172.21.15.90:0/1876439979 >> v1:172.21.15.110:6789/0 conn(0x7fe94017bb30 legacy=0x7fe9400847b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe946cee700 1 -- 172.21.15.90:0/1876439979 >> v1:172.21.15.90:6789/0 conn(0x7fe94017b750 legacy=0x7fe9400edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9454eb700 1 -- 172.21.15.90:0/1876439979 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831574545 0 0) 0x7fe9400ee6c0 con 0x7fe94017b750 2022-07-05T11:46:25.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe946cee700 1 -- 172.21.15.90:0/1876439979 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940083cd0 con 0x7fe9400ee270 2022-07-05T11:46:25.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe946cee700 1 --2- 172.21.15.90:0/1876439979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9400ee270 0x7fe940084ec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe93c009760 tx=0x7fe93c009060).ready entity=mon.0 client_cookie=1de798eba833588c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9454eb700 1 -- 172.21.15.90:0/1876439979 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c009120 con 0x7fe9400ee270 2022-07-05T11:46:25.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9454eb700 1 -- 172.21.15.90:0/1876439979 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00b580 con 0x7fe9400ee270 2022-07-05T11:46:25.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9454eb700 1 -- 172.21.15.90:0/1876439979 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00b900 con 0x7fe9400ee270 2022-07-05T11:46:25.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9474ef700 1 -- 172.21.15.90:0/1876439979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9400ee270 msgr2=0x7fe940084ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9474ef700 1 --2- 172.21.15.90:0/1876439979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9400ee270 0x7fe940084ec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe93c009760 tx=0x7fe93c009060).stop 2022-07-05T11:46:25.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9474ef700 1 -- 172.21.15.90:0/1876439979 shutdown_connections 2022-07-05T11:46:25.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9474ef700 1 --2- 172.21.15.90:0/1876439979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9400ee270 0x7fe940084ec0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9474ef700 1 -- 172.21.15.90:0/1876439979 >> 172.21.15.90:0/1876439979 conn(0x7fe9400f27c0 msgr2=0x7fe9400f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9474ef700 1 -- 172.21.15.90:0/1876439979 shutdown_connections 2022-07-05T11:46:25.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.636+0000 7fe9474ef700 1 -- 172.21.15.90:0/1876439979 wait complete. 2022-07-05T11:46:25.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.638+0000 7fe9474ef700 1 Processor -- start 2022-07-05T11:46:25.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.638+0000 7fe9474ef700 1 -- start start 2022-07-05T11:46:25.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9474ef700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9400ee270 0x7fe940174360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9474ef700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94017b750 0x7fe9400e9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9474ef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94017bb30 0x7fe9400ea020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9474ef700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400eb6d0 con 0x7fe94017b750 2022-07-05T11:46:25.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9474ef700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400ea510 con 0x7fe9400ee270 2022-07-05T11:46:25.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9474ef700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400ea7e0 con 0x7fe94017bb30 2022-07-05T11:46:25.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94017b750 0x7fe9400e9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94017b750 0x7fe9400e9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56962/0 (socket says 172.21.15.90:56962) 2022-07-05T11:46:25.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 -- 172.21.15.90:0/3388421145 learned_addr learned my addr 172.21.15.90:0/3388421145 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe946cee700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94017bb30 0x7fe9400ea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9464ed700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9400ee270 0x7fe940174360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 -- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94017bb30 msgr2=0x7fe9400ea020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94017bb30 0x7fe9400ea020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 -- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9400ee270 msgr2=0x7fe940174360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9400ee270 0x7fe940174360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 -- 172.21.15.90:0/3388421145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c0092a0 con 0x7fe94017b750 2022-07-05T11:46:25.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe945cec700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94017b750 0x7fe9400e9b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe93000c440 tx=0x7fe930007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000f470 con 0x7fe94017b750 2022-07-05T11:46:25.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93000f5f0 con 0x7fe94017b750 2022-07-05T11:46:25.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9400eaac0 con 0x7fe94017b750 2022-07-05T11:46:25.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.639+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000f9b0 con 0x7fe94017b750 2022-07-05T11:46:25.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.640+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9400eb080 con 0x7fe94017b750 2022-07-05T11:46:25.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.640+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe94006be40 con 0x7fe94017b750 2022-07-05T11:46:25.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.641+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe930019030 con 0x7fe94017b750 2022-07-05T11:46:25.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe92e7fc700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe92008ba40 0x7fe92008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe9300affd0 con 0x7fe94017b750 2022-07-05T11:46:25.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe92e7fc700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:6803/37784,v1:172.21.15.149:6806/37784] conn(0x7fe920097420 0x7fe9200998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 --> [v2:172.21.15.149:6803/37784,v1:172.21.15.149:6806/37784] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe920099f40 con 0x7fe920097420 2022-07-05T11:46:25.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9300b0340 con 0x7fe94017b750 2022-07-05T11:46:25.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe9464ed700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe92008ba40 0x7fe92008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe946cee700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:6803/37784,v1:172.21.15.149:6806/37784] conn(0x7fe920097420 0x7fe9200998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.642+0000 7fe9464ed700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe92008ba40 0x7fe92008df00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe938001560 tx=0x7fe938009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.643+0000 7fe946cee700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:6803/37784,v1:172.21.15.149:6806/37784] conn(0x7fe920097420 0x7fe9200998c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.643+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== osd.5 v2:172.21.15.149:6803/37784 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe920099f40 con 0x7fe920097420 2022-07-05T11:46:25.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.657+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 --> [v2:172.21.15.149:6803/37784,v1:172.21.15.149:6806/37784] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe94017d370 con 0x7fe920097420 2022-07-05T11:46:25.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe92e7fc700 1 -- 172.21.15.90:0/3388421145 <== osd.5 v2:172.21.15.149:6803/37784 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe93c00b840 con 0x7fe920097420 2022-07-05T11:46:25.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:6803/37784,v1:172.21.15.149:6806/37784] conn(0x7fe920097420 msgr2=0x7fe9200998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.149:6803/37784,v1:172.21.15.149:6806/37784] conn(0x7fe920097420 0x7fe9200998c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe92008ba40 msgr2=0x7fe92008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe92008ba40 0x7fe92008df00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe938001560 tx=0x7fe938009040).stop 2022-07-05T11:46:25.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94017b750 msgr2=0x7fe9400e9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 --2- 172.21.15.90:0/3388421145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94017b750 0x7fe9400e9b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe93000c440 tx=0x7fe930007dc0).stop 2022-07-05T11:46:25.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe946cee700 1 -- 172.21.15.90:0/3388421145 reap_dead start 2022-07-05T11:46:25.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 shutdown_connections 2022-07-05T11:46:25.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 >> 172.21.15.90:0/3388421145 conn(0x7fe9400f27c0 msgr2=0x7fe940085100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 shutdown_connections 2022-07-05T11:46:25.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.658+0000 7fe9474ef700 1 -- 172.21.15.90:0/3388421145 wait complete. 2022-07-05T11:46:25.680 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:25.680 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-07-05T11:46:25.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.793+0000 7fe296c7a700 1 Processor -- start 2022-07-05T11:46:25.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.793+0000 7fe296c7a700 1 -- start start 2022-07-05T11:46:25.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe296c7a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe29017dbb0 0x7fe29017ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe296c7a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe29017df90 0x7fe2900ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe296c7a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe290084870 con 0x7fe2900ed5c0 2022-07-05T11:46:25.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe296c7a700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe290084b50 con 0x7fe29017dbb0 2022-07-05T11:46:25.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe296c7a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900ec5f0 con 0x7fe29017df90 2022-07-05T11:46:25.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe29017dbb0 0x7fe29017ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe29017dbb0 0x7fe29017ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56970/0 (socket says 172.21.15.90:56970) 2022-07-05T11:46:25.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 -- 172.21.15.90:0/1691796675 learned_addr learned my addr 172.21.15.90:0/1691796675 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe28ffff700 1 --2- 172.21.15.90:0/1691796675 >> v2:172.21.15.110:3300/0 conn(0x7fe29017df90 0x7fe2900ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 -- 172.21.15.90:0/1691796675 >> v2:172.21.15.110:3300/0 conn(0x7fe29017df90 msgr2=0x7fe2900ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 --2- 172.21.15.90:0/1691796675 >> v2:172.21.15.110:3300/0 conn(0x7fe29017df90 0x7fe2900ed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 -- 172.21.15.90:0/1691796675 >> v1:172.21.15.149:6789/0 conn(0x7fe2900ed5c0 legacy=0x7fe290083820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 -- 172.21.15.90:0/1691796675 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900ec8d0 con 0x7fe29017dbb0 2022-07-05T11:46:25.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe294a16700 1 --2- 172.21.15.90:0/1691796675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe29017dbb0 0x7fe29017ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fe2900f16f0 tx=0x7fe2800090f0).ready entity=mon.0 client_cookie=dc110778d3c28633 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe28f7fe700 1 -- 172.21.15.90:0/1691796675 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000b5a0 con 0x7fe29017dbb0 2022-07-05T11:46:25.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe28f7fe700 1 -- 172.21.15.90:0/1691796675 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28000b700 con 0x7fe29017dbb0 2022-07-05T11:46:25.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.794+0000 7fe28f7fe700 1 -- 172.21.15.90:0/1691796675 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000ba80 con 0x7fe29017dbb0 2022-07-05T11:46:25.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 -- 172.21.15.90:0/1691796675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe29017dbb0 msgr2=0x7fe29017ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 --2- 172.21.15.90:0/1691796675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe29017dbb0 0x7fe29017ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fe2900f16f0 tx=0x7fe2800090f0).stop 2022-07-05T11:46:25.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 -- 172.21.15.90:0/1691796675 shutdown_connections 2022-07-05T11:46:25.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 --2- 172.21.15.90:0/1691796675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe29017dbb0 0x7fe29017ec40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 --2- 172.21.15.90:0/1691796675 >> v2:172.21.15.110:3300/0 conn(0x7fe29017df90 0x7fe2900ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 -- 172.21.15.90:0/1691796675 >> 172.21.15.90:0/1691796675 conn(0x7fe2900f17e0 msgr2=0x7fe2900f1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 -- 172.21.15.90:0/1691796675 shutdown_connections 2022-07-05T11:46:25.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.795+0000 7fe296c7a700 1 -- 172.21.15.90:0/1691796675 wait complete. 2022-07-05T11:46:25.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.796+0000 7fe296c7a700 1 Processor -- start 2022-07-05T11:46:25.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.797+0000 7fe296c7a700 1 -- start start 2022-07-05T11:46:25.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.797+0000 7fe296c7a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2900ed5c0 0x7fe29016ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.797+0000 7fe296c7a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29017dbb0 0x7fe29016b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.797+0000 7fe296c7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe29017df90 0x7fe290162020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe296c7a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29016a870 con 0x7fe2900ed5c0 2022-07-05T11:46:25.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe296c7a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290169980 con 0x7fe29017dbb0 2022-07-05T11:46:25.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe296c7a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290169c60 con 0x7fe29017df90 2022-07-05T11:46:25.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2900ed5c0 0x7fe29016ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2900ed5c0 0x7fe29016ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56976/0 (socket says 172.21.15.90:56976) 2022-07-05T11:46:25.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 -- 172.21.15.90:0/2985436868 learned_addr learned my addr 172.21.15.90:0/2985436868 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe295217700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe29017df90 0x7fe290162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe28ffff700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29017dbb0 0x7fe29016b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 -- 172.21.15.90:0/2985436868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe29017df90 msgr2=0x7fe290162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe29017df90 0x7fe290162020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 -- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29017dbb0 msgr2=0x7fe29016b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29017dbb0 0x7fe29016b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 -- 172.21.15.90:0/2985436868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280009370 con 0x7fe2900ed5c0 2022-07-05T11:46:25.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe28ffff700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29017dbb0 0x7fe29016b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:25.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe294a16700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2900ed5c0 0x7fe29016ad00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fe280009130 tx=0x7fe280015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000b870 con 0x7fe2900ed5c0 2022-07-05T11:46:25.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28000b9d0 con 0x7fe2900ed5c0 2022-07-05T11:46:25.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe290169f40 con 0x7fe2900ed5c0 2022-07-05T11:46:25.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28001c670 con 0x7fe2900ed5c0 2022-07-05T11:46:25.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.798+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29016a500 con 0x7fe2900ed5c0 2022-07-05T11:46:25.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.799+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe29006be40 con 0x7fe2900ed5c0 2022-07-05T11:46:25.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.800+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe28002c070 con 0x7fe2900ed5c0 2022-07-05T11:46:25.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.800+0000 7fe28cff9700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe27008ba40 0x7fe27008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.800+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe2800b2440 con 0x7fe2900ed5c0 2022-07-05T11:46:25.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.801+0000 7fe28cff9700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:6816/37464,v1:172.21.15.90:6817/37464] conn(0x7fe270097420 0x7fe2700998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.801+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 --> [v2:172.21.15.90:6816/37464,v1:172.21.15.90:6817/37464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe270099f40 con 0x7fe270097420 2022-07-05T11:46:25.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.801+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2800b4a20 con 0x7fe2900ed5c0 2022-07-05T11:46:25.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.801+0000 7fe28ffff700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe27008ba40 0x7fe27008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.801+0000 7fe295217700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:6816/37464,v1:172.21.15.90:6817/37464] conn(0x7fe270097420 0x7fe2700998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.801+0000 7fe295217700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:6816/37464,v1:172.21.15.90:6817/37464] conn(0x7fe270097420 0x7fe2700998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.801+0000 7fe28ffff700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe27008ba40 0x7fe27008df00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe284006fd0 tx=0x7fe284008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.802+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== osd.6 v2:172.21.15.90:6816/37464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe270099f40 con 0x7fe270097420 2022-07-05T11:46:25.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.815+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 --> [v2:172.21.15.90:6816/37464,v1:172.21.15.90:6817/37464] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe29016a9b0 con 0x7fe270097420 2022-07-05T11:46:25.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe28cff9700 1 -- 172.21.15.90:0/2985436868 <== osd.6 v2:172.21.15.90:6816/37464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe288003f70 con 0x7fe270097420 2022-07-05T11:46:25.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:6816/37464,v1:172.21.15.90:6817/37464] conn(0x7fe270097420 msgr2=0x7fe2700998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:6816/37464,v1:172.21.15.90:6817/37464] conn(0x7fe270097420 0x7fe2700998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe27008ba40 msgr2=0x7fe27008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe27008ba40 0x7fe27008df00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe284006fd0 tx=0x7fe284008040).stop 2022-07-05T11:46:25.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2900ed5c0 msgr2=0x7fe29016ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 --2- 172.21.15.90:0/2985436868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2900ed5c0 0x7fe29016ad00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fe280009130 tx=0x7fe280015000).stop 2022-07-05T11:46:25.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe295217700 1 -- 172.21.15.90:0/2985436868 reap_dead start 2022-07-05T11:46:25.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 shutdown_connections 2022-07-05T11:46:25.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 >> 172.21.15.90:0/2985436868 conn(0x7fe2900f17e0 msgr2=0x7fe2900eeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 shutdown_connections 2022-07-05T11:46:25.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.816+0000 7fe296c7a700 1 -- 172.21.15.90:0/2985436868 wait complete. 2022-07-05T11:46:25.831 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:25.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-07-05T11:46:25.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.943+0000 7f2f02ca0700 1 Processor -- start 2022-07-05T11:46:25.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.943+0000 7f2f02ca0700 1 -- start start 2022-07-05T11:46:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f02ca0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2efc17bac0 0x7f2efc0661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f02ca0700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2efc0666e0 0x7f2efc17e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f02ca0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc17dc60 con 0x7f2efc17e5e0 2022-07-05T11:46:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f02ca0700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc17d960 con 0x7f2efc17bac0 2022-07-05T11:46:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f02ca0700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc066c30 con 0x7f2efc0666e0 2022-07-05T11:46:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f00a3c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2efc17bac0 0x7f2efc0661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f00a3c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2efc17bac0 0x7f2efc0661f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56984/0 (socket says 172.21.15.90:56984) 2022-07-05T11:46:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2f00a3c700 1 -- 172.21.15.90:0/3407315018 learned_addr learned my addr 172.21.15.90:0/3407315018 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.944+0000 7f2efbfff700 1 --2- 172.21.15.90:0/3407315018 >> v2:172.21.15.110:3300/0 conn(0x7f2efc0666e0 0x7f2efc17e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f00a3c700 1 -- 172.21.15.90:0/3407315018 >> v2:172.21.15.110:3300/0 conn(0x7f2efc0666e0 msgr2=0x7f2efc17e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:25.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f00a3c700 1 --2- 172.21.15.90:0/3407315018 >> v2:172.21.15.110:3300/0 conn(0x7f2efc0666e0 0x7f2efc17e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f00a3c700 1 -- 172.21.15.90:0/3407315018 >> v1:172.21.15.149:6789/0 conn(0x7f2efc17e5e0 legacy=0x7f2efc0ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f00a3c700 1 -- 172.21.15.90:0/3407315018 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc066f10 con 0x7f2efc17bac0 2022-07-05T11:46:25.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f00a3c700 1 --2- 172.21.15.90:0/3407315018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17bac0 0x7f2efc0661f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2efc0f39f0 tx=0x7f2ef40090f0).ready entity=mon.0 client_cookie=711fb16c6af58b25 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2efb7fe700 1 -- 172.21.15.90:0/3407315018 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400b600 con 0x7f2efc17bac0 2022-07-05T11:46:25.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2efb7fe700 1 -- 172.21.15.90:0/3407315018 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400b760 con 0x7f2efc17bac0 2022-07-05T11:46:25.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2efb7fe700 1 -- 172.21.15.90:0/3407315018 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400bae0 con 0x7f2efc17bac0 2022-07-05T11:46:25.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 -- 172.21.15.90:0/3407315018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17bac0 msgr2=0x7f2efc0661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 --2- 172.21.15.90:0/3407315018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17bac0 0x7f2efc0661f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2efc0f39f0 tx=0x7f2ef40090f0).stop 2022-07-05T11:46:25.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 -- 172.21.15.90:0/3407315018 shutdown_connections 2022-07-05T11:46:25.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 --2- 172.21.15.90:0/3407315018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17bac0 0x7f2efc0661f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 --2- 172.21.15.90:0/3407315018 >> v2:172.21.15.110:3300/0 conn(0x7f2efc0666e0 0x7f2efc17e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 -- 172.21.15.90:0/3407315018 >> 172.21.15.90:0/3407315018 conn(0x7f2efc0f2960 msgr2=0x7f2efc0f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 -- 172.21.15.90:0/3407315018 shutdown_connections 2022-07-05T11:46:25.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.945+0000 7f2f02ca0700 1 -- 172.21.15.90:0/3407315018 wait complete. 2022-07-05T11:46:25.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.947+0000 7f2f02ca0700 1 Processor -- start 2022-07-05T11:46:25.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.947+0000 7f2f02ca0700 1 -- start start 2022-07-05T11:46:25.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f02ca0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc0666e0 0x7f2efc18dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f02ca0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2efc17bac0 0x7f2efc190850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f02ca0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17e5e0 0x7f2efc18f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f02ca0700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc18f1c0 con 0x7f2efc17e5e0 2022-07-05T11:46:25.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f02ca0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc18fb40 con 0x7f2efc17bac0 2022-07-05T11:46:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f02ca0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc18e2d0 con 0x7f2efc0666e0 2022-07-05T11:46:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17e5e0 0x7f2efc18f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17e5e0 0x7f2efc18f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56992/0 (socket says 172.21.15.90:56992) 2022-07-05T11:46:25.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 -- 172.21.15.90:0/1421173775 learned_addr learned my addr 172.21.15.90:0/1421173775 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:25.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2efbfff700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2efc17bac0 0x7f2efc190850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f00a3c700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc0666e0 0x7f2efc18dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 -- 172.21.15.90:0/1421173775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc0666e0 msgr2=0x7f2efc18dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc0666e0 0x7f2efc18dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 -- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2efc17bac0 msgr2=0x7f2efc190850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2efc17bac0 0x7f2efc190850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 -- 172.21.15.90:0/1421173775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4009370 con 0x7f2efc17e5e0 2022-07-05T11:46:25.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2efbfff700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2efc17bac0 0x7f2efc190850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:25.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2f0123d700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17e5e0 0x7f2efc18f650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2ee400c470 tx=0x7f2ee4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.948+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400ce30 con 0x7f2efc17e5e0 2022-07-05T11:46:25.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.949+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400f470 con 0x7f2efc17e5e0 2022-07-05T11:46:25.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.949+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc18e5b0 con 0x7f2efc17e5e0 2022-07-05T11:46:25.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.949+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400f7f0 con 0x7f2efc17e5e0 2022-07-05T11:46:25.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.949+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc18eb70 con 0x7f2efc17e5e0 2022-07-05T11:46:25.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.949+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2efc06be40 con 0x7f2efc17e5e0 2022-07-05T11:46:25.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.950+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2ee4022070 con 0x7f2efc17e5e0 2022-07-05T11:46:25.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2ef8ff9700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2ee008ba40 0x7f2ee008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f2ee40b0810 con 0x7f2efc17e5e0 2022-07-05T11:46:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2ef8ff9700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6821/37189,v1:172.21.15.110:6823/37189] conn(0x7f2ee0097420 0x7f2ee00998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 --> [v2:172.21.15.110:6821/37189,v1:172.21.15.110:6823/37189] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ee0099f40 con 0x7f2ee0097420 2022-07-05T11:46:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ee40b0b80 con 0x7f2efc17e5e0 2022-07-05T11:46:25.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2f00a3c700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2ee008ba40 0x7f2ee008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2efbfff700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6821/37189,v1:172.21.15.110:6823/37189] conn(0x7f2ee0097420 0x7f2ee00998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:25.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2f00a3c700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2ee008ba40 0x7f2ee008df00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2ef4009130 tx=0x7f2ef4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.951+0000 7f2efbfff700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6821/37189,v1:172.21.15.110:6823/37189] conn(0x7f2ee0097420 0x7f2ee00998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:25.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.952+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== osd.7 v2:172.21.15.110:6821/37189 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2ee0099f40 con 0x7f2ee0097420 2022-07-05T11:46:25.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.966+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 --> [v2:172.21.15.110:6821/37189,v1:172.21.15.110:6823/37189] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2efc18f300 con 0x7f2ee0097420 2022-07-05T11:46:25.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2ef8ff9700 1 -- 172.21.15.90:0/1421173775 <== osd.7 v2:172.21.15.110:6821/37189 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2efc18f300 con 0x7f2ee0097420 2022-07-05T11:46:25.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6821/37189,v1:172.21.15.110:6823/37189] conn(0x7f2ee0097420 msgr2=0x7f2ee00998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6821/37189,v1:172.21.15.110:6823/37189] conn(0x7f2ee0097420 0x7f2ee00998c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:25.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2ee008ba40 msgr2=0x7f2ee008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2ee008ba40 0x7f2ee008df00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2ef4009130 tx=0x7f2ef4017000).stop 2022-07-05T11:46:25.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17e5e0 msgr2=0x7f2efc18f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:25.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 --2- 172.21.15.90:0/1421173775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc17e5e0 0x7f2efc18f650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2ee400c470 tx=0x7f2ee4007dd0).stop 2022-07-05T11:46:25.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f0123d700 1 -- 172.21.15.90:0/1421173775 reap_dead start 2022-07-05T11:46:25.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 shutdown_connections 2022-07-05T11:46:25.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 >> 172.21.15.90:0/1421173775 conn(0x7f2efc0f2960 msgr2=0x7f2efc0ec790 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:25.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 shutdown_connections 2022-07-05T11:46:25.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:25.967+0000 7f2f02ca0700 1 -- 172.21.15.90:0/1421173775 wait complete. 2022-07-05T11:46:25.980 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:25.981 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2022-07-05T11:46:26.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.093+0000 7f159955d700 1 Processor -- start 2022-07-05T11:46:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.093+0000 7f159955d700 1 -- start start 2022-07-05T11:46:26.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f159955d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15941782d0 0x7f159417fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f159955d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15941786b0 0x7f15940ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f159955d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15940854c0 con 0x7f159417f0e0 2022-07-05T11:46:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f159955d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1594178b40 con 0x7f15941786b0 2022-07-05T11:46:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f159955d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1594086060 con 0x7f15941782d0 2022-07-05T11:46:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f15937fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15941786b0 0x7f15940ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f15937fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15941786b0 0x7f15940ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:33318/0 (socket says 172.21.15.90:33318) 2022-07-05T11:46:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f15937fe700 1 -- 172.21.15.90:0/501790152 learned_addr learned my addr 172.21.15.90:0/501790152 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f15927fc700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f159417f0e0 0x7f1594085950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59536/0 (socket says 172.21.15.90:59536) 2022-07-05T11:46:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.094+0000 7f1592ffd700 1 --2- 172.21.15.90:0/501790152 >> v2:172.21.15.149:3300/0 conn(0x7f15941782d0 0x7f159417fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f15937fe700 1 -- 172.21.15.90:0/501790152 >> v2:172.21.15.149:3300/0 conn(0x7f15941782d0 msgr2=0x7f159417fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:26.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f15937fe700 1 --2- 172.21.15.90:0/501790152 >> v2:172.21.15.149:3300/0 conn(0x7f15941782d0 0x7f159417fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f15937fe700 1 -- 172.21.15.90:0/501790152 >> v1:172.21.15.110:6789/0 conn(0x7f159417f0e0 legacy=0x7f1594085950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f1591ffb700 1 -- 172.21.15.90:0/501790152 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936261034 0 0) 0x7f15940854c0 con 0x7f159417f0e0 2022-07-05T11:46:26.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f15937fe700 1 -- 172.21.15.90:0/501790152 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940845d0 con 0x7f15941786b0 2022-07-05T11:46:26.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f15937fe700 1 --2- 172.21.15.90:0/501790152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941786b0 0x7f15940ed300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1594086cd0 tx=0x7f158c009840).ready entity=mon.1 client_cookie=c3298871aad6ddfc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f1591ffb700 1 -- 172.21.15.90:0/501790152 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00e070 con 0x7f15941786b0 2022-07-05T11:46:26.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f1591ffb700 1 -- 172.21.15.90:0/501790152 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00ba20 con 0x7f15941786b0 2022-07-05T11:46:26.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f1591ffb700 1 -- 172.21.15.90:0/501790152 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00bda0 con 0x7f15941786b0 2022-07-05T11:46:26.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 -- 172.21.15.90:0/501790152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941786b0 msgr2=0x7f15940ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 --2- 172.21.15.90:0/501790152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941786b0 0x7f15940ed300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1594086cd0 tx=0x7f158c009840).stop 2022-07-05T11:46:26.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 -- 172.21.15.90:0/501790152 shutdown_connections 2022-07-05T11:46:26.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 --2- 172.21.15.90:0/501790152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941786b0 0x7f15940ed300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 --2- 172.21.15.90:0/501790152 >> v2:172.21.15.149:3300/0 conn(0x7f15941782d0 0x7f159417fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 -- 172.21.15.90:0/501790152 >> 172.21.15.90:0/501790152 conn(0x7f15940f2960 msgr2=0x7f15940f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 -- 172.21.15.90:0/501790152 shutdown_connections 2022-07-05T11:46:26.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.095+0000 7f159955d700 1 -- 172.21.15.90:0/501790152 wait complete. 2022-07-05T11:46:26.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.097+0000 7f159955d700 1 Processor -- start 2022-07-05T11:46:26.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.097+0000 7f159955d700 1 -- start start 2022-07-05T11:46:26.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f159955d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941782d0 0x7f159416ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f159955d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15941786b0 0x7f159416ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f159955d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159417f0e0 0x7f1594182c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f159955d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594192cc0 con 0x7f15941786b0 2022-07-05T11:46:26.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f159955d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594170900 con 0x7f15941782d0 2022-07-05T11:46:26.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f159955d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594192040 con 0x7f159417f0e0 2022-07-05T11:46:26.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f15927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15941786b0 0x7f159416ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f15927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15941786b0 0x7f159416ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57002/0 (socket says 172.21.15.90:57002) 2022-07-05T11:46:26.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f15927fc700 1 -- 172.21.15.90:0/3598767699 learned_addr learned my addr 172.21.15.90:0/3598767699 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f1592ffd700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941782d0 0x7f159416ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f15937fe700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159417f0e0 0x7f1594182c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.098+0000 7f15927fc700 1 -- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159417f0e0 msgr2=0x7f1594182c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f15927fc700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159417f0e0 0x7f1594182c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f15927fc700 1 -- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941782d0 msgr2=0x7f159416ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f15927fc700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15941782d0 0x7f159416ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f15927fc700 1 -- 172.21.15.90:0/3598767699 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c009ae0 con 0x7f15941786b0 2022-07-05T11:46:26.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f15927fc700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15941786b0 0x7f159416ef50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f158800c490 tx=0x7f1588007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15880070d0 con 0x7f15941786b0 2022-07-05T11:46:26.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1588007250 con 0x7f15941786b0 2022-07-05T11:46:26.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1594192320 con 0x7f15941786b0 2022-07-05T11:46:26.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15880056e0 con 0x7f15941786b0 2022-07-05T11:46:26.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.099+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15941928e0 con 0x7f15941786b0 2022-07-05T11:46:26.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.100+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f159406be40 con 0x7f15941786b0 2022-07-05T11:46:26.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f158801a060 con 0x7f15941786b0 2022-07-05T11:46:26.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f157affd700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157408ba40 0x7f157408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f15880b09d0 con 0x7f15941786b0 2022-07-05T11:46:26.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f1592ffd700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157408ba40 0x7f157408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f157affd700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:6800/37785,v1:172.21.15.149:6801/37785] conn(0x7f1574097420 0x7f15740998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 --> [v2:172.21.15.149:6800/37785,v1:172.21.15.149:6801/37785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1574099f40 con 0x7f1574097420 2022-07-05T11:46:26.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15880b0d40 con 0x7f15941786b0 2022-07-05T11:46:26.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.101+0000 7f15937fe700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:6800/37785,v1:172.21.15.149:6801/37785] conn(0x7f1574097420 0x7f15740998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.102+0000 7f1592ffd700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157408ba40 0x7f157408df00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1584009c30 tx=0x7f1584009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.102+0000 7f15937fe700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:6800/37785,v1:172.21.15.149:6801/37785] conn(0x7f1574097420 0x7f15740998c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.103+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== osd.8 v2:172.21.15.149:6800/37785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1574099f40 con 0x7f1574097420 2022-07-05T11:46:26.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 --> [v2:172.21.15.149:6800/37785,v1:172.21.15.149:6801/37785] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1594191e30 con 0x7f1574097420 2022-07-05T11:46:26.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f157affd700 1 -- 172.21.15.90:0/3598767699 <== osd.8 v2:172.21.15.149:6800/37785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1594191e30 con 0x7f1574097420 2022-07-05T11:46:26.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:6800/37785,v1:172.21.15.149:6801/37785] conn(0x7f1574097420 msgr2=0x7f15740998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.149:6800/37785,v1:172.21.15.149:6801/37785] conn(0x7f1574097420 0x7f15740998c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157408ba40 msgr2=0x7f157408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157408ba40 0x7f157408df00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1584009c30 tx=0x7f1584009060).stop 2022-07-05T11:46:26.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15941786b0 msgr2=0x7f159416ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 --2- 172.21.15.90:0/3598767699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15941786b0 0x7f159416ef50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f158800c490 tx=0x7f1588007de0).stop 2022-07-05T11:46:26.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f15937fe700 1 -- 172.21.15.90:0/3598767699 reap_dead start 2022-07-05T11:46:26.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 shutdown_connections 2022-07-05T11:46:26.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.117+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 >> 172.21.15.90:0/3598767699 conn(0x7f15940f2960 msgr2=0x7f15940eecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.118+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 shutdown_connections 2022-07-05T11:46:26.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.118+0000 7f159955d700 1 -- 172.21.15.90:0/3598767699 wait complete. 2022-07-05T11:46:26.141 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:26.142 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2022-07-05T11:46:26.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.254+0000 7f5b8e4e9700 1 Processor -- start 2022-07-05T11:46:26.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.254+0000 7f5b8e4e9700 1 -- start start 2022-07-05T11:46:26.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.255+0000 7f5b8e4e9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b8817dd60 0x7f5b880c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.255+0000 7f5b8e4e9700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b880c3a10 con 0x7f5b880c4390 2022-07-05T11:46:26.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.255+0000 7f5b8e4e9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8817f210 con 0x7f5b8817d980 2022-07-05T11:46:26.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.255+0000 7f5b8e4e9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880ed0c0 con 0x7f5b8817dd60 2022-07-05T11:46:26.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.255+0000 7f5b8cce6700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b8817dd60 0x7f5b880c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.255+0000 7f5b8dce8700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5b880c4390 0x7f5b880ef320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49952/0 (socket says 172.21.15.90:49952) 2022-07-05T11:46:26.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.255+0000 7f5b8dce8700 1 -- 172.21.15.90:0/1686062859 learned_addr learned my addr 172.21.15.90:0/1686062859 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:26.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8cce6700 1 -- 172.21.15.90:0/1686062859 >> v1:172.21.15.149:6789/0 conn(0x7f5b8817d980 legacy=0x7f5b8817eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8cce6700 1 -- 172.21.15.90:0/1686062859 >> v1:172.21.15.90:6789/0 conn(0x7f5b880c4390 legacy=0x7f5b880ef320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8cce6700 1 -- 172.21.15.90:0/1686062859 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880ed380 con 0x7f5b8817dd60 2022-07-05T11:46:26.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b87fff700 1 -- 172.21.15.90:0/1686062859 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450112794 0 0) 0x7f5b880c3a10 con 0x7f5b880c4390 2022-07-05T11:46:26.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8cce6700 1 --2- 172.21.15.90:0/1686062859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b8817dd60 0x7f5b880c3ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5b7c009760 tx=0x7f5b7c009060).ready entity=mon.0 client_cookie=cdf38474252f0946 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b87fff700 1 -- 172.21.15.90:0/1686062859 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c009120 con 0x7f5b8817dd60 2022-07-05T11:46:26.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b87fff700 1 -- 172.21.15.90:0/1686062859 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00b580 con 0x7f5b8817dd60 2022-07-05T11:46:26.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b87fff700 1 -- 172.21.15.90:0/1686062859 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00b900 con 0x7f5b8817dd60 2022-07-05T11:46:26.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1686062859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b8817dd60 msgr2=0x7f5b880c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8e4e9700 1 --2- 172.21.15.90:0/1686062859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b8817dd60 0x7f5b880c3ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5b7c009760 tx=0x7f5b7c009060).stop 2022-07-05T11:46:26.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1686062859 shutdown_connections 2022-07-05T11:46:26.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8e4e9700 1 --2- 172.21.15.90:0/1686062859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b8817dd60 0x7f5b880c3ea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.256+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1686062859 >> 172.21.15.90:0/1686062859 conn(0x7f5b880f1420 msgr2=0x7f5b880f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.257+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1686062859 shutdown_connections 2022-07-05T11:46:26.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.257+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1686062859 wait complete. 2022-07-05T11:46:26.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.258+0000 7f5b8e4e9700 1 Processor -- start 2022-07-05T11:46:26.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.258+0000 7f5b8e4e9700 1 -- start start 2022-07-05T11:46:26.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8e4e9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b880c4390 0x7f5b8818f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8e4e9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b8817d980 0x7f5b8815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8e4e9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8817dd60 0x7f5b88180050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8e4e9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8818f520 con 0x7f5b880c4390 2022-07-05T11:46:26.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8e4e9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8817f600 con 0x7f5b8817dd60 2022-07-05T11:46:26.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8e4e9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8817fbc0 con 0x7f5b8817d980 2022-07-05T11:46:26.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8d4e7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b880c4390 0x7f5b8818f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8d4e7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b880c4390 0x7f5b8818f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57016/0 (socket says 172.21.15.90:57016) 2022-07-05T11:46:26.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8d4e7700 1 -- 172.21.15.90:0/1130728790 learned_addr learned my addr 172.21.15.90:0/1130728790 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8cce6700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b8817d980 0x7f5b8815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.259+0000 7f5b8dce8700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8817dd60 0x7f5b88180050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8d4e7700 1 -- 172.21.15.90:0/1130728790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b8817d980 msgr2=0x7f5b8815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8d4e7700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b8817d980 0x7f5b8815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8d4e7700 1 -- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8817dd60 msgr2=0x7f5b88180050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8d4e7700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b8817dd60 0x7f5b88180050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8d4e7700 1 -- 172.21.15.90:0/1130728790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0092a0 con 0x7f5b880c4390 2022-07-05T11:46:26.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8d4e7700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b880c4390 0x7f5b8818f030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5b7800c870 tx=0x7f5b78001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78006a20 con 0x7f5b880c4390 2022-07-05T11:46:26.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b78006b80 con 0x7f5b880c4390 2022-07-05T11:46:26.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880c5d30 con 0x7f5b880c4390 2022-07-05T11:46:26.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78007020 con 0x7f5b880c4390 2022-07-05T11:46:26.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.260+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b880c62f0 con 0x7f5b880c4390 2022-07-05T11:46:26.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.261+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b880ccec0 con 0x7f5b880c4390 2022-07-05T11:46:26.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.261+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f5b78018020 con 0x7f5b880c4390 2022-07-05T11:46:26.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.262+0000 7f5b857fa700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5b6808ba40 0x7f5b6808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.262+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f5b780b1200 con 0x7f5b880c4390 2022-07-05T11:46:26.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.262+0000 7f5b857fa700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:6820/37470,v1:172.21.15.90:6822/37470] conn(0x7f5b68097420 0x7f5b680998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.262+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 --> [v2:172.21.15.90:6820/37470,v1:172.21.15.90:6822/37470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b68099f40 con 0x7f5b68097420 2022-07-05T11:46:26.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.262+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b780b1570 con 0x7f5b880c4390 2022-07-05T11:46:26.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.262+0000 7f5b8cce6700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5b6808ba40 0x7f5b6808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.262+0000 7f5b8dce8700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:6820/37470,v1:172.21.15.90:6822/37470] conn(0x7f5b68097420 0x7f5b680998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.263+0000 7f5b8dce8700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:6820/37470,v1:172.21.15.90:6822/37470] conn(0x7f5b68097420 0x7f5b680998c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.263+0000 7f5b8cce6700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5b6808ba40 0x7f5b6808df00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5b8806a4a0 tx=0x7f5b7c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.263+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== osd.9 v2:172.21.15.90:6820/37470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f5b68099f40 con 0x7f5b68097420 2022-07-05T11:46:26.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.277+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 --> [v2:172.21.15.90:6820/37470,v1:172.21.15.90:6822/37470] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b8817fd00 con 0x7f5b68097420 2022-07-05T11:46:26.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.277+0000 7f5b857fa700 1 -- 172.21.15.90:0/1130728790 <== osd.9 v2:172.21.15.90:6820/37470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b80007090 con 0x7f5b68097420 2022-07-05T11:46:26.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:6820/37470,v1:172.21.15.90:6822/37470] conn(0x7f5b68097420 msgr2=0x7f5b680998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:6820/37470,v1:172.21.15.90:6822/37470] conn(0x7f5b68097420 0x7f5b680998c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5b6808ba40 msgr2=0x7f5b6808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5b6808ba40 0x7f5b6808df00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5b8806a4a0 tx=0x7f5b7c017000).stop 2022-07-05T11:46:26.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b880c4390 msgr2=0x7f5b8818f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 --2- 172.21.15.90:0/1130728790 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b880c4390 0x7f5b8818f030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5b7800c870 tx=0x7f5b78001660).stop 2022-07-05T11:46:26.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8dce8700 1 -- 172.21.15.90:0/1130728790 reap_dead start 2022-07-05T11:46:26.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 shutdown_connections 2022-07-05T11:46:26.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 >> 172.21.15.90:0/1130728790 conn(0x7f5b880f1420 msgr2=0x7f5b880c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 shutdown_connections 2022-07-05T11:46:26.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.278+0000 7f5b8e4e9700 1 -- 172.21.15.90:0/1130728790 wait complete. 2022-07-05T11:46:26.296 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:26.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2022-07-05T11:46:26.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.409+0000 7ff2c6d65700 1 Processor -- start 2022-07-05T11:46:26.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.409+0000 7ff2c6d65700 1 -- start start 2022-07-05T11:46:26.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c6d65700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2c00ca450 0x7ff2c0084c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c6d65700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2c0085180 0x7ff2c00855f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c6d65700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c0084800 con 0x7ff2c0174e20 2022-07-05T11:46:26.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c6d65700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c00cb2e0 con 0x7ff2c0085180 2022-07-05T11:46:26.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c6d65700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c00caa40 con 0x7ff2c00ca450 2022-07-05T11:46:26.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2c0085180 0x7ff2c00855f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2c0085180 0x7ff2c00855f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57028/0 (socket says 172.21.15.90:57028) 2022-07-05T11:46:26.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 -- 172.21.15.90:0/2873989316 learned_addr learned my addr 172.21.15.90:0/2873989316 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2b7fff700 1 --2- 172.21.15.90:0/2873989316 >> v2:172.21.15.110:3300/0 conn(0x7ff2c00ca450 0x7ff2c0084c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 -- 172.21.15.90:0/2873989316 >> v2:172.21.15.110:3300/0 conn(0x7ff2c00ca450 msgr2=0x7ff2c0084c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:26.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 --2- 172.21.15.90:0/2873989316 >> v2:172.21.15.110:3300/0 conn(0x7ff2c00ca450 0x7ff2c0084c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 -- 172.21.15.90:0/2873989316 >> v1:172.21.15.149:6789/0 conn(0x7ff2c0174e20 legacy=0x7ff2c00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:26.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 -- 172.21.15.90:0/2873989316 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00cad20 con 0x7ff2c0085180 2022-07-05T11:46:26.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.410+0000 7ff2c5302700 1 --2- 172.21.15.90:0/2873989316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0085180 0x7ff2c00855f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7ff2c0086d00 tx=0x7ff2b80090f0).ready entity=mon.0 client_cookie=ff0042e1d850d308 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2b77fe700 1 -- 172.21.15.90:0/2873989316 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80058d0 con 0x7ff2c0085180 2022-07-05T11:46:26.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2b77fe700 1 -- 172.21.15.90:0/2873989316 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b8005a30 con 0x7ff2c0085180 2022-07-05T11:46:26.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2b77fe700 1 -- 172.21.15.90:0/2873989316 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8005db0 con 0x7ff2c0085180 2022-07-05T11:46:26.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 -- 172.21.15.90:0/2873989316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0085180 msgr2=0x7ff2c00855f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 --2- 172.21.15.90:0/2873989316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0085180 0x7ff2c00855f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7ff2c0086d00 tx=0x7ff2b80090f0).stop 2022-07-05T11:46:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 -- 172.21.15.90:0/2873989316 shutdown_connections 2022-07-05T11:46:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 --2- 172.21.15.90:0/2873989316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0085180 0x7ff2c00855f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 --2- 172.21.15.90:0/2873989316 >> v2:172.21.15.110:3300/0 conn(0x7ff2c00ca450 0x7ff2c0084c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 -- 172.21.15.90:0/2873989316 >> 172.21.15.90:0/2873989316 conn(0x7ff2c00ef400 msgr2=0x7ff2c00ef810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 -- 172.21.15.90:0/2873989316 shutdown_connections 2022-07-05T11:46:26.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.411+0000 7ff2c6d65700 1 -- 172.21.15.90:0/2873989316 wait complete. 2022-07-05T11:46:26.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.412+0000 7ff2c6d65700 1 Processor -- start 2022-07-05T11:46:26.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.413+0000 7ff2c6d65700 1 -- start start 2022-07-05T11:46:26.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c0085180 0x7ff2c017f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c00ca450 0x7ff2c016dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0174e20 0x7ff2c0181360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0180ed0 con 0x7ff2c0174e20 2022-07-05T11:46:26.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c017ffe0 con 0x7ff2c0085180 2022-07-05T11:46:26.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c01802c0 con 0x7ff2c00ca450 2022-07-05T11:46:26.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0174e20 0x7ff2c0181360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0174e20 0x7ff2c0181360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57036/0 (socket says 172.21.15.90:57036) 2022-07-05T11:46:26.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 -- 172.21.15.90:0/3414611785 learned_addr learned my addr 172.21.15.90:0/3414611785 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c4b01700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c0085180 0x7ff2c017f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2b7fff700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c00ca450 0x7ff2c016dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 -- 172.21.15.90:0/3414611785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c00ca450 msgr2=0x7ff2c016dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c00ca450 0x7ff2c016dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 -- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c0085180 msgr2=0x7ff2c017f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c0085180 0x7ff2c017f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 -- 172.21.15.90:0/3414611785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009350 con 0x7ff2c0174e20 2022-07-05T11:46:26.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2b7fff700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c00ca450 0x7ff2c016dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:26.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c5302700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0174e20 0x7ff2c0181360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff2b8000ea0 tx=0x7ff2b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80058d0 con 0x7ff2c0174e20 2022-07-05T11:46:26.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b800b7b0 con 0x7ff2c0174e20 2022-07-05T11:46:26.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800bb70 con 0x7ff2c0174e20 2022-07-05T11:46:26.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c01805a0 con 0x7ff2c0174e20 2022-07-05T11:46:26.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.414+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c0180b60 con 0x7ff2c0174e20 2022-07-05T11:46:26.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.415+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2c006be40 con 0x7ff2c0174e20 2022-07-05T11:46:26.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.416+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff2b800f070 con 0x7ff2c0174e20 2022-07-05T11:46:26.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.416+0000 7ff2b4ff9700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff2a008ba10 0x7ff2a008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff2b80b24b0 con 0x7ff2c0174e20 2022-07-05T11:46:26.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2b4ff9700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6818/37190,v1:172.21.15.110:6819/37190] conn(0x7ff2a00973f0 0x7ff2a0099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 --> [v2:172.21.15.110:6818/37190,v1:172.21.15.110:6819/37190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2a0099f10 con 0x7ff2a00973f0 2022-07-05T11:46:26.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2b80b27a0 con 0x7ff2c0174e20 2022-07-05T11:46:26.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2c4b01700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff2a008ba10 0x7ff2a008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2b7fff700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6818/37190,v1:172.21.15.110:6819/37190] conn(0x7ff2a00973f0 0x7ff2a0099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2c4b01700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff2a008ba10 0x7ff2a008ded0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff2bc006fd0 tx=0x7ff2bc009250).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.417+0000 7ff2b7fff700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6818/37190,v1:172.21.15.110:6819/37190] conn(0x7ff2a00973f0 0x7ff2a0099890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.418+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== osd.10 v2:172.21.15.110:6818/37190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7ff2a0099f10 con 0x7ff2a00973f0 2022-07-05T11:46:26.442 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.432+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 --> [v2:172.21.15.110:6818/37190,v1:172.21.15.110:6819/37190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2c0181010 con 0x7ff2a00973f0 2022-07-05T11:46:26.443 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.432+0000 7ff2b4ff9700 1 -- 172.21.15.90:0/3414611785 <== osd.10 v2:172.21.15.110:6818/37190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2c0181010 con 0x7ff2a00973f0 2022-07-05T11:46:26.445 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6818/37190,v1:172.21.15.110:6819/37190] conn(0x7ff2a00973f0 msgr2=0x7ff2a0099890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.445 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6818/37190,v1:172.21.15.110:6819/37190] conn(0x7ff2a00973f0 0x7ff2a0099890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.445 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff2a008ba10 msgr2=0x7ff2a008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.446 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff2a008ba10 0x7ff2a008ded0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff2bc006fd0 tx=0x7ff2bc009250).stop 2022-07-05T11:46:26.446 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0174e20 msgr2=0x7ff2c0181360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.446 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 --2- 172.21.15.90:0/3414611785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2c0174e20 0x7ff2c0181360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff2b8000ea0 tx=0x7ff2b8016000).stop 2022-07-05T11:46:26.446 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c5302700 1 -- 172.21.15.90:0/3414611785 reap_dead start 2022-07-05T11:46:26.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 shutdown_connections 2022-07-05T11:46:26.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 >> 172.21.15.90:0/3414611785 conn(0x7ff2c00ef400 msgr2=0x7ff2c00ee9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 shutdown_connections 2022-07-05T11:46:26.448 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.433+0000 7ff2c6d65700 1 -- 172.21.15.90:0/3414611785 wait complete. 2022-07-05T11:46:26.448 INFO:teuthology.orchestra.run.smithi090.stdout:73014444041 2022-07-05T11:46:26.448 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2022-07-05T11:46:26.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.560+0000 7f0ffd2d5700 1 Processor -- start 2022-07-05T11:46:26.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.560+0000 7f0ffd2d5700 1 -- start start 2022-07-05T11:46:26.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.561+0000 7f0ffd2d5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0ff80edbe0 0x7f0ff817e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.561+0000 7f0ffd2d5700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ff80ea470 0x7f0ff80ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.561+0000 7f0ffd2d5700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80ec150 con 0x7f0ff817ddc0 2022-07-05T11:46:26.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.561+0000 7f0ffd2d5700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff817e690 con 0x7f0ff80ea470 2022-07-05T11:46:26.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.561+0000 7f0ffd2d5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80ec430 con 0x7f0ff80edbe0 2022-07-05T11:46:26.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.561+0000 7f0ff77fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ff80ea470 0x7f0ff80ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff77fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ff80ea470 0x7f0ff80ea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57044/0 (socket says 172.21.15.90:57044) 2022-07-05T11:46:26.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff77fe700 1 -- 172.21.15.90:0/3073761883 learned_addr learned my addr 172.21.15.90:0/3073761883 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff6ffd700 1 --1- 172.21.15.90:0/3073761883 >> v1:172.21.15.110:6789/0 conn(0x7f0ff817ddc0 0x7f0ff80ed4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59580/0 (socket says 172.21.15.90:59580) 2022-07-05T11:46:26.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff67fc700 1 --2- 172.21.15.90:0/3073761883 >> v2:172.21.15.149:3300/0 conn(0x7f0ff80edbe0 0x7f0ff817e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff77fe700 1 -- 172.21.15.90:0/3073761883 >> v2:172.21.15.149:3300/0 conn(0x7f0ff80edbe0 msgr2=0x7f0ff817e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:26.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff77fe700 1 --2- 172.21.15.90:0/3073761883 >> v2:172.21.15.149:3300/0 conn(0x7f0ff80edbe0 0x7f0ff817e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff77fe700 1 -- 172.21.15.90:0/3073761883 >> v1:172.21.15.110:6789/0 conn(0x7f0ff817ddc0 legacy=0x7f0ff80ed4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff77fe700 1 -- 172.21.15.90:0/3073761883 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80ec710 con 0x7f0ff80ea470 2022-07-05T11:46:26.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff5ffb700 1 -- 172.21.15.90:0/3073761883 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003830567 0 0) 0x7f0ff80ec150 con 0x7f0ff817ddc0 2022-07-05T11:46:26.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff77fe700 1 --2- 172.21.15.90:0/3073761883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff80ea8b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f0ff80e4c20 tx=0x7f0ff0009840).ready entity=mon.0 client_cookie=8243ab66c847504a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff5ffb700 1 -- 172.21.15.90:0/3073761883 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000e070 con 0x7f0ff80ea470 2022-07-05T11:46:26.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff5ffb700 1 -- 172.21.15.90:0/3073761883 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000ba20 con 0x7f0ff80ea470 2022-07-05T11:46:26.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ff5ffb700 1 -- 172.21.15.90:0/3073761883 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000bda0 con 0x7f0ff80ea470 2022-07-05T11:46:26.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/3073761883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 msgr2=0x7f0ff80ea8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.562+0000 7f0ffd2d5700 1 --2- 172.21.15.90:0/3073761883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff80ea8b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f0ff80e4c20 tx=0x7f0ff0009840).stop 2022-07-05T11:46:26.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.563+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/3073761883 shutdown_connections 2022-07-05T11:46:26.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.563+0000 7f0ffd2d5700 1 --2- 172.21.15.90:0/3073761883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff80ea8b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.563+0000 7f0ffd2d5700 1 --2- 172.21.15.90:0/3073761883 >> v2:172.21.15.149:3300/0 conn(0x7f0ff80edbe0 0x7f0ff817e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.563+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/3073761883 >> 172.21.15.90:0/3073761883 conn(0x7f0ff80f21e0 msgr2=0x7f0ff80ee1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.563+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/3073761883 shutdown_connections 2022-07-05T11:46:26.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.563+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/3073761883 wait complete. 2022-07-05T11:46:26.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.564+0000 7f0ffd2d5700 1 Processor -- start 2022-07-05T11:46:26.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.564+0000 7f0ffd2d5700 1 -- start start 2022-07-05T11:46:26.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ffd2d5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff816ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ffd2d5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff80edbe0 0x7f0ff8164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ffd2d5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff817ddc0 0x7f0ff818e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ffd2d5700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff816eef0 con 0x7f0ff80ea470 2022-07-05T11:46:26.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ffd2d5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8181360 con 0x7f0ff817ddc0 2022-07-05T11:46:26.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ffd2d5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff818ed40 con 0x7f0ff80edbe0 2022-07-05T11:46:26.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff816ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff816ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57052/0 (socket says 172.21.15.90:57052) 2022-07-05T11:46:26.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ff6ffd700 1 -- 172.21.15.90:0/1477922009 learned_addr learned my addr 172.21.15.90:0/1477922009 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.565+0000 7f0ff77fe700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff817ddc0 0x7f0ff818e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ff6ffd700 1 -- 172.21.15.90:0/1477922009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff80edbe0 msgr2=0x7f0ff8164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ff6ffd700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff80edbe0 0x7f0ff8164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:26.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ff6ffd700 1 -- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff817ddc0 msgr2=0x7f0ff818e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ff6ffd700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff817ddc0 0x7f0ff818e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ff6ffd700 1 -- 172.21.15.90:0/1477922009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009ae0 con 0x7f0ff80ea470 2022-07-05T11:46:26.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ff6ffd700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff816ea00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f0fe800c440 tx=0x7f0fe8007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe80072e0 con 0x7f0ff80ea470 2022-07-05T11:46:26.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8007460 con 0x7f0ff80ea470 2022-07-05T11:46:26.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8005930 con 0x7f0ff80ea470 2022-07-05T11:46:26.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff818f020 con 0x7f0ff80ea470 2022-07-05T11:46:26.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.566+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8180ff0 con 0x7f0ff80ea470 2022-07-05T11:46:26.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.567+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ff8180b70 con 0x7f0ff80ea470 2022-07-05T11:46:26.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.568+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f0fe8010070 con 0x7f0ff80ea470 2022-07-05T11:46:26.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.568+0000 7f0fdeffd700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0fd808ba40 0x7f0fd808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.568+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0fe80affe0 con 0x7f0ff80ea470 2022-07-05T11:46:26.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.568+0000 7f0fdeffd700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.149:6824/37830,v1:172.21.15.149:6825/37830] conn(0x7f0fd8097420 0x7f0fd80998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.568+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 --> [v2:172.21.15.149:6824/37830,v1:172.21.15.149:6825/37830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fd8099f40 con 0x7f0fd8097420 2022-07-05T11:46:26.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.568+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fe80b0350 con 0x7f0ff80ea470 2022-07-05T11:46:26.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.568+0000 7f0ff67fc700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0fd808ba40 0x7f0fd808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.569+0000 7f0ff77fe700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.149:6824/37830,v1:172.21.15.149:6825/37830] conn(0x7f0fd8097420 0x7f0fd80998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.569+0000 7f0ff67fc700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0fd808ba40 0x7f0fd808df00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0ff8180620 tx=0x7f0fec009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.569+0000 7f0ff77fe700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.149:6824/37830,v1:172.21.15.149:6825/37830] conn(0x7f0fd8097420 0x7f0fd80998c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.570+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== osd.11 v2:172.21.15.149:6824/37830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0fd8099f40 con 0x7f0fd8097420 2022-07-05T11:46:26.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.584+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 --> [v2:172.21.15.149:6824/37830,v1:172.21.15.149:6825/37830] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ff8046db0 con 0x7f0fd8097420 2022-07-05T11:46:26.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.584+0000 7f0fdeffd700 1 -- 172.21.15.90:0/1477922009 <== osd.11 v2:172.21.15.149:6824/37830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ff8046db0 con 0x7f0fd8097420 2022-07-05T11:46:26.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 >> [v2:172.21.15.149:6824/37830,v1:172.21.15.149:6825/37830] conn(0x7f0fd8097420 msgr2=0x7f0fd80998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.149:6824/37830,v1:172.21.15.149:6825/37830] conn(0x7f0fd8097420 0x7f0fd80998c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0fd808ba40 msgr2=0x7f0fd808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0fd808ba40 0x7f0fd808df00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0ff8180620 tx=0x7f0fec009060).stop 2022-07-05T11:46:26.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 msgr2=0x7f0ff816ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 --2- 172.21.15.90:0/1477922009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff80ea470 0x7f0ff816ea00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f0fe800c440 tx=0x7f0fe8007e30).stop 2022-07-05T11:46:26.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ff77fe700 1 -- 172.21.15.90:0/1477922009 reap_dead start 2022-07-05T11:46:26.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 shutdown_connections 2022-07-05T11:46:26.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 >> 172.21.15.90:0/1477922009 conn(0x7f0ff80f21e0 msgr2=0x7f0ff817f060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 shutdown_connections 2022-07-05T11:46:26.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.585+0000 7f0ffd2d5700 1 -- 172.21.15.90:0/1477922009 wait complete. 2022-07-05T11:46:26.599 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:26.600 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-07-05T11:46:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.711+0000 7ff39b13a700 1 Processor -- start 2022-07-05T11:46:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.711+0000 7ff39b13a700 1 -- start start 2022-07-05T11:46:26.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39b13a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff39417b750 0x7ff39417bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39b13a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff3940847b0 0x7ff394084c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39b13a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940ee6f0 con 0x7ff3940edb60 2022-07-05T11:46:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39b13a700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff394083710 con 0x7ff39417b750 2022-07-05T11:46:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39b13a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3940839f0 con 0x7ff3940847b0 2022-07-05T11:46:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39a138700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff39417b750 0x7ff39417bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39a138700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff39417b750 0x7ff39417bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57058/0 (socket says 172.21.15.90:57058) 2022-07-05T11:46:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39a138700 1 -- 172.21.15.90:0/2969403282 learned_addr learned my addr 172.21.15.90:0/2969403282 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.712+0000 7ff39a939700 1 --2- 172.21.15.90:0/2969403282 >> v2:172.21.15.149:3300/0 conn(0x7ff3940847b0 0x7ff394084c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39a138700 1 -- 172.21.15.90:0/2969403282 >> v2:172.21.15.149:3300/0 conn(0x7ff3940847b0 msgr2=0x7ff394084c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:26.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39a138700 1 --2- 172.21.15.90:0/2969403282 >> v2:172.21.15.149:3300/0 conn(0x7ff3940847b0 0x7ff394084c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39a138700 1 -- 172.21.15.90:0/2969403282 >> v1:172.21.15.149:6789/0 conn(0x7ff3940edb60 legacy=0x7ff3940edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:26.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39a138700 1 -- 172.21.15.90:0/2969403282 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394083cd0 con 0x7ff39417b750 2022-07-05T11:46:26.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39a138700 1 --2- 172.21.15.90:0/2969403282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff39417b750 0x7ff39417bb30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff394085d40 tx=0x7ff38c009840).ready entity=mon.0 client_cookie=8705c250fa1bf475 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff399136700 1 -- 172.21.15.90:0/2969403282 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00e070 con 0x7ff39417b750 2022-07-05T11:46:26.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff399136700 1 -- 172.21.15.90:0/2969403282 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00ba10 con 0x7ff39417b750 2022-07-05T11:46:26.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff399136700 1 -- 172.21.15.90:0/2969403282 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00bd90 con 0x7ff39417b750 2022-07-05T11:46:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 -- 172.21.15.90:0/2969403282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff39417b750 msgr2=0x7ff39417bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2969403282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff39417b750 0x7ff39417bb30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff394085d40 tx=0x7ff38c009840).stop 2022-07-05T11:46:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 -- 172.21.15.90:0/2969403282 shutdown_connections 2022-07-05T11:46:26.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2969403282 >> v2:172.21.15.149:3300/0 conn(0x7ff3940847b0 0x7ff394084c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2969403282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff39417b750 0x7ff39417bb30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 -- 172.21.15.90:0/2969403282 >> 172.21.15.90:0/2969403282 conn(0x7ff3940f27c0 msgr2=0x7ff3940f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 -- 172.21.15.90:0/2969403282 shutdown_connections 2022-07-05T11:46:26.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.713+0000 7ff39b13a700 1 -- 172.21.15.90:0/2969403282 wait complete. 2022-07-05T11:46:26.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.715+0000 7ff39b13a700 1 Processor -- start 2022-07-05T11:46:26.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.715+0000 7ff39b13a700 1 -- start start 2022-07-05T11:46:26.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3940847b0 0x7ff394190900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3940edb60 0x7ff39416cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff39417b750 0x7ff39416e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394190df0 con 0x7ff3940847b0 2022-07-05T11:46:26.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39416d2b0 con 0x7ff3940edb60 2022-07-05T11:46:26.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39416d4e0 con 0x7ff39417b750 2022-07-05T11:46:26.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3940847b0 0x7ff394190900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3940847b0 0x7ff394190900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57064/0 (socket says 172.21.15.90:57064) 2022-07-05T11:46:26.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 -- 172.21.15.90:0/2911522135 learned_addr learned my addr 172.21.15.90:0/2911522135 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:26.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 -- 172.21.15.90:0/2911522135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff39417b750 msgr2=0x7ff39416e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff39417b750 0x7ff39416e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:26.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 -- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3940edb60 msgr2=0x7ff39416cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff399937700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3940edb60 0x7ff39416cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3940edb60 0x7ff39416cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 -- 172.21.15.90:0/2911522135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c009ae0 con 0x7ff3940847b0 2022-07-05T11:46:26.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff399937700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3940edb60 0x7ff39416cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:26.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39a138700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3940847b0 0x7ff394190900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7ff38c009540 tx=0x7ff38c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff3827fc700 1 -- 172.21.15.90:0/2911522135 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c013d10 con 0x7ff3940847b0 2022-07-05T11:46:26.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff3827fc700 1 -- 172.21.15.90:0/2911522135 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c013e70 con 0x7ff3940847b0 2022-07-05T11:46:26.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39416d7c0 con 0x7ff3940847b0 2022-07-05T11:46:26.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff3827fc700 1 -- 172.21.15.90:0/2911522135 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c01e6a0 con 0x7ff3940847b0 2022-07-05T11:46:26.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.716+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39416dd80 con 0x7ff3940847b0 2022-07-05T11:46:26.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.717+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39406be40 con 0x7ff3940847b0 2022-07-05T11:46:26.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.718+0000 7ff3827fc700 1 -- 172.21.15.90:0/2911522135 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff38c025030 con 0x7ff3940847b0 2022-07-05T11:46:26.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.718+0000 7ff3827fc700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff37408ba40 0x7ff37408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:26.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.719+0000 7ff3827fc700 1 -- 172.21.15.90:0/2911522135 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff38c0b1e20 con 0x7ff3940847b0 2022-07-05T11:46:26.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.719+0000 7ff399937700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff37408ba40 0x7ff37408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:26.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.719+0000 7ff399937700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff37408ba40 0x7ff37408df00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff38400a820 tx=0x7ff384008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:26.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.722+0000 7ff3827fc700 1 -- 172.21.15.90:0/2911522135 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7ff38c082ae0 con 0x7ff3940847b0 2022-07-05T11:46:26.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.884+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff3940c3990 con 0x7ff3940847b0 2022-07-05T11:46:26.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.884+0000 7ff3827fc700 1 -- 172.21.15.90:0/2911522135 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff38c023030 con 0x7ff3940847b0 2022-07-05T11:46:26.886 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:26.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff37408ba40 msgr2=0x7ff37408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff37408ba40 0x7ff37408df00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff38400a820 tx=0x7ff384008040).stop 2022-07-05T11:46:26.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3940847b0 msgr2=0x7ff394190900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:26.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3940847b0 0x7ff394190900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7ff38c009540 tx=0x7ff38c009840).stop 2022-07-05T11:46:26.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 shutdown_connections 2022-07-05T11:46:26.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff37408ba40 0x7ff37408df00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff39417b750 0x7ff39416e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:26.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3940847b0 0x7ff394190900 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 --2- 172.21.15.90:0/2911522135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3940edb60 0x7ff39416cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:26.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 >> 172.21.15.90:0/2911522135 conn(0x7ff3940f27c0 msgr2=0x7ff39417c250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:26.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 shutdown_connections 2022-07-05T11:46:26.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:26.886+0000 7ff39b13a700 1 -- 172.21.15.90:0/2911522135 wait complete. 2022-07-05T11:46:26.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.0 2022-07-05T11:46:26.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-07-05T11:46:27.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.011+0000 7effa7280700 1 Processor -- start 2022-07-05T11:46:27.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.011+0000 7effa7280700 1 -- start start 2022-07-05T11:46:27.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa7280700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effa017dd60 0x7effa00c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa7280700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7effa00c4390 0x7effa00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa7280700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00c3a10 con 0x7effa017d980 2022-07-05T11:46:27.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa7280700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa00f0330 con 0x7effa017dd60 2022-07-05T11:46:27.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa7280700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa017f210 con 0x7effa00c4390 2022-07-05T11:46:27.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa5a7d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effa017dd60 0x7effa00c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa5a7d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effa017dd60 0x7effa00c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:33396/0 (socket says 172.21.15.90:33396) 2022-07-05T11:46:27.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa5a7d700 1 -- 172.21.15.90:0/2257134373 learned_addr learned my addr 172.21.15.90:0/2257134373 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:27.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa6a7f700 1 --2- 172.21.15.90:0/2257134373 >> v2:172.21.15.149:3300/0 conn(0x7effa00c4390 0x7effa00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa627e700 1 --1- 172.21.15.90:0/2257134373 >> v1:172.21.15.149:6789/0 conn(0x7effa017d980 0x7effa017eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:46254/0 (socket says 172.21.15.90:46254) 2022-07-05T11:46:27.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa5a7d700 1 -- 172.21.15.90:0/2257134373 >> v2:172.21.15.149:3300/0 conn(0x7effa00c4390 msgr2=0x7effa00c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:27.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa5a7d700 1 --2- 172.21.15.90:0/2257134373 >> v2:172.21.15.149:3300/0 conn(0x7effa00c4390 0x7effa00c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa5a7d700 1 -- 172.21.15.90:0/2257134373 >> v1:172.21.15.149:6789/0 conn(0x7effa017d980 legacy=0x7effa017eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.012+0000 7effa5a7d700 1 -- 172.21.15.90:0/2257134373 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00ed380 con 0x7effa017dd60 2022-07-05T11:46:27.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa5a7d700 1 --2- 172.21.15.90:0/2257134373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 0x7effa00c3ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7effa00eb9d0 tx=0x7eff900090f0).ready entity=mon.1 client_cookie=dc38ea8dc87de96e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa527c700 1 -- 172.21.15.90:0/2257134373 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000b520 con 0x7effa017dd60 2022-07-05T11:46:27.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa527c700 1 -- 172.21.15.90:0/2257134373 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9000b680 con 0x7effa017dd60 2022-07-05T11:46:27.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa527c700 1 -- 172.21.15.90:0/2257134373 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000ba20 con 0x7effa017dd60 2022-07-05T11:46:27.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 -- 172.21.15.90:0/2257134373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 msgr2=0x7effa00c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 --2- 172.21.15.90:0/2257134373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 0x7effa00c3ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7effa00eb9d0 tx=0x7eff900090f0).stop 2022-07-05T11:46:27.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 -- 172.21.15.90:0/2257134373 shutdown_connections 2022-07-05T11:46:27.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 --2- 172.21.15.90:0/2257134373 >> v2:172.21.15.149:3300/0 conn(0x7effa00c4390 0x7effa00c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 --2- 172.21.15.90:0/2257134373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 0x7effa00c3ea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 -- 172.21.15.90:0/2257134373 >> 172.21.15.90:0/2257134373 conn(0x7effa00f1420 msgr2=0x7effa00f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:27.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 -- 172.21.15.90:0/2257134373 shutdown_connections 2022-07-05T11:46:27.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.013+0000 7effa7280700 1 -- 172.21.15.90:0/2257134373 wait complete. 2022-07-05T11:46:27.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.015+0000 7effa7280700 1 Processor -- start 2022-07-05T11:46:27.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.015+0000 7effa7280700 1 -- start start 2022-07-05T11:46:27.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa7280700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa00c4390 0x7effa018f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa7280700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa017d980 0x7effa01769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa7280700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 0x7effa00c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa7280700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0176eb0 con 0x7effa017d980 2022-07-05T11:46:27.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa7280700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00c6590 con 0x7effa017dd60 2022-07-05T11:46:27.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa7280700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00c56a0 con 0x7effa00c4390 2022-07-05T11:46:27.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa017d980 0x7effa01769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa017d980 0x7effa01769c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57080/0 (socket says 172.21.15.90:57080) 2022-07-05T11:46:27.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 -- 172.21.15.90:0/173700167 learned_addr learned my addr 172.21.15.90:0/173700167 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:27.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa627e700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa00c4390 0x7effa018f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa6a7f700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 0x7effa00c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 -- 172.21.15.90:0/173700167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa00c4390 msgr2=0x7effa018f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa00c4390 0x7effa018f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 -- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 msgr2=0x7effa00c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 0x7effa00c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 -- 172.21.15.90:0/173700167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009370 con 0x7effa017d980 2022-07-05T11:46:27.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa5a7d700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa017d980 0x7effa01769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7effa00ebac0 tx=0x7eff90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7eff8e7fc700 1 -- 172.21.15.90:0/173700167 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90006d90 con 0x7effa017d980 2022-07-05T11:46:27.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7eff8e7fc700 1 -- 172.21.15.90:0/173700167 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90006990 con 0x7effa017d980 2022-07-05T11:46:27.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa00c5980 con 0x7effa017d980 2022-07-05T11:46:27.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.016+0000 7eff8e7fc700 1 -- 172.21.15.90:0/173700167 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000b7f0 con 0x7effa017d980 2022-07-05T11:46:27.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.017+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00c5f40 con 0x7effa017d980 2022-07-05T11:46:27.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.017+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa00c66d0 con 0x7effa017d980 2022-07-05T11:46:27.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.018+0000 7eff8e7fc700 1 -- 172.21.15.90:0/173700167 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7eff9002c070 con 0x7effa017d980 2022-07-05T11:46:27.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.019+0000 7eff8e7fc700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7eff8008ba40 0x7eff8008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.019+0000 7eff8e7fc700 1 -- 172.21.15.90:0/173700167 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7eff900b2470 con 0x7effa017d980 2022-07-05T11:46:27.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.019+0000 7effa627e700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7eff8008ba40 0x7eff8008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.019+0000 7effa627e700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7eff8008ba40 0x7eff8008df00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7eff98000f80 tx=0x7eff98001530).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.022+0000 7eff8e7fc700 1 -- 172.21.15.90:0/173700167 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7eff90083130 con 0x7effa017d980 2022-07-05T11:46:27.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.182+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effa006be40 con 0x7effa017d980 2022-07-05T11:46:27.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.183+0000 7eff8e7fc700 1 -- 172.21.15.90:0/173700167 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff90020090 con 0x7effa017d980 2022-07-05T11:46:27.186 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:27.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7eff8008ba40 msgr2=0x7eff8008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7eff8008ba40 0x7eff8008df00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7eff98000f80 tx=0x7eff98001530).stop 2022-07-05T11:46:27.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa017d980 msgr2=0x7effa01769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa017d980 0x7effa01769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7effa00ebac0 tx=0x7eff90017000).stop 2022-07-05T11:46:27.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 shutdown_connections 2022-07-05T11:46:27.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7eff8008ba40 0x7eff8008df00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effa017dd60 0x7effa00c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa00c4390 0x7effa018f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 --2- 172.21.15.90:0/173700167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa017d980 0x7effa01769c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 >> 172.21.15.90:0/173700167 conn(0x7effa00f1420 msgr2=0x7effa0177dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:27.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.184+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 shutdown_connections 2022-07-05T11:46:27.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.185+0000 7effa7280700 1 -- 172.21.15.90:0/173700167 wait complete. 2022-07-05T11:46:27.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.1 2022-07-05T11:46:27.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-07-05T11:46:27.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.313+0000 7f23e1f49700 1 Processor -- start 2022-07-05T11:46:27.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.313+0000 7f23e1f49700 1 -- start start 2022-07-05T11:46:27.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23e1f49700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f23dc0c45b0 0x7f23dc0ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23e1f49700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0c3a10 con 0x7f23dc17dd60 2022-07-05T11:46:27.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23e1f49700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0f0330 con 0x7f23dc17d980 2022-07-05T11:46:27.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23e1f49700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc17f210 con 0x7f23dc0c45b0 2022-07-05T11:46:27.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23dbfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f23dc17dd60 0x7f23dc0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50028/0 (socket says 172.21.15.90:50028) 2022-07-05T11:46:27.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23dbfff700 1 -- 172.21.15.90:0/384976981 learned_addr learned my addr 172.21.15.90:0/384976981 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:27.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23e1748700 1 --2- 172.21.15.90:0/384976981 >> v2:172.21.15.149:3300/0 conn(0x7f23dc0c45b0 0x7f23dc0ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819514479 0 0) 0x7f23dc0c3a10 con 0x7f23dc17dd60 2022-07-05T11:46:27.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.314+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c00033f0 con 0x7f23dc17dd60 2022-07-05T11:46:27.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827317462 0 0) 0x7f23c00033f0 con 0x7f23dc17dd60 2022-07-05T11:46:27.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 >> v2:172.21.15.149:3300/0 conn(0x7f23dc0c45b0 msgr2=0x7f23dc0ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:27.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 --2- 172.21.15.90:0/384976981 >> v2:172.21.15.149:3300/0 conn(0x7f23dc0c45b0 0x7f23dc0ec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 >> v1:172.21.15.149:6789/0 conn(0x7f23dc17d980 legacy=0x7f23dc17eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0ed380 con 0x7f23dc17dd60 2022-07-05T11:46:27.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f23c8001470 con 0x7f23dc17dd60 2022-07-05T11:46:27.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 >> v1:172.21.15.90:6789/0 conn(0x7f23dc17dd60 legacy=0x7f23dc0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c0003930 0x7f23c0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c0004690 0x7f23c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0005120 0x7f23c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc17f210 con 0x7f23c0004690 2022-07-05T11:46:27.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c000c030 con 0x7f23c0005120 2022-07-05T11:46:27.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c000c1f0 con 0x7f23c0003930 2022-07-05T11:46:27.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23dbfff700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c0004690 0x7f23c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23e0f47700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c0003930 0x7f23c0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23dbfff700 1 -- 172.21.15.90:0/384976981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c0003930 msgr2=0x7f23c0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:27.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23dbfff700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c0003930 0x7f23c0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23e1748700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0005120 0x7f23c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23dbfff700 1 -- 172.21.15.90:0/384976981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0005120 msgr2=0x7f23c000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:27.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23dbfff700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0005120 0x7f23c000b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23e1748700 1 -- 172.21.15.90:0/384976981 reap_dead start 2022-07-05T11:46:27.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23dbfff700 1 -- 172.21.15.90:0/384976981 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00033f0 con 0x7f23c0004690 2022-07-05T11:46:27.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23dbfff700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c0004690 0x7f23c0004b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f23c800c190 tx=0x7f23c8001e50).ready entity=mon.0 client_cookie=4da2e177ca76eaec server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8007a20 con 0x7f23c0004690 2022-07-05T11:46:27.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c800cac0 con 0x7f23c0004690 2022-07-05T11:46:27.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.315+0000 7f23db7fe700 1 -- 172.21.15.90:0/384976981 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800ce40 con 0x7f23c0004690 2022-07-05T11:46:27.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.316+0000 7f23e1f49700 1 -- 172.21.15.90:0/384976981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c0004690 msgr2=0x7f23c0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.316+0000 7f23e1f49700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c0004690 0x7f23c0004b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f23c800c190 tx=0x7f23c8001e50).stop 2022-07-05T11:46:27.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.316+0000 7f23e1f49700 1 -- 172.21.15.90:0/384976981 shutdown_connections 2022-07-05T11:46:27.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.316+0000 7f23e1f49700 1 --2- 172.21.15.90:0/384976981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c0004690 0x7f23c0004b10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.316+0000 7f23e1f49700 1 -- 172.21.15.90:0/384976981 >> 172.21.15.90:0/384976981 conn(0x7f23dc0f1420 msgr2=0x7f23dc0f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:27.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.316+0000 7f23e1f49700 1 -- 172.21.15.90:0/384976981 shutdown_connections 2022-07-05T11:46:27.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.316+0000 7f23e1f49700 1 -- 172.21.15.90:0/384976981 wait complete. 2022-07-05T11:46:27.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.317+0000 7f23e1f49700 1 Processor -- start 2022-07-05T11:46:27.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.317+0000 7f23e1f49700 1 -- start start 2022-07-05T11:46:27.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.318+0000 7f23e1f49700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0004690 0x7f23dc175b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.318+0000 7f23e1f49700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc176080 0x7f23dc1806d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.318+0000 7f23e1f49700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23dc180bc0 0x7f23dc181040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.318+0000 7f23e1f49700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc176500 con 0x7f23dc180bc0 2022-07-05T11:46:27.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.318+0000 7f23e1f49700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc180240 con 0x7f23c0004690 2022-07-05T11:46:27.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.318+0000 7f23e1f49700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cc390 con 0x7f23dc176080 2022-07-05T11:46:27.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.318+0000 7f23e1748700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23dc180bc0 0x7f23dc181040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23dc180bc0 0x7f23dc181040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57102/0 (socket says 172.21.15.90:57102) 2022-07-05T11:46:27.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 -- 172.21.15.90:0/403086289 learned_addr learned my addr 172.21.15.90:0/403086289 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:27.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23dbfff700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc176080 0x7f23dc1806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e0f47700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0004690 0x7f23dc175b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 -- 172.21.15.90:0/403086289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc176080 msgr2=0x7f23dc1806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc176080 0x7f23dc1806d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 -- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0004690 msgr2=0x7f23dc175b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0004690 0x7f23dc175b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 -- 172.21.15.90:0/403086289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0cc670 con 0x7f23dc180bc0 2022-07-05T11:46:27.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1748700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23dc180bc0 0x7f23dc181040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f23dc0f07f0 tx=0x7f23d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23d8ff9700 1 -- 172.21.15.90:0/403086289 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4009b90 con 0x7f23dc180bc0 2022-07-05T11:46:27.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23d8ff9700 1 -- 172.21.15.90:0/403086289 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400fb50 con 0x7f23dc180bc0 2022-07-05T11:46:27.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc17f630 con 0x7f23dc180bc0 2022-07-05T11:46:27.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23d8ff9700 1 -- 172.21.15.90:0/403086289 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4014410 con 0x7f23dc180bc0 2022-07-05T11:46:27.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.319+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc17fbf0 con 0x7f23dc180bc0 2022-07-05T11:46:27.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.320+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc06be40 con 0x7f23dc180bc0 2022-07-05T11:46:27.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.321+0000 7f23d8ff9700 1 -- 172.21.15.90:0/403086289 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f23d40147c0 con 0x7f23dc180bc0 2022-07-05T11:46:27.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.321+0000 7f23d8ff9700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f23c408ba40 0x7f23c408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.321+0000 7f23d8ff9700 1 -- 172.21.15.90:0/403086289 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f23d40b1230 con 0x7f23dc180bc0 2022-07-05T11:46:27.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.321+0000 7f23e0f47700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f23c408ba40 0x7f23c408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.322+0000 7f23e0f47700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f23c408ba40 0x7f23c408df00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f23d0000c00 tx=0x7f23d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.325+0000 7f23d8ff9700 1 -- 172.21.15.90:0/403086289 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f23d4081ef0 con 0x7f23dc180bc0 2022-07-05T11:46:27.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.489+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23dc0ed660 con 0x7f23dc180bc0 2022-07-05T11:46:27.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.489+0000 7f23d8ff9700 1 -- 172.21.15.90:0/403086289 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23d4085510 con 0x7f23dc180bc0 2022-07-05T11:46:27.491 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:27.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f23c408ba40 msgr2=0x7f23c408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f23c408ba40 0x7f23c408df00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f23d0000c00 tx=0x7f23d0009040).stop 2022-07-05T11:46:27.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23dc180bc0 msgr2=0x7f23dc181040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23dc180bc0 0x7f23dc181040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f23dc0f07f0 tx=0x7f23d400b040).stop 2022-07-05T11:46:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 shutdown_connections 2022-07-05T11:46:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f23c408ba40 0x7f23c408df00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23dc180bc0 0x7f23dc181040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c0004690 0x7f23dc175b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 --2- 172.21.15.90:0/403086289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc176080 0x7f23dc1806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 >> 172.21.15.90:0/403086289 conn(0x7f23dc0f1420 msgr2=0x7f23dc183b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:27.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 shutdown_connections 2022-07-05T11:46:27.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.491+0000 7f23e1f49700 1 -- 172.21.15.90:0/403086289 wait complete. 2022-07-05T11:46:27.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.2 2022-07-05T11:46:27.505 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-07-05T11:46:27.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.617+0000 7ff0853b5700 1 Processor -- start 2022-07-05T11:46:27.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.617+0000 7ff0853b5700 1 -- start start 2022-07-05T11:46:27.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.618+0000 7ff0853b5700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff08017da60 0x7ff08017de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.618+0000 7ff0853b5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff0800c7d00 0x7ff08017eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.618+0000 7ff0853b5700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0800c9090 con 0x7ff08017f070 2022-07-05T11:46:27.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.618+0000 7ff0853b5700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0800c81a0 con 0x7ff08017da60 2022-07-05T11:46:27.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff0853b5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0800c8480 con 0x7ff0800c7d00 2022-07-05T11:46:27.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07effd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff08017da60 0x7ff08017de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07f7fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff08017f070 0x7ff0800c9520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50048/0 (socket says 172.21.15.90:50048) 2022-07-05T11:46:27.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07effd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff08017da60 0x7ff08017de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57106/0 (socket says 172.21.15.90:57106) 2022-07-05T11:46:27.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07f7fe700 1 -- 172.21.15.90:0/9550046 learned_addr learned my addr 172.21.15.90:0/9550046 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:27.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/9550046 >> v2:172.21.15.149:3300/0 conn(0x7ff0800c7d00 0x7ff08017eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07effd700 1 -- 172.21.15.90:0/9550046 >> v2:172.21.15.149:3300/0 conn(0x7ff0800c7d00 msgr2=0x7ff08017eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:27.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07effd700 1 --2- 172.21.15.90:0/9550046 >> v2:172.21.15.149:3300/0 conn(0x7ff0800c7d00 0x7ff08017eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07effd700 1 -- 172.21.15.90:0/9550046 >> v1:172.21.15.90:6789/0 conn(0x7ff08017f070 legacy=0x7ff0800c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07dffb700 1 -- 172.21.15.90:0/9550046 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101595910 0 0) 0x7ff0800c9090 con 0x7ff08017f070 2022-07-05T11:46:27.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07effd700 1 -- 172.21.15.90:0/9550046 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0800c8760 con 0x7ff08017da60 2022-07-05T11:46:27.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07effd700 1 --2- 172.21.15.90:0/9550046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff08017da60 0x7ff08017de40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff070009e60 tx=0x7ff070009780).ready entity=mon.0 client_cookie=f1f61226dc70ca3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07dffb700 1 -- 172.21.15.90:0/9550046 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000e070 con 0x7ff08017da60 2022-07-05T11:46:27.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07dffb700 1 -- 172.21.15.90:0/9550046 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07000bbf0 con 0x7ff08017da60 2022-07-05T11:46:27.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.619+0000 7ff07dffb700 1 -- 172.21.15.90:0/9550046 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070012410 con 0x7ff08017da60 2022-07-05T11:46:27.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 -- 172.21.15.90:0/9550046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff08017da60 msgr2=0x7ff08017de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 --2- 172.21.15.90:0/9550046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff08017da60 0x7ff08017de40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff070009e60 tx=0x7ff070009780).stop 2022-07-05T11:46:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 -- 172.21.15.90:0/9550046 shutdown_connections 2022-07-05T11:46:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 --2- 172.21.15.90:0/9550046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff08017da60 0x7ff08017de40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 --2- 172.21.15.90:0/9550046 >> v2:172.21.15.149:3300/0 conn(0x7ff0800c7d00 0x7ff08017eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 -- 172.21.15.90:0/9550046 >> 172.21.15.90:0/9550046 conn(0x7ff0800f4b70 msgr2=0x7ff0800f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:27.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 -- 172.21.15.90:0/9550046 shutdown_connections 2022-07-05T11:46:27.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.620+0000 7ff0853b5700 1 -- 172.21.15.90:0/9550046 wait complete. 2022-07-05T11:46:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.621+0000 7ff0853b5700 1 Processor -- start 2022-07-05T11:46:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.621+0000 7ff0853b5700 1 -- start start 2022-07-05T11:46:27.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff0853b5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800c7d00 0x7ff08018ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff0853b5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff08017da60 0x7ff08016d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff0853b5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff08017f070 0x7ff08016d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff0853b5700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801918e0 con 0x7ff0800c7d00 2022-07-05T11:46:27.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff0853b5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801909f0 con 0x7ff08017f070 2022-07-05T11:46:27.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff0853b5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080190cd0 con 0x7ff08017da60 2022-07-05T11:46:27.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff07effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800c7d00 0x7ff08018ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff07effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800c7d00 0x7ff08018ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57112/0 (socket says 172.21.15.90:57112) 2022-07-05T11:46:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff07effd700 1 -- 172.21.15.90:0/3880032184 learned_addr learned my addr 172.21.15.90:0/3880032184 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff08017da60 0x7ff08016d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff07effd700 1 -- 172.21.15.90:0/3880032184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff08017da60 msgr2=0x7ff08016d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.622+0000 7ff07effd700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff08017da60 0x7ff08016d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff07effd700 1 -- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff08017f070 msgr2=0x7ff08016d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff07effd700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff08017f070 0x7ff08016d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff07effd700 1 -- 172.21.15.90:0/3880032184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070009a20 con 0x7ff0800c7d00 2022-07-05T11:46:27.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff07effd700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800c7d00 0x7ff08018ef50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff080088b30 tx=0x7ff070009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff076ffd700 1 -- 172.21.15.90:0/3880032184 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07001d630 con 0x7ff0800c7d00 2022-07-05T11:46:27.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff076ffd700 1 -- 172.21.15.90:0/3880032184 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07001d790 con 0x7ff0800c7d00 2022-07-05T11:46:27.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff076ffd700 1 -- 172.21.15.90:0/3880032184 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07001db50 con 0x7ff0800c7d00 2022-07-05T11:46:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff080190fb0 con 0x7ff0800c7d00 2022-07-05T11:46:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.623+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff080191570 con 0x7ff0800c7d00 2022-07-05T11:46:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.624+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080191730 con 0x7ff0800c7d00 2022-07-05T11:46:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.625+0000 7ff076ffd700 1 -- 172.21.15.90:0/3880032184 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff07002f3d0 con 0x7ff0800c7d00 2022-07-05T11:46:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.625+0000 7ff076ffd700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff06408ba40 0x7ff06408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.625+0000 7ff076ffd700 1 -- 172.21.15.90:0/3880032184 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff0700b3660 con 0x7ff0800c7d00 2022-07-05T11:46:27.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.625+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff06408ba40 0x7ff06408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.626+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff06408ba40 0x7ff06408df00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff068006fd0 tx=0x7ff068008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.628+0000 7ff076ffd700 1 -- 172.21.15.90:0/3880032184 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7ff070084320 con 0x7ff0800c7d00 2022-07-05T11:46:27.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.789+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff08006be40 con 0x7ff0800c7d00 2022-07-05T11:46:27.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.789+0000 7ff076ffd700 1 -- 172.21.15.90:0/3880032184 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff070017030 con 0x7ff0800c7d00 2022-07-05T11:46:27.791 INFO:teuthology.orchestra.run.smithi090.stdout:73014444039 2022-07-05T11:46:27.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff06408ba40 msgr2=0x7ff06408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff06408ba40 0x7ff06408df00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff068006fd0 tx=0x7ff068008040).stop 2022-07-05T11:46:27.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800c7d00 msgr2=0x7ff08018ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800c7d00 0x7ff08018ef50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff080088b30 tx=0x7ff070009780).stop 2022-07-05T11:46:27.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 shutdown_connections 2022-07-05T11:46:27.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff06408ba40 0x7ff06408df00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff08017f070 0x7ff08016d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:27.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800c7d00 0x7ff08018ef50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.791+0000 7ff0853b5700 1 --2- 172.21.15.90:0/3880032184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff08017da60 0x7ff08016d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.792+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 >> 172.21.15.90:0/3880032184 conn(0x7ff0800f4b70 msgr2=0x7ff0801773f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:27.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.792+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 shutdown_connections 2022-07-05T11:46:27.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.792+0000 7ff0853b5700 1 -- 172.21.15.90:0/3880032184 wait complete. 2022-07-05T11:46:27.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.3 2022-07-05T11:46:27.805 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-07-05T11:46:27.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.918+0000 7f75b163b700 1 Processor -- start 2022-07-05T11:46:27.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.918+0000 7f75b163b700 1 -- start start 2022-07-05T11:46:27.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75b163b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f75ac0c2240 0x7f75ac17fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75b163b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0c26c0 con 0x7f75ac1785a0 2022-07-05T11:46:27.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75b163b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac178980 con 0x7f75ac17ffa0 2022-07-05T11:46:27.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75b163b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0c2900 con 0x7f75ac0c2240 2022-07-05T11:46:27.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75a27fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f75ac0c2240 0x7f75ac17fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75aaffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f75ac1785a0 0x7f75ac0c1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50060/0 (socket says 172.21.15.90:50060) 2022-07-05T11:46:27.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75aaffd700 1 -- 172.21.15.90:0/2494161701 learned_addr learned my addr 172.21.15.90:0/2494161701 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:27.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75a27fc700 1 -- 172.21.15.90:0/2494161701 >> v1:172.21.15.149:6789/0 conn(0x7f75ac17ffa0 legacy=0x7f75ac17e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:27.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75a27fc700 1 -- 172.21.15.90:0/2494161701 >> v1:172.21.15.90:6789/0 conn(0x7f75ac1785a0 legacy=0x7f75ac0c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75a27fc700 1 -- 172.21.15.90:0/2494161701 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0c2be0 con 0x7f75ac0c2240 2022-07-05T11:46:27.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75aa7fc700 1 -- 172.21.15.90:0/2494161701 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062148655 0 0) 0x7f759c001110 con 0x7f75ac1785a0 2022-07-05T11:46:27.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75a27fc700 1 --2- 172.21.15.90:0/2494161701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0c2240 0x7f75ac17fab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f7594009760 tx=0x7f7594009060).ready entity=mon.0 client_cookie=714b66f5557d1fec server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75aa7fc700 1 -- 172.21.15.90:0/2494161701 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400b580 con 0x7f75ac0c2240 2022-07-05T11:46:27.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75aa7fc700 1 -- 172.21.15.90:0/2494161701 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400b6e0 con 0x7f75ac0c2240 2022-07-05T11:46:27.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.919+0000 7f75aa7fc700 1 -- 172.21.15.90:0/2494161701 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400ba60 con 0x7f75ac0c2240 2022-07-05T11:46:27.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.920+0000 7f75b163b700 1 -- 172.21.15.90:0/2494161701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0c2240 msgr2=0x7f75ac17fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.920+0000 7f75b163b700 1 --2- 172.21.15.90:0/2494161701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0c2240 0x7f75ac17fab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f7594009760 tx=0x7f7594009060).stop 2022-07-05T11:46:27.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.920+0000 7f75b163b700 1 -- 172.21.15.90:0/2494161701 shutdown_connections 2022-07-05T11:46:27.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.920+0000 7f75b163b700 1 --2- 172.21.15.90:0/2494161701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0c2240 0x7f75ac17fab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.920+0000 7f75b163b700 1 -- 172.21.15.90:0/2494161701 >> 172.21.15.90:0/2494161701 conn(0x7f75ac0f22f0 msgr2=0x7f75ac0ee2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:27.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.920+0000 7f75b163b700 1 -- 172.21.15.90:0/2494161701 shutdown_connections 2022-07-05T11:46:27.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.920+0000 7f75b163b700 1 -- 172.21.15.90:0/2494161701 wait complete. 2022-07-05T11:46:27.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.921+0000 7f75b163b700 1 Processor -- start 2022-07-05T11:46:27.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.921+0000 7f75b163b700 1 -- start start 2022-07-05T11:46:27.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.922+0000 7f75b163b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac0c2240 0x7f75ac16df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.922+0000 7f75b163b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75ac1785a0 0x7f75ac0ebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.922+0000 7f75b163b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac17ffa0 0x7f75ac0ec320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.922+0000 7f75b163b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0ec810 con 0x7f75ac17ffa0 2022-07-05T11:46:27.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.922+0000 7f75b163b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac180b70 con 0x7f75ac1785a0 2022-07-05T11:46:27.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.922+0000 7f75b163b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac180590 con 0x7f75ac0c2240 2022-07-05T11:46:27.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac17ffa0 0x7f75ac0ec320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac17ffa0 0x7f75ac0ec320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57130/0 (socket says 172.21.15.90:57130) 2022-07-05T11:46:27.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 -- 172.21.15.90:0/910106077 learned_addr learned my addr 172.21.15.90:0/910106077 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:27.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75aaffd700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac0c2240 0x7f75ac16df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75a27fc700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75ac1785a0 0x7f75ac0ebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 -- 172.21.15.90:0/910106077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac0c2240 msgr2=0x7f75ac16df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac0c2240 0x7f75ac16df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 -- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75ac1785a0 msgr2=0x7f75ac0ebe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:27.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75ac1785a0 0x7f75ac0ebe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:27.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 -- 172.21.15.90:0/910106077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940092a0 con 0x7f75ac17ffa0 2022-07-05T11:46:27.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75a27fc700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75ac1785a0 0x7f75ac0ebe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:27.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75ab7fe700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac17ffa0 0x7f75ac0ec320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f75a400c740 tx=0x7f75a4001540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75a37fe700 1 -- 172.21.15.90:0/910106077 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4010510 con 0x7f75ac17ffa0 2022-07-05T11:46:27.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75a37fe700 1 -- 172.21.15.90:0/910106077 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a4010670 con 0x7f75ac17ffa0 2022-07-05T11:46:27.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac16e3f0 con 0x7f75ac17ffa0 2022-07-05T11:46:27.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75a37fe700 1 -- 172.21.15.90:0/910106077 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40109f0 con 0x7f75ac17ffa0 2022-07-05T11:46:27.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.923+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac0eccf0 con 0x7f75ac17ffa0 2022-07-05T11:46:27.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.924+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac06be40 con 0x7f75ac17ffa0 2022-07-05T11:46:27.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.925+0000 7f75a37fe700 1 -- 172.21.15.90:0/910106077 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f75a4010070 con 0x7f75ac17ffa0 2022-07-05T11:46:27.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.925+0000 7f75a37fe700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f759008ba70 0x7f759008df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:27.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.925+0000 7f75a37fe700 1 -- 172.21.15.90:0/910106077 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f75a40b0580 con 0x7f75ac17ffa0 2022-07-05T11:46:27.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.926+0000 7f75aaffd700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f759008ba70 0x7f759008df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:27.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.926+0000 7f75aaffd700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f759008ba70 0x7f759008df30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f75ac17fbe0 tx=0x7f759c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:27.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:27.929+0000 7f75a37fe700 1 -- 172.21.15.90:0/910106077 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f75a4081240 con 0x7f75ac17ffa0 2022-07-05T11:46:28.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.091+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f75ac0c1910 con 0x7f75ac17ffa0 2022-07-05T11:46:28.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.092+0000 7f75a37fe700 1 -- 172.21.15.90:0/910106077 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75a4084860 con 0x7f75ac17ffa0 2022-07-05T11:46:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:28.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f759008ba70 msgr2=0x7f759008df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f759008ba70 0x7f759008df30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f75ac17fbe0 tx=0x7f759c009040).stop 2022-07-05T11:46:28.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac17ffa0 msgr2=0x7f75ac0ec320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac17ffa0 0x7f75ac0ec320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f75a400c740 tx=0x7f75a4001540).stop 2022-07-05T11:46:28.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 shutdown_connections 2022-07-05T11:46:28.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f759008ba70 0x7f759008df30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac17ffa0 0x7f75ac0ec320 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.093+0000 7f75b163b700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac0c2240 0x7f75ac16df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.094+0000 7f75b163b700 1 --2- 172.21.15.90:0/910106077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75ac1785a0 0x7f75ac0ebe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.094+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 >> 172.21.15.90:0/910106077 conn(0x7f75ac0f22f0 msgr2=0x7f75ac175c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:28.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.094+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 shutdown_connections 2022-07-05T11:46:28.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.094+0000 7f75b163b700 1 -- 172.21.15.90:0/910106077 wait complete. 2022-07-05T11:46:28.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.4 2022-07-05T11:46:28.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-07-05T11:46:28.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.221+0000 7f986564b700 1 Processor -- start 2022-07-05T11:46:28.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.221+0000 7f986564b700 1 -- start start 2022-07-05T11:46:28.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.222+0000 7f986564b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9860176340 0x7f98600841d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.222+0000 7f986564b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f98600c7160 0x7f986017f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.222+0000 7f986564b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986017be20 con 0x7f9860175f60 2022-07-05T11:46:28.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.222+0000 7f986564b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986017af30 con 0x7f9860176340 2022-07-05T11:46:28.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.222+0000 7f986564b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986017b210 con 0x7f98600c7160 2022-07-05T11:46:28.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.222+0000 7f985ffff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9860175f60 0x7f98600c6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50074/0 (socket says 172.21.15.90:50074) 2022-07-05T11:46:28.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.222+0000 7f985ffff700 1 -- 172.21.15.90:0/3496946235 learned_addr learned my addr 172.21.15.90:0/3496946235 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:28.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 --2- 172.21.15.90:0/3496946235 >> v2:172.21.15.110:3300/0 conn(0x7f9860176340 0x7f98600841d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393284641 0 0) 0x7f986017be20 con 0x7f9860175f60 2022-07-05T11:46:28.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f984c0033f0 con 0x7f9860175f60 2022-07-05T11:46:28.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f9864e4a700 1 --2- 172.21.15.90:0/3496946235 >> v2:172.21.15.149:3300/0 conn(0x7f98600c7160 0x7f986017f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4204169118 0 0) 0x7f984c0033f0 con 0x7f9860175f60 2022-07-05T11:46:28.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 >> v2:172.21.15.149:3300/0 conn(0x7f98600c7160 msgr2=0x7f986017f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 --2- 172.21.15.90:0/3496946235 >> v2:172.21.15.149:3300/0 conn(0x7f98600c7160 0x7f986017f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 >> v2:172.21.15.110:3300/0 conn(0x7f9860176340 msgr2=0x7f98600841d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 --2- 172.21.15.90:0/3496946235 >> v2:172.21.15.110:3300/0 conn(0x7f9860176340 0x7f98600841d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986017b4f0 con 0x7f9860175f60 2022-07-05T11:46:28.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f9850001470 con 0x7f9860175f60 2022-07-05T11:46:28.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 >> v1:172.21.15.90:6789/0 conn(0x7f9860175f60 legacy=0x7f98600c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c003930 0x7f984c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f984c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f984c005000 0x7f984c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986017af30 con 0x7f984c004690 2022-07-05T11:46:28.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986017b210 con 0x7f984c003930 2022-07-05T11:46:28.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c00be80 con 0x7f984c005000 2022-07-05T11:46:28.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f984c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985ffff700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c003930 0x7f984c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f9864e4a700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f984c005000 0x7f984c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 -- 172.21.15.90:0/3496946235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f984c005000 msgr2=0x7f984c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f984c005000 0x7f984c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 -- 172.21.15.90:0/3496946235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c003930 msgr2=0x7f984c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c003930 0x7f984c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 -- 172.21.15.90:0/3496946235 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c0033f0 con 0x7f984c004690 2022-07-05T11:46:28.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f9864e4a700 1 -- 172.21.15.90:0/3496946235 reap_dead start 2022-07-05T11:46:28.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985f7fe700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f984c004b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9854009a80 tx=0x7f9854009060).ready entity=mon.0 client_cookie=4a2707a168312bd8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.223+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854009430 con 0x7f984c004690 2022-07-05T11:46:28.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400e640 con 0x7f984c004690 2022-07-05T11:46:28.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f985effd700 1 -- 172.21.15.90:0/3496946235 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400e9c0 con 0x7f984c004690 2022-07-05T11:46:28.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f986564b700 1 -- 172.21.15.90:0/3496946235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 msgr2=0x7f984c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f986564b700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f984c004b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9854009a80 tx=0x7f9854009060).stop 2022-07-05T11:46:28.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f986564b700 1 -- 172.21.15.90:0/3496946235 shutdown_connections 2022-07-05T11:46:28.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f986564b700 1 --2- 172.21.15.90:0/3496946235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f984c004b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f986564b700 1 -- 172.21.15.90:0/3496946235 >> 172.21.15.90:0/3496946235 conn(0x7f98600ee4b0 msgr2=0x7f9860083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:28.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f986564b700 1 -- 172.21.15.90:0/3496946235 shutdown_connections 2022-07-05T11:46:28.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.224+0000 7f986564b700 1 -- 172.21.15.90:0/3496946235 wait complete. 2022-07-05T11:46:28.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.225+0000 7f986564b700 1 Processor -- start 2022-07-05T11:46:28.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.226+0000 7f986564b700 1 -- start start 2022-07-05T11:46:28.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.226+0000 7f986564b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f986016ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f986564b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f986016c530 0x7f986018f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f986564b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986016a1b0 0x7f986016a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f986564b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986016c9b0 con 0x7f984c004690 2022-07-05T11:46:28.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f986564b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986016b1b0 con 0x7f986016a1b0 2022-07-05T11:46:28.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f986564b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986016b490 con 0x7f986016c530 2022-07-05T11:46:28.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f986016ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f986016ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57146/0 (socket says 172.21.15.90:57146) 2022-07-05T11:46:28.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 -- 172.21.15.90:0/562218846 learned_addr learned my addr 172.21.15.90:0/562218846 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:28.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985f7fe700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f986016c530 0x7f986018f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f9864e4a700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986016a1b0 0x7f986016a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 -- 172.21.15.90:0/562218846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f986016c530 msgr2=0x7f986018f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f986016c530 0x7f986018f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 -- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986016a1b0 msgr2=0x7f986016a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986016a1b0 0x7f986016a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 -- 172.21.15.90:0/562218846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986016b770 con 0x7f984c004690 2022-07-05T11:46:28.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985f7fe700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f986016c530 0x7f986018f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:28.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f9864e4a700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986016a1b0 0x7f986016a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:28.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f985ffff700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f986016ab50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9850007fd0 tx=0x7f98600ea720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f9847fff700 1 -- 172.21.15.90:0/562218846 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850004e70 con 0x7f984c004690 2022-07-05T11:46:28.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f9847fff700 1 -- 172.21.15.90:0/562218846 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985000f870 con 0x7f984c004690 2022-07-05T11:46:28.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986016ba50 con 0x7f984c004690 2022-07-05T11:46:28.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f9847fff700 1 -- 172.21.15.90:0/562218846 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985000fbf0 con 0x7f984c004690 2022-07-05T11:46:28.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.227+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986016c010 con 0x7f984c004690 2022-07-05T11:46:28.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.228+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986016c230 con 0x7f984c004690 2022-07-05T11:46:28.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.229+0000 7f9847fff700 1 -- 172.21.15.90:0/562218846 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f985001c360 con 0x7f984c004690 2022-07-05T11:46:28.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.229+0000 7f9847fff700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f984008ba40 0x7f984008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.230+0000 7f9847fff700 1 -- 172.21.15.90:0/562218846 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f98500b0150 con 0x7f984c004690 2022-07-05T11:46:28.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.230+0000 7f985f7fe700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f984008ba40 0x7f984008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.230+0000 7f985f7fe700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f984008ba40 0x7f984008df00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f98600694d0 tx=0x7f985401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.233+0000 7f9847fff700 1 -- 172.21.15.90:0/562218846 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f9850080d90 con 0x7f984c004690 2022-07-05T11:46:28.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.397+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f986006be40 con 0x7f984c004690 2022-07-05T11:46:28.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.397+0000 7f9847fff700 1 -- 172.21.15.90:0/562218846 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9850019030 con 0x7f984c004690 2022-07-05T11:46:28.398 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:28.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f984008ba40 msgr2=0x7f984008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f984008ba40 0x7f984008df00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f98600694d0 tx=0x7f985401a000).stop 2022-07-05T11:46:28.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 msgr2=0x7f986016ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f986016ab50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9850007fd0 tx=0x7f98600ea720).stop 2022-07-05T11:46:28.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 shutdown_connections 2022-07-05T11:46:28.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f984008ba40 0x7f984008df00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986016a1b0 0x7f986016a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f984c004690 0x7f986016ab50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 --2- 172.21.15.90:0/562218846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f986016c530 0x7f986018f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 >> 172.21.15.90:0/562218846 conn(0x7f98600ee4b0 msgr2=0x7f98600c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:28.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 shutdown_connections 2022-07-05T11:46:28.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.399+0000 7f986564b700 1 -- 172.21.15.90:0/562218846 wait complete. 2022-07-05T11:46:28.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.5 2022-07-05T11:46:28.413 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-07-05T11:46:28.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.524+0000 7fa18a914700 1 Processor -- start 2022-07-05T11:46:28.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.524+0000 7fa18a914700 1 -- start start 2022-07-05T11:46:28.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.525+0000 7fa18a914700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa184175e20 0x7fa184176200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.525+0000 7fa18a914700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa18417b2c0 0x7fa18417b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.525+0000 7fa18a914700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa184179cf0 con 0x7fa18417c5b0 2022-07-05T11:46:28.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.525+0000 7fa18a914700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1840c4920 con 0x7fa184175e20 2022-07-05T11:46:28.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.525+0000 7fa18a914700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18417ae30 con 0x7fa18417b2c0 2022-07-05T11:46:28.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.525+0000 7fa189111700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa18417c5b0 0x7fa18417ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50094/0 (socket says 172.21.15.90:50094) 2022-07-05T11:46:28.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.525+0000 7fa189111700 1 -- 172.21.15.90:0/3048756158 learned_addr learned my addr 172.21.15.90:0/3048756158 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:28.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189912700 1 --2- 172.21.15.90:0/3048756158 >> v2:172.21.15.110:3300/0 conn(0x7fa184175e20 0x7fa184176200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa18a113700 1 --2- 172.21.15.90:0/3048756158 >> v2:172.21.15.149:3300/0 conn(0x7fa18417b2c0 0x7fa18417b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167352221 0 0) 0x7fa184179cf0 con 0x7fa18417c5b0 2022-07-05T11:46:28.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa16c0033f0 con 0x7fa18417c5b0 2022-07-05T11:46:28.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498884554 0 0) 0x7fa16c0033f0 con 0x7fa18417c5b0 2022-07-05T11:46:28.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 >> v2:172.21.15.149:3300/0 conn(0x7fa18417b2c0 msgr2=0x7fa18417b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 --2- 172.21.15.90:0/3048756158 >> v2:172.21.15.149:3300/0 conn(0x7fa18417b2c0 0x7fa18417b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 >> v2:172.21.15.110:3300/0 conn(0x7fa184175e20 msgr2=0x7fa184176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 --2- 172.21.15.90:0/3048756158 >> v2:172.21.15.110:3300/0 conn(0x7fa184175e20 0x7fa184176200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184179f40 con 0x7fa18417c5b0 2022-07-05T11:46:28.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fa174001470 con 0x7fa18417c5b0 2022-07-05T11:46:28.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189912700 1 --2- 172.21.15.90:0/3048756158 >> v2:172.21.15.110:3300/0 conn(0x7fa184175e20 0x7fa184176200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:28.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa18a113700 1 --2- 172.21.15.90:0/3048756158 >> v2:172.21.15.149:3300/0 conn(0x7fa18417b2c0 0x7fa18417b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:28.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 >> v1:172.21.15.90:6789/0 conn(0x7fa18417c5b0 legacy=0x7fa18417ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16c003930 0x7fa16c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c004690 0x7fa16c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c005000 0x7fa16c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840c4920 con 0x7fa16c004690 2022-07-05T11:46:28.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18417ae30 con 0x7fa16c003930 2022-07-05T11:46:28.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c010290 con 0x7fa16c005000 2022-07-05T11:46:28.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189111700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c004690 0x7fa16c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189912700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16c003930 0x7fa16c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa18a113700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c005000 0x7fa16c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189111700 1 -- 172.21.15.90:0/3048756158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c005000 msgr2=0x7fa16c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189111700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c005000 0x7fa16c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189111700 1 -- 172.21.15.90:0/3048756158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16c003930 msgr2=0x7fa16c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189111700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16c003930 0x7fa16c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa18a113700 1 -- 172.21.15.90:0/3048756158 reap_dead start 2022-07-05T11:46:28.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.526+0000 7fa189111700 1 -- 172.21.15.90:0/3048756158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0033f0 con 0x7fa16c004690 2022-07-05T11:46:28.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa189111700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c004690 0x7fa16c004b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa17400c210 tx=0x7fa18417c080).ready entity=mon.0 client_cookie=b18b5e12a36f6c27 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174007a60 con 0x7fa16c004690 2022-07-05T11:46:28.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17400ca60 con 0x7fa16c004690 2022-07-05T11:46:28.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa188910700 1 -- 172.21.15.90:0/3048756158 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17400cde0 con 0x7fa16c004690 2022-07-05T11:46:28.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa18a914700 1 -- 172.21.15.90:0/3048756158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c004690 msgr2=0x7fa16c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa18a914700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c004690 0x7fa16c004b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa17400c210 tx=0x7fa18417c080).stop 2022-07-05T11:46:28.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa18a914700 1 -- 172.21.15.90:0/3048756158 shutdown_connections 2022-07-05T11:46:28.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa18a914700 1 --2- 172.21.15.90:0/3048756158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c004690 0x7fa16c004b10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa18a914700 1 -- 172.21.15.90:0/3048756158 >> 172.21.15.90:0/3048756158 conn(0x7fa1840ee1a0 msgr2=0x7fa1840ee5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:28.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa18a914700 1 -- 172.21.15.90:0/3048756158 shutdown_connections 2022-07-05T11:46:28.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.527+0000 7fa18a914700 1 -- 172.21.15.90:0/3048756158 wait complete. 2022-07-05T11:46:28.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.529+0000 7fa18a914700 1 Processor -- start 2022-07-05T11:46:28.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.529+0000 7fa18a914700 1 -- start start 2022-07-05T11:46:28.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a914700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c004690 0x7fa184169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a914700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa184169730 0x7fa1840c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a914700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1840c7600 0x7fa18418c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a914700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840c81a0 con 0x7fa184169730 2022-07-05T11:46:28.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a914700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18418bd00 con 0x7fa1840c7600 2022-07-05T11:46:28.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a914700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa184169bb0 con 0x7fa16c004690 2022-07-05T11:46:28.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa184169730 0x7fa1840c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa184169730 0x7fa1840c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57164/0 (socket says 172.21.15.90:57164) 2022-07-05T11:46:28.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 -- 172.21.15.90:0/3229017422 learned_addr learned my addr 172.21.15.90:0/3229017422 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:28.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189912700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c004690 0x7fa184169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a113700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1840c7600 0x7fa18418c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 -- 172.21.15.90:0/3229017422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c004690 msgr2=0x7fa184169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c004690 0x7fa184169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 -- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1840c7600 msgr2=0x7fa18418c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1840c7600 0x7fa18418c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 -- 172.21.15.90:0/3229017422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840c7ec0 con 0x7fa184169730 2022-07-05T11:46:28.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa189111700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa184169730 0x7fa1840c7110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fa17400ca30 tx=0x7fa174015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa171ffb700 1 -- 172.21.15.90:0/3229017422 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174001640 con 0x7fa184169730 2022-07-05T11:46:28.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa171ffb700 1 -- 172.21.15.90:0/3229017422 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1740017a0 con 0x7fa184169730 2022-07-05T11:46:28.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18418b3d0 con 0x7fa184169730 2022-07-05T11:46:28.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.530+0000 7fa171ffb700 1 -- 172.21.15.90:0/3229017422 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174004900 con 0x7fa184169730 2022-07-05T11:46:28.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.531+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18418b990 con 0x7fa184169730 2022-07-05T11:46:28.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.531+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18418ce50 con 0x7fa184169730 2022-07-05T11:46:28.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.532+0000 7fa171ffb700 1 -- 172.21.15.90:0/3229017422 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fa174027070 con 0x7fa184169730 2022-07-05T11:46:28.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.533+0000 7fa171ffb700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa16408ba40 0x7fa16408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.533+0000 7fa171ffb700 1 -- 172.21.15.90:0/3229017422 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa1740b1470 con 0x7fa184169730 2022-07-05T11:46:28.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.533+0000 7fa189912700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa16408ba40 0x7fa16408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.533+0000 7fa189912700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa16408ba40 0x7fa16408df00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa1840eb3e0 tx=0x7fa17c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.536+0000 7fa171ffb700 1 -- 172.21.15.90:0/3229017422 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fa174082130 con 0x7fa184169730 2022-07-05T11:46:28.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.703+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa18418ce50 con 0x7fa184169730 2022-07-05T11:46:28.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.703+0000 7fa171ffb700 1 -- 172.21.15.90:0/3229017422 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa18418ce50 con 0x7fa184169730 2022-07-05T11:46:28.705 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:28.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa16408ba40 msgr2=0x7fa16408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa16408ba40 0x7fa16408df00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa1840eb3e0 tx=0x7fa17c009060).stop 2022-07-05T11:46:28.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa184169730 msgr2=0x7fa1840c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa184169730 0x7fa1840c7110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fa17400ca30 tx=0x7fa174015000).stop 2022-07-05T11:46:28.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 shutdown_connections 2022-07-05T11:46:28.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa16408ba40 0x7fa16408df00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1840c7600 0x7fa18418c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16c004690 0x7fa184169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 --2- 172.21.15.90:0/3229017422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa184169730 0x7fa1840c7110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 >> 172.21.15.90:0/3229017422 conn(0x7fa1840ee1a0 msgr2=0x7fa18416e480 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:28.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 shutdown_connections 2022-07-05T11:46:28.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.705+0000 7fa18a914700 1 -- 172.21.15.90:0/3229017422 wait complete. 2022-07-05T11:46:28.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.6 2022-07-05T11:46:28.720 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-07-05T11:46:28.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.835+0000 7f6ddc90e700 1 Processor -- start 2022-07-05T11:46:28.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.835+0000 7f6ddc90e700 1 -- start start 2022-07-05T11:46:28.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6ddc90e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6dd80c7d00 0x7f6dd817de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6ddc90e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd80c9090 con 0x7f6dd817da60 2022-07-05T11:46:28.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6ddc90e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd80c81a0 con 0x7f6dd80c9520 2022-07-05T11:46:28.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6ddc90e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd80c8480 con 0x7f6dd80c7d00 2022-07-05T11:46:28.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd659c700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6dd817da60 0x7f6dd817eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50110/0 (socket says 172.21.15.90:50110) 2022-07-05T11:46:28.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd659c700 1 -- 172.21.15.90:0/2242249272 learned_addr learned my addr 172.21.15.90:0/2242249272 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:28.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363784759 0 0) 0x7f6dd80c9090 con 0x7f6dd817da60 2022-07-05T11:46:28.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/2242249272 >> v2:172.21.15.110:3300/0 conn(0x7f6dd80c7d00 0x7f6dd817de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db80033f0 con 0x7f6dd817da60 2022-07-05T11:46:28.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2740729230 0 0) 0x7f6db80033f0 con 0x7f6dd817da60 2022-07-05T11:46:28.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 >> v2:172.21.15.110:3300/0 conn(0x7f6dd80c7d00 msgr2=0x7f6dd817de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 --2- 172.21.15.90:0/2242249272 >> v2:172.21.15.110:3300/0 conn(0x7f6dd80c7d00 0x7f6dd817de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 >> v1:172.21.15.149:6789/0 conn(0x7f6dd80c9520 legacy=0x7f6dd80c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80c8760 con 0x7f6dd817da60 2022-07-05T11:46:28.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f6dc80017f0 con 0x7f6dd817da60 2022-07-05T11:46:28.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 >> v1:172.21.15.90:6789/0 conn(0x7f6dd817da60 legacy=0x7f6dd817eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8003930 0x7f6db8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.836+0000 7f6dd559a700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db8005000 0x7f6db800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c8480 con 0x7f6db8004690 2022-07-05T11:46:28.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800bf30 con 0x7f6db8003930 2022-07-05T11:46:28.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800c0f0 con 0x7f6db8005000 2022-07-05T11:46:28.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd659c700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8003930 0x7f6db8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd6d9d700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db8005000 0x7f6db800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd5d9b700 1 -- 172.21.15.90:0/2242249272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db8005000 msgr2=0x7f6db800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db8005000 0x7f6db800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd5d9b700 1 -- 172.21.15.90:0/2242249272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8003930 msgr2=0x7f6db8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:28.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db8003930 0x7f6db8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd5d9b700 1 -- 172.21.15.90:0/2242249272 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80033f0 con 0x7f6db8004690 2022-07-05T11:46:28.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd6d9d700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db8005000 0x7f6db800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:28.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd6d9d700 1 -- 172.21.15.90:0/2242249272 reap_dead start 2022-07-05T11:46:28.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6dc0009a80 tx=0x7f6dc0009060).ready entity=mon.0 client_cookie=96d06a2fbe97a81e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0009430 con 0x7f6db8004690 2022-07-05T11:46:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc000e640 con 0x7f6db8004690 2022-07-05T11:46:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6dd559a700 1 -- 172.21.15.90:0/2242249272 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000e9c0 con 0x7f6db8004690 2022-07-05T11:46:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6ddc90e700 1 -- 172.21.15.90:0/2242249272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 msgr2=0x7f6db8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.837+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6dc0009a80 tx=0x7f6dc0009060).stop 2022-07-05T11:46:28.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.838+0000 7f6ddc90e700 1 -- 172.21.15.90:0/2242249272 shutdown_connections 2022-07-05T11:46:28.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.838+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/2242249272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.838+0000 7f6ddc90e700 1 -- 172.21.15.90:0/2242249272 >> 172.21.15.90:0/2242249272 conn(0x7f6dd80f4b70 msgr2=0x7f6dd80f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.838+0000 7f6ddc90e700 1 -- 172.21.15.90:0/2242249272 shutdown_connections 2022-07-05T11:46:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.838+0000 7f6ddc90e700 1 -- 172.21.15.90:0/2242249272 wait complete. 2022-07-05T11:46:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.839+0000 7f6ddc90e700 1 Processor -- start 2022-07-05T11:46:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.839+0000 7f6ddc90e700 1 -- start start 2022-07-05T11:46:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6ddc90e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6dd8192740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6ddc90e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd8087ba0 0x7f6dd80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6ddc90e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8088020 0x7f6dd80cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6ddc90e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80caff0 con 0x7f6db8004690 2022-07-05T11:46:28.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6ddc90e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c52c0 con 0x7f6dd8088020 2022-07-05T11:46:28.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6ddc90e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c55a0 con 0x7f6dd8087ba0 2022-07-05T11:46:28.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6dd8192740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6dd8192740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57182/0 (socket says 172.21.15.90:57182) 2022-07-05T11:46:28.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 -- 172.21.15.90:0/799825969 learned_addr learned my addr 172.21.15.90:0/799825969 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:28.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd8087ba0 0x7f6dd80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd6d9d700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8088020 0x7f6dd80cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 -- 172.21.15.90:0/799825969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd8087ba0 msgr2=0x7f6dd80ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd8087ba0 0x7f6dd80ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 -- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8088020 msgr2=0x7f6dd80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:28.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8088020 0x7f6dd80cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:28.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 -- 172.21.15.90:0/799825969 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80c5880 con 0x7f6db8004690 2022-07-05T11:46:28.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd6d9d700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8088020 0x7f6dd80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:28.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd8087ba0 0x7f6dd80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:28.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.840+0000 7f6dd659c700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6dd8192740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6dc8007860 tx=0x7f6dc80018e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.841+0000 7f6dce7fc700 1 -- 172.21.15.90:0/799825969 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8007a10 con 0x7f6db8004690 2022-07-05T11:46:28.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.841+0000 7f6dce7fc700 1 -- 172.21.15.90:0/799825969 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80020e0 con 0x7f6db8004690 2022-07-05T11:46:28.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.841+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd80c5b60 con 0x7f6db8004690 2022-07-05T11:46:28.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.841+0000 7f6dce7fc700 1 -- 172.21.15.90:0/799825969 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800fe90 con 0x7f6db8004690 2022-07-05T11:46:28.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.841+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd80c6120 con 0x7f6db8004690 2022-07-05T11:46:28.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.842+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd806be40 con 0x7f6db8004690 2022-07-05T11:46:28.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.842+0000 7f6dce7fc700 1 -- 172.21.15.90:0/799825969 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6dc801b030 con 0x7f6db8004690 2022-07-05T11:46:28.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.843+0000 7f6dce7fc700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dbc08ba40 0x7f6dbc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:28.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.843+0000 7f6dce7fc700 1 -- 172.21.15.90:0/799825969 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6dc80b0520 con 0x7f6db8004690 2022-07-05T11:46:28.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.843+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dbc08ba40 0x7f6dbc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.843+0000 7f6dd5d9b700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dbc08ba40 0x7f6dbc08df00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6dd80f57b0 tx=0x7f6dc001a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:28.847+0000 7f6dce7fc700 1 -- 172.21.15.90:0/799825969 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f6dc8084c70 con 0x7f6db8004690 2022-07-05T11:46:29.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.007+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6dd80c8a40 con 0x7f6db8004690 2022-07-05T11:46:29.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.007+0000 7f6dce7fc700 1 -- 172.21.15.90:0/799825969 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6dc8084800 con 0x7f6db8004690 2022-07-05T11:46:29.009 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:29.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dbc08ba40 msgr2=0x7f6dbc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dbc08ba40 0x7f6dbc08df00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6dd80f57b0 tx=0x7f6dc001a000).stop 2022-07-05T11:46:29.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 msgr2=0x7f6dd8192740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6dd8192740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6dc8007860 tx=0x7f6dc80018e0).stop 2022-07-05T11:46:29.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 shutdown_connections 2022-07-05T11:46:29.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dbc08ba40 0x7f6dbc08df00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd8088020 0x7f6dd80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db8004690 0x7f6dd8192740 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 --2- 172.21.15.90:0/799825969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd8087ba0 0x7f6dd80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 >> 172.21.15.90:0/799825969 conn(0x7f6dd80f4b70 msgr2=0x7f6dd81832c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:29.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 shutdown_connections 2022-07-05T11:46:29.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.009+0000 7f6ddc90e700 1 -- 172.21.15.90:0/799825969 wait complete. 2022-07-05T11:46:29.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.7 2022-07-05T11:46:29.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2022-07-05T11:46:29.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.138+0000 7f3052826700 1 Processor -- start 2022-07-05T11:46:29.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.138+0000 7f3052826700 1 -- start start 2022-07-05T11:46:29.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3052826700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f304c178090 0x7f304c178470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3052826700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c17f9d0 con 0x7f304c0c2000 2022-07-05T11:46:29.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3052826700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0c2d20 con 0x7f304c17fe60 2022-07-05T11:46:29.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3052826700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c17f730 con 0x7f304c178090 2022-07-05T11:46:29.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3051023700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f304c0c2000 0x7f304c0c24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50130/0 (socket says 172.21.15.90:50130) 2022-07-05T11:46:29.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3051023700 1 -- 172.21.15.90:0/3637688082 learned_addr learned my addr 172.21.15.90:0/3637688082 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:29.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3051824700 1 --2- 172.21.15.90:0/3637688082 >> v2:172.21.15.110:3300/0 conn(0x7f304c178090 0x7f304c178470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3050822700 1 -- 172.21.15.90:0/3637688082 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056970148 0 0) 0x7f304c17f9d0 con 0x7f304c0c2000 2022-07-05T11:46:29.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3050822700 1 -- 172.21.15.90:0/3637688082 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30340033f0 con 0x7f304c0c2000 2022-07-05T11:46:29.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3051824700 1 -- 172.21.15.90:0/3637688082 >> v1:172.21.15.110:6789/0 conn(0x7f304c17fe60 legacy=0x7f304c1802a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3051824700 1 -- 172.21.15.90:0/3637688082 >> v1:172.21.15.90:6789/0 conn(0x7f304c0c2000 legacy=0x7f304c0c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.139+0000 7f3051824700 1 -- 172.21.15.90:0/3637688082 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0c3000 con 0x7f304c178090 2022-07-05T11:46:29.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3051824700 1 --2- 172.21.15.90:0/3637688082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 0x7f304c178470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3048009760 tx=0x7f3048009060).ready entity=mon.1 client_cookie=b6505eb853b69308 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3050822700 1 -- 172.21.15.90:0/3637688082 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800f510 con 0x7f304c178090 2022-07-05T11:46:29.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3050822700 1 -- 172.21.15.90:0/3637688082 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800f670 con 0x7f304c178090 2022-07-05T11:46:29.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3050822700 1 -- 172.21.15.90:0/3637688082 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800f9f0 con 0x7f304c178090 2022-07-05T11:46:29.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3052826700 1 -- 172.21.15.90:0/3637688082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 msgr2=0x7f304c178470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3052826700 1 --2- 172.21.15.90:0/3637688082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 0x7f304c178470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3048009760 tx=0x7f3048009060).stop 2022-07-05T11:46:29.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3052826700 1 -- 172.21.15.90:0/3637688082 shutdown_connections 2022-07-05T11:46:29.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3052826700 1 --2- 172.21.15.90:0/3637688082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 0x7f304c178470 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3052826700 1 -- 172.21.15.90:0/3637688082 >> 172.21.15.90:0/3637688082 conn(0x7f304c05d9a0 msgr2=0x7f304c05ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:29.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3052826700 1 -- 172.21.15.90:0/3637688082 shutdown_connections 2022-07-05T11:46:29.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.140+0000 7f3052826700 1 -- 172.21.15.90:0/3637688082 wait complete. 2022-07-05T11:46:29.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.142+0000 7f3052826700 1 Processor -- start 2022-07-05T11:46:29.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.142+0000 7f3052826700 1 -- start start 2022-07-05T11:46:29.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052826700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c0c2000 0x7f304c171000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052826700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 0x7f304c176e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052826700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f304c17fe60 0x7f304c177300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052826700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0f1560 con 0x7f304c17fe60 2022-07-05T11:46:29.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052826700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0f0670 con 0x7f304c178090 2022-07-05T11:46:29.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052826700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0f0950 con 0x7f304c0c2000 2022-07-05T11:46:29.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f304c17fe60 0x7f304c177300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f304c17fe60 0x7f304c177300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57198/0 (socket says 172.21.15.90:57198) 2022-07-05T11:46:29.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 -- 172.21.15.90:0/4247350033 learned_addr learned my addr 172.21.15.90:0/4247350033 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:29.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3051023700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 0x7f304c176e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3051824700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c0c2000 0x7f304c171000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 -- 172.21.15.90:0/4247350033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c0c2000 msgr2=0x7f304c171000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c0c2000 0x7f304c171000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 -- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 msgr2=0x7f304c176e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 0x7f304c176e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 -- 172.21.15.90:0/4247350033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480092a0 con 0x7f304c17fe60 2022-07-05T11:46:29.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052025700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f304c17fe60 0x7f304c177300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f304400c7c0 tx=0x7f3044001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3039ffb700 1 -- 172.21.15.90:0/4247350033 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400e4a0 con 0x7f304c17fe60 2022-07-05T11:46:29.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3039ffb700 1 -- 172.21.15.90:0/4247350033 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400e600 con 0x7f304c17fe60 2022-07-05T11:46:29.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c0f0c30 con 0x7f304c17fe60 2022-07-05T11:46:29.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.143+0000 7f3039ffb700 1 -- 172.21.15.90:0/4247350033 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400e980 con 0x7f304c17fe60 2022-07-05T11:46:29.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.144+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c0f11f0 con 0x7f304c17fe60 2022-07-05T11:46:29.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.145+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c06be40 con 0x7f304c17fe60 2022-07-05T11:46:29.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.145+0000 7f3039ffb700 1 -- 172.21.15.90:0/4247350033 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3044010070 con 0x7f304c17fe60 2022-07-05T11:46:29.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.146+0000 7f3039ffb700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f302c08ba40 0x7f302c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.146+0000 7f3039ffb700 1 -- 172.21.15.90:0/4247350033 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f30440afff0 con 0x7f304c17fe60 2022-07-05T11:46:29.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.146+0000 7f3051824700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f302c08ba40 0x7f302c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.146+0000 7f3051824700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f302c08ba40 0x7f302c08df00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f3048006d30 tx=0x7f3048017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.149+0000 7f3039ffb700 1 -- 172.21.15.90:0/4247350033 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3044080c70 con 0x7f304c17fe60 2022-07-05T11:46:29.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.309+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f304c0c32e0 con 0x7f304c17fe60 2022-07-05T11:46:29.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.310+0000 7f3039ffb700 1 -- 172.21.15.90:0/4247350033 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3044084290 con 0x7f304c17fe60 2022-07-05T11:46:29.311 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:29.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f302c08ba40 msgr2=0x7f302c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f302c08ba40 0x7f302c08df00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f3048006d30 tx=0x7f3048017000).stop 2022-07-05T11:46:29.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f304c17fe60 msgr2=0x7f304c177300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f304c17fe60 0x7f304c177300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f304400c7c0 tx=0x7f3044001510).stop 2022-07-05T11:46:29.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 shutdown_connections 2022-07-05T11:46:29.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f302c08ba40 0x7f302c08df00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f304c17fe60 0x7f304c177300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c0c2000 0x7f304c171000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 --2- 172.21.15.90:0/4247350033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c178090 0x7f304c176e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 >> 172.21.15.90:0/4247350033 conn(0x7f304c05d9a0 msgr2=0x7f304c1723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:29.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 shutdown_connections 2022-07-05T11:46:29.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.312+0000 7f3052826700 1 -- 172.21.15.90:0/4247350033 wait complete. 2022-07-05T11:46:29.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.8 2022-07-05T11:46:29.327 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2022-07-05T11:46:29.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.440+0000 7f46e7a46700 1 Processor -- start 2022-07-05T11:46:29.442 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.441+0000 7f46e7a46700 1 -- start start 2022-07-05T11:46:29.446 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e7a46700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f46e0174b70 0x7f46e0174f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e7a46700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46e0180af0 0x7f46e0180f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e7a46700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e0175440 con 0x7f46e0181460 2022-07-05T11:46:29.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e7a46700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00ca3c0 con 0x7f46e0174b70 2022-07-05T11:46:29.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e7a46700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e0180660 con 0x7f46e0180af0 2022-07-05T11:46:29.448 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f46e0174b70 0x7f46e0174f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.448 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f46e0174b70 0x7f46e0174f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57202/0 (socket says 172.21.15.90:57202) 2022-07-05T11:46:29.448 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 -- 172.21.15.90:0/970743002 learned_addr learned my addr 172.21.15.90:0/970743002 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:29.449 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e4fe1700 1 --2- 172.21.15.90:0/970743002 >> v2:172.21.15.149:3300/0 conn(0x7f46e0180af0 0x7f46e0180f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.449 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 -- 172.21.15.90:0/970743002 >> v2:172.21.15.149:3300/0 conn(0x7f46e0180af0 msgr2=0x7f46e0180f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:29.449 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 --2- 172.21.15.90:0/970743002 >> v2:172.21.15.149:3300/0 conn(0x7f46e0180af0 0x7f46e0180f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.449 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 -- 172.21.15.90:0/970743002 >> v1:172.21.15.110:6789/0 conn(0x7f46e0181460 legacy=0x7f46e0084090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.449 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 -- 172.21.15.90:0/970743002 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e017fa50 con 0x7f46e0174b70 2022-07-05T11:46:29.450 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46e57e2700 1 --2- 172.21.15.90:0/970743002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0174b70 0x7f46e0174f50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f46e0083690 tx=0x7f46dc0090f0).ready entity=mon.0 client_cookie=bf791c6f52921853 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.450 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.442+0000 7f46cffff700 1 -- 172.21.15.90:0/970743002 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00b600 con 0x7f46e0174b70 2022-07-05T11:46:29.450 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46cffff700 1 -- 172.21.15.90:0/970743002 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00b760 con 0x7f46e0174b70 2022-07-05T11:46:29.451 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46cffff700 1 -- 172.21.15.90:0/970743002 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00bae0 con 0x7f46e0174b70 2022-07-05T11:46:29.451 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 -- 172.21.15.90:0/970743002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0174b70 msgr2=0x7f46e0174f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.452 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 --2- 172.21.15.90:0/970743002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0174b70 0x7f46e0174f50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f46e0083690 tx=0x7f46dc0090f0).stop 2022-07-05T11:46:29.452 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 -- 172.21.15.90:0/970743002 shutdown_connections 2022-07-05T11:46:29.452 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 --2- 172.21.15.90:0/970743002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0174b70 0x7f46e0174f50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.453 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 --2- 172.21.15.90:0/970743002 >> v2:172.21.15.149:3300/0 conn(0x7f46e0180af0 0x7f46e0180f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.453 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 -- 172.21.15.90:0/970743002 >> 172.21.15.90:0/970743002 conn(0x7f46e005e440 msgr2=0x7f46e00f1860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:29.454 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 -- 172.21.15.90:0/970743002 shutdown_connections 2022-07-05T11:46:29.454 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.443+0000 7f46e7a46700 1 -- 172.21.15.90:0/970743002 wait complete. 2022-07-05T11:46:29.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.445+0000 7f46e7a46700 1 Processor -- start 2022-07-05T11:46:29.455 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.445+0000 7f46e7a46700 1 -- start start 2022-07-05T11:46:29.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46e0174b70 0x7f46e016db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46e0180af0 0x7f46e00ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0181460 0x7f46e0063480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00c4e50 con 0x7f46e0181460 2022-07-05T11:46:29.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00c3d10 con 0x7f46e0180af0 2022-07-05T11:46:29.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00c3f60 con 0x7f46e0174b70 2022-07-05T11:46:29.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0181460 0x7f46e0063480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0181460 0x7f46e0063480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57212/0 (socket says 172.21.15.90:57212) 2022-07-05T11:46:29.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 -- 172.21.15.90:0/2660153641 learned_addr learned my addr 172.21.15.90:0/2660153641 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:29.465 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e4fe1700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46e0180af0 0x7f46e00ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.465 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e57e2700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46e0174b70 0x7f46e016db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.466 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 -- 172.21.15.90:0/2660153641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46e0174b70 msgr2=0x7f46e016db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.466 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46e0174b70 0x7f46e016db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.467 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 -- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46e0180af0 msgr2=0x7f46e00ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.467 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46e0180af0 0x7f46e00ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 -- 172.21.15.90:0/2660153641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc009370 con 0x7f46e0181460 2022-07-05T11:46:29.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e57e2700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46e0174b70 0x7f46e016db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:29.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e5fe3700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0181460 0x7f46e0063480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f46d8002230 tx=0x7f46d80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46cd7fa700 1 -- 172.21.15.90:0/2660153641 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8010510 con 0x7f46e0181460 2022-07-05T11:46:29.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46cd7fa700 1 -- 172.21.15.90:0/2660153641 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d8010670 con 0x7f46e0181460 2022-07-05T11:46:29.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e00c4240 con 0x7f46e0181460 2022-07-05T11:46:29.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46cd7fa700 1 -- 172.21.15.90:0/2660153641 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80109f0 con 0x7f46e0181460 2022-07-05T11:46:29.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.446+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e00c4800 con 0x7f46e0181460 2022-07-05T11:46:29.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.447+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e006be40 con 0x7f46e0181460 2022-07-05T11:46:29.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.448+0000 7f46cd7fa700 1 -- 172.21.15.90:0/2660153641 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f46d8010070 con 0x7f46e0181460 2022-07-05T11:46:29.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.449+0000 7f46cd7fa700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f46c008ba40 0x7f46c008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.449+0000 7f46cd7fa700 1 -- 172.21.15.90:0/2660153641 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f46d80b03a0 con 0x7f46e0181460 2022-07-05T11:46:29.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.449+0000 7f46e57e2700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f46c008ba40 0x7f46c008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.449+0000 7f46e57e2700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f46c008ba40 0x7f46c008df00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f46dc009130 tx=0x7f46dc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.453+0000 7f46cd7fa700 1 -- 172.21.15.90:0/2660153641 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f46d8081060 con 0x7f46e0181460 2022-07-05T11:46:29.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.615+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f46e0175440 con 0x7f46e0181460 2022-07-05T11:46:29.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.615+0000 7f46cd7fa700 1 -- 172.21.15.90:0/2660153641 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46e0175440 con 0x7f46e0181460 2022-07-05T11:46:29.617 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:29.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f46c008ba40 msgr2=0x7f46c008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f46c008ba40 0x7f46c008df00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f46dc009130 tx=0x7f46dc017000).stop 2022-07-05T11:46:29.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0181460 msgr2=0x7f46e0063480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0181460 0x7f46e0063480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f46d8002230 tx=0x7f46d80015e0).stop 2022-07-05T11:46:29.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 shutdown_connections 2022-07-05T11:46:29.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f46c008ba40 0x7f46c008df00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0181460 0x7f46e0063480 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46e0174b70 0x7f46e016db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 --2- 172.21.15.90:0/2660153641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46e0180af0 0x7f46e00ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 >> 172.21.15.90:0/2660153641 conn(0x7f46e005e440 msgr2=0x7f46e00f10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:29.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.617+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 shutdown_connections 2022-07-05T11:46:29.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.618+0000 7f46e7a46700 1 -- 172.21.15.90:0/2660153641 wait complete. 2022-07-05T11:46:29.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.9 2022-07-05T11:46:29.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2022-07-05T11:46:29.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.743+0000 7f6d14069700 1 Processor -- start 2022-07-05T11:46:29.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.743+0000 7f6d14069700 1 -- start start 2022-07-05T11:46:29.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d14069700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6d0c1785d0 0x7f6d0c17d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d14069700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c17cbb0 con 0x7f6d0c17d9b0 2022-07-05T11:46:29.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d14069700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c17c2c0 con 0x7f6d0c17d530 2022-07-05T11:46:29.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d14069700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0c17f580 con 0x7f6d0c1785d0 2022-07-05T11:46:29.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d12606700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6d0c17d9b0 0x7f6d0c182290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50160/0 (socket says 172.21.15.90:50160) 2022-07-05T11:46:29.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d12606700 1 -- 172.21.15.90:0/387376517 learned_addr learned my addr 172.21.15.90:0/387376517 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:29.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d11e05700 1 --2- 172.21.15.90:0/387376517 >> v2:172.21.15.149:3300/0 conn(0x7f6d0c1785d0 0x7f6d0c17d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574583485 0 0) 0x7f6d0c17cbb0 con 0x7f6d0c17d9b0 2022-07-05T11:46:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.744+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf40033f0 con 0x7f6d0c17d9b0 2022-07-05T11:46:29.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469742318 0 0) 0x7f6d0c17c2c0 con 0x7f6d0c17d530 2022-07-05T11:46:29.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d0c17cbb0 con 0x7f6d0c17d530 2022-07-05T11:46:29.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1291786728 0 0) 0x7f6cf40033f0 con 0x7f6d0c17d9b0 2022-07-05T11:46:29.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 >> v2:172.21.15.149:3300/0 conn(0x7f6d0c1785d0 msgr2=0x7f6d0c17d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:29.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 --2- 172.21.15.90:0/387376517 >> v2:172.21.15.149:3300/0 conn(0x7f6d0c1785d0 0x7f6d0c17d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 >> v1:172.21.15.149:6789/0 conn(0x7f6d0c17d530 legacy=0x7f6d0c181b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0c8430 con 0x7f6d0c17d9b0 2022-07-05T11:46:29.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f6d04001470 con 0x7f6d0c17d9b0 2022-07-05T11:46:29.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 >> v1:172.21.15.90:6789/0 conn(0x7f6d0c17d9b0 legacy=0x7f6d0c182290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6cf4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf4004690 0x7f6cf4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cf4005070 0x7f6cf400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c17f580 con 0x7f6cf4003ac0 2022-07-05T11:46:29.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf400c010 con 0x7f6cf4004690 2022-07-05T11:46:29.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf400c1d0 con 0x7f6cf4005070 2022-07-05T11:46:29.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d11e05700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6cf4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d12606700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cf4005070 0x7f6cf400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d11e05700 1 -- 172.21.15.90:0/387376517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cf4005070 msgr2=0x7f6cf400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:29.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d11e05700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cf4005070 0x7f6cf400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d11e05700 1 -- 172.21.15.90:0/387376517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf4004690 msgr2=0x7f6cf4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:29.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d11e05700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf4004690 0x7f6cf4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:29.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d12606700 1 -- 172.21.15.90:0/387376517 reap_dead start 2022-07-05T11:46:29.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d11e05700 1 -- 172.21.15.90:0/387376517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40033f0 con 0x7f6cf4003ac0 2022-07-05T11:46:29.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.745+0000 7f6d11e05700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6cf4003ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f6d0800e210 tx=0x7f6d0800b040).ready entity=mon.0 client_cookie=81e9dcc03992604d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08009ac0 con 0x7f6cf4003ac0 2022-07-05T11:46:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0800f040 con 0x7f6cf4003ac0 2022-07-05T11:46:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d10e03700 1 -- 172.21.15.90:0/387376517 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800ecd0 con 0x7f6cf4003ac0 2022-07-05T11:46:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d14069700 1 -- 172.21.15.90:0/387376517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 msgr2=0x7f6cf4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d14069700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6cf4003ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f6d0800e210 tx=0x7f6d0800b040).stop 2022-07-05T11:46:29.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d14069700 1 -- 172.21.15.90:0/387376517 shutdown_connections 2022-07-05T11:46:29.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d14069700 1 --2- 172.21.15.90:0/387376517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6cf4003ec0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d14069700 1 -- 172.21.15.90:0/387376517 >> 172.21.15.90:0/387376517 conn(0x7f6d0c0ee530 msgr2=0x7f6d0c083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:29.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d14069700 1 -- 172.21.15.90:0/387376517 shutdown_connections 2022-07-05T11:46:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.746+0000 7f6d14069700 1 -- 172.21.15.90:0/387376517 wait complete. 2022-07-05T11:46:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.748+0000 7f6d14069700 1 Processor -- start 2022-07-05T11:46:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.748+0000 7f6d14069700 1 -- start start 2022-07-05T11:46:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d14069700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6d0c0eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d14069700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c1712d0 0x7f6d0c0e4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d14069700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d0c0e4fd0 0x7f6d0c191ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d14069700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0eaa10 con 0x7f6cf4003ac0 2022-07-05T11:46:29.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d14069700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0e9b20 con 0x7f6d0c0e4fd0 2022-07-05T11:46:29.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d14069700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0e9e00 con 0x7f6d0c1712d0 2022-07-05T11:46:29.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6d0c0eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6d0c0eaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57228/0 (socket says 172.21.15.90:57228) 2022-07-05T11:46:29.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 -- 172.21.15.90:0/917757477 learned_addr learned my addr 172.21.15.90:0/917757477 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:29.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11604700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c1712d0 0x7f6d0c0e4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d12606700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d0c0e4fd0 0x7f6d0c191ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 -- 172.21.15.90:0/917757477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c1712d0 msgr2=0x7f6d0c0e4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c1712d0 0x7f6d0c0e4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 -- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d0c0e4fd0 msgr2=0x7f6d0c191ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d0c0e4fd0 0x7f6d0c191ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 -- 172.21.15.90:0/917757477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0ea0e0 con 0x7f6cf4003ac0 2022-07-05T11:46:29.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11604700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c1712d0 0x7f6d0c0e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:29.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d11e05700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6d0c0eaea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6cf400bfe0 tx=0x7f6d0801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6cf9ffb700 1 -- 172.21.15.90:0/917757477 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08013d70 con 0x7f6cf4003ac0 2022-07-05T11:46:29.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6cf9ffb700 1 -- 172.21.15.90:0/917757477 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d08027420 con 0x7f6cf4003ac0 2022-07-05T11:46:29.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c0ea3c0 con 0x7f6cf4003ac0 2022-07-05T11:46:29.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.749+0000 7f6cf9ffb700 1 -- 172.21.15.90:0/917757477 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08027610 con 0x7f6cf4003ac0 2022-07-05T11:46:29.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.750+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c171750 con 0x7f6cf4003ac0 2022-07-05T11:46:29.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.750+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c0ea860 con 0x7f6cf4003ac0 2022-07-05T11:46:29.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.751+0000 7f6cf9ffb700 1 -- 172.21.15.90:0/917757477 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6d0802e070 con 0x7f6cf4003ac0 2022-07-05T11:46:29.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.752+0000 7f6cf9ffb700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cec08ba40 0x7f6cec08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:29.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.752+0000 7f6cf9ffb700 1 -- 172.21.15.90:0/917757477 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6d080b2b60 con 0x7f6cf4003ac0 2022-07-05T11:46:29.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.752+0000 7f6d11604700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cec08ba40 0x7f6cec08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:29.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.752+0000 7f6d11604700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cec08ba40 0x7f6cec08df00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f6d0c06a5b0 tx=0x7f6cfc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:29.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.755+0000 7f6cf9ffb700 1 -- 172.21.15.90:0/917757477 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f6d080837a0 con 0x7f6cf4003ac0 2022-07-05T11:46:29.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.916+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f6d0c0eacf0 con 0x7f6cf4003ac0 2022-07-05T11:46:29.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.916+0000 7f6cf9ffb700 1 -- 172.21.15.90:0/917757477 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f6d0802c020 con 0x7f6cf4003ac0 2022-07-05T11:46:29.918 INFO:teuthology.orchestra.run.smithi090.stdout:73014444041 2022-07-05T11:46:29.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cec08ba40 msgr2=0x7f6cec08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cec08ba40 0x7f6cec08df00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f6d0c06a5b0 tx=0x7f6cfc009040).stop 2022-07-05T11:46:29.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 msgr2=0x7f6d0c0eaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:29.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6d0c0eaea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6cf400bfe0 tx=0x7f6d0801a000).stop 2022-07-05T11:46:29.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 shutdown_connections 2022-07-05T11:46:29.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cec08ba40 0x7f6cec08df00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d0c0e4fd0 0x7f6d0c191ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cf4003ac0 0x7f6d0c0eaea0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 --2- 172.21.15.90:0/917757477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c1712d0 0x7f6d0c0e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:29.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 >> 172.21.15.90:0/917757477 conn(0x7f6d0c0ee530 msgr2=0x7f6d0c17bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:29.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 shutdown_connections 2022-07-05T11:46:29.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:29.918+0000 7f6d14069700 1 -- 172.21.15.90:0/917757477 wait complete. 2022-07-05T11:46:29.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.10 2022-07-05T11:46:29.933 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2022-07-05T11:46:30.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.044+0000 7f87ec717700 1 Processor -- start 2022-07-05T11:46:30.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.045+0000 7f87ec717700 1 -- start start 2022-07-05T11:46:30.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ec717700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f87e41782d0 0x7f87e417fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ec717700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f87e41786b0 0x7f87e40ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ec717700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e40854c0 con 0x7f87e417f0e0 2022-07-05T11:46:30.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ec717700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e4178b40 con 0x7f87e41782d0 2022-07-05T11:46:30.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ec717700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e4086060 con 0x7f87e41786b0 2022-07-05T11:46:30.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f87e41782d0 0x7f87e417fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f87e41782d0 0x7f87e417fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57236/0 (socket says 172.21.15.90:57236) 2022-07-05T11:46:30.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3159756857 learned_addr learned my addr 172.21.15.90:0/3159756857 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:30.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87eacb4700 1 --2- 172.21.15.90:0/3159756857 >> v2:172.21.15.149:3300/0 conn(0x7f87e41786b0 0x7f87e40ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3159756857 >> v2:172.21.15.149:3300/0 conn(0x7f87e41786b0 msgr2=0x7f87e40ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:30.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 --2- 172.21.15.90:0/3159756857 >> v2:172.21.15.149:3300/0 conn(0x7f87e41786b0 0x7f87e40ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3159756857 >> v1:172.21.15.149:6789/0 conn(0x7f87e417f0e0 legacy=0x7f87e4085950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:30.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3159756857 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40845d0 con 0x7f87e41782d0 2022-07-05T11:46:30.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87ea4b3700 1 --2- 172.21.15.90:0/3159756857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e417fa70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f87e40c4bb0 tx=0x7f87d4009840).ready entity=mon.0 client_cookie=6f57f4d3b1b6ba17 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87e94b1700 1 -- 172.21.15.90:0/3159756857 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400e070 con 0x7f87e41782d0 2022-07-05T11:46:30.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.046+0000 7f87e94b1700 1 -- 172.21.15.90:0/3159756857 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400ba10 con 0x7f87e41782d0 2022-07-05T11:46:30.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87e94b1700 1 -- 172.21.15.90:0/3159756857 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400bd90 con 0x7f87e41782d0 2022-07-05T11:46:30.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 -- 172.21.15.90:0/3159756857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 msgr2=0x7f87e417fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 --2- 172.21.15.90:0/3159756857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e417fa70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f87e40c4bb0 tx=0x7f87d4009840).stop 2022-07-05T11:46:30.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 -- 172.21.15.90:0/3159756857 shutdown_connections 2022-07-05T11:46:30.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 --2- 172.21.15.90:0/3159756857 >> v2:172.21.15.149:3300/0 conn(0x7f87e41786b0 0x7f87e40ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 --2- 172.21.15.90:0/3159756857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e417fa70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 -- 172.21.15.90:0/3159756857 >> 172.21.15.90:0/3159756857 conn(0x7f87e40f2960 msgr2=0x7f87e40f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:30.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 -- 172.21.15.90:0/3159756857 shutdown_connections 2022-07-05T11:46:30.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.047+0000 7f87ec717700 1 -- 172.21.15.90:0/3159756857 wait complete. 2022-07-05T11:46:30.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.048+0000 7f87ec717700 1 Processor -- start 2022-07-05T11:46:30.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.048+0000 7f87ec717700 1 -- start start 2022-07-05T11:46:30.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.049+0000 7f87ec717700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e4172880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.049+0000 7f87ec717700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87e41786b0 0x7f87e416ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.049+0000 7f87ec717700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e417f0e0 0x7f87e416f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.049+0000 7f87ec717700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4172d70 con 0x7f87e41782d0 2022-07-05T11:46:30.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.049+0000 7f87ec717700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e417ff80 con 0x7f87e417f0e0 2022-07-05T11:46:30.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.049+0000 7f87ec717700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4180540 con 0x7f87e41786b0 2022-07-05T11:46:30.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e4172880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e4172880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57244/0 (socket says 172.21.15.90:57244) 2022-07-05T11:46:30.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3082492251 learned_addr learned my addr 172.21.15.90:0/3082492251 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:30.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87e9cb2700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87e41786b0 0x7f87e416ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87eacb4700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e417f0e0 0x7f87e416f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3082492251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87e41786b0 msgr2=0x7f87e416ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87e41786b0 0x7f87e416ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e417f0e0 msgr2=0x7f87e416f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e417f0e0 0x7f87e416f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 -- 172.21.15.90:0/3082492251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009ae0 con 0x7f87e41782d0 2022-07-05T11:46:30.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ea4b3700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e4172880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f87e4086fd0 tx=0x7f87d4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87e27fc700 1 -- 172.21.15.90:0/3082492251 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4013d10 con 0x7f87e41782d0 2022-07-05T11:46:30.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87e27fc700 1 -- 172.21.15.90:0/3082492251 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4013e70 con 0x7f87e41782d0 2022-07-05T11:46:30.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e4191c40 con 0x7f87e41782d0 2022-07-05T11:46:30.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87e27fc700 1 -- 172.21.15.90:0/3082492251 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d401d620 con 0x7f87e41782d0 2022-07-05T11:46:30.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.050+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e4192200 con 0x7f87e41782d0 2022-07-05T11:46:30.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.051+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e406be40 con 0x7f87e41782d0 2022-07-05T11:46:30.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.052+0000 7f87e27fc700 1 -- 172.21.15.90:0/3082492251 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f87d401b040 con 0x7f87e41782d0 2022-07-05T11:46:30.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.053+0000 7f87e27fc700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f87c408ba40 0x7f87c408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.053+0000 7f87e27fc700 1 -- 172.21.15.90:0/3082492251 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f87d40b2f40 con 0x7f87e41782d0 2022-07-05T11:46:30.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.053+0000 7f87e9cb2700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f87c408ba40 0x7f87c408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.053+0000 7f87e9cb2700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f87c408ba40 0x7f87c408df00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f87e40e64c0 tx=0x7f87d8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.056+0000 7f87e27fc700 1 -- 172.21.15.90:0/3082492251 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f87d4083b80 con 0x7f87e41782d0 2022-07-05T11:46:30.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.219+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f87e406be40 con 0x7f87e41782d0 2022-07-05T11:46:30.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.220+0000 7f87e27fc700 1 -- 172.21.15.90:0/3082492251 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f87d40871a0 con 0x7f87e41782d0 2022-07-05T11:46:30.221 INFO:teuthology.orchestra.run.smithi090.stdout:73014444040 2022-07-05T11:46:30.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.221+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f87c408ba40 msgr2=0x7f87c408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.221+0000 7f87ec717700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f87c408ba40 0x7f87c408df00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f87e40e64c0 tx=0x7f87d8008040).stop 2022-07-05T11:46:30.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.221+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 msgr2=0x7f87e4172880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.221+0000 7f87ec717700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e4172880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f87e4086fd0 tx=0x7f87d4009840).stop 2022-07-05T11:46:30.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 shutdown_connections 2022-07-05T11:46:30.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f87c408ba40 0x7f87c408df00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e417f0e0 0x7f87e416f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e41782d0 0x7f87e4172880 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 --2- 172.21.15.90:0/3082492251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87e41786b0 0x7f87e416ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 >> 172.21.15.90:0/3082492251 conn(0x7f87e40f2960 msgr2=0x7f87e4083870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:30.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 shutdown_connections 2022-07-05T11:46:30.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.222+0000 7f87ec717700 1 -- 172.21.15.90:0/3082492251 wait complete. 2022-07-05T11:46:30.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.11 2022-07-05T11:46:30.234 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-07-05T11:46:30.235 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-07-05T11:46:30.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.346+0000 7f92d9de4700 1 Processor -- start 2022-07-05T11:46:30.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.346+0000 7f92d9de4700 1 -- start start 2022-07-05T11:46:30.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d9de4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f92d41785d0 0x7f92d417d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d9de4700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f92d417d530 0x7f92d417d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d9de4700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f92d4181b80 0x7f92d4182010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d9de4700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d417cbb0 con 0x7f92d4181b80 2022-07-05T11:46:30.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d9de4700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d417c2c0 con 0x7f92d417d530 2022-07-05T11:46:30.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d9de4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d40c8430 con 0x7f92d41785d0 2022-07-05T11:46:30.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f92d4181b80 0x7f92d4182010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f92d4181b80 0x7f92d4182010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57254/0 (socket says 172.21.15.90:57254) 2022-07-05T11:46:30.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 -- 172.21.15.90:0/3771735558 learned_addr learned my addr 172.21.15.90:0/3771735558 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:30.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d37fe700 1 --2- 172.21.15.90:0/3771735558 >> v2:172.21.15.149:3300/0 conn(0x7f92d41785d0 0x7f92d417d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d2ffd700 1 --2- 172.21.15.90:0/3771735558 >> v2:172.21.15.110:3300/0 conn(0x7f92d417d530 0x7f92d417d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 -- 172.21.15.90:0/3771735558 >> v2:172.21.15.149:3300/0 conn(0x7f92d41785d0 msgr2=0x7f92d417d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:30.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 --2- 172.21.15.90:0/3771735558 >> v2:172.21.15.149:3300/0 conn(0x7f92d41785d0 0x7f92d417d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 -- 172.21.15.90:0/3771735558 >> v2:172.21.15.110:3300/0 conn(0x7f92d417d530 msgr2=0x7f92d417d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:30.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 --2- 172.21.15.90:0/3771735558 >> v2:172.21.15.110:3300/0 conn(0x7f92d417d530 0x7f92d417d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 -- 172.21.15.90:0/3771735558 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d417c560 con 0x7f92d4181b80 2022-07-05T11:46:30.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d2ffd700 1 --2- 172.21.15.90:0/3771735558 >> v2:172.21.15.110:3300/0 conn(0x7f92d417d530 0x7f92d417d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:30.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d3fff700 1 --2- 172.21.15.90:0/3771735558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d4181b80 0x7f92d4182010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f92d4085ad0 tx=0x7f92cc0090f0).ready entity=mon.0 client_cookie=2fc5e46f9319cb08 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d27fc700 1 -- 172.21.15.90:0/3771735558 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00b600 con 0x7f92d4181b80 2022-07-05T11:46:30.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d27fc700 1 -- 172.21.15.90:0/3771735558 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc00b760 con 0x7f92d4181b80 2022-07-05T11:46:30.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.347+0000 7f92d27fc700 1 -- 172.21.15.90:0/3771735558 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00bb00 con 0x7f92d4181b80 2022-07-05T11:46:30.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 -- 172.21.15.90:0/3771735558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d4181b80 msgr2=0x7f92d4182010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 --2- 172.21.15.90:0/3771735558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d4181b80 0x7f92d4182010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f92d4085ad0 tx=0x7f92cc0090f0).stop 2022-07-05T11:46:30.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 -- 172.21.15.90:0/3771735558 shutdown_connections 2022-07-05T11:46:30.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 --2- 172.21.15.90:0/3771735558 >> v2:172.21.15.149:3300/0 conn(0x7f92d41785d0 0x7f92d417d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 --2- 172.21.15.90:0/3771735558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d4181b80 0x7f92d4182010 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 --2- 172.21.15.90:0/3771735558 >> v2:172.21.15.110:3300/0 conn(0x7f92d417d530 0x7f92d417d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 -- 172.21.15.90:0/3771735558 >> 172.21.15.90:0/3771735558 conn(0x7f92d40ee530 msgr2=0x7f92d4083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:30.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 -- 172.21.15.90:0/3771735558 shutdown_connections 2022-07-05T11:46:30.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.348+0000 7f92d9de4700 1 -- 172.21.15.90:0/3771735558 wait complete. 2022-07-05T11:46:30.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.349+0000 7f92d9de4700 1 Processor -- start 2022-07-05T11:46:30.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.349+0000 7f92d9de4700 1 -- start start 2022-07-05T11:46:30.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.350+0000 7f92d9de4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d41785d0 0x7f92d4171090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.350+0000 7f92d9de4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d417d530 0x7f92d4171580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.350+0000 7f92d9de4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d4181b80 0x7f92d40ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.350+0000 7f92d9de4700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40e4ae0 con 0x7f92d417d530 2022-07-05T11:46:30.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.350+0000 7f92d9de4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40e5380 con 0x7f92d4181b80 2022-07-05T11:46:30.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.350+0000 7f92d9de4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40eadf0 con 0x7f92d41785d0 2022-07-05T11:46:30.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.350+0000 7f92d2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d417d530 0x7f92d4171580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d417d530 0x7f92d4171580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57256/0 (socket says 172.21.15.90:57256) 2022-07-05T11:46:30.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 -- 172.21.15.90:0/2727814192 learned_addr learned my addr 172.21.15.90:0/2727814192 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:30.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d3fff700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d4181b80 0x7f92d40ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d37fe700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d41785d0 0x7f92d4171090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 -- 172.21.15.90:0/2727814192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d41785d0 msgr2=0x7f92d4171090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d41785d0 0x7f92d4171090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 -- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d4181b80 msgr2=0x7f92d40ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d4181b80 0x7f92d40ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 -- 172.21.15.90:0/2727814192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc009370 con 0x7f92d417d530 2022-07-05T11:46:30.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d2ffd700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d417d530 0x7f92d4171580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f92c800c8b0 tx=0x7f92c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92bb7fe700 1 -- 172.21.15.90:0/2727814192 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8010580 con 0x7f92d417d530 2022-07-05T11:46:30.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92bb7fe700 1 -- 172.21.15.90:0/2727814192 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c80106e0 con 0x7f92d417d530 2022-07-05T11:46:30.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d40eb0d0 con 0x7f92d417d530 2022-07-05T11:46:30.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92bb7fe700 1 -- 172.21.15.90:0/2727814192 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8010a80 con 0x7f92d417d530 2022-07-05T11:46:30.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.351+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40e5010 con 0x7f92d417d530 2022-07-05T11:46:30.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.352+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d406be40 con 0x7f92d417d530 2022-07-05T11:46:30.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.353+0000 7f92bb7fe700 1 -- 172.21.15.90:0/2727814192 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f92c8011410 con 0x7f92d417d530 2022-07-05T11:46:30.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.353+0000 7f92bb7fe700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f92b408ba40 0x7f92b408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.354+0000 7f92bb7fe700 1 -- 172.21.15.90:0/2727814192 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f92c80b1340 con 0x7f92d417d530 2022-07-05T11:46:30.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.354+0000 7f92d37fe700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f92b408ba40 0x7f92b408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.354+0000 7f92d37fe700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f92b408ba40 0x7f92b408df00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f92c40075a0 tx=0x7f92c40097b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.356+0000 7f92bb7fe700 1 -- 172.21.15.90:0/2727814192 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f92c8081f80 con 0x7f92d417d530 2022-07-05T11:46:30.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.516+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 --> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92d417c840 con 0x7f92b408ba40 2022-07-05T11:46:30.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.529+0000 7f92bb7fe700 1 -- 172.21.15.90:0/2727814192 <== mgr.4105 v2:172.21.15.110:6800/36906 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434313 (secure 0 0 0) 0x7f92d417c840 con 0x7f92b408ba40 2022-07-05T11:46:30.537 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:30.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f92b408ba40 msgr2=0x7f92b408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f92b408ba40 0x7f92b408df00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f92c40075a0 tx=0x7f92c40097b0).stop 2022-07-05T11:46:30.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d417d530 msgr2=0x7f92d4171580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d417d530 0x7f92d4171580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f92c800c8b0 tx=0x7f92c8008040).stop 2022-07-05T11:46:30.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 shutdown_connections 2022-07-05T11:46:30.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f92b408ba40 0x7f92b408df00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92d4181b80 0x7f92d40ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d41785d0 0x7f92d4171090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 --2- 172.21.15.90:0/2727814192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d417d530 0x7f92d4171580 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 >> 172.21.15.90:0/2727814192 conn(0x7f92d40ee530 msgr2=0x7f92d40c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:30.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 shutdown_connections 2022-07-05T11:46:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.532+0000 7f92d9de4700 1 -- 172.21.15.90:0/2727814192 wait complete. 2022-07-05T11:46:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2022-07-05T11:46:30.552 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2022-07-05T11:46:29.121001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7144,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":50,"num_read_kb":37,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":64128,"kb_used_data":4000,"kb_used_omap":0,"kb_used_meta":60032,"kb_avail":1132397952,"statfs":{"total":1159641169920,"available":1159575502848,"internally_reserved":0,"allocated":4096000,"data_stored":1976972,"data_compressed":167460,"data_compressed_allocated":245760,"data_compressed_original":491520,"omap_allocated":0,"internal_metadata":61472768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4838,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":50,"num_read_kb":37,"num_write":83,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004212"},"pg_stats":[{"pgid":"3.3f","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360284+0000","last_change":"2022-07-05T11:46:04.211228+0000","last_active":"2022-07-05T11:46:21.360284+0000","last_peered":"2022-07-05T11:46:21.360284+0000","last_clean":"2022-07-05T11:46:21.360284+0000","last_became_active":"2022-07-05T11:46:04.210963+0000","last_became_peered":"2022-07-05T11:46:04.210963+0000","last_unstale":"2022-07-05T11:46:21.360284+0000","last_undegraded":"2022-07-05T11:46:21.360284+0000","last_fullsized":"2022-07-05T11:46:21.360284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029059+0000","last_change":"2022-07-05T11:46:04.590106+0000","last_active":"2022-07-05T11:46:09.029059+0000","last_peered":"2022-07-05T11:46:09.029059+0000","last_clean":"2022-07-05T11:46:09.029059+0000","last_became_active":"2022-07-05T11:46:04.589807+0000","last_became_peered":"2022-07-05T11:46:04.589807+0000","last_unstale":"2022-07-05T11:46:09.029059+0000","last_undegraded":"2022-07-05T11:46:09.029059+0000","last_fullsized":"2022-07-05T11:46:09.029059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.408147+0000","last_change":"2022-07-05T11:46:04.202921+0000","last_active":"2022-07-05T11:46:10.408147+0000","last_peered":"2022-07-05T11:46:10.408147+0000","last_clean":"2022-07-05T11:46:10.408147+0000","last_became_active":"2022-07-05T11:46:04.202631+0000","last_became_peered":"2022-07-05T11:46:04.202631+0000","last_unstale":"2022-07-05T11:46:10.408147+0000","last_undegraded":"2022-07-05T11:46:10.408147+0000","last_fullsized":"2022-07-05T11:46:10.408147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028341+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.028341+0000","last_peered":"2022-07-05T11:46:09.028341+0000","last_clean":"2022-07-05T11:46:09.028341+0000","last_became_active":"2022-07-05T11:46:04.595253+0000","last_became_peered":"2022-07-05T11:46:04.595253+0000","last_unstale":"2022-07-05T11:46:09.028341+0000","last_undegraded":"2022-07-05T11:46:09.028341+0000","last_fullsized":"2022-07-05T11:46:09.028341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360892+0000","last_change":"2022-07-05T11:46:04.211131+0000","last_active":"2022-07-05T11:46:21.360892+0000","last_peered":"2022-07-05T11:46:21.360892+0000","last_clean":"2022-07-05T11:46:21.360892+0000","last_became_active":"2022-07-05T11:46:04.210828+0000","last_became_peered":"2022-07-05T11:46:04.210828+0000","last_unstale":"2022-07-05T11:46:21.360892+0000","last_undegraded":"2022-07-05T11:46:21.360892+0000","last_fullsized":"2022-07-05T11:46:21.360892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012401+0000","last_change":"2022-07-05T11:46:04.592905+0000","last_active":"2022-07-05T11:46:09.012401+0000","last_peered":"2022-07-05T11:46:09.012401+0000","last_clean":"2022-07-05T11:46:09.012401+0000","last_became_active":"2022-07-05T11:46:04.592593+0000","last_became_peered":"2022-07-05T11:46:04.592593+0000","last_unstale":"2022-07-05T11:46:09.012401+0000","last_undegraded":"2022-07-05T11:46:09.012401+0000","last_fullsized":"2022-07-05T11:46:09.012401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012779+0000","last_change":"2022-07-05T11:46:04.209903+0000","last_active":"2022-07-05T11:46:09.012779+0000","last_peered":"2022-07-05T11:46:09.012779+0000","last_clean":"2022-07-05T11:46:09.012779+0000","last_became_active":"2022-07-05T11:46:04.204575+0000","last_became_peered":"2022-07-05T11:46:04.204575+0000","last_unstale":"2022-07-05T11:46:09.012779+0000","last_undegraded":"2022-07-05T11:46:09.012779+0000","last_fullsized":"2022-07-05T11:46:09.012779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974869+0000","last_change":"2022-07-05T11:46:04.595822+0000","last_active":"2022-07-05T11:46:08.974869+0000","last_peered":"2022-07-05T11:46:08.974869+0000","last_clean":"2022-07-05T11:46:08.974869+0000","last_became_active":"2022-07-05T11:46:04.595306+0000","last_became_peered":"2022-07-05T11:46:04.595306+0000","last_unstale":"2022-07-05T11:46:08.974869+0000","last_undegraded":"2022-07-05T11:46:08.974869+0000","last_fullsized":"2022-07-05T11:46:08.974869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"25'1","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029038+0000","last_change":"2022-07-05T11:46:04.202298+0000","last_active":"2022-07-05T11:46:09.029038+0000","last_peered":"2022-07-05T11:46:09.029038+0000","last_clean":"2022-07-05T11:46:09.029038+0000","last_became_active":"2022-07-05T11:46:04.202010+0000","last_became_peered":"2022-07-05T11:46:04.202010+0000","last_unstale":"2022-07-05T11:46:09.029038+0000","last_undegraded":"2022-07-05T11:46:09.029038+0000","last_fullsized":"2022-07-05T11:46:09.029038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029758+0000","last_change":"2022-07-05T11:46:04.590970+0000","last_active":"2022-07-05T11:46:09.029758+0000","last_peered":"2022-07-05T11:46:09.029758+0000","last_clean":"2022-07-05T11:46:09.029758+0000","last_became_active":"2022-07-05T11:46:04.590714+0000","last_became_peered":"2022-07-05T11:46:04.590714+0000","last_unstale":"2022-07-05T11:46:09.029758+0000","last_undegraded":"2022-07-05T11:46:09.029758+0000","last_fullsized":"2022-07-05T11:46:09.029758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358625+0000","last_change":"2022-07-05T11:46:04.204607+0000","last_active":"2022-07-05T11:46:21.358625+0000","last_peered":"2022-07-05T11:46:21.358625+0000","last_clean":"2022-07-05T11:46:21.358625+0000","last_became_active":"2022-07-05T11:46:04.204287+0000","last_became_peered":"2022-07-05T11:46:04.204287+0000","last_unstale":"2022-07-05T11:46:21.358625+0000","last_undegraded":"2022-07-05T11:46:21.358625+0000","last_fullsized":"2022-07-05T11:46:21.358625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012802+0000","last_change":"2022-07-05T11:46:04.606655+0000","last_active":"2022-07-05T11:46:09.012802+0000","last_peered":"2022-07-05T11:46:09.012802+0000","last_clean":"2022-07-05T11:46:09.012802+0000","last_became_active":"2022-07-05T11:46:04.606370+0000","last_became_peered":"2022-07-05T11:46:04.606370+0000","last_unstale":"2022-07-05T11:46:09.012802+0000","last_undegraded":"2022-07-05T11:46:09.012802+0000","last_fullsized":"2022-07-05T11:46:09.012802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360703+0000","last_change":"2022-07-05T11:46:04.206427+0000","last_active":"2022-07-05T11:46:21.360703+0000","last_peered":"2022-07-05T11:46:21.360703+0000","last_clean":"2022-07-05T11:46:21.360703+0000","last_became_active":"2022-07-05T11:46:04.206192+0000","last_became_peered":"2022-07-05T11:46:04.206192+0000","last_unstale":"2022-07-05T11:46:21.360703+0000","last_undegraded":"2022-07-05T11:46:21.360703+0000","last_fullsized":"2022-07-05T11:46:21.360703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028587+0000","last_change":"2022-07-05T11:46:04.599321+0000","last_active":"2022-07-05T11:46:09.028587+0000","last_peered":"2022-07-05T11:46:09.028587+0000","last_clean":"2022-07-05T11:46:09.028587+0000","last_became_active":"2022-07-05T11:46:04.597626+0000","last_became_peered":"2022-07-05T11:46:04.597626+0000","last_unstale":"2022-07-05T11:46:09.028587+0000","last_undegraded":"2022-07-05T11:46:09.028587+0000","last_fullsized":"2022-07-05T11:46:09.028587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407177+0000","last_change":"2022-07-05T11:46:04.204458+0000","last_active":"2022-07-05T11:46:10.407177+0000","last_peered":"2022-07-05T11:46:10.407177+0000","last_clean":"2022-07-05T11:46:10.407177+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:10.407177+0000","last_undegraded":"2022-07-05T11:46:10.407177+0000","last_fullsized":"2022-07-05T11:46:10.407177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028708+0000","last_change":"2022-07-05T11:46:04.598830+0000","last_active":"2022-07-05T11:46:09.028708+0000","last_peered":"2022-07-05T11:46:09.028708+0000","last_clean":"2022-07-05T11:46:09.028708+0000","last_became_active":"2022-07-05T11:46:04.597158+0000","last_became_peered":"2022-07-05T11:46:04.597158+0000","last_unstale":"2022-07-05T11:46:09.028708+0000","last_undegraded":"2022-07-05T11:46:09.028708+0000","last_fullsized":"2022-07-05T11:46:09.028708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029721+0000","last_change":"2022-07-05T11:46:04.207355+0000","last_active":"2022-07-05T11:46:09.029721+0000","last_peered":"2022-07-05T11:46:09.029721+0000","last_clean":"2022-07-05T11:46:09.029721+0000","last_became_active":"2022-07-05T11:46:04.207059+0000","last_became_peered":"2022-07-05T11:46:04.207059+0000","last_unstale":"2022-07-05T11:46:09.029721+0000","last_undegraded":"2022-07-05T11:46:09.029721+0000","last_fullsized":"2022-07-05T11:46:09.029721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012425+0000","last_change":"2022-07-05T11:46:04.595782+0000","last_active":"2022-07-05T11:46:09.012425+0000","last_peered":"2022-07-05T11:46:09.012425+0000","last_clean":"2022-07-05T11:46:09.012425+0000","last_became_active":"2022-07-05T11:46:04.595530+0000","last_became_peered":"2022-07-05T11:46:04.595530+0000","last_unstale":"2022-07-05T11:46:09.012425+0000","last_undegraded":"2022-07-05T11:46:09.012425+0000","last_fullsized":"2022-07-05T11:46:09.012425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.351876+0000","last_change":"2022-07-05T11:46:04.210209+0000","last_active":"2022-07-05T11:46:20.351876+0000","last_peered":"2022-07-05T11:46:20.351876+0000","last_clean":"2022-07-05T11:46:20.351876+0000","last_became_active":"2022-07-05T11:46:04.209883+0000","last_became_peered":"2022-07-05T11:46:04.209883+0000","last_unstale":"2022-07-05T11:46:20.351876+0000","last_undegraded":"2022-07-05T11:46:20.351876+0000","last_fullsized":"2022-07-05T11:46:20.351876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028150+0000","last_change":"2022-07-05T11:46:04.600375+0000","last_active":"2022-07-05T11:46:09.028150+0000","last_peered":"2022-07-05T11:46:09.028150+0000","last_clean":"2022-07-05T11:46:09.028150+0000","last_became_active":"2022-07-05T11:46:04.600101+0000","last_became_peered":"2022-07-05T11:46:04.600101+0000","last_unstale":"2022-07-05T11:46:09.028150+0000","last_undegraded":"2022-07-05T11:46:09.028150+0000","last_fullsized":"2022-07-05T11:46:09.028150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030246+0000","last_change":"2022-07-05T11:46:04.204891+0000","last_active":"2022-07-05T11:46:09.030246+0000","last_peered":"2022-07-05T11:46:09.030246+0000","last_clean":"2022-07-05T11:46:09.030246+0000","last_became_active":"2022-07-05T11:46:04.204619+0000","last_became_peered":"2022-07-05T11:46:04.204619+0000","last_unstale":"2022-07-05T11:46:09.030246+0000","last_undegraded":"2022-07-05T11:46:09.030246+0000","last_fullsized":"2022-07-05T11:46:09.030246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028234+0000","last_change":"2022-07-05T11:46:04.600335+0000","last_active":"2022-07-05T11:46:09.028234+0000","last_peered":"2022-07-05T11:46:09.028234+0000","last_clean":"2022-07-05T11:46:09.028234+0000","last_became_active":"2022-07-05T11:46:04.600026+0000","last_became_peered":"2022-07-05T11:46:04.600026+0000","last_unstale":"2022-07-05T11:46:09.028234+0000","last_undegraded":"2022-07-05T11:46:09.028234+0000","last_fullsized":"2022-07-05T11:46:09.028234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'9","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.369870+0000","last_change":"2022-07-05T11:46:04.210563+0000","last_active":"2022-07-05T11:46:25.369870+0000","last_peered":"2022-07-05T11:46:25.369870+0000","last_clean":"2022-07-05T11:46:25.369870+0000","last_became_active":"2022-07-05T11:46:04.210264+0000","last_became_peered":"2022-07-05T11:46:04.210264+0000","last_unstale":"2022-07-05T11:46:25.369870+0000","last_undegraded":"2022-07-05T11:46:25.369870+0000","last_fullsized":"2022-07-05T11:46:25.369870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3070,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975654+0000","last_change":"2022-07-05T11:46:04.596566+0000","last_active":"2022-07-05T11:46:08.975654+0000","last_peered":"2022-07-05T11:46:08.975654+0000","last_clean":"2022-07-05T11:46:08.975654+0000","last_became_active":"2022-07-05T11:46:04.596385+0000","last_became_peered":"2022-07-05T11:46:04.596385+0000","last_unstale":"2022-07-05T11:46:08.975654+0000","last_undegraded":"2022-07-05T11:46:08.975654+0000","last_fullsized":"2022-07-05T11:46:08.975654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359717+0000","last_change":"2022-07-05T11:46:04.205836+0000","last_active":"2022-07-05T11:46:21.359717+0000","last_peered":"2022-07-05T11:46:21.359717+0000","last_clean":"2022-07-05T11:46:21.359717+0000","last_became_active":"2022-07-05T11:46:04.205522+0000","last_became_peered":"2022-07-05T11:46:04.205522+0000","last_unstale":"2022-07-05T11:46:21.359717+0000","last_undegraded":"2022-07-05T11:46:21.359717+0000","last_fullsized":"2022-07-05T11:46:21.359717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027942+0000","last_change":"2022-07-05T11:46:04.600047+0000","last_active":"2022-07-05T11:46:09.027942+0000","last_peered":"2022-07-05T11:46:09.027942+0000","last_clean":"2022-07-05T11:46:09.027942+0000","last_became_active":"2022-07-05T11:46:04.599735+0000","last_became_peered":"2022-07-05T11:46:04.599735+0000","last_unstale":"2022-07-05T11:46:09.027942+0000","last_undegraded":"2022-07-05T11:46:09.027942+0000","last_fullsized":"2022-07-05T11:46:09.027942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027527+0000","last_change":"2022-07-05T11:46:04.204754+0000","last_active":"2022-07-05T11:46:09.027527+0000","last_peered":"2022-07-05T11:46:09.027527+0000","last_clean":"2022-07-05T11:46:09.027527+0000","last_became_active":"2022-07-05T11:46:04.204466+0000","last_became_peered":"2022-07-05T11:46:04.204466+0000","last_unstale":"2022-07-05T11:46:09.027527+0000","last_undegraded":"2022-07-05T11:46:09.027527+0000","last_fullsized":"2022-07-05T11:46:09.027527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012900+0000","last_change":"2022-07-05T11:46:04.594552+0000","last_active":"2022-07-05T11:46:09.012900+0000","last_peered":"2022-07-05T11:46:09.012900+0000","last_clean":"2022-07-05T11:46:09.012900+0000","last_became_active":"2022-07-05T11:46:04.594285+0000","last_became_peered":"2022-07-05T11:46:04.594285+0000","last_unstale":"2022-07-05T11:46:09.012900+0000","last_undegraded":"2022-07-05T11:46:09.012900+0000","last_fullsized":"2022-07-05T11:46:09.012900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027421+0000","last_change":"2022-07-05T11:46:04.206416+0000","last_active":"2022-07-05T11:46:09.027421+0000","last_peered":"2022-07-05T11:46:09.027421+0000","last_clean":"2022-07-05T11:46:09.027421+0000","last_became_active":"2022-07-05T11:46:04.206118+0000","last_became_peered":"2022-07-05T11:46:04.206118+0000","last_unstale":"2022-07-05T11:46:09.027421+0000","last_undegraded":"2022-07-05T11:46:09.027421+0000","last_fullsized":"2022-07-05T11:46:09.027421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975854+0000","last_change":"2022-07-05T11:46:04.596814+0000","last_active":"2022-07-05T11:46:08.975854+0000","last_peered":"2022-07-05T11:46:08.975854+0000","last_clean":"2022-07-05T11:46:08.975854+0000","last_became_active":"2022-07-05T11:46:04.596492+0000","last_became_peered":"2022-07-05T11:46:04.596492+0000","last_unstale":"2022-07-05T11:46:08.975854+0000","last_undegraded":"2022-07-05T11:46:08.975854+0000","last_fullsized":"2022-07-05T11:46:08.975854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'10","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359758+0000","last_change":"2022-07-05T11:46:04.208748+0000","last_active":"2022-07-05T11:46:21.359758+0000","last_peered":"2022-07-05T11:46:21.359758+0000","last_clean":"2022-07-05T11:46:21.359758+0000","last_became_active":"2022-07-05T11:46:04.208440+0000","last_became_peered":"2022-07-05T11:46:04.208440+0000","last_unstale":"2022-07-05T11:46:21.359758+0000","last_undegraded":"2022-07-05T11:46:21.359758+0000","last_fullsized":"2022-07-05T11:46:21.359758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974079+0000","last_change":"2022-07-05T11:46:04.592371+0000","last_active":"2022-07-05T11:46:08.974079+0000","last_peered":"2022-07-05T11:46:08.974079+0000","last_clean":"2022-07-05T11:46:08.974079+0000","last_became_active":"2022-07-05T11:46:04.592201+0000","last_became_peered":"2022-07-05T11:46:04.592201+0000","last_unstale":"2022-07-05T11:46:08.974079+0000","last_undegraded":"2022-07-05T11:46:08.974079+0000","last_fullsized":"2022-07-05T11:46:08.974079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.982904+0000","last_change":"2022-07-05T11:46:04.211261+0000","last_active":"2022-07-05T11:46:09.982904+0000","last_peered":"2022-07-05T11:46:09.982904+0000","last_clean":"2022-07-05T11:46:09.982904+0000","last_became_active":"2022-07-05T11:46:04.211004+0000","last_became_peered":"2022-07-05T11:46:04.211004+0000","last_unstale":"2022-07-05T11:46:09.982904+0000","last_undegraded":"2022-07-05T11:46:09.982904+0000","last_fullsized":"2022-07-05T11:46:09.982904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974789+0000","last_change":"2022-07-05T11:46:04.597787+0000","last_active":"2022-07-05T11:46:08.974789+0000","last_peered":"2022-07-05T11:46:08.974789+0000","last_clean":"2022-07-05T11:46:08.974789+0000","last_became_active":"2022-07-05T11:46:04.597433+0000","last_became_peered":"2022-07-05T11:46:04.597433+0000","last_unstale":"2022-07-05T11:46:08.974789+0000","last_undegraded":"2022-07-05T11:46:08.974789+0000","last_fullsized":"2022-07-05T11:46:08.974789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974038+0000","last_change":"2022-07-05T11:46:04.211347+0000","last_active":"2022-07-05T11:46:08.974038+0000","last_peered":"2022-07-05T11:46:08.974038+0000","last_clean":"2022-07-05T11:46:08.974038+0000","last_became_active":"2022-07-05T11:46:04.211045+0000","last_became_peered":"2022-07-05T11:46:04.211045+0000","last_unstale":"2022-07-05T11:46:08.974038+0000","last_undegraded":"2022-07-05T11:46:08.974038+0000","last_fullsized":"2022-07-05T11:46:08.974038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973840+0000","last_change":"2022-07-05T11:46:04.587177+0000","last_active":"2022-07-05T11:46:08.973840+0000","last_peered":"2022-07-05T11:46:08.973840+0000","last_clean":"2022-07-05T11:46:08.973840+0000","last_became_active":"2022-07-05T11:46:04.586915+0000","last_became_peered":"2022-07-05T11:46:04.586915+0000","last_unstale":"2022-07-05T11:46:08.973840+0000","last_undegraded":"2022-07-05T11:46:08.973840+0000","last_fullsized":"2022-07-05T11:46:08.973840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317123+0000","last_change":"2022-07-05T11:46:04.213135+0000","last_active":"2022-07-05T11:46:10.317123+0000","last_peered":"2022-07-05T11:46:10.317123+0000","last_clean":"2022-07-05T11:46:10.317123+0000","last_became_active":"2022-07-05T11:46:04.212877+0000","last_became_peered":"2022-07-05T11:46:04.212877+0000","last_unstale":"2022-07-05T11:46:10.317123+0000","last_undegraded":"2022-07-05T11:46:10.317123+0000","last_fullsized":"2022-07-05T11:46:10.317123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975178+0000","last_change":"2022-07-05T11:46:04.598414+0000","last_active":"2022-07-05T11:46:08.975178+0000","last_peered":"2022-07-05T11:46:08.975178+0000","last_clean":"2022-07-05T11:46:08.975178+0000","last_became_active":"2022-07-05T11:46:04.595082+0000","last_became_peered":"2022-07-05T11:46:04.595082+0000","last_unstale":"2022-07-05T11:46:08.975178+0000","last_undegraded":"2022-07-05T11:46:08.975178+0000","last_fullsized":"2022-07-05T11:46:08.975178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360365+0000","last_change":"2022-07-05T11:46:04.208533+0000","last_active":"2022-07-05T11:46:21.360365+0000","last_peered":"2022-07-05T11:46:21.360365+0000","last_clean":"2022-07-05T11:46:21.360365+0000","last_became_active":"2022-07-05T11:46:04.208198+0000","last_became_peered":"2022-07-05T11:46:04.208198+0000","last_unstale":"2022-07-05T11:46:21.360365+0000","last_undegraded":"2022-07-05T11:46:21.360365+0000","last_fullsized":"2022-07-05T11:46:21.360365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029685+0000","last_change":"2022-07-05T11:46:04.590329+0000","last_active":"2022-07-05T11:46:09.029685+0000","last_peered":"2022-07-05T11:46:09.029685+0000","last_clean":"2022-07-05T11:46:09.029685+0000","last_became_active":"2022-07-05T11:46:04.590046+0000","last_became_peered":"2022-07-05T11:46:04.590046+0000","last_unstale":"2022-07-05T11:46:09.029685+0000","last_undegraded":"2022-07-05T11:46:09.029685+0000","last_fullsized":"2022-07-05T11:46:09.029685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352181+0000","last_change":"2022-07-05T11:46:04.207526+0000","last_active":"2022-07-05T11:46:20.352181+0000","last_peered":"2022-07-05T11:46:20.352181+0000","last_clean":"2022-07-05T11:46:20.352181+0000","last_became_active":"2022-07-05T11:46:04.207209+0000","last_became_peered":"2022-07-05T11:46:04.207209+0000","last_unstale":"2022-07-05T11:46:20.352181+0000","last_undegraded":"2022-07-05T11:46:20.352181+0000","last_fullsized":"2022-07-05T11:46:20.352181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029663+0000","last_change":"2022-07-05T11:46:04.590203+0000","last_active":"2022-07-05T11:46:09.029663+0000","last_peered":"2022-07-05T11:46:09.029663+0000","last_clean":"2022-07-05T11:46:09.029663+0000","last_became_active":"2022-07-05T11:46:04.589893+0000","last_became_peered":"2022-07-05T11:46:04.589893+0000","last_unstale":"2022-07-05T11:46:09.029663+0000","last_undegraded":"2022-07-05T11:46:09.029663+0000","last_fullsized":"2022-07-05T11:46:09.029663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407980+0000","last_change":"2022-07-05T11:46:04.207726+0000","last_active":"2022-07-05T11:46:10.407980+0000","last_peered":"2022-07-05T11:46:10.407980+0000","last_clean":"2022-07-05T11:46:10.407980+0000","last_became_active":"2022-07-05T11:46:04.207398+0000","last_became_peered":"2022-07-05T11:46:04.207398+0000","last_unstale":"2022-07-05T11:46:10.407980+0000","last_undegraded":"2022-07-05T11:46:10.407980+0000","last_fullsized":"2022-07-05T11:46:10.407980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028460+0000","last_change":"2022-07-05T11:46:04.598660+0000","last_active":"2022-07-05T11:46:09.028460+0000","last_peered":"2022-07-05T11:46:09.028460+0000","last_clean":"2022-07-05T11:46:09.028460+0000","last_became_active":"2022-07-05T11:46:04.598419+0000","last_became_peered":"2022-07-05T11:46:04.598419+0000","last_unstale":"2022-07-05T11:46:09.028460+0000","last_undegraded":"2022-07-05T11:46:09.028460+0000","last_fullsized":"2022-07-05T11:46:09.028460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028769+0000","last_change":"2022-07-05T11:46:04.214164+0000","last_active":"2022-07-05T11:46:09.028769+0000","last_peered":"2022-07-05T11:46:09.028769+0000","last_clean":"2022-07-05T11:46:09.028769+0000","last_became_active":"2022-07-05T11:46:04.213794+0000","last_became_peered":"2022-07-05T11:46:04.213794+0000","last_unstale":"2022-07-05T11:46:09.028769+0000","last_undegraded":"2022-07-05T11:46:09.028769+0000","last_fullsized":"2022-07-05T11:46:09.028769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.599315+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.599091+0000","last_became_peered":"2022-07-05T11:46:04.599091+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353175+0000","last_change":"2022-07-05T11:46:04.208200+0000","last_active":"2022-07-05T11:46:20.353175+0000","last_peered":"2022-07-05T11:46:20.353175+0000","last_clean":"2022-07-05T11:46:20.353175+0000","last_became_active":"2022-07-05T11:46:04.207891+0000","last_became_peered":"2022-07-05T11:46:04.207891+0000","last_unstale":"2022-07-05T11:46:20.353175+0000","last_undegraded":"2022-07-05T11:46:20.353175+0000","last_fullsized":"2022-07-05T11:46:20.353175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028740+0000","last_change":"2022-07-05T11:46:04.594011+0000","last_active":"2022-07-05T11:46:09.028740+0000","last_peered":"2022-07-05T11:46:09.028740+0000","last_clean":"2022-07-05T11:46:09.028740+0000","last_became_active":"2022-07-05T11:46:04.593800+0000","last_became_peered":"2022-07-05T11:46:04.593800+0000","last_unstale":"2022-07-05T11:46:09.028740+0000","last_undegraded":"2022-07-05T11:46:09.028740+0000","last_fullsized":"2022-07-05T11:46:09.028740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353238+0000","last_change":"2022-07-05T11:46:04.206715+0000","last_active":"2022-07-05T11:46:20.353238+0000","last_peered":"2022-07-05T11:46:20.353238+0000","last_clean":"2022-07-05T11:46:20.353238+0000","last_became_active":"2022-07-05T11:46:04.206230+0000","last_became_peered":"2022-07-05T11:46:04.206230+0000","last_unstale":"2022-07-05T11:46:20.353238+0000","last_undegraded":"2022-07-05T11:46:20.353238+0000","last_fullsized":"2022-07-05T11:46:20.353238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029238+0000","last_change":"2022-07-05T11:46:04.590527+0000","last_active":"2022-07-05T11:46:09.029238+0000","last_peered":"2022-07-05T11:46:09.029238+0000","last_clean":"2022-07-05T11:46:09.029238+0000","last_became_active":"2022-07-05T11:46:04.589992+0000","last_became_peered":"2022-07-05T11:46:04.589992+0000","last_unstale":"2022-07-05T11:46:09.029238+0000","last_undegraded":"2022-07-05T11:46:09.029238+0000","last_fullsized":"2022-07-05T11:46:09.029238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317357+0000","last_change":"2022-07-05T11:46:04.209943+0000","last_active":"2022-07-05T11:46:10.317357+0000","last_peered":"2022-07-05T11:46:10.317357+0000","last_clean":"2022-07-05T11:46:10.317357+0000","last_became_active":"2022-07-05T11:46:04.209640+0000","last_became_peered":"2022-07-05T11:46:04.209640+0000","last_unstale":"2022-07-05T11:46:10.317357+0000","last_undegraded":"2022-07-05T11:46:10.317357+0000","last_fullsized":"2022-07-05T11:46:10.317357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028615+0000","last_change":"2022-07-05T11:46:04.593997+0000","last_active":"2022-07-05T11:46:09.028615+0000","last_peered":"2022-07-05T11:46:09.028615+0000","last_clean":"2022-07-05T11:46:09.028615+0000","last_became_active":"2022-07-05T11:46:04.593708+0000","last_became_peered":"2022-07-05T11:46:04.593708+0000","last_unstale":"2022-07-05T11:46:09.028615+0000","last_undegraded":"2022-07-05T11:46:09.028615+0000","last_fullsized":"2022-07-05T11:46:09.028615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352932+0000","last_change":"2022-07-05T11:46:04.203818+0000","last_active":"2022-07-05T11:46:20.352932+0000","last_peered":"2022-07-05T11:46:20.352932+0000","last_clean":"2022-07-05T11:46:20.352932+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:20.352932+0000","last_undegraded":"2022-07-05T11:46:20.352932+0000","last_fullsized":"2022-07-05T11:46:20.352932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975098+0000","last_change":"2022-07-05T11:46:04.598669+0000","last_active":"2022-07-05T11:46:08.975098+0000","last_peered":"2022-07-05T11:46:08.975098+0000","last_clean":"2022-07-05T11:46:08.975098+0000","last_became_active":"2022-07-05T11:46:04.598400+0000","last_became_peered":"2022-07-05T11:46:04.598400+0000","last_unstale":"2022-07-05T11:46:08.975098+0000","last_undegraded":"2022-07-05T11:46:08.975098+0000","last_fullsized":"2022-07-05T11:46:08.975098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028775+0000","last_change":"2022-07-05T11:46:04.212247+0000","last_active":"2022-07-05T11:46:09.028775+0000","last_peered":"2022-07-05T11:46:09.028775+0000","last_clean":"2022-07-05T11:46:09.028775+0000","last_became_active":"2022-07-05T11:46:04.211958+0000","last_became_peered":"2022-07-05T11:46:04.211958+0000","last_unstale":"2022-07-05T11:46:09.028775+0000","last_undegraded":"2022-07-05T11:46:09.028775+0000","last_fullsized":"2022-07-05T11:46:09.028775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029158+0000","last_change":"2022-07-05T11:46:04.599477+0000","last_active":"2022-07-05T11:46:09.029158+0000","last_peered":"2022-07-05T11:46:09.029158+0000","last_clean":"2022-07-05T11:46:09.029158+0000","last_became_active":"2022-07-05T11:46:04.599214+0000","last_became_peered":"2022-07-05T11:46:04.599214+0000","last_unstale":"2022-07-05T11:46:09.029158+0000","last_undegraded":"2022-07-05T11:46:09.029158+0000","last_fullsized":"2022-07-05T11:46:09.029158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027608+0000","last_change":"2022-07-05T11:46:04.209196+0000","last_active":"2022-07-05T11:46:09.027608+0000","last_peered":"2022-07-05T11:46:09.027608+0000","last_clean":"2022-07-05T11:46:09.027608+0000","last_became_active":"2022-07-05T11:46:04.208918+0000","last_became_peered":"2022-07-05T11:46:04.208918+0000","last_unstale":"2022-07-05T11:46:09.027608+0000","last_undegraded":"2022-07-05T11:46:09.027608+0000","last_fullsized":"2022-07-05T11:46:09.027608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975167+0000","last_change":"2022-07-05T11:46:04.594414+0000","last_active":"2022-07-05T11:46:08.975167+0000","last_peered":"2022-07-05T11:46:08.975167+0000","last_clean":"2022-07-05T11:46:08.975167+0000","last_became_active":"2022-07-05T11:46:04.594114+0000","last_became_peered":"2022-07-05T11:46:04.594114+0000","last_unstale":"2022-07-05T11:46:08.975167+0000","last_undegraded":"2022-07-05T11:46:08.975167+0000","last_fullsized":"2022-07-05T11:46:08.975167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027763+0000","last_change":"2022-07-05T11:46:04.215006+0000","last_active":"2022-07-05T11:46:09.027763+0000","last_peered":"2022-07-05T11:46:09.027763+0000","last_clean":"2022-07-05T11:46:09.027763+0000","last_became_active":"2022-07-05T11:46:04.214585+0000","last_became_peered":"2022-07-05T11:46:04.214585+0000","last_unstale":"2022-07-05T11:46:09.027763+0000","last_undegraded":"2022-07-05T11:46:09.027763+0000","last_fullsized":"2022-07-05T11:46:09.027763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030101+0000","last_change":"2022-07-05T11:46:04.601912+0000","last_active":"2022-07-05T11:46:09.030101+0000","last_peered":"2022-07-05T11:46:09.030101+0000","last_clean":"2022-07-05T11:46:09.030101+0000","last_became_active":"2022-07-05T11:46:04.601605+0000","last_became_peered":"2022-07-05T11:46:04.601605+0000","last_unstale":"2022-07-05T11:46:09.030101+0000","last_undegraded":"2022-07-05T11:46:09.030101+0000","last_fullsized":"2022-07-05T11:46:09.030101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371134+0000","last_change":"2022-07-05T11:46:04.208064+0000","last_active":"2022-07-05T11:46:25.371134+0000","last_peered":"2022-07-05T11:46:25.371134+0000","last_clean":"2022-07-05T11:46:25.371134+0000","last_became_active":"2022-07-05T11:46:04.207845+0000","last_became_peered":"2022-07-05T11:46:04.207845+0000","last_unstale":"2022-07-05T11:46:25.371134+0000","last_undegraded":"2022-07-05T11:46:25.371134+0000","last_fullsized":"2022-07-05T11:46:25.371134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030056+0000","last_change":"2022-07-05T11:46:04.589990+0000","last_active":"2022-07-05T11:46:09.030056+0000","last_peered":"2022-07-05T11:46:09.030056+0000","last_clean":"2022-07-05T11:46:09.030056+0000","last_became_active":"2022-07-05T11:46:04.589734+0000","last_became_peered":"2022-07-05T11:46:04.589734+0000","last_unstale":"2022-07-05T11:46:09.030056+0000","last_undegraded":"2022-07-05T11:46:09.030056+0000","last_fullsized":"2022-07-05T11:46:09.030056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974955+0000","last_change":"2022-07-05T11:46:04.208275+0000","last_active":"2022-07-05T11:46:08.974955+0000","last_peered":"2022-07-05T11:46:08.974955+0000","last_clean":"2022-07-05T11:46:08.974955+0000","last_became_active":"2022-07-05T11:46:04.208001+0000","last_became_peered":"2022-07-05T11:46:04.208001+0000","last_unstale":"2022-07-05T11:46:08.974955+0000","last_undegraded":"2022-07-05T11:46:08.974955+0000","last_fullsized":"2022-07-05T11:46:08.974955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028628+0000","last_change":"2022-07-05T11:46:04.597446+0000","last_active":"2022-07-05T11:46:09.028628+0000","last_peered":"2022-07-05T11:46:09.028628+0000","last_clean":"2022-07-05T11:46:09.028628+0000","last_became_active":"2022-07-05T11:46:04.596828+0000","last_became_peered":"2022-07-05T11:46:04.596828+0000","last_unstale":"2022-07-05T11:46:09.028628+0000","last_undegraded":"2022-07-05T11:46:09.028628+0000","last_fullsized":"2022-07-05T11:46:09.028628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360630+0000","last_change":"2022-07-05T11:46:04.211080+0000","last_active":"2022-07-05T11:46:21.360630+0000","last_peered":"2022-07-05T11:46:21.360630+0000","last_clean":"2022-07-05T11:46:21.360630+0000","last_became_active":"2022-07-05T11:46:04.210805+0000","last_became_peered":"2022-07-05T11:46:04.210805+0000","last_unstale":"2022-07-05T11:46:21.360630+0000","last_undegraded":"2022-07-05T11:46:21.360630+0000","last_fullsized":"2022-07-05T11:46:21.360630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012330+0000","last_change":"2022-07-05T11:46:04.594116+0000","last_active":"2022-07-05T11:46:09.012330+0000","last_peered":"2022-07-05T11:46:09.012330+0000","last_clean":"2022-07-05T11:46:09.012330+0000","last_became_active":"2022-07-05T11:46:04.593716+0000","last_became_peered":"2022-07-05T11:46:04.593716+0000","last_unstale":"2022-07-05T11:46:09.012330+0000","last_undegraded":"2022-07-05T11:46:09.012330+0000","last_fullsized":"2022-07-05T11:46:09.012330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017611+0000","last_change":"2022-07-05T11:46:09.014114+0000","last_active":"2022-07-05T11:46:09.017611+0000","last_peered":"2022-07-05T11:46:09.017611+0000","last_clean":"2022-07-05T11:46:09.017611+0000","last_became_active":"2022-07-05T11:46:09.013707+0000","last_became_peered":"2022-07-05T11:46:09.013707+0000","last_unstale":"2022-07-05T11:46:09.017611+0000","last_undegraded":"2022-07-05T11:46:09.017611+0000","last_fullsized":"2022-07-05T11:46:09.017611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029324+0000","last_change":"2022-07-05T11:46:04.213375+0000","last_active":"2022-07-05T11:46:09.029324+0000","last_peered":"2022-07-05T11:46:09.029324+0000","last_clean":"2022-07-05T11:46:09.029324+0000","last_became_active":"2022-07-05T11:46:04.213094+0000","last_became_peered":"2022-07-05T11:46:04.213094+0000","last_unstale":"2022-07-05T11:46:09.029324+0000","last_undegraded":"2022-07-05T11:46:09.029324+0000","last_fullsized":"2022-07-05T11:46:09.029324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027648+0000","last_change":"2022-07-05T11:46:04.599779+0000","last_active":"2022-07-05T11:46:09.027648+0000","last_peered":"2022-07-05T11:46:09.027648+0000","last_clean":"2022-07-05T11:46:09.027648+0000","last_became_active":"2022-07-05T11:46:04.597330+0000","last_became_peered":"2022-07-05T11:46:04.597330+0000","last_unstale":"2022-07-05T11:46:09.027648+0000","last_undegraded":"2022-07-05T11:46:09.027648+0000","last_fullsized":"2022-07-05T11:46:09.027648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012222+0000","last_change":"2022-07-05T11:46:08.615050+0000","last_active":"2022-07-05T11:46:09.012222+0000","last_peered":"2022-07-05T11:46:09.012222+0000","last_clean":"2022-07-05T11:46:09.012222+0000","last_became_active":"2022-07-05T11:46:08.614715+0000","last_became_peered":"2022-07-05T11:46:08.614715+0000","last_unstale":"2022-07-05T11:46:09.012222+0000","last_undegraded":"2022-07-05T11:46:09.012222+0000","last_fullsized":"2022-07-05T11:46:09.012222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975318+0000","last_change":"2022-07-05T11:46:04.206835+0000","last_active":"2022-07-05T11:46:08.975318+0000","last_peered":"2022-07-05T11:46:08.975318+0000","last_clean":"2022-07-05T11:46:08.975318+0000","last_became_active":"2022-07-05T11:46:04.206389+0000","last_became_peered":"2022-07-05T11:46:04.206389+0000","last_unstale":"2022-07-05T11:46:08.975318+0000","last_undegraded":"2022-07-05T11:46:08.975318+0000","last_fullsized":"2022-07-05T11:46:08.975318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012352+0000","last_change":"2022-07-05T11:46:04.595704+0000","last_active":"2022-07-05T11:46:09.012352+0000","last_peered":"2022-07-05T11:46:09.012352+0000","last_clean":"2022-07-05T11:46:09.012352+0000","last_became_active":"2022-07-05T11:46:04.594581+0000","last_became_peered":"2022-07-05T11:46:04.594581+0000","last_unstale":"2022-07-05T11:46:09.012352+0000","last_undegraded":"2022-07-05T11:46:09.012352+0000","last_fullsized":"2022-07-05T11:46:09.012352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028313+0000","last_change":"2022-07-05T11:46:08.618434+0000","last_active":"2022-07-05T11:46:09.028313+0000","last_peered":"2022-07-05T11:46:09.028313+0000","last_clean":"2022-07-05T11:46:09.028313+0000","last_became_active":"2022-07-05T11:46:08.618022+0000","last_became_peered":"2022-07-05T11:46:08.618022+0000","last_unstale":"2022-07-05T11:46:09.028313+0000","last_undegraded":"2022-07-05T11:46:09.028313+0000","last_fullsized":"2022-07-05T11:46:09.028313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029453+0000","last_change":"2022-07-05T11:46:04.213103+0000","last_active":"2022-07-05T11:46:09.029453+0000","last_peered":"2022-07-05T11:46:09.029453+0000","last_clean":"2022-07-05T11:46:09.029453+0000","last_became_active":"2022-07-05T11:46:04.211627+0000","last_became_peered":"2022-07-05T11:46:04.211627+0000","last_unstale":"2022-07-05T11:46:09.029453+0000","last_undegraded":"2022-07-05T11:46:09.029453+0000","last_fullsized":"2022-07-05T11:46:09.029453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012463+0000","last_change":"2022-07-05T11:46:04.593912+0000","last_active":"2022-07-05T11:46:09.012463+0000","last_peered":"2022-07-05T11:46:09.012463+0000","last_clean":"2022-07-05T11:46:09.012463+0000","last_became_active":"2022-07-05T11:46:04.593631+0000","last_became_peered":"2022-07-05T11:46:04.593631+0000","last_unstale":"2022-07-05T11:46:09.012463+0000","last_undegraded":"2022-07-05T11:46:09.012463+0000","last_fullsized":"2022-07-05T11:46:09.012463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028223+0000","last_change":"2022-07-05T11:46:09.013932+0000","last_active":"2022-07-05T11:46:09.028223+0000","last_peered":"2022-07-05T11:46:09.028223+0000","last_clean":"2022-07-05T11:46:09.028223+0000","last_became_active":"2022-07-05T11:46:09.013609+0000","last_became_peered":"2022-07-05T11:46:09.013609+0000","last_unstale":"2022-07-05T11:46:09.028223+0000","last_undegraded":"2022-07-05T11:46:09.028223+0000","last_fullsized":"2022-07-05T11:46:09.028223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028226+0000","last_change":"2022-07-05T11:46:09.016568+0000","last_active":"2022-07-05T11:46:09.028226+0000","last_peered":"2022-07-05T11:46:09.028226+0000","last_clean":"2022-07-05T11:46:09.028226+0000","last_became_active":"2022-07-05T11:46:09.016162+0000","last_became_peered":"2022-07-05T11:46:09.016162+0000","last_unstale":"2022-07-05T11:46:09.028226+0000","last_undegraded":"2022-07-05T11:46:09.028226+0000","last_fullsized":"2022-07-05T11:46:09.028226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'4","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371598+0000","last_change":"2022-07-05T11:46:04.208656+0000","last_active":"2022-07-05T11:46:25.371598+0000","last_peered":"2022-07-05T11:46:25.371598+0000","last_clean":"2022-07-05T11:46:25.371598+0000","last_became_active":"2022-07-05T11:46:04.208394+0000","last_became_peered":"2022-07-05T11:46:04.208394+0000","last_unstale":"2022-07-05T11:46:25.371598+0000","last_undegraded":"2022-07-05T11:46:25.371598+0000","last_fullsized":"2022-07-05T11:46:25.371598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027906+0000","last_change":"2022-07-05T11:46:04.600156+0000","last_active":"2022-07-05T11:46:09.027906+0000","last_peered":"2022-07-05T11:46:09.027906+0000","last_clean":"2022-07-05T11:46:09.027906+0000","last_became_active":"2022-07-05T11:46:04.599836+0000","last_became_peered":"2022-07-05T11:46:04.599836+0000","last_unstale":"2022-07-05T11:46:09.027906+0000","last_undegraded":"2022-07-05T11:46:09.027906+0000","last_fullsized":"2022-07-05T11:46:09.027906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027863+0000","last_change":"2022-07-05T11:46:04.599555+0000","last_active":"2022-07-05T11:46:09.027863+0000","last_peered":"2022-07-05T11:46:09.027863+0000","last_clean":"2022-07-05T11:46:09.027863+0000","last_became_active":"2022-07-05T11:46:04.597036+0000","last_became_peered":"2022-07-05T11:46:04.597036+0000","last_unstale":"2022-07-05T11:46:09.027863+0000","last_undegraded":"2022-07-05T11:46:09.027863+0000","last_fullsized":"2022-07-05T11:46:09.027863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.357392+0000","last_change":"2022-07-05T11:46:04.215037+0000","last_active":"2022-07-05T11:46:21.357392+0000","last_peered":"2022-07-05T11:46:21.357392+0000","last_clean":"2022-07-05T11:46:21.357392+0000","last_became_active":"2022-07-05T11:46:04.214699+0000","last_became_peered":"2022-07-05T11:46:04.214699+0000","last_unstale":"2022-07-05T11:46:21.357392+0000","last_undegraded":"2022-07-05T11:46:21.357392+0000","last_fullsized":"2022-07-05T11:46:21.357392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012966+0000","last_change":"2022-07-05T11:46:00.405416+0000","last_active":"2022-07-05T11:46:09.012966+0000","last_peered":"2022-07-05T11:46:09.012966+0000","last_clean":"2022-07-05T11:46:09.012966+0000","last_became_active":"2022-07-05T11:46:00.405179+0000","last_became_peered":"2022-07-05T11:46:00.405179+0000","last_unstale":"2022-07-05T11:46:09.012966+0000","last_undegraded":"2022-07-05T11:46:09.012966+0000","last_fullsized":"2022-07-05T11:46:09.012966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027570+0000","last_change":"2022-07-05T11:46:08.616541+0000","last_active":"2022-07-05T11:46:09.027570+0000","last_peered":"2022-07-05T11:46:09.027570+0000","last_clean":"2022-07-05T11:46:09.027570+0000","last_became_active":"2022-07-05T11:46:08.616124+0000","last_became_peered":"2022-07-05T11:46:08.616124+0000","last_unstale":"2022-07-05T11:46:09.027570+0000","last_undegraded":"2022-07-05T11:46:09.027570+0000","last_fullsized":"2022-07-05T11:46:09.027570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028425+0000","last_change":"2022-07-05T11:46:04.584095+0000","last_active":"2022-07-05T11:46:09.028425+0000","last_peered":"2022-07-05T11:46:09.028425+0000","last_clean":"2022-07-05T11:46:09.028425+0000","last_became_active":"2022-07-05T11:46:04.583806+0000","last_became_peered":"2022-07-05T11:46:04.583806+0000","last_unstale":"2022-07-05T11:46:09.028425+0000","last_undegraded":"2022-07-05T11:46:09.028425+0000","last_fullsized":"2022-07-05T11:46:09.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974096+0000","last_change":"2022-07-05T11:46:00.174377+0000","last_active":"2022-07-05T11:46:08.974096+0000","last_peered":"2022-07-05T11:46:08.974096+0000","last_clean":"2022-07-05T11:46:08.974096+0000","last_became_active":"2022-07-05T11:46:00.174041+0000","last_became_peered":"2022-07-05T11:46:00.174041+0000","last_unstale":"2022-07-05T11:46:08.974096+0000","last_undegraded":"2022-07-05T11:46:08.974096+0000","last_fullsized":"2022-07-05T11:46:08.974096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029651+0000","last_change":"2022-07-05T11:46:04.201186+0000","last_active":"2022-07-05T11:46:09.029651+0000","last_peered":"2022-07-05T11:46:09.029651+0000","last_clean":"2022-07-05T11:46:09.029651+0000","last_became_active":"2022-07-05T11:46:04.200331+0000","last_became_peered":"2022-07-05T11:46:04.200331+0000","last_unstale":"2022-07-05T11:46:09.029651+0000","last_undegraded":"2022-07-05T11:46:09.029651+0000","last_fullsized":"2022-07-05T11:46:09.029651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012267+0000","last_change":"2022-07-05T11:46:08.617187+0000","last_active":"2022-07-05T11:46:09.012267+0000","last_peered":"2022-07-05T11:46:09.012267+0000","last_clean":"2022-07-05T11:46:09.012267+0000","last_became_active":"2022-07-05T11:46:08.616787+0000","last_became_peered":"2022-07-05T11:46:08.616787+0000","last_unstale":"2022-07-05T11:46:09.012267+0000","last_undegraded":"2022-07-05T11:46:09.012267+0000","last_fullsized":"2022-07-05T11:46:09.012267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974758+0000","last_change":"2022-07-05T11:46:04.595606+0000","last_active":"2022-07-05T11:46:08.974758+0000","last_peered":"2022-07-05T11:46:08.974758+0000","last_clean":"2022-07-05T11:46:08.974758+0000","last_became_active":"2022-07-05T11:46:04.594962+0000","last_became_peered":"2022-07-05T11:46:04.594962+0000","last_unstale":"2022-07-05T11:46:08.974758+0000","last_undegraded":"2022-07-05T11:46:08.974758+0000","last_fullsized":"2022-07-05T11:46:08.974758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028691+0000","last_change":"2022-07-05T11:46:04.208492+0000","last_active":"2022-07-05T11:46:09.028691+0000","last_peered":"2022-07-05T11:46:09.028691+0000","last_clean":"2022-07-05T11:46:09.028691+0000","last_became_active":"2022-07-05T11:46:04.208135+0000","last_became_peered":"2022-07-05T11:46:04.208135+0000","last_unstale":"2022-07-05T11:46:09.028691+0000","last_undegraded":"2022-07-05T11:46:09.028691+0000","last_fullsized":"2022-07-05T11:46:09.028691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028400+0000","last_change":"2022-07-05T11:46:01.122048+0000","last_active":"2022-07-05T11:46:09.028400+0000","last_peered":"2022-07-05T11:46:09.028400+0000","last_clean":"2022-07-05T11:46:09.028400+0000","last_became_active":"2022-07-05T11:46:01.121724+0000","last_became_peered":"2022-07-05T11:46:01.121724+0000","last_unstale":"2022-07-05T11:46:09.028400+0000","last_undegraded":"2022-07-05T11:46:09.028400+0000","last_fullsized":"2022-07-05T11:46:09.028400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029610+0000","last_change":"2022-07-05T11:46:08.614936+0000","last_active":"2022-07-05T11:46:09.029610+0000","last_peered":"2022-07-05T11:46:09.029610+0000","last_clean":"2022-07-05T11:46:09.029610+0000","last_became_active":"2022-07-05T11:46:08.613212+0000","last_became_peered":"2022-07-05T11:46:08.613212+0000","last_unstale":"2022-07-05T11:46:09.029610+0000","last_undegraded":"2022-07-05T11:46:09.029610+0000","last_fullsized":"2022-07-05T11:46:09.029610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358743+0000","last_change":"2022-07-05T11:46:04.207235+0000","last_active":"2022-07-05T11:46:21.358743+0000","last_peered":"2022-07-05T11:46:21.358743+0000","last_clean":"2022-07-05T11:46:21.358743+0000","last_became_active":"2022-07-05T11:46:04.206912+0000","last_became_peered":"2022-07-05T11:46:04.206912+0000","last_unstale":"2022-07-05T11:46:21.358743+0000","last_undegraded":"2022-07-05T11:46:21.358743+0000","last_fullsized":"2022-07-05T11:46:21.358743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027868+0000","last_change":"2022-07-05T11:46:00.387606+0000","last_active":"2022-07-05T11:46:09.027868+0000","last_peered":"2022-07-05T11:46:09.027868+0000","last_clean":"2022-07-05T11:46:09.027868+0000","last_became_active":"2022-07-05T11:46:00.387285+0000","last_became_peered":"2022-07-05T11:46:00.387285+0000","last_unstale":"2022-07-05T11:46:09.027868+0000","last_undegraded":"2022-07-05T11:46:09.027868+0000","last_fullsized":"2022-07-05T11:46:09.027868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975087+0000","last_change":"2022-07-05T11:46:04.597434+0000","last_active":"2022-07-05T11:46:08.975087+0000","last_peered":"2022-07-05T11:46:08.975087+0000","last_clean":"2022-07-05T11:46:08.975087+0000","last_became_active":"2022-07-05T11:46:04.596283+0000","last_became_peered":"2022-07-05T11:46:04.596283+0000","last_unstale":"2022-07-05T11:46:08.975087+0000","last_undegraded":"2022-07-05T11:46:08.975087+0000","last_fullsized":"2022-07-05T11:46:08.975087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030525+0000","last_change":"2022-07-05T11:46:08.618008+0000","last_active":"2022-07-05T11:46:09.030525+0000","last_peered":"2022-07-05T11:46:09.030525+0000","last_clean":"2022-07-05T11:46:09.030525+0000","last_became_active":"2022-07-05T11:46:08.617640+0000","last_became_peered":"2022-07-05T11:46:08.617640+0000","last_unstale":"2022-07-05T11:46:09.030525+0000","last_undegraded":"2022-07-05T11:46:09.030525+0000","last_fullsized":"2022-07-05T11:46:09.030525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407205+0000","last_change":"2022-07-05T11:46:04.205557+0000","last_active":"2022-07-05T11:46:10.407205+0000","last_peered":"2022-07-05T11:46:10.407205+0000","last_clean":"2022-07-05T11:46:10.407205+0000","last_became_active":"2022-07-05T11:46:04.203760+0000","last_became_peered":"2022-07-05T11:46:04.203760+0000","last_unstale":"2022-07-05T11:46:10.407205+0000","last_undegraded":"2022-07-05T11:46:10.407205+0000","last_fullsized":"2022-07-05T11:46:10.407205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027789+0000","last_change":"2022-07-05T11:45:58.489958+0000","last_active":"2022-07-05T11:46:09.027789+0000","last_peered":"2022-07-05T11:46:09.027789+0000","last_clean":"2022-07-05T11:46:09.027789+0000","last_became_active":"2022-07-05T11:45:58.489710+0000","last_became_peered":"2022-07-05T11:45:58.489710+0000","last_unstale":"2022-07-05T11:46:09.027789+0000","last_undegraded":"2022-07-05T11:46:09.027789+0000","last_fullsized":"2022-07-05T11:46:09.027789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_clean_scrub_stamp":"2022-07-05T11:45:57.143009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012518+0000","last_change":"2022-07-05T11:46:01.154008+0000","last_active":"2022-07-05T11:46:09.012518+0000","last_peered":"2022-07-05T11:46:09.012518+0000","last_clean":"2022-07-05T11:46:09.012518+0000","last_became_active":"2022-07-05T11:46:01.153653+0000","last_became_peered":"2022-07-05T11:46:01.153653+0000","last_unstale":"2022-07-05T11:46:09.012518+0000","last_undegraded":"2022-07-05T11:46:09.012518+0000","last_fullsized":"2022-07-05T11:46:09.012518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029959+0000","last_change":"2022-07-05T11:46:04.597444+0000","last_active":"2022-07-05T11:46:09.029959+0000","last_peered":"2022-07-05T11:46:09.029959+0000","last_clean":"2022-07-05T11:46:09.029959+0000","last_became_active":"2022-07-05T11:46:04.597199+0000","last_became_peered":"2022-07-05T11:46:04.597199+0000","last_unstale":"2022-07-05T11:46:09.029959+0000","last_undegraded":"2022-07-05T11:46:09.029959+0000","last_fullsized":"2022-07-05T11:46:09.029959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028215+0000","last_change":"2022-07-05T11:46:09.017084+0000","last_active":"2022-07-05T11:46:09.028215+0000","last_peered":"2022-07-05T11:46:09.028215+0000","last_clean":"2022-07-05T11:46:09.028215+0000","last_became_active":"2022-07-05T11:46:09.016658+0000","last_became_peered":"2022-07-05T11:46:09.016658+0000","last_unstale":"2022-07-05T11:46:09.028215+0000","last_undegraded":"2022-07-05T11:46:09.028215+0000","last_fullsized":"2022-07-05T11:46:09.028215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358568+0000","last_change":"2022-07-05T11:46:04.209767+0000","last_active":"2022-07-05T11:46:21.358568+0000","last_peered":"2022-07-05T11:46:21.358568+0000","last_clean":"2022-07-05T11:46:21.358568+0000","last_became_active":"2022-07-05T11:46:04.209524+0000","last_became_peered":"2022-07-05T11:46:04.209524+0000","last_unstale":"2022-07-05T11:46:21.358568+0000","last_undegraded":"2022-07-05T11:46:21.358568+0000","last_fullsized":"2022-07-05T11:46:21.358568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028541+0000","last_change":"2022-07-05T11:46:01.118061+0000","last_active":"2022-07-05T11:46:09.028541+0000","last_peered":"2022-07-05T11:46:09.028541+0000","last_clean":"2022-07-05T11:46:09.028541+0000","last_became_active":"2022-07-05T11:46:01.117762+0000","last_became_peered":"2022-07-05T11:46:01.117762+0000","last_unstale":"2022-07-05T11:46:09.028541+0000","last_undegraded":"2022-07-05T11:46:09.028541+0000","last_fullsized":"2022-07-05T11:46:09.028541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028916+0000","last_change":"2022-07-05T11:46:04.594377+0000","last_active":"2022-07-05T11:46:09.028916+0000","last_peered":"2022-07-05T11:46:09.028916+0000","last_clean":"2022-07-05T11:46:09.028916+0000","last_became_active":"2022-07-05T11:46:04.594103+0000","last_became_peered":"2022-07-05T11:46:04.594103+0000","last_unstale":"2022-07-05T11:46:09.028916+0000","last_undegraded":"2022-07-05T11:46:09.028916+0000","last_fullsized":"2022-07-05T11:46:09.028916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017137+0000","last_change":"2022-07-05T11:46:09.014687+0000","last_active":"2022-07-05T11:46:09.017137+0000","last_peered":"2022-07-05T11:46:09.017137+0000","last_clean":"2022-07-05T11:46:09.017137+0000","last_became_active":"2022-07-05T11:46:09.014298+0000","last_became_peered":"2022-07-05T11:46:09.014298+0000","last_unstale":"2022-07-05T11:46:09.017137+0000","last_undegraded":"2022-07-05T11:46:09.017137+0000","last_fullsized":"2022-07-05T11:46:09.017137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028627+0000","last_change":"2022-07-05T11:46:04.593068+0000","last_active":"2022-07-05T11:46:09.028627+0000","last_peered":"2022-07-05T11:46:09.028627+0000","last_clean":"2022-07-05T11:46:09.028627+0000","last_became_active":"2022-07-05T11:46:04.592770+0000","last_became_peered":"2022-07-05T11:46:04.592770+0000","last_unstale":"2022-07-05T11:46:09.028627+0000","last_undegraded":"2022-07-05T11:46:09.028627+0000","last_fullsized":"2022-07-05T11:46:09.028627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:22.362211+0000","last_change":"2022-07-05T11:46:04.205846+0000","last_active":"2022-07-05T11:46:22.362211+0000","last_peered":"2022-07-05T11:46:22.362211+0000","last_clean":"2022-07-05T11:46:22.362211+0000","last_became_active":"2022-07-05T11:46:04.205358+0000","last_became_peered":"2022-07-05T11:46:04.205358+0000","last_unstale":"2022-07-05T11:46:22.362211+0000","last_undegraded":"2022-07-05T11:46:22.362211+0000","last_fullsized":"2022-07-05T11:46:22.362211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028856+0000","last_change":"2022-07-05T11:46:00.171709+0000","last_active":"2022-07-05T11:46:09.028856+0000","last_peered":"2022-07-05T11:46:09.028856+0000","last_clean":"2022-07-05T11:46:09.028856+0000","last_became_active":"2022-07-05T11:46:00.171328+0000","last_became_peered":"2022-07-05T11:46:00.171328+0000","last_unstale":"2022-07-05T11:46:09.028856+0000","last_undegraded":"2022-07-05T11:46:09.028856+0000","last_fullsized":"2022-07-05T11:46:09.028856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017640+0000","last_change":"2022-07-05T11:46:09.015332+0000","last_active":"2022-07-05T11:46:09.017640+0000","last_peered":"2022-07-05T11:46:09.017640+0000","last_clean":"2022-07-05T11:46:09.017640+0000","last_became_active":"2022-07-05T11:46:09.013688+0000","last_became_peered":"2022-07-05T11:46:09.013688+0000","last_unstale":"2022-07-05T11:46:09.017640+0000","last_undegraded":"2022-07-05T11:46:09.017640+0000","last_fullsized":"2022-07-05T11:46:09.017640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028419+0000","last_change":"2022-07-05T11:46:04.600986+0000","last_active":"2022-07-05T11:46:09.028419+0000","last_peered":"2022-07-05T11:46:09.028419+0000","last_clean":"2022-07-05T11:46:09.028419+0000","last_became_active":"2022-07-05T11:46:04.600619+0000","last_became_peered":"2022-07-05T11:46:04.600619+0000","last_unstale":"2022-07-05T11:46:09.028419+0000","last_undegraded":"2022-07-05T11:46:09.028419+0000","last_fullsized":"2022-07-05T11:46:09.028419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030201+0000","last_change":"2022-07-05T11:46:04.201044+0000","last_active":"2022-07-05T11:46:09.030201+0000","last_peered":"2022-07-05T11:46:09.030201+0000","last_clean":"2022-07-05T11:46:09.030201+0000","last_became_active":"2022-07-05T11:46:04.200743+0000","last_became_peered":"2022-07-05T11:46:04.200743+0000","last_unstale":"2022-07-05T11:46:09.030201+0000","last_undegraded":"2022-07-05T11:46:09.030201+0000","last_fullsized":"2022-07-05T11:46:09.030201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974024+0000","last_change":"2022-07-05T11:46:00.406891+0000","last_active":"2022-07-05T11:46:08.974024+0000","last_peered":"2022-07-05T11:46:08.974024+0000","last_clean":"2022-07-05T11:46:08.974024+0000","last_became_active":"2022-07-05T11:46:00.406555+0000","last_became_peered":"2022-07-05T11:46:00.406555+0000","last_unstale":"2022-07-05T11:46:08.974024+0000","last_undegraded":"2022-07-05T11:46:08.974024+0000","last_fullsized":"2022-07-05T11:46:08.974024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027228+0000","last_change":"2022-07-05T11:46:09.014076+0000","last_active":"2022-07-05T11:46:09.027228+0000","last_peered":"2022-07-05T11:46:09.027228+0000","last_clean":"2022-07-05T11:46:09.027228+0000","last_became_active":"2022-07-05T11:46:09.013674+0000","last_became_peered":"2022-07-05T11:46:09.013674+0000","last_unstale":"2022-07-05T11:46:09.027228+0000","last_undegraded":"2022-07-05T11:46:09.027228+0000","last_fullsized":"2022-07-05T11:46:09.027228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974896+0000","last_change":"2022-07-05T11:46:04.204890+0000","last_active":"2022-07-05T11:46:08.974896+0000","last_peered":"2022-07-05T11:46:08.974896+0000","last_clean":"2022-07-05T11:46:08.974896+0000","last_became_active":"2022-07-05T11:46:04.204615+0000","last_became_peered":"2022-07-05T11:46:04.204615+0000","last_unstale":"2022-07-05T11:46:08.974896+0000","last_undegraded":"2022-07-05T11:46:08.974896+0000","last_fullsized":"2022-07-05T11:46:08.974896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974109+0000","last_change":"2022-07-05T11:46:04.592359+0000","last_active":"2022-07-05T11:46:08.974109+0000","last_peered":"2022-07-05T11:46:08.974109+0000","last_clean":"2022-07-05T11:46:08.974109+0000","last_became_active":"2022-07-05T11:46:04.592112+0000","last_became_peered":"2022-07-05T11:46:04.592112+0000","last_unstale":"2022-07-05T11:46:08.974109+0000","last_undegraded":"2022-07-05T11:46:08.974109+0000","last_fullsized":"2022-07-05T11:46:08.974109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027403+0000","last_change":"2022-07-05T11:46:09.016814+0000","last_active":"2022-07-05T11:46:09.027403+0000","last_peered":"2022-07-05T11:46:09.027403+0000","last_clean":"2022-07-05T11:46:09.027403+0000","last_became_active":"2022-07-05T11:46:09.016282+0000","last_became_peered":"2022-07-05T11:46:09.016282+0000","last_unstale":"2022-07-05T11:46:09.027403+0000","last_undegraded":"2022-07-05T11:46:09.027403+0000","last_fullsized":"2022-07-05T11:46:09.027403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353211+0000","last_change":"2022-07-05T11:46:04.199484+0000","last_active":"2022-07-05T11:46:20.353211+0000","last_peered":"2022-07-05T11:46:20.353211+0000","last_clean":"2022-07-05T11:46:20.353211+0000","last_became_active":"2022-07-05T11:46:04.199190+0000","last_became_peered":"2022-07-05T11:46:04.199190+0000","last_unstale":"2022-07-05T11:46:20.353211+0000","last_undegraded":"2022-07-05T11:46:20.353211+0000","last_fullsized":"2022-07-05T11:46:20.353211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012845+0000","last_change":"2022-07-05T11:46:04.594175+0000","last_active":"2022-07-05T11:46:09.012845+0000","last_peered":"2022-07-05T11:46:09.012845+0000","last_clean":"2022-07-05T11:46:09.012845+0000","last_became_active":"2022-07-05T11:46:04.593700+0000","last_became_peered":"2022-07-05T11:46:04.593700+0000","last_unstale":"2022-07-05T11:46:09.012845+0000","last_undegraded":"2022-07-05T11:46:09.012845+0000","last_fullsized":"2022-07-05T11:46:09.012845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013139+0000","last_change":"2022-07-05T11:46:08.614509+0000","last_active":"2022-07-05T11:46:09.013139+0000","last_peered":"2022-07-05T11:46:09.013139+0000","last_clean":"2022-07-05T11:46:09.013139+0000","last_became_active":"2022-07-05T11:46:08.613935+0000","last_became_peered":"2022-07-05T11:46:08.613935+0000","last_unstale":"2022-07-05T11:46:09.013139+0000","last_undegraded":"2022-07-05T11:46:09.013139+0000","last_fullsized":"2022-07-05T11:46:09.013139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028943+0000","last_change":"2022-07-05T11:46:04.210344+0000","last_active":"2022-07-05T11:46:09.028943+0000","last_peered":"2022-07-05T11:46:09.028943+0000","last_clean":"2022-07-05T11:46:09.028943+0000","last_became_active":"2022-07-05T11:46:04.210054+0000","last_became_peered":"2022-07-05T11:46:04.210054+0000","last_unstale":"2022-07-05T11:46:09.028943+0000","last_undegraded":"2022-07-05T11:46:09.028943+0000","last_fullsized":"2022-07-05T11:46:09.028943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013018+0000","last_change":"2022-07-05T11:46:04.601851+0000","last_active":"2022-07-05T11:46:09.013018+0000","last_peered":"2022-07-05T11:46:09.013018+0000","last_clean":"2022-07-05T11:46:09.013018+0000","last_became_active":"2022-07-05T11:46:04.601528+0000","last_became_peered":"2022-07-05T11:46:04.601528+0000","last_unstale":"2022-07-05T11:46:09.013018+0000","last_undegraded":"2022-07-05T11:46:09.013018+0000","last_fullsized":"2022-07-05T11:46:09.013018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029283+0000","last_change":"2022-07-05T11:46:08.613389+0000","last_active":"2022-07-05T11:46:09.029283+0000","last_peered":"2022-07-05T11:46:09.029283+0000","last_clean":"2022-07-05T11:46:09.029283+0000","last_became_active":"2022-07-05T11:46:08.612988+0000","last_became_peered":"2022-07-05T11:46:08.612988+0000","last_unstale":"2022-07-05T11:46:09.029283+0000","last_undegraded":"2022-07-05T11:46:09.029283+0000","last_fullsized":"2022-07-05T11:46:09.029283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407358+0000","last_change":"2022-07-05T11:46:04.203173+0000","last_active":"2022-07-05T11:46:10.407358+0000","last_peered":"2022-07-05T11:46:10.407358+0000","last_clean":"2022-07-05T11:46:10.407358+0000","last_became_active":"2022-07-05T11:46:04.202879+0000","last_became_peered":"2022-07-05T11:46:04.202879+0000","last_unstale":"2022-07-05T11:46:10.407358+0000","last_undegraded":"2022-07-05T11:46:10.407358+0000","last_fullsized":"2022-07-05T11:46:10.407358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013005+0000","last_change":"2022-07-05T11:46:04.593203+0000","last_active":"2022-07-05T11:46:09.013005+0000","last_peered":"2022-07-05T11:46:09.013005+0000","last_clean":"2022-07-05T11:46:09.013005+0000","last_became_active":"2022-07-05T11:46:04.592953+0000","last_became_peered":"2022-07-05T11:46:04.592953+0000","last_unstale":"2022-07-05T11:46:09.013005+0000","last_undegraded":"2022-07-05T11:46:09.013005+0000","last_fullsized":"2022-07-05T11:46:09.013005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975419+0000","last_change":"2022-07-05T11:46:08.617348+0000","last_active":"2022-07-05T11:46:08.975419+0000","last_peered":"2022-07-05T11:46:08.975419+0000","last_clean":"2022-07-05T11:46:08.975419+0000","last_became_active":"2022-07-05T11:46:08.616964+0000","last_became_peered":"2022-07-05T11:46:08.616964+0000","last_unstale":"2022-07-05T11:46:08.975419+0000","last_undegraded":"2022-07-05T11:46:08.975419+0000","last_fullsized":"2022-07-05T11:46:08.975419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.213520+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.213132+0000","last_became_peered":"2022-07-05T11:46:04.213132+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027579+0000","last_change":"2022-07-05T11:46:04.589449+0000","last_active":"2022-07-05T11:46:09.027579+0000","last_peered":"2022-07-05T11:46:09.027579+0000","last_clean":"2022-07-05T11:46:09.027579+0000","last_became_active":"2022-07-05T11:46:04.589174+0000","last_became_peered":"2022-07-05T11:46:04.589174+0000","last_unstale":"2022-07-05T11:46:09.027579+0000","last_undegraded":"2022-07-05T11:46:09.027579+0000","last_fullsized":"2022-07-05T11:46:09.027579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027455+0000","last_change":"2022-07-05T11:46:08.617763+0000","last_active":"2022-07-05T11:46:09.027455+0000","last_peered":"2022-07-05T11:46:09.027455+0000","last_clean":"2022-07-05T11:46:09.027455+0000","last_became_active":"2022-07-05T11:46:08.617423+0000","last_became_peered":"2022-07-05T11:46:08.617423+0000","last_unstale":"2022-07-05T11:46:09.027455+0000","last_undegraded":"2022-07-05T11:46:09.027455+0000","last_fullsized":"2022-07-05T11:46:09.027455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030147+0000","last_change":"2022-07-05T11:46:04.211055+0000","last_active":"2022-07-05T11:46:09.030147+0000","last_peered":"2022-07-05T11:46:09.030147+0000","last_clean":"2022-07-05T11:46:09.030147+0000","last_became_active":"2022-07-05T11:46:04.210609+0000","last_became_peered":"2022-07-05T11:46:04.210609+0000","last_unstale":"2022-07-05T11:46:09.030147+0000","last_undegraded":"2022-07-05T11:46:09.030147+0000","last_fullsized":"2022-07-05T11:46:09.030147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028195+0000","last_change":"2022-07-05T11:46:04.583067+0000","last_active":"2022-07-05T11:46:09.028195+0000","last_peered":"2022-07-05T11:46:09.028195+0000","last_clean":"2022-07-05T11:46:09.028195+0000","last_became_active":"2022-07-05T11:46:04.582776+0000","last_became_peered":"2022-07-05T11:46:04.582776+0000","last_unstale":"2022-07-05T11:46:09.028195+0000","last_undegraded":"2022-07-05T11:46:09.028195+0000","last_fullsized":"2022-07-05T11:46:09.028195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975477+0000","last_change":"2022-07-05T11:46:08.619668+0000","last_active":"2022-07-05T11:46:08.975477+0000","last_peered":"2022-07-05T11:46:08.975477+0000","last_clean":"2022-07-05T11:46:08.975477+0000","last_became_active":"2022-07-05T11:46:08.619010+0000","last_became_peered":"2022-07-05T11:46:08.619010+0000","last_unstale":"2022-07-05T11:46:08.975477+0000","last_undegraded":"2022-07-05T11:46:08.975477+0000","last_fullsized":"2022-07-05T11:46:08.975477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975957+0000","last_change":"2022-07-05T11:46:04.202962+0000","last_active":"2022-07-05T11:46:08.975957+0000","last_peered":"2022-07-05T11:46:08.975957+0000","last_clean":"2022-07-05T11:46:08.975957+0000","last_became_active":"2022-07-05T11:46:04.202639+0000","last_became_peered":"2022-07-05T11:46:04.202639+0000","last_unstale":"2022-07-05T11:46:08.975957+0000","last_undegraded":"2022-07-05T11:46:08.975957+0000","last_fullsized":"2022-07-05T11:46:08.975957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975054+0000","last_change":"2022-07-05T11:46:04.595796+0000","last_active":"2022-07-05T11:46:08.975054+0000","last_peered":"2022-07-05T11:46:08.975054+0000","last_clean":"2022-07-05T11:46:08.975054+0000","last_became_active":"2022-07-05T11:46:04.595457+0000","last_became_peered":"2022-07-05T11:46:04.595457+0000","last_unstale":"2022-07-05T11:46:08.975054+0000","last_undegraded":"2022-07-05T11:46:08.975054+0000","last_fullsized":"2022-07-05T11:46:08.975054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027470+0000","last_change":"2022-07-05T11:46:08.617306+0000","last_active":"2022-07-05T11:46:09.027470+0000","last_peered":"2022-07-05T11:46:09.027470+0000","last_clean":"2022-07-05T11:46:09.027470+0000","last_became_active":"2022-07-05T11:46:08.616927+0000","last_became_peered":"2022-07-05T11:46:08.616927+0000","last_unstale":"2022-07-05T11:46:09.027470+0000","last_undegraded":"2022-07-05T11:46:09.027470+0000","last_fullsized":"2022-07-05T11:46:09.027470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.171485+0000","last_change":"2022-07-05T11:46:04.205780+0000","last_active":"2022-07-05T11:46:10.171485+0000","last_peered":"2022-07-05T11:46:10.171485+0000","last_clean":"2022-07-05T11:46:10.171485+0000","last_became_active":"2022-07-05T11:46:04.205486+0000","last_became_peered":"2022-07-05T11:46:04.205486+0000","last_unstale":"2022-07-05T11:46:10.171485+0000","last_undegraded":"2022-07-05T11:46:10.171485+0000","last_fullsized":"2022-07-05T11:46:10.171485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974611+0000","last_change":"2022-07-05T11:46:04.606819+0000","last_active":"2022-07-05T11:46:08.974611+0000","last_peered":"2022-07-05T11:46:08.974611+0000","last_clean":"2022-07-05T11:46:08.974611+0000","last_became_active":"2022-07-05T11:46:04.606484+0000","last_became_peered":"2022-07-05T11:46:04.606484+0000","last_unstale":"2022-07-05T11:46:08.974611+0000","last_undegraded":"2022-07-05T11:46:08.974611+0000","last_fullsized":"2022-07-05T11:46:08.974611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028555+0000","last_change":"2022-07-05T11:46:08.617224+0000","last_active":"2022-07-05T11:46:09.028555+0000","last_peered":"2022-07-05T11:46:09.028555+0000","last_clean":"2022-07-05T11:46:09.028555+0000","last_became_active":"2022-07-05T11:46:08.616821+0000","last_became_peered":"2022-07-05T11:46:08.616821+0000","last_unstale":"2022-07-05T11:46:09.028555+0000","last_undegraded":"2022-07-05T11:46:09.028555+0000","last_fullsized":"2022-07-05T11:46:09.028555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.170891+0000","last_change":"2022-07-05T11:46:04.204034+0000","last_active":"2022-07-05T11:46:10.170891+0000","last_peered":"2022-07-05T11:46:10.170891+0000","last_clean":"2022-07-05T11:46:10.170891+0000","last_became_active":"2022-07-05T11:46:04.203694+0000","last_became_peered":"2022-07-05T11:46:04.203694+0000","last_unstale":"2022-07-05T11:46:10.170891+0000","last_undegraded":"2022-07-05T11:46:10.170891+0000","last_fullsized":"2022-07-05T11:46:10.170891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974125+0000","last_change":"2022-07-05T11:46:04.593441+0000","last_active":"2022-07-05T11:46:08.974125+0000","last_peered":"2022-07-05T11:46:08.974125+0000","last_clean":"2022-07-05T11:46:08.974125+0000","last_became_active":"2022-07-05T11:46:04.593175+0000","last_became_peered":"2022-07-05T11:46:04.593175+0000","last_unstale":"2022-07-05T11:46:08.974125+0000","last_undegraded":"2022-07-05T11:46:08.974125+0000","last_fullsized":"2022-07-05T11:46:08.974125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028366+0000","last_change":"2022-07-05T11:46:09.016544+0000","last_active":"2022-07-05T11:46:09.028366+0000","last_peered":"2022-07-05T11:46:09.028366+0000","last_clean":"2022-07-05T11:46:09.028366+0000","last_became_active":"2022-07-05T11:46:09.016045+0000","last_became_peered":"2022-07-05T11:46:09.016045+0000","last_unstale":"2022-07-05T11:46:09.028366+0000","last_undegraded":"2022-07-05T11:46:09.028366+0000","last_fullsized":"2022-07-05T11:46:09.028366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'3","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371602+0000","last_change":"2022-07-05T11:46:04.207209+0000","last_active":"2022-07-05T11:46:25.371602+0000","last_peered":"2022-07-05T11:46:25.371602+0000","last_clean":"2022-07-05T11:46:25.371602+0000","last_became_active":"2022-07-05T11:46:04.206333+0000","last_became_peered":"2022-07-05T11:46:04.206333+0000","last_unstale":"2022-07-05T11:46:25.371602+0000","last_undegraded":"2022-07-05T11:46:25.371602+0000","last_fullsized":"2022-07-05T11:46:25.371602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029985+0000","last_change":"2022-07-05T11:46:04.591635+0000","last_active":"2022-07-05T11:46:09.029985+0000","last_peered":"2022-07-05T11:46:09.029985+0000","last_clean":"2022-07-05T11:46:09.029985+0000","last_became_active":"2022-07-05T11:46:04.591370+0000","last_became_peered":"2022-07-05T11:46:04.591370+0000","last_unstale":"2022-07-05T11:46:09.029985+0000","last_undegraded":"2022-07-05T11:46:09.029985+0000","last_fullsized":"2022-07-05T11:46:09.029985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029798+0000","last_change":"2022-07-05T11:46:08.617287+0000","last_active":"2022-07-05T11:46:09.029798+0000","last_peered":"2022-07-05T11:46:09.029798+0000","last_clean":"2022-07-05T11:46:09.029798+0000","last_became_active":"2022-07-05T11:46:08.616929+0000","last_became_peered":"2022-07-05T11:46:08.616929+0000","last_unstale":"2022-07-05T11:46:09.029798+0000","last_undegraded":"2022-07-05T11:46:09.029798+0000","last_fullsized":"2022-07-05T11:46:09.029798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352160+0000","last_change":"2022-07-05T11:46:04.207520+0000","last_active":"2022-07-05T11:46:20.352160+0000","last_peered":"2022-07-05T11:46:20.352160+0000","last_clean":"2022-07-05T11:46:20.352160+0000","last_became_active":"2022-07-05T11:46:04.207167+0000","last_became_peered":"2022-07-05T11:46:04.207167+0000","last_unstale":"2022-07-05T11:46:20.352160+0000","last_undegraded":"2022-07-05T11:46:20.352160+0000","last_fullsized":"2022-07-05T11:46:20.352160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975400+0000","last_change":"2022-07-05T11:46:04.606473+0000","last_active":"2022-07-05T11:46:08.975400+0000","last_peered":"2022-07-05T11:46:08.975400+0000","last_clean":"2022-07-05T11:46:08.975400+0000","last_became_active":"2022-07-05T11:46:04.606183+0000","last_became_peered":"2022-07-05T11:46:04.606183+0000","last_unstale":"2022-07-05T11:46:08.975400+0000","last_undegraded":"2022-07-05T11:46:08.975400+0000","last_fullsized":"2022-07-05T11:46:08.975400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029169+0000","last_change":"2022-07-05T11:46:08.615322+0000","last_active":"2022-07-05T11:46:09.029169+0000","last_peered":"2022-07-05T11:46:09.029169+0000","last_clean":"2022-07-05T11:46:09.029169+0000","last_became_active":"2022-07-05T11:46:08.614916+0000","last_became_peered":"2022-07-05T11:46:08.614916+0000","last_unstale":"2022-07-05T11:46:09.029169+0000","last_undegraded":"2022-07-05T11:46:09.029169+0000","last_fullsized":"2022-07-05T11:46:09.029169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352984+0000","last_change":"2022-07-05T11:46:04.207417+0000","last_active":"2022-07-05T11:46:20.352984+0000","last_peered":"2022-07-05T11:46:20.352984+0000","last_clean":"2022-07-05T11:46:20.352984+0000","last_became_active":"2022-07-05T11:46:04.207078+0000","last_became_peered":"2022-07-05T11:46:04.207078+0000","last_unstale":"2022-07-05T11:46:20.352984+0000","last_undegraded":"2022-07-05T11:46:20.352984+0000","last_fullsized":"2022-07-05T11:46:20.352984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976049+0000","last_change":"2022-07-05T11:46:04.597152+0000","last_active":"2022-07-05T11:46:08.976049+0000","last_peered":"2022-07-05T11:46:08.976049+0000","last_clean":"2022-07-05T11:46:08.976049+0000","last_became_active":"2022-07-05T11:46:04.596847+0000","last_became_peered":"2022-07-05T11:46:04.596847+0000","last_unstale":"2022-07-05T11:46:08.976049+0000","last_undegraded":"2022-07-05T11:46:08.976049+0000","last_fullsized":"2022-07-05T11:46:08.976049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029455+0000","last_change":"2022-07-05T11:46:08.615281+0000","last_active":"2022-07-05T11:46:09.029455+0000","last_peered":"2022-07-05T11:46:09.029455+0000","last_clean":"2022-07-05T11:46:09.029455+0000","last_became_active":"2022-07-05T11:46:08.614859+0000","last_became_peered":"2022-07-05T11:46:08.614859+0000","last_unstale":"2022-07-05T11:46:09.029455+0000","last_undegraded":"2022-07-05T11:46:09.029455+0000","last_fullsized":"2022-07-05T11:46:09.029455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.369437+0000","last_change":"2022-07-05T11:46:04.209548+0000","last_active":"2022-07-05T11:46:25.369437+0000","last_peered":"2022-07-05T11:46:25.369437+0000","last_clean":"2022-07-05T11:46:25.369437+0000","last_became_active":"2022-07-05T11:46:04.209278+0000","last_became_peered":"2022-07-05T11:46:04.209278+0000","last_unstale":"2022-07-05T11:46:25.369437+0000","last_undegraded":"2022-07-05T11:46:25.369437+0000","last_fullsized":"2022-07-05T11:46:25.369437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012545+0000","last_change":"2022-07-05T11:46:04.601803+0000","last_active":"2022-07-05T11:46:09.012545+0000","last_peered":"2022-07-05T11:46:09.012545+0000","last_clean":"2022-07-05T11:46:09.012545+0000","last_became_active":"2022-07-05T11:46:04.601475+0000","last_became_peered":"2022-07-05T11:46:04.601475+0000","last_unstale":"2022-07-05T11:46:09.012545+0000","last_undegraded":"2022-07-05T11:46:09.012545+0000","last_fullsized":"2022-07-05T11:46:09.012545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028752+0000","last_change":"2022-07-05T11:46:08.617939+0000","last_active":"2022-07-05T11:46:09.028752+0000","last_peered":"2022-07-05T11:46:09.028752+0000","last_clean":"2022-07-05T11:46:09.028752+0000","last_became_active":"2022-07-05T11:46:08.617538+0000","last_became_peered":"2022-07-05T11:46:08.617538+0000","last_unstale":"2022-07-05T11:46:09.028752+0000","last_undegraded":"2022-07-05T11:46:09.028752+0000","last_fullsized":"2022-07-05T11:46:09.028752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352085+0000","last_change":"2022-07-05T11:46:04.199561+0000","last_active":"2022-07-05T11:46:20.352085+0000","last_peered":"2022-07-05T11:46:20.352085+0000","last_clean":"2022-07-05T11:46:20.352085+0000","last_became_active":"2022-07-05T11:46:04.199232+0000","last_became_peered":"2022-07-05T11:46:04.199232+0000","last_unstale":"2022-07-05T11:46:20.352085+0000","last_undegraded":"2022-07-05T11:46:20.352085+0000","last_fullsized":"2022-07-05T11:46:20.352085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973881+0000","last_change":"2022-07-05T11:46:04.601813+0000","last_active":"2022-07-05T11:46:08.973881+0000","last_peered":"2022-07-05T11:46:08.973881+0000","last_clean":"2022-07-05T11:46:08.973881+0000","last_became_active":"2022-07-05T11:46:04.601595+0000","last_became_peered":"2022-07-05T11:46:04.601595+0000","last_unstale":"2022-07-05T11:46:08.973881+0000","last_undegraded":"2022-07-05T11:46:08.973881+0000","last_fullsized":"2022-07-05T11:46:08.973881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975282+0000","last_change":"2022-07-05T11:46:08.621246+0000","last_active":"2022-07-05T11:46:08.975282+0000","last_peered":"2022-07-05T11:46:08.975282+0000","last_clean":"2022-07-05T11:46:08.975282+0000","last_became_active":"2022-07-05T11:46:08.620839+0000","last_became_peered":"2022-07-05T11:46:08.620839+0000","last_unstale":"2022-07-05T11:46:08.975282+0000","last_undegraded":"2022-07-05T11:46:08.975282+0000","last_fullsized":"2022-07-05T11:46:08.975282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029752+0000","last_change":"2022-07-05T11:46:04.204062+0000","last_active":"2022-07-05T11:46:09.029752+0000","last_peered":"2022-07-05T11:46:09.029752+0000","last_clean":"2022-07-05T11:46:09.029752+0000","last_became_active":"2022-07-05T11:46:04.203763+0000","last_became_peered":"2022-07-05T11:46:04.203763+0000","last_unstale":"2022-07-05T11:46:09.029752+0000","last_undegraded":"2022-07-05T11:46:09.029752+0000","last_fullsized":"2022-07-05T11:46:09.029752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029094+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.029094+0000","last_peered":"2022-07-05T11:46:09.029094+0000","last_clean":"2022-07-05T11:46:09.029094+0000","last_became_active":"2022-07-05T11:46:04.595288+0000","last_became_peered":"2022-07-05T11:46:04.595288+0000","last_unstale":"2022-07-05T11:46:09.029094+0000","last_undegraded":"2022-07-05T11:46:09.029094+0000","last_fullsized":"2022-07-05T11:46:09.029094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027709+0000","last_change":"2022-07-05T11:46:08.617183+0000","last_active":"2022-07-05T11:46:09.027709+0000","last_peered":"2022-07-05T11:46:09.027709+0000","last_clean":"2022-07-05T11:46:09.027709+0000","last_became_active":"2022-07-05T11:46:08.616762+0000","last_became_peered":"2022-07-05T11:46:08.616762+0000","last_unstale":"2022-07-05T11:46:09.027709+0000","last_undegraded":"2022-07-05T11:46:09.027709+0000","last_fullsized":"2022-07-05T11:46:09.027709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371041+0000","last_change":"2022-07-05T11:46:04.206938+0000","last_active":"2022-07-05T11:46:25.371041+0000","last_peered":"2022-07-05T11:46:25.371041+0000","last_clean":"2022-07-05T11:46:25.371041+0000","last_became_active":"2022-07-05T11:46:04.206676+0000","last_became_peered":"2022-07-05T11:46:04.206676+0000","last_unstale":"2022-07-05T11:46:25.371041+0000","last_undegraded":"2022-07-05T11:46:25.371041+0000","last_fullsized":"2022-07-05T11:46:25.371041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973848+0000","last_change":"2022-07-05T11:46:04.589404+0000","last_active":"2022-07-05T11:46:08.973848+0000","last_peered":"2022-07-05T11:46:08.973848+0000","last_clean":"2022-07-05T11:46:08.973848+0000","last_became_active":"2022-07-05T11:46:04.589158+0000","last_became_peered":"2022-07-05T11:46:04.589158+0000","last_unstale":"2022-07-05T11:46:08.973848+0000","last_undegraded":"2022-07-05T11:46:08.973848+0000","last_fullsized":"2022-07-05T11:46:08.973848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028490+0000","last_change":"2022-07-05T11:46:08.619220+0000","last_active":"2022-07-05T11:46:09.028490+0000","last_peered":"2022-07-05T11:46:09.028490+0000","last_clean":"2022-07-05T11:46:09.028490+0000","last_became_active":"2022-07-05T11:46:08.618815+0000","last_became_peered":"2022-07-05T11:46:08.618815+0000","last_unstale":"2022-07-05T11:46:09.028490+0000","last_undegraded":"2022-07-05T11:46:09.028490+0000","last_fullsized":"2022-07-05T11:46:09.028490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974161+0000","last_change":"2022-07-05T11:46:08.617688+0000","last_active":"2022-07-05T11:46:08.974161+0000","last_peered":"2022-07-05T11:46:08.974161+0000","last_clean":"2022-07-05T11:46:08.974161+0000","last_became_active":"2022-07-05T11:46:08.617331+0000","last_became_peered":"2022-07-05T11:46:08.617331+0000","last_unstale":"2022-07-05T11:46:08.974161+0000","last_undegraded":"2022-07-05T11:46:08.974161+0000","last_fullsized":"2022-07-05T11:46:08.974161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029067+0000","last_change":"2022-07-05T11:46:04.199672+0000","last_active":"2022-07-05T11:46:09.029067+0000","last_peered":"2022-07-05T11:46:09.029067+0000","last_clean":"2022-07-05T11:46:09.029067+0000","last_became_active":"2022-07-05T11:46:04.199366+0000","last_became_peered":"2022-07-05T11:46:04.199366+0000","last_unstale":"2022-07-05T11:46:09.029067+0000","last_undegraded":"2022-07-05T11:46:09.029067+0000","last_fullsized":"2022-07-05T11:46:09.029067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976202+0000","last_change":"2022-07-05T11:46:04.598274+0000","last_active":"2022-07-05T11:46:08.976202+0000","last_peered":"2022-07-05T11:46:08.976202+0000","last_clean":"2022-07-05T11:46:08.976202+0000","last_became_active":"2022-07-05T11:46:04.597995+0000","last_became_peered":"2022-07-05T11:46:04.597995+0000","last_unstale":"2022-07-05T11:46:08.976202+0000","last_undegraded":"2022-07-05T11:46:08.976202+0000","last_fullsized":"2022-07-05T11:46:08.976202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030310+0000","last_change":"2022-07-05T11:46:08.612501+0000","last_active":"2022-07-05T11:46:09.030310+0000","last_peered":"2022-07-05T11:46:09.030310+0000","last_clean":"2022-07-05T11:46:09.030310+0000","last_became_active":"2022-07-05T11:46:08.611956+0000","last_became_peered":"2022-07-05T11:46:08.611956+0000","last_unstale":"2022-07-05T11:46:09.030310+0000","last_undegraded":"2022-07-05T11:46:09.030310+0000","last_fullsized":"2022-07-05T11:46:09.030310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973916+0000","last_change":"2022-07-05T11:46:04.212557+0000","last_active":"2022-07-05T11:46:08.973916+0000","last_peered":"2022-07-05T11:46:08.973916+0000","last_clean":"2022-07-05T11:46:08.973916+0000","last_became_active":"2022-07-05T11:46:04.212259+0000","last_became_peered":"2022-07-05T11:46:04.212259+0000","last_unstale":"2022-07-05T11:46:08.973916+0000","last_undegraded":"2022-07-05T11:46:08.973916+0000","last_fullsized":"2022-07-05T11:46:08.973916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028001+0000","last_change":"2022-07-05T11:46:04.593690+0000","last_active":"2022-07-05T11:46:09.028001+0000","last_peered":"2022-07-05T11:46:09.028001+0000","last_clean":"2022-07-05T11:46:09.028001+0000","last_became_active":"2022-07-05T11:46:04.593427+0000","last_became_peered":"2022-07-05T11:46:04.593427+0000","last_unstale":"2022-07-05T11:46:09.028001+0000","last_undegraded":"2022-07-05T11:46:09.028001+0000","last_fullsized":"2022-07-05T11:46:09.028001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028319+0000","last_change":"2022-07-05T11:46:04.204419+0000","last_active":"2022-07-05T11:46:09.028319+0000","last_peered":"2022-07-05T11:46:09.028319+0000","last_clean":"2022-07-05T11:46:09.028319+0000","last_became_active":"2022-07-05T11:46:04.204078+0000","last_became_peered":"2022-07-05T11:46:04.204078+0000","last_unstale":"2022-07-05T11:46:09.028319+0000","last_undegraded":"2022-07-05T11:46:09.028319+0000","last_fullsized":"2022-07-05T11:46:09.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028300+0000","last_change":"2022-07-05T11:46:04.600858+0000","last_active":"2022-07-05T11:46:09.028300+0000","last_peered":"2022-07-05T11:46:09.028300+0000","last_clean":"2022-07-05T11:46:09.028300+0000","last_became_active":"2022-07-05T11:46:04.600564+0000","last_became_peered":"2022-07-05T11:46:04.600564+0000","last_unstale":"2022-07-05T11:46:09.028300+0000","last_undegraded":"2022-07-05T11:46:09.028300+0000","last_fullsized":"2022-07-05T11:46:09.028300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017952+0000","last_change":"2022-07-05T11:46:09.017127+0000","last_active":"2022-07-05T11:46:09.017952+0000","last_peered":"2022-07-05T11:46:09.017952+0000","last_clean":"2022-07-05T11:46:09.017952+0000","last_became_active":"2022-07-05T11:46:09.016451+0000","last_became_peered":"2022-07-05T11:46:09.016451+0000","last_unstale":"2022-07-05T11:46:09.017952+0000","last_undegraded":"2022-07-05T11:46:09.017952+0000","last_fullsized":"2022-07-05T11:46:09.017952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7144,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":50,"num_read_kb":37,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5348,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366492,"statfs":{"total":96636764160,"available":96631287808,"internally_reserved":0,"allocated":356352,"data_stored":165443,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":166661,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164957,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":163725,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":6,"up_from":17,"seq":73014444041,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":164777,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163647,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163717,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444040,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":4,"up_from":17,"seq":73014444041,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":168453,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366500,"statfs":{"total":96636764160,"available":96631296000,"internally_reserved":0,"allocated":348160,"data_stored":164851,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-07-05T11:46:30.562 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-07-05T11:46:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.702+0000 7f32853ae700 1 Processor -- start 2022-07-05T11:46:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.702+0000 7f32853ae700 1 -- start start 2022-07-05T11:46:30.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f32853ae700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f328017b750 0x7f328017bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f32853ae700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32800edb60 0x7f32800edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f32853ae700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f32800ee4d0 0x7f32800847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f32853ae700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3280083710 con 0x7f32800ee4d0 2022-07-05T11:46:30.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f32853ae700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32800839f0 con 0x7f32800edb60 2022-07-05T11:46:30.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f32853ae700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3280083cd0 con 0x7f328017b750 2022-07-05T11:46:30.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f3284bad700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f32800ee4d0 0x7f32800847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f3284bad700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f32800ee4d0 0x7f32800847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57268/0 (socket says 172.21.15.90:57268) 2022-07-05T11:46:30.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f3284bad700 1 -- 172.21.15.90:0/2407731317 learned_addr learned my addr 172.21.15.90:0/2407731317 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:30.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.703+0000 7f3277fff700 1 --2- 172.21.15.90:0/2407731317 >> v2:172.21.15.110:3300/0 conn(0x7f32800edb60 0x7f32800edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f327ffff700 1 --2- 172.21.15.90:0/2407731317 >> v2:172.21.15.149:3300/0 conn(0x7f328017b750 0x7f328017bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f3284bad700 1 -- 172.21.15.90:0/2407731317 >> v2:172.21.15.149:3300/0 conn(0x7f328017b750 msgr2=0x7f328017bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:30.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f3284bad700 1 --2- 172.21.15.90:0/2407731317 >> v2:172.21.15.149:3300/0 conn(0x7f328017b750 0x7f328017bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f3284bad700 1 -- 172.21.15.90:0/2407731317 >> v2:172.21.15.110:3300/0 conn(0x7f32800edb60 msgr2=0x7f32800edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:30.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f3284bad700 1 --2- 172.21.15.90:0/2407731317 >> v2:172.21.15.110:3300/0 conn(0x7f32800edb60 0x7f32800edfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f3284bad700 1 -- 172.21.15.90:0/2407731317 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280083fb0 con 0x7f32800ee4d0 2022-07-05T11:46:30.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f3284bad700 1 --2- 172.21.15.90:0/2407731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32800ee4d0 0x7f32800847b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f328006a750 tx=0x7f3278009840).ready entity=mon.0 client_cookie=6ba98f2ee34a2744 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f327f7fe700 1 -- 172.21.15.90:0/2407731317 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327800e070 con 0x7f32800ee4d0 2022-07-05T11:46:30.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f327f7fe700 1 -- 172.21.15.90:0/2407731317 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327800b9f0 con 0x7f32800ee4d0 2022-07-05T11:46:30.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f327f7fe700 1 -- 172.21.15.90:0/2407731317 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327800bd70 con 0x7f32800ee4d0 2022-07-05T11:46:30.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f32853ae700 1 -- 172.21.15.90:0/2407731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32800ee4d0 msgr2=0x7f32800847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f32853ae700 1 --2- 172.21.15.90:0/2407731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32800ee4d0 0x7f32800847b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f328006a750 tx=0x7f3278009840).stop 2022-07-05T11:46:30.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f32853ae700 1 -- 172.21.15.90:0/2407731317 shutdown_connections 2022-07-05T11:46:30.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f32853ae700 1 --2- 172.21.15.90:0/2407731317 >> v2:172.21.15.149:3300/0 conn(0x7f328017b750 0x7f328017bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f32853ae700 1 --2- 172.21.15.90:0/2407731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32800ee4d0 0x7f32800847b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f32853ae700 1 --2- 172.21.15.90:0/2407731317 >> v2:172.21.15.110:3300/0 conn(0x7f32800edb60 0x7f32800edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.704+0000 7f32853ae700 1 -- 172.21.15.90:0/2407731317 >> 172.21.15.90:0/2407731317 conn(0x7f32800f27c0 msgr2=0x7f32800f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:30.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.705+0000 7f32853ae700 1 -- 172.21.15.90:0/2407731317 shutdown_connections 2022-07-05T11:46:30.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.705+0000 7f32853ae700 1 -- 172.21.15.90:0/2407731317 wait complete. 2022-07-05T11:46:30.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.706+0000 7f32853ae700 1 Processor -- start 2022-07-05T11:46:30.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.706+0000 7f32853ae700 1 -- start start 2022-07-05T11:46:30.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f32853ae700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32800edb60 0x7f328018ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f32853ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32800ee4d0 0x7f328018cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f32853ae700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328017b750 0x7f328018b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f32853ae700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800e9c60 con 0x7f328017b750 2022-07-05T11:46:30.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f32853ae700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328018eba0 con 0x7f32800edb60 2022-07-05T11:46:30.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f32853ae700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328018ee80 con 0x7f32800ee4d0 2022-07-05T11:46:30.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328017b750 0x7f328018b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328017b750 0x7f328018b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57274/0 (socket says 172.21.15.90:57274) 2022-07-05T11:46:30.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 -- 172.21.15.90:0/2162998681 learned_addr learned my addr 172.21.15.90:0/2162998681 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:30.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f327ffff700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32800edb60 0x7f328018ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3277fff700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32800ee4d0 0x7f328018cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 -- 172.21.15.90:0/2162998681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32800ee4d0 msgr2=0x7f328018cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32800ee4d0 0x7f328018cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 -- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32800edb60 msgr2=0x7f328018ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32800edb60 0x7f328018ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 -- 172.21.15.90:0/2162998681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278009ae0 con 0x7f328017b750 2022-07-05T11:46:30.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.707+0000 7f3284bad700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328017b750 0x7f328018b9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3280086d90 tx=0x7f3278009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.708+0000 7f327cff9700 1 -- 172.21.15.90:0/2162998681 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327800bd70 con 0x7f328017b750 2022-07-05T11:46:30.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.708+0000 7f327cff9700 1 -- 172.21.15.90:0/2162998681 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327800b6c0 con 0x7f328017b750 2022-07-05T11:46:30.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.708+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328018f160 con 0x7f328017b750 2022-07-05T11:46:30.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.708+0000 7f327cff9700 1 -- 172.21.15.90:0/2162998681 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327801d6b0 con 0x7f328017b750 2022-07-05T11:46:30.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.708+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328018f720 con 0x7f328017b750 2022-07-05T11:46:30.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.709+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328006be40 con 0x7f328017b750 2022-07-05T11:46:30.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.709+0000 7f327cff9700 1 -- 172.21.15.90:0/2162998681 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3278024030 con 0x7f328017b750 2022-07-05T11:46:30.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.710+0000 7f327cff9700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f326408ba10 0x7f326408ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:30.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.710+0000 7f327cff9700 1 -- 172.21.15.90:0/2162998681 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f32780b1e80 con 0x7f328017b750 2022-07-05T11:46:30.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.710+0000 7f327ffff700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f326408ba10 0x7f326408ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:30.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.710+0000 7f327ffff700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f326408ba10 0x7f326408ded0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f327000bb30 tx=0x7f3270008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:30.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.714+0000 7f327cff9700 1 -- 172.21.15.90:0/2162998681 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3278082b40 con 0x7f328017b750 2022-07-05T11:46:30.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.870+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 --> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f328006b020 con 0x7f326408ba10 2022-07-05T11:46:30.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.883+0000 7f327cff9700 1 -- 172.21.15.90:0/2162998681 <== mgr.4105 v2:172.21.15.110:6800/36906 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434313 (secure 0 0 0) 0x7f328006b020 con 0x7f326408ba10 2022-07-05T11:46:30.891 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:30.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f326408ba10 msgr2=0x7f326408ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f326408ba10 0x7f326408ded0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f327000bb30 tx=0x7f3270008040).stop 2022-07-05T11:46:30.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328017b750 msgr2=0x7f328018b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:30.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328017b750 0x7f328018b9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3280086d90 tx=0x7f3278009840).stop 2022-07-05T11:46:30.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 shutdown_connections 2022-07-05T11:46:30.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f326408ba10 0x7f326408ded0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328017b750 0x7f328018b9d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32800edb60 0x7f328018ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 --2- 172.21.15.90:0/2162998681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32800ee4d0 0x7f328018cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:30.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 >> 172.21.15.90:0/2162998681 conn(0x7f32800f27c0 msgr2=0x7f32800f2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:30.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 shutdown_connections 2022-07-05T11:46:30.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:30.887+0000 7f32853ae700 1 -- 172.21.15.90:0/2162998681 wait complete. 2022-07-05T11:46:30.899 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2022-07-05T11:46:30.900 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2022-07-05T11:46:29.121001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7144,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":50,"num_read_kb":37,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":64128,"kb_used_data":4000,"kb_used_omap":0,"kb_used_meta":60032,"kb_avail":1132397952,"statfs":{"total":1159641169920,"available":1159575502848,"internally_reserved":0,"allocated":4096000,"data_stored":1976972,"data_compressed":167460,"data_compressed_allocated":245760,"data_compressed_original":491520,"omap_allocated":0,"internal_metadata":61472768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4838,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":50,"num_read_kb":37,"num_write":83,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004212"},"pg_stats":[{"pgid":"3.3f","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360284+0000","last_change":"2022-07-05T11:46:04.211228+0000","last_active":"2022-07-05T11:46:21.360284+0000","last_peered":"2022-07-05T11:46:21.360284+0000","last_clean":"2022-07-05T11:46:21.360284+0000","last_became_active":"2022-07-05T11:46:04.210963+0000","last_became_peered":"2022-07-05T11:46:04.210963+0000","last_unstale":"2022-07-05T11:46:21.360284+0000","last_undegraded":"2022-07-05T11:46:21.360284+0000","last_fullsized":"2022-07-05T11:46:21.360284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029059+0000","last_change":"2022-07-05T11:46:04.590106+0000","last_active":"2022-07-05T11:46:09.029059+0000","last_peered":"2022-07-05T11:46:09.029059+0000","last_clean":"2022-07-05T11:46:09.029059+0000","last_became_active":"2022-07-05T11:46:04.589807+0000","last_became_peered":"2022-07-05T11:46:04.589807+0000","last_unstale":"2022-07-05T11:46:09.029059+0000","last_undegraded":"2022-07-05T11:46:09.029059+0000","last_fullsized":"2022-07-05T11:46:09.029059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.408147+0000","last_change":"2022-07-05T11:46:04.202921+0000","last_active":"2022-07-05T11:46:10.408147+0000","last_peered":"2022-07-05T11:46:10.408147+0000","last_clean":"2022-07-05T11:46:10.408147+0000","last_became_active":"2022-07-05T11:46:04.202631+0000","last_became_peered":"2022-07-05T11:46:04.202631+0000","last_unstale":"2022-07-05T11:46:10.408147+0000","last_undegraded":"2022-07-05T11:46:10.408147+0000","last_fullsized":"2022-07-05T11:46:10.408147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028341+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.028341+0000","last_peered":"2022-07-05T11:46:09.028341+0000","last_clean":"2022-07-05T11:46:09.028341+0000","last_became_active":"2022-07-05T11:46:04.595253+0000","last_became_peered":"2022-07-05T11:46:04.595253+0000","last_unstale":"2022-07-05T11:46:09.028341+0000","last_undegraded":"2022-07-05T11:46:09.028341+0000","last_fullsized":"2022-07-05T11:46:09.028341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360892+0000","last_change":"2022-07-05T11:46:04.211131+0000","last_active":"2022-07-05T11:46:21.360892+0000","last_peered":"2022-07-05T11:46:21.360892+0000","last_clean":"2022-07-05T11:46:21.360892+0000","last_became_active":"2022-07-05T11:46:04.210828+0000","last_became_peered":"2022-07-05T11:46:04.210828+0000","last_unstale":"2022-07-05T11:46:21.360892+0000","last_undegraded":"2022-07-05T11:46:21.360892+0000","last_fullsized":"2022-07-05T11:46:21.360892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012401+0000","last_change":"2022-07-05T11:46:04.592905+0000","last_active":"2022-07-05T11:46:09.012401+0000","last_peered":"2022-07-05T11:46:09.012401+0000","last_clean":"2022-07-05T11:46:09.012401+0000","last_became_active":"2022-07-05T11:46:04.592593+0000","last_became_peered":"2022-07-05T11:46:04.592593+0000","last_unstale":"2022-07-05T11:46:09.012401+0000","last_undegraded":"2022-07-05T11:46:09.012401+0000","last_fullsized":"2022-07-05T11:46:09.012401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012779+0000","last_change":"2022-07-05T11:46:04.209903+0000","last_active":"2022-07-05T11:46:09.012779+0000","last_peered":"2022-07-05T11:46:09.012779+0000","last_clean":"2022-07-05T11:46:09.012779+0000","last_became_active":"2022-07-05T11:46:04.204575+0000","last_became_peered":"2022-07-05T11:46:04.204575+0000","last_unstale":"2022-07-05T11:46:09.012779+0000","last_undegraded":"2022-07-05T11:46:09.012779+0000","last_fullsized":"2022-07-05T11:46:09.012779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974869+0000","last_change":"2022-07-05T11:46:04.595822+0000","last_active":"2022-07-05T11:46:08.974869+0000","last_peered":"2022-07-05T11:46:08.974869+0000","last_clean":"2022-07-05T11:46:08.974869+0000","last_became_active":"2022-07-05T11:46:04.595306+0000","last_became_peered":"2022-07-05T11:46:04.595306+0000","last_unstale":"2022-07-05T11:46:08.974869+0000","last_undegraded":"2022-07-05T11:46:08.974869+0000","last_fullsized":"2022-07-05T11:46:08.974869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"25'1","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029038+0000","last_change":"2022-07-05T11:46:04.202298+0000","last_active":"2022-07-05T11:46:09.029038+0000","last_peered":"2022-07-05T11:46:09.029038+0000","last_clean":"2022-07-05T11:46:09.029038+0000","last_became_active":"2022-07-05T11:46:04.202010+0000","last_became_peered":"2022-07-05T11:46:04.202010+0000","last_unstale":"2022-07-05T11:46:09.029038+0000","last_undegraded":"2022-07-05T11:46:09.029038+0000","last_fullsized":"2022-07-05T11:46:09.029038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029758+0000","last_change":"2022-07-05T11:46:04.590970+0000","last_active":"2022-07-05T11:46:09.029758+0000","last_peered":"2022-07-05T11:46:09.029758+0000","last_clean":"2022-07-05T11:46:09.029758+0000","last_became_active":"2022-07-05T11:46:04.590714+0000","last_became_peered":"2022-07-05T11:46:04.590714+0000","last_unstale":"2022-07-05T11:46:09.029758+0000","last_undegraded":"2022-07-05T11:46:09.029758+0000","last_fullsized":"2022-07-05T11:46:09.029758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358625+0000","last_change":"2022-07-05T11:46:04.204607+0000","last_active":"2022-07-05T11:46:21.358625+0000","last_peered":"2022-07-05T11:46:21.358625+0000","last_clean":"2022-07-05T11:46:21.358625+0000","last_became_active":"2022-07-05T11:46:04.204287+0000","last_became_peered":"2022-07-05T11:46:04.204287+0000","last_unstale":"2022-07-05T11:46:21.358625+0000","last_undegraded":"2022-07-05T11:46:21.358625+0000","last_fullsized":"2022-07-05T11:46:21.358625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012802+0000","last_change":"2022-07-05T11:46:04.606655+0000","last_active":"2022-07-05T11:46:09.012802+0000","last_peered":"2022-07-05T11:46:09.012802+0000","last_clean":"2022-07-05T11:46:09.012802+0000","last_became_active":"2022-07-05T11:46:04.606370+0000","last_became_peered":"2022-07-05T11:46:04.606370+0000","last_unstale":"2022-07-05T11:46:09.012802+0000","last_undegraded":"2022-07-05T11:46:09.012802+0000","last_fullsized":"2022-07-05T11:46:09.012802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360703+0000","last_change":"2022-07-05T11:46:04.206427+0000","last_active":"2022-07-05T11:46:21.360703+0000","last_peered":"2022-07-05T11:46:21.360703+0000","last_clean":"2022-07-05T11:46:21.360703+0000","last_became_active":"2022-07-05T11:46:04.206192+0000","last_became_peered":"2022-07-05T11:46:04.206192+0000","last_unstale":"2022-07-05T11:46:21.360703+0000","last_undegraded":"2022-07-05T11:46:21.360703+0000","last_fullsized":"2022-07-05T11:46:21.360703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028587+0000","last_change":"2022-07-05T11:46:04.599321+0000","last_active":"2022-07-05T11:46:09.028587+0000","last_peered":"2022-07-05T11:46:09.028587+0000","last_clean":"2022-07-05T11:46:09.028587+0000","last_became_active":"2022-07-05T11:46:04.597626+0000","last_became_peered":"2022-07-05T11:46:04.597626+0000","last_unstale":"2022-07-05T11:46:09.028587+0000","last_undegraded":"2022-07-05T11:46:09.028587+0000","last_fullsized":"2022-07-05T11:46:09.028587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407177+0000","last_change":"2022-07-05T11:46:04.204458+0000","last_active":"2022-07-05T11:46:10.407177+0000","last_peered":"2022-07-05T11:46:10.407177+0000","last_clean":"2022-07-05T11:46:10.407177+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:10.407177+0000","last_undegraded":"2022-07-05T11:46:10.407177+0000","last_fullsized":"2022-07-05T11:46:10.407177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028708+0000","last_change":"2022-07-05T11:46:04.598830+0000","last_active":"2022-07-05T11:46:09.028708+0000","last_peered":"2022-07-05T11:46:09.028708+0000","last_clean":"2022-07-05T11:46:09.028708+0000","last_became_active":"2022-07-05T11:46:04.597158+0000","last_became_peered":"2022-07-05T11:46:04.597158+0000","last_unstale":"2022-07-05T11:46:09.028708+0000","last_undegraded":"2022-07-05T11:46:09.028708+0000","last_fullsized":"2022-07-05T11:46:09.028708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029721+0000","last_change":"2022-07-05T11:46:04.207355+0000","last_active":"2022-07-05T11:46:09.029721+0000","last_peered":"2022-07-05T11:46:09.029721+0000","last_clean":"2022-07-05T11:46:09.029721+0000","last_became_active":"2022-07-05T11:46:04.207059+0000","last_became_peered":"2022-07-05T11:46:04.207059+0000","last_unstale":"2022-07-05T11:46:09.029721+0000","last_undegraded":"2022-07-05T11:46:09.029721+0000","last_fullsized":"2022-07-05T11:46:09.029721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012425+0000","last_change":"2022-07-05T11:46:04.595782+0000","last_active":"2022-07-05T11:46:09.012425+0000","last_peered":"2022-07-05T11:46:09.012425+0000","last_clean":"2022-07-05T11:46:09.012425+0000","last_became_active":"2022-07-05T11:46:04.595530+0000","last_became_peered":"2022-07-05T11:46:04.595530+0000","last_unstale":"2022-07-05T11:46:09.012425+0000","last_undegraded":"2022-07-05T11:46:09.012425+0000","last_fullsized":"2022-07-05T11:46:09.012425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.351876+0000","last_change":"2022-07-05T11:46:04.210209+0000","last_active":"2022-07-05T11:46:20.351876+0000","last_peered":"2022-07-05T11:46:20.351876+0000","last_clean":"2022-07-05T11:46:20.351876+0000","last_became_active":"2022-07-05T11:46:04.209883+0000","last_became_peered":"2022-07-05T11:46:04.209883+0000","last_unstale":"2022-07-05T11:46:20.351876+0000","last_undegraded":"2022-07-05T11:46:20.351876+0000","last_fullsized":"2022-07-05T11:46:20.351876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028150+0000","last_change":"2022-07-05T11:46:04.600375+0000","last_active":"2022-07-05T11:46:09.028150+0000","last_peered":"2022-07-05T11:46:09.028150+0000","last_clean":"2022-07-05T11:46:09.028150+0000","last_became_active":"2022-07-05T11:46:04.600101+0000","last_became_peered":"2022-07-05T11:46:04.600101+0000","last_unstale":"2022-07-05T11:46:09.028150+0000","last_undegraded":"2022-07-05T11:46:09.028150+0000","last_fullsized":"2022-07-05T11:46:09.028150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030246+0000","last_change":"2022-07-05T11:46:04.204891+0000","last_active":"2022-07-05T11:46:09.030246+0000","last_peered":"2022-07-05T11:46:09.030246+0000","last_clean":"2022-07-05T11:46:09.030246+0000","last_became_active":"2022-07-05T11:46:04.204619+0000","last_became_peered":"2022-07-05T11:46:04.204619+0000","last_unstale":"2022-07-05T11:46:09.030246+0000","last_undegraded":"2022-07-05T11:46:09.030246+0000","last_fullsized":"2022-07-05T11:46:09.030246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028234+0000","last_change":"2022-07-05T11:46:04.600335+0000","last_active":"2022-07-05T11:46:09.028234+0000","last_peered":"2022-07-05T11:46:09.028234+0000","last_clean":"2022-07-05T11:46:09.028234+0000","last_became_active":"2022-07-05T11:46:04.600026+0000","last_became_peered":"2022-07-05T11:46:04.600026+0000","last_unstale":"2022-07-05T11:46:09.028234+0000","last_undegraded":"2022-07-05T11:46:09.028234+0000","last_fullsized":"2022-07-05T11:46:09.028234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'9","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.369870+0000","last_change":"2022-07-05T11:46:04.210563+0000","last_active":"2022-07-05T11:46:25.369870+0000","last_peered":"2022-07-05T11:46:25.369870+0000","last_clean":"2022-07-05T11:46:25.369870+0000","last_became_active":"2022-07-05T11:46:04.210264+0000","last_became_peered":"2022-07-05T11:46:04.210264+0000","last_unstale":"2022-07-05T11:46:25.369870+0000","last_undegraded":"2022-07-05T11:46:25.369870+0000","last_fullsized":"2022-07-05T11:46:25.369870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3070,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975654+0000","last_change":"2022-07-05T11:46:04.596566+0000","last_active":"2022-07-05T11:46:08.975654+0000","last_peered":"2022-07-05T11:46:08.975654+0000","last_clean":"2022-07-05T11:46:08.975654+0000","last_became_active":"2022-07-05T11:46:04.596385+0000","last_became_peered":"2022-07-05T11:46:04.596385+0000","last_unstale":"2022-07-05T11:46:08.975654+0000","last_undegraded":"2022-07-05T11:46:08.975654+0000","last_fullsized":"2022-07-05T11:46:08.975654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359717+0000","last_change":"2022-07-05T11:46:04.205836+0000","last_active":"2022-07-05T11:46:21.359717+0000","last_peered":"2022-07-05T11:46:21.359717+0000","last_clean":"2022-07-05T11:46:21.359717+0000","last_became_active":"2022-07-05T11:46:04.205522+0000","last_became_peered":"2022-07-05T11:46:04.205522+0000","last_unstale":"2022-07-05T11:46:21.359717+0000","last_undegraded":"2022-07-05T11:46:21.359717+0000","last_fullsized":"2022-07-05T11:46:21.359717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027942+0000","last_change":"2022-07-05T11:46:04.600047+0000","last_active":"2022-07-05T11:46:09.027942+0000","last_peered":"2022-07-05T11:46:09.027942+0000","last_clean":"2022-07-05T11:46:09.027942+0000","last_became_active":"2022-07-05T11:46:04.599735+0000","last_became_peered":"2022-07-05T11:46:04.599735+0000","last_unstale":"2022-07-05T11:46:09.027942+0000","last_undegraded":"2022-07-05T11:46:09.027942+0000","last_fullsized":"2022-07-05T11:46:09.027942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027527+0000","last_change":"2022-07-05T11:46:04.204754+0000","last_active":"2022-07-05T11:46:09.027527+0000","last_peered":"2022-07-05T11:46:09.027527+0000","last_clean":"2022-07-05T11:46:09.027527+0000","last_became_active":"2022-07-05T11:46:04.204466+0000","last_became_peered":"2022-07-05T11:46:04.204466+0000","last_unstale":"2022-07-05T11:46:09.027527+0000","last_undegraded":"2022-07-05T11:46:09.027527+0000","last_fullsized":"2022-07-05T11:46:09.027527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012900+0000","last_change":"2022-07-05T11:46:04.594552+0000","last_active":"2022-07-05T11:46:09.012900+0000","last_peered":"2022-07-05T11:46:09.012900+0000","last_clean":"2022-07-05T11:46:09.012900+0000","last_became_active":"2022-07-05T11:46:04.594285+0000","last_became_peered":"2022-07-05T11:46:04.594285+0000","last_unstale":"2022-07-05T11:46:09.012900+0000","last_undegraded":"2022-07-05T11:46:09.012900+0000","last_fullsized":"2022-07-05T11:46:09.012900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027421+0000","last_change":"2022-07-05T11:46:04.206416+0000","last_active":"2022-07-05T11:46:09.027421+0000","last_peered":"2022-07-05T11:46:09.027421+0000","last_clean":"2022-07-05T11:46:09.027421+0000","last_became_active":"2022-07-05T11:46:04.206118+0000","last_became_peered":"2022-07-05T11:46:04.206118+0000","last_unstale":"2022-07-05T11:46:09.027421+0000","last_undegraded":"2022-07-05T11:46:09.027421+0000","last_fullsized":"2022-07-05T11:46:09.027421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975854+0000","last_change":"2022-07-05T11:46:04.596814+0000","last_active":"2022-07-05T11:46:08.975854+0000","last_peered":"2022-07-05T11:46:08.975854+0000","last_clean":"2022-07-05T11:46:08.975854+0000","last_became_active":"2022-07-05T11:46:04.596492+0000","last_became_peered":"2022-07-05T11:46:04.596492+0000","last_unstale":"2022-07-05T11:46:08.975854+0000","last_undegraded":"2022-07-05T11:46:08.975854+0000","last_fullsized":"2022-07-05T11:46:08.975854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'10","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359758+0000","last_change":"2022-07-05T11:46:04.208748+0000","last_active":"2022-07-05T11:46:21.359758+0000","last_peered":"2022-07-05T11:46:21.359758+0000","last_clean":"2022-07-05T11:46:21.359758+0000","last_became_active":"2022-07-05T11:46:04.208440+0000","last_became_peered":"2022-07-05T11:46:04.208440+0000","last_unstale":"2022-07-05T11:46:21.359758+0000","last_undegraded":"2022-07-05T11:46:21.359758+0000","last_fullsized":"2022-07-05T11:46:21.359758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974079+0000","last_change":"2022-07-05T11:46:04.592371+0000","last_active":"2022-07-05T11:46:08.974079+0000","last_peered":"2022-07-05T11:46:08.974079+0000","last_clean":"2022-07-05T11:46:08.974079+0000","last_became_active":"2022-07-05T11:46:04.592201+0000","last_became_peered":"2022-07-05T11:46:04.592201+0000","last_unstale":"2022-07-05T11:46:08.974079+0000","last_undegraded":"2022-07-05T11:46:08.974079+0000","last_fullsized":"2022-07-05T11:46:08.974079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.982904+0000","last_change":"2022-07-05T11:46:04.211261+0000","last_active":"2022-07-05T11:46:09.982904+0000","last_peered":"2022-07-05T11:46:09.982904+0000","last_clean":"2022-07-05T11:46:09.982904+0000","last_became_active":"2022-07-05T11:46:04.211004+0000","last_became_peered":"2022-07-05T11:46:04.211004+0000","last_unstale":"2022-07-05T11:46:09.982904+0000","last_undegraded":"2022-07-05T11:46:09.982904+0000","last_fullsized":"2022-07-05T11:46:09.982904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974789+0000","last_change":"2022-07-05T11:46:04.597787+0000","last_active":"2022-07-05T11:46:08.974789+0000","last_peered":"2022-07-05T11:46:08.974789+0000","last_clean":"2022-07-05T11:46:08.974789+0000","last_became_active":"2022-07-05T11:46:04.597433+0000","last_became_peered":"2022-07-05T11:46:04.597433+0000","last_unstale":"2022-07-05T11:46:08.974789+0000","last_undegraded":"2022-07-05T11:46:08.974789+0000","last_fullsized":"2022-07-05T11:46:08.974789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974038+0000","last_change":"2022-07-05T11:46:04.211347+0000","last_active":"2022-07-05T11:46:08.974038+0000","last_peered":"2022-07-05T11:46:08.974038+0000","last_clean":"2022-07-05T11:46:08.974038+0000","last_became_active":"2022-07-05T11:46:04.211045+0000","last_became_peered":"2022-07-05T11:46:04.211045+0000","last_unstale":"2022-07-05T11:46:08.974038+0000","last_undegraded":"2022-07-05T11:46:08.974038+0000","last_fullsized":"2022-07-05T11:46:08.974038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973840+0000","last_change":"2022-07-05T11:46:04.587177+0000","last_active":"2022-07-05T11:46:08.973840+0000","last_peered":"2022-07-05T11:46:08.973840+0000","last_clean":"2022-07-05T11:46:08.973840+0000","last_became_active":"2022-07-05T11:46:04.586915+0000","last_became_peered":"2022-07-05T11:46:04.586915+0000","last_unstale":"2022-07-05T11:46:08.973840+0000","last_undegraded":"2022-07-05T11:46:08.973840+0000","last_fullsized":"2022-07-05T11:46:08.973840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317123+0000","last_change":"2022-07-05T11:46:04.213135+0000","last_active":"2022-07-05T11:46:10.317123+0000","last_peered":"2022-07-05T11:46:10.317123+0000","last_clean":"2022-07-05T11:46:10.317123+0000","last_became_active":"2022-07-05T11:46:04.212877+0000","last_became_peered":"2022-07-05T11:46:04.212877+0000","last_unstale":"2022-07-05T11:46:10.317123+0000","last_undegraded":"2022-07-05T11:46:10.317123+0000","last_fullsized":"2022-07-05T11:46:10.317123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975178+0000","last_change":"2022-07-05T11:46:04.598414+0000","last_active":"2022-07-05T11:46:08.975178+0000","last_peered":"2022-07-05T11:46:08.975178+0000","last_clean":"2022-07-05T11:46:08.975178+0000","last_became_active":"2022-07-05T11:46:04.595082+0000","last_became_peered":"2022-07-05T11:46:04.595082+0000","last_unstale":"2022-07-05T11:46:08.975178+0000","last_undegraded":"2022-07-05T11:46:08.975178+0000","last_fullsized":"2022-07-05T11:46:08.975178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360365+0000","last_change":"2022-07-05T11:46:04.208533+0000","last_active":"2022-07-05T11:46:21.360365+0000","last_peered":"2022-07-05T11:46:21.360365+0000","last_clean":"2022-07-05T11:46:21.360365+0000","last_became_active":"2022-07-05T11:46:04.208198+0000","last_became_peered":"2022-07-05T11:46:04.208198+0000","last_unstale":"2022-07-05T11:46:21.360365+0000","last_undegraded":"2022-07-05T11:46:21.360365+0000","last_fullsized":"2022-07-05T11:46:21.360365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029685+0000","last_change":"2022-07-05T11:46:04.590329+0000","last_active":"2022-07-05T11:46:09.029685+0000","last_peered":"2022-07-05T11:46:09.029685+0000","last_clean":"2022-07-05T11:46:09.029685+0000","last_became_active":"2022-07-05T11:46:04.590046+0000","last_became_peered":"2022-07-05T11:46:04.590046+0000","last_unstale":"2022-07-05T11:46:09.029685+0000","last_undegraded":"2022-07-05T11:46:09.029685+0000","last_fullsized":"2022-07-05T11:46:09.029685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352181+0000","last_change":"2022-07-05T11:46:04.207526+0000","last_active":"2022-07-05T11:46:20.352181+0000","last_peered":"2022-07-05T11:46:20.352181+0000","last_clean":"2022-07-05T11:46:20.352181+0000","last_became_active":"2022-07-05T11:46:04.207209+0000","last_became_peered":"2022-07-05T11:46:04.207209+0000","last_unstale":"2022-07-05T11:46:20.352181+0000","last_undegraded":"2022-07-05T11:46:20.352181+0000","last_fullsized":"2022-07-05T11:46:20.352181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029663+0000","last_change":"2022-07-05T11:46:04.590203+0000","last_active":"2022-07-05T11:46:09.029663+0000","last_peered":"2022-07-05T11:46:09.029663+0000","last_clean":"2022-07-05T11:46:09.029663+0000","last_became_active":"2022-07-05T11:46:04.589893+0000","last_became_peered":"2022-07-05T11:46:04.589893+0000","last_unstale":"2022-07-05T11:46:09.029663+0000","last_undegraded":"2022-07-05T11:46:09.029663+0000","last_fullsized":"2022-07-05T11:46:09.029663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407980+0000","last_change":"2022-07-05T11:46:04.207726+0000","last_active":"2022-07-05T11:46:10.407980+0000","last_peered":"2022-07-05T11:46:10.407980+0000","last_clean":"2022-07-05T11:46:10.407980+0000","last_became_active":"2022-07-05T11:46:04.207398+0000","last_became_peered":"2022-07-05T11:46:04.207398+0000","last_unstale":"2022-07-05T11:46:10.407980+0000","last_undegraded":"2022-07-05T11:46:10.407980+0000","last_fullsized":"2022-07-05T11:46:10.407980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028460+0000","last_change":"2022-07-05T11:46:04.598660+0000","last_active":"2022-07-05T11:46:09.028460+0000","last_peered":"2022-07-05T11:46:09.028460+0000","last_clean":"2022-07-05T11:46:09.028460+0000","last_became_active":"2022-07-05T11:46:04.598419+0000","last_became_peered":"2022-07-05T11:46:04.598419+0000","last_unstale":"2022-07-05T11:46:09.028460+0000","last_undegraded":"2022-07-05T11:46:09.028460+0000","last_fullsized":"2022-07-05T11:46:09.028460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028769+0000","last_change":"2022-07-05T11:46:04.214164+0000","last_active":"2022-07-05T11:46:09.028769+0000","last_peered":"2022-07-05T11:46:09.028769+0000","last_clean":"2022-07-05T11:46:09.028769+0000","last_became_active":"2022-07-05T11:46:04.213794+0000","last_became_peered":"2022-07-05T11:46:04.213794+0000","last_unstale":"2022-07-05T11:46:09.028769+0000","last_undegraded":"2022-07-05T11:46:09.028769+0000","last_fullsized":"2022-07-05T11:46:09.028769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.599315+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.599091+0000","last_became_peered":"2022-07-05T11:46:04.599091+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353175+0000","last_change":"2022-07-05T11:46:04.208200+0000","last_active":"2022-07-05T11:46:20.353175+0000","last_peered":"2022-07-05T11:46:20.353175+0000","last_clean":"2022-07-05T11:46:20.353175+0000","last_became_active":"2022-07-05T11:46:04.207891+0000","last_became_peered":"2022-07-05T11:46:04.207891+0000","last_unstale":"2022-07-05T11:46:20.353175+0000","last_undegraded":"2022-07-05T11:46:20.353175+0000","last_fullsized":"2022-07-05T11:46:20.353175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028740+0000","last_change":"2022-07-05T11:46:04.594011+0000","last_active":"2022-07-05T11:46:09.028740+0000","last_peered":"2022-07-05T11:46:09.028740+0000","last_clean":"2022-07-05T11:46:09.028740+0000","last_became_active":"2022-07-05T11:46:04.593800+0000","last_became_peered":"2022-07-05T11:46:04.593800+0000","last_unstale":"2022-07-05T11:46:09.028740+0000","last_undegraded":"2022-07-05T11:46:09.028740+0000","last_fullsized":"2022-07-05T11:46:09.028740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353238+0000","last_change":"2022-07-05T11:46:04.206715+0000","last_active":"2022-07-05T11:46:20.353238+0000","last_peered":"2022-07-05T11:46:20.353238+0000","last_clean":"2022-07-05T11:46:20.353238+0000","last_became_active":"2022-07-05T11:46:04.206230+0000","last_became_peered":"2022-07-05T11:46:04.206230+0000","last_unstale":"2022-07-05T11:46:20.353238+0000","last_undegraded":"2022-07-05T11:46:20.353238+0000","last_fullsized":"2022-07-05T11:46:20.353238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029238+0000","last_change":"2022-07-05T11:46:04.590527+0000","last_active":"2022-07-05T11:46:09.029238+0000","last_peered":"2022-07-05T11:46:09.029238+0000","last_clean":"2022-07-05T11:46:09.029238+0000","last_became_active":"2022-07-05T11:46:04.589992+0000","last_became_peered":"2022-07-05T11:46:04.589992+0000","last_unstale":"2022-07-05T11:46:09.029238+0000","last_undegraded":"2022-07-05T11:46:09.029238+0000","last_fullsized":"2022-07-05T11:46:09.029238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317357+0000","last_change":"2022-07-05T11:46:04.209943+0000","last_active":"2022-07-05T11:46:10.317357+0000","last_peered":"2022-07-05T11:46:10.317357+0000","last_clean":"2022-07-05T11:46:10.317357+0000","last_became_active":"2022-07-05T11:46:04.209640+0000","last_became_peered":"2022-07-05T11:46:04.209640+0000","last_unstale":"2022-07-05T11:46:10.317357+0000","last_undegraded":"2022-07-05T11:46:10.317357+0000","last_fullsized":"2022-07-05T11:46:10.317357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028615+0000","last_change":"2022-07-05T11:46:04.593997+0000","last_active":"2022-07-05T11:46:09.028615+0000","last_peered":"2022-07-05T11:46:09.028615+0000","last_clean":"2022-07-05T11:46:09.028615+0000","last_became_active":"2022-07-05T11:46:04.593708+0000","last_became_peered":"2022-07-05T11:46:04.593708+0000","last_unstale":"2022-07-05T11:46:09.028615+0000","last_undegraded":"2022-07-05T11:46:09.028615+0000","last_fullsized":"2022-07-05T11:46:09.028615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352932+0000","last_change":"2022-07-05T11:46:04.203818+0000","last_active":"2022-07-05T11:46:20.352932+0000","last_peered":"2022-07-05T11:46:20.352932+0000","last_clean":"2022-07-05T11:46:20.352932+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:20.352932+0000","last_undegraded":"2022-07-05T11:46:20.352932+0000","last_fullsized":"2022-07-05T11:46:20.352932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975098+0000","last_change":"2022-07-05T11:46:04.598669+0000","last_active":"2022-07-05T11:46:08.975098+0000","last_peered":"2022-07-05T11:46:08.975098+0000","last_clean":"2022-07-05T11:46:08.975098+0000","last_became_active":"2022-07-05T11:46:04.598400+0000","last_became_peered":"2022-07-05T11:46:04.598400+0000","last_unstale":"2022-07-05T11:46:08.975098+0000","last_undegraded":"2022-07-05T11:46:08.975098+0000","last_fullsized":"2022-07-05T11:46:08.975098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028775+0000","last_change":"2022-07-05T11:46:04.212247+0000","last_active":"2022-07-05T11:46:09.028775+0000","last_peered":"2022-07-05T11:46:09.028775+0000","last_clean":"2022-07-05T11:46:09.028775+0000","last_became_active":"2022-07-05T11:46:04.211958+0000","last_became_peered":"2022-07-05T11:46:04.211958+0000","last_unstale":"2022-07-05T11:46:09.028775+0000","last_undegraded":"2022-07-05T11:46:09.028775+0000","last_fullsized":"2022-07-05T11:46:09.028775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029158+0000","last_change":"2022-07-05T11:46:04.599477+0000","last_active":"2022-07-05T11:46:09.029158+0000","last_peered":"2022-07-05T11:46:09.029158+0000","last_clean":"2022-07-05T11:46:09.029158+0000","last_became_active":"2022-07-05T11:46:04.599214+0000","last_became_peered":"2022-07-05T11:46:04.599214+0000","last_unstale":"2022-07-05T11:46:09.029158+0000","last_undegraded":"2022-07-05T11:46:09.029158+0000","last_fullsized":"2022-07-05T11:46:09.029158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027608+0000","last_change":"2022-07-05T11:46:04.209196+0000","last_active":"2022-07-05T11:46:09.027608+0000","last_peered":"2022-07-05T11:46:09.027608+0000","last_clean":"2022-07-05T11:46:09.027608+0000","last_became_active":"2022-07-05T11:46:04.208918+0000","last_became_peered":"2022-07-05T11:46:04.208918+0000","last_unstale":"2022-07-05T11:46:09.027608+0000","last_undegraded":"2022-07-05T11:46:09.027608+0000","last_fullsized":"2022-07-05T11:46:09.027608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975167+0000","last_change":"2022-07-05T11:46:04.594414+0000","last_active":"2022-07-05T11:46:08.975167+0000","last_peered":"2022-07-05T11:46:08.975167+0000","last_clean":"2022-07-05T11:46:08.975167+0000","last_became_active":"2022-07-05T11:46:04.594114+0000","last_became_peered":"2022-07-05T11:46:04.594114+0000","last_unstale":"2022-07-05T11:46:08.975167+0000","last_undegraded":"2022-07-05T11:46:08.975167+0000","last_fullsized":"2022-07-05T11:46:08.975167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027763+0000","last_change":"2022-07-05T11:46:04.215006+0000","last_active":"2022-07-05T11:46:09.027763+0000","last_peered":"2022-07-05T11:46:09.027763+0000","last_clean":"2022-07-05T11:46:09.027763+0000","last_became_active":"2022-07-05T11:46:04.214585+0000","last_became_peered":"2022-07-05T11:46:04.214585+0000","last_unstale":"2022-07-05T11:46:09.027763+0000","last_undegraded":"2022-07-05T11:46:09.027763+0000","last_fullsized":"2022-07-05T11:46:09.027763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030101+0000","last_change":"2022-07-05T11:46:04.601912+0000","last_active":"2022-07-05T11:46:09.030101+0000","last_peered":"2022-07-05T11:46:09.030101+0000","last_clean":"2022-07-05T11:46:09.030101+0000","last_became_active":"2022-07-05T11:46:04.601605+0000","last_became_peered":"2022-07-05T11:46:04.601605+0000","last_unstale":"2022-07-05T11:46:09.030101+0000","last_undegraded":"2022-07-05T11:46:09.030101+0000","last_fullsized":"2022-07-05T11:46:09.030101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371134+0000","last_change":"2022-07-05T11:46:04.208064+0000","last_active":"2022-07-05T11:46:25.371134+0000","last_peered":"2022-07-05T11:46:25.371134+0000","last_clean":"2022-07-05T11:46:25.371134+0000","last_became_active":"2022-07-05T11:46:04.207845+0000","last_became_peered":"2022-07-05T11:46:04.207845+0000","last_unstale":"2022-07-05T11:46:25.371134+0000","last_undegraded":"2022-07-05T11:46:25.371134+0000","last_fullsized":"2022-07-05T11:46:25.371134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030056+0000","last_change":"2022-07-05T11:46:04.589990+0000","last_active":"2022-07-05T11:46:09.030056+0000","last_peered":"2022-07-05T11:46:09.030056+0000","last_clean":"2022-07-05T11:46:09.030056+0000","last_became_active":"2022-07-05T11:46:04.589734+0000","last_became_peered":"2022-07-05T11:46:04.589734+0000","last_unstale":"2022-07-05T11:46:09.030056+0000","last_undegraded":"2022-07-05T11:46:09.030056+0000","last_fullsized":"2022-07-05T11:46:09.030056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974955+0000","last_change":"2022-07-05T11:46:04.208275+0000","last_active":"2022-07-05T11:46:08.974955+0000","last_peered":"2022-07-05T11:46:08.974955+0000","last_clean":"2022-07-05T11:46:08.974955+0000","last_became_active":"2022-07-05T11:46:04.208001+0000","last_became_peered":"2022-07-05T11:46:04.208001+0000","last_unstale":"2022-07-05T11:46:08.974955+0000","last_undegraded":"2022-07-05T11:46:08.974955+0000","last_fullsized":"2022-07-05T11:46:08.974955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028628+0000","last_change":"2022-07-05T11:46:04.597446+0000","last_active":"2022-07-05T11:46:09.028628+0000","last_peered":"2022-07-05T11:46:09.028628+0000","last_clean":"2022-07-05T11:46:09.028628+0000","last_became_active":"2022-07-05T11:46:04.596828+0000","last_became_peered":"2022-07-05T11:46:04.596828+0000","last_unstale":"2022-07-05T11:46:09.028628+0000","last_undegraded":"2022-07-05T11:46:09.028628+0000","last_fullsized":"2022-07-05T11:46:09.028628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360630+0000","last_change":"2022-07-05T11:46:04.211080+0000","last_active":"2022-07-05T11:46:21.360630+0000","last_peered":"2022-07-05T11:46:21.360630+0000","last_clean":"2022-07-05T11:46:21.360630+0000","last_became_active":"2022-07-05T11:46:04.210805+0000","last_became_peered":"2022-07-05T11:46:04.210805+0000","last_unstale":"2022-07-05T11:46:21.360630+0000","last_undegraded":"2022-07-05T11:46:21.360630+0000","last_fullsized":"2022-07-05T11:46:21.360630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012330+0000","last_change":"2022-07-05T11:46:04.594116+0000","last_active":"2022-07-05T11:46:09.012330+0000","last_peered":"2022-07-05T11:46:09.012330+0000","last_clean":"2022-07-05T11:46:09.012330+0000","last_became_active":"2022-07-05T11:46:04.593716+0000","last_became_peered":"2022-07-05T11:46:04.593716+0000","last_unstale":"2022-07-05T11:46:09.012330+0000","last_undegraded":"2022-07-05T11:46:09.012330+0000","last_fullsized":"2022-07-05T11:46:09.012330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017611+0000","last_change":"2022-07-05T11:46:09.014114+0000","last_active":"2022-07-05T11:46:09.017611+0000","last_peered":"2022-07-05T11:46:09.017611+0000","last_clean":"2022-07-05T11:46:09.017611+0000","last_became_active":"2022-07-05T11:46:09.013707+0000","last_became_peered":"2022-07-05T11:46:09.013707+0000","last_unstale":"2022-07-05T11:46:09.017611+0000","last_undegraded":"2022-07-05T11:46:09.017611+0000","last_fullsized":"2022-07-05T11:46:09.017611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029324+0000","last_change":"2022-07-05T11:46:04.213375+0000","last_active":"2022-07-05T11:46:09.029324+0000","last_peered":"2022-07-05T11:46:09.029324+0000","last_clean":"2022-07-05T11:46:09.029324+0000","last_became_active":"2022-07-05T11:46:04.213094+0000","last_became_peered":"2022-07-05T11:46:04.213094+0000","last_unstale":"2022-07-05T11:46:09.029324+0000","last_undegraded":"2022-07-05T11:46:09.029324+0000","last_fullsized":"2022-07-05T11:46:09.029324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027648+0000","last_change":"2022-07-05T11:46:04.599779+0000","last_active":"2022-07-05T11:46:09.027648+0000","last_peered":"2022-07-05T11:46:09.027648+0000","last_clean":"2022-07-05T11:46:09.027648+0000","last_became_active":"2022-07-05T11:46:04.597330+0000","last_became_peered":"2022-07-05T11:46:04.597330+0000","last_unstale":"2022-07-05T11:46:09.027648+0000","last_undegraded":"2022-07-05T11:46:09.027648+0000","last_fullsized":"2022-07-05T11:46:09.027648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012222+0000","last_change":"2022-07-05T11:46:08.615050+0000","last_active":"2022-07-05T11:46:09.012222+0000","last_peered":"2022-07-05T11:46:09.012222+0000","last_clean":"2022-07-05T11:46:09.012222+0000","last_became_active":"2022-07-05T11:46:08.614715+0000","last_became_peered":"2022-07-05T11:46:08.614715+0000","last_unstale":"2022-07-05T11:46:09.012222+0000","last_undegraded":"2022-07-05T11:46:09.012222+0000","last_fullsized":"2022-07-05T11:46:09.012222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975318+0000","last_change":"2022-07-05T11:46:04.206835+0000","last_active":"2022-07-05T11:46:08.975318+0000","last_peered":"2022-07-05T11:46:08.975318+0000","last_clean":"2022-07-05T11:46:08.975318+0000","last_became_active":"2022-07-05T11:46:04.206389+0000","last_became_peered":"2022-07-05T11:46:04.206389+0000","last_unstale":"2022-07-05T11:46:08.975318+0000","last_undegraded":"2022-07-05T11:46:08.975318+0000","last_fullsized":"2022-07-05T11:46:08.975318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012352+0000","last_change":"2022-07-05T11:46:04.595704+0000","last_active":"2022-07-05T11:46:09.012352+0000","last_peered":"2022-07-05T11:46:09.012352+0000","last_clean":"2022-07-05T11:46:09.012352+0000","last_became_active":"2022-07-05T11:46:04.594581+0000","last_became_peered":"2022-07-05T11:46:04.594581+0000","last_unstale":"2022-07-05T11:46:09.012352+0000","last_undegraded":"2022-07-05T11:46:09.012352+0000","last_fullsized":"2022-07-05T11:46:09.012352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028313+0000","last_change":"2022-07-05T11:46:08.618434+0000","last_active":"2022-07-05T11:46:09.028313+0000","last_peered":"2022-07-05T11:46:09.028313+0000","last_clean":"2022-07-05T11:46:09.028313+0000","last_became_active":"2022-07-05T11:46:08.618022+0000","last_became_peered":"2022-07-05T11:46:08.618022+0000","last_unstale":"2022-07-05T11:46:09.028313+0000","last_undegraded":"2022-07-05T11:46:09.028313+0000","last_fullsized":"2022-07-05T11:46:09.028313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029453+0000","last_change":"2022-07-05T11:46:04.213103+0000","last_active":"2022-07-05T11:46:09.029453+0000","last_peered":"2022-07-05T11:46:09.029453+0000","last_clean":"2022-07-05T11:46:09.029453+0000","last_became_active":"2022-07-05T11:46:04.211627+0000","last_became_peered":"2022-07-05T11:46:04.211627+0000","last_unstale":"2022-07-05T11:46:09.029453+0000","last_undegraded":"2022-07-05T11:46:09.029453+0000","last_fullsized":"2022-07-05T11:46:09.029453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012463+0000","last_change":"2022-07-05T11:46:04.593912+0000","last_active":"2022-07-05T11:46:09.012463+0000","last_peered":"2022-07-05T11:46:09.012463+0000","last_clean":"2022-07-05T11:46:09.012463+0000","last_became_active":"2022-07-05T11:46:04.593631+0000","last_became_peered":"2022-07-05T11:46:04.593631+0000","last_unstale":"2022-07-05T11:46:09.012463+0000","last_undegraded":"2022-07-05T11:46:09.012463+0000","last_fullsized":"2022-07-05T11:46:09.012463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028223+0000","last_change":"2022-07-05T11:46:09.013932+0000","last_active":"2022-07-05T11:46:09.028223+0000","last_peered":"2022-07-05T11:46:09.028223+0000","last_clean":"2022-07-05T11:46:09.028223+0000","last_became_active":"2022-07-05T11:46:09.013609+0000","last_became_peered":"2022-07-05T11:46:09.013609+0000","last_unstale":"2022-07-05T11:46:09.028223+0000","last_undegraded":"2022-07-05T11:46:09.028223+0000","last_fullsized":"2022-07-05T11:46:09.028223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028226+0000","last_change":"2022-07-05T11:46:09.016568+0000","last_active":"2022-07-05T11:46:09.028226+0000","last_peered":"2022-07-05T11:46:09.028226+0000","last_clean":"2022-07-05T11:46:09.028226+0000","last_became_active":"2022-07-05T11:46:09.016162+0000","last_became_peered":"2022-07-05T11:46:09.016162+0000","last_unstale":"2022-07-05T11:46:09.028226+0000","last_undegraded":"2022-07-05T11:46:09.028226+0000","last_fullsized":"2022-07-05T11:46:09.028226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'4","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371598+0000","last_change":"2022-07-05T11:46:04.208656+0000","last_active":"2022-07-05T11:46:25.371598+0000","last_peered":"2022-07-05T11:46:25.371598+0000","last_clean":"2022-07-05T11:46:25.371598+0000","last_became_active":"2022-07-05T11:46:04.208394+0000","last_became_peered":"2022-07-05T11:46:04.208394+0000","last_unstale":"2022-07-05T11:46:25.371598+0000","last_undegraded":"2022-07-05T11:46:25.371598+0000","last_fullsized":"2022-07-05T11:46:25.371598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027906+0000","last_change":"2022-07-05T11:46:04.600156+0000","last_active":"2022-07-05T11:46:09.027906+0000","last_peered":"2022-07-05T11:46:09.027906+0000","last_clean":"2022-07-05T11:46:09.027906+0000","last_became_active":"2022-07-05T11:46:04.599836+0000","last_became_peered":"2022-07-05T11:46:04.599836+0000","last_unstale":"2022-07-05T11:46:09.027906+0000","last_undegraded":"2022-07-05T11:46:09.027906+0000","last_fullsized":"2022-07-05T11:46:09.027906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027863+0000","last_change":"2022-07-05T11:46:04.599555+0000","last_active":"2022-07-05T11:46:09.027863+0000","last_peered":"2022-07-05T11:46:09.027863+0000","last_clean":"2022-07-05T11:46:09.027863+0000","last_became_active":"2022-07-05T11:46:04.597036+0000","last_became_peered":"2022-07-05T11:46:04.597036+0000","last_unstale":"2022-07-05T11:46:09.027863+0000","last_undegraded":"2022-07-05T11:46:09.027863+0000","last_fullsized":"2022-07-05T11:46:09.027863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.357392+0000","last_change":"2022-07-05T11:46:04.215037+0000","last_active":"2022-07-05T11:46:21.357392+0000","last_peered":"2022-07-05T11:46:21.357392+0000","last_clean":"2022-07-05T11:46:21.357392+0000","last_became_active":"2022-07-05T11:46:04.214699+0000","last_became_peered":"2022-07-05T11:46:04.214699+0000","last_unstale":"2022-07-05T11:46:21.357392+0000","last_undegraded":"2022-07-05T11:46:21.357392+0000","last_fullsized":"2022-07-05T11:46:21.357392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012966+0000","last_change":"2022-07-05T11:46:00.405416+0000","last_active":"2022-07-05T11:46:09.012966+0000","last_peered":"2022-07-05T11:46:09.012966+0000","last_clean":"2022-07-05T11:46:09.012966+0000","last_became_active":"2022-07-05T11:46:00.405179+0000","last_became_peered":"2022-07-05T11:46:00.405179+0000","last_unstale":"2022-07-05T11:46:09.012966+0000","last_undegraded":"2022-07-05T11:46:09.012966+0000","last_fullsized":"2022-07-05T11:46:09.012966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027570+0000","last_change":"2022-07-05T11:46:08.616541+0000","last_active":"2022-07-05T11:46:09.027570+0000","last_peered":"2022-07-05T11:46:09.027570+0000","last_clean":"2022-07-05T11:46:09.027570+0000","last_became_active":"2022-07-05T11:46:08.616124+0000","last_became_peered":"2022-07-05T11:46:08.616124+0000","last_unstale":"2022-07-05T11:46:09.027570+0000","last_undegraded":"2022-07-05T11:46:09.027570+0000","last_fullsized":"2022-07-05T11:46:09.027570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028425+0000","last_change":"2022-07-05T11:46:04.584095+0000","last_active":"2022-07-05T11:46:09.028425+0000","last_peered":"2022-07-05T11:46:09.028425+0000","last_clean":"2022-07-05T11:46:09.028425+0000","last_became_active":"2022-07-05T11:46:04.583806+0000","last_became_peered":"2022-07-05T11:46:04.583806+0000","last_unstale":"2022-07-05T11:46:09.028425+0000","last_undegraded":"2022-07-05T11:46:09.028425+0000","last_fullsized":"2022-07-05T11:46:09.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974096+0000","last_change":"2022-07-05T11:46:00.174377+0000","last_active":"2022-07-05T11:46:08.974096+0000","last_peered":"2022-07-05T11:46:08.974096+0000","last_clean":"2022-07-05T11:46:08.974096+0000","last_became_active":"2022-07-05T11:46:00.174041+0000","last_became_peered":"2022-07-05T11:46:00.174041+0000","last_unstale":"2022-07-05T11:46:08.974096+0000","last_undegraded":"2022-07-05T11:46:08.974096+0000","last_fullsized":"2022-07-05T11:46:08.974096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029651+0000","last_change":"2022-07-05T11:46:04.201186+0000","last_active":"2022-07-05T11:46:09.029651+0000","last_peered":"2022-07-05T11:46:09.029651+0000","last_clean":"2022-07-05T11:46:09.029651+0000","last_became_active":"2022-07-05T11:46:04.200331+0000","last_became_peered":"2022-07-05T11:46:04.200331+0000","last_unstale":"2022-07-05T11:46:09.029651+0000","last_undegraded":"2022-07-05T11:46:09.029651+0000","last_fullsized":"2022-07-05T11:46:09.029651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012267+0000","last_change":"2022-07-05T11:46:08.617187+0000","last_active":"2022-07-05T11:46:09.012267+0000","last_peered":"2022-07-05T11:46:09.012267+0000","last_clean":"2022-07-05T11:46:09.012267+0000","last_became_active":"2022-07-05T11:46:08.616787+0000","last_became_peered":"2022-07-05T11:46:08.616787+0000","last_unstale":"2022-07-05T11:46:09.012267+0000","last_undegraded":"2022-07-05T11:46:09.012267+0000","last_fullsized":"2022-07-05T11:46:09.012267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974758+0000","last_change":"2022-07-05T11:46:04.595606+0000","last_active":"2022-07-05T11:46:08.974758+0000","last_peered":"2022-07-05T11:46:08.974758+0000","last_clean":"2022-07-05T11:46:08.974758+0000","last_became_active":"2022-07-05T11:46:04.594962+0000","last_became_peered":"2022-07-05T11:46:04.594962+0000","last_unstale":"2022-07-05T11:46:08.974758+0000","last_undegraded":"2022-07-05T11:46:08.974758+0000","last_fullsized":"2022-07-05T11:46:08.974758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028691+0000","last_change":"2022-07-05T11:46:04.208492+0000","last_active":"2022-07-05T11:46:09.028691+0000","last_peered":"2022-07-05T11:46:09.028691+0000","last_clean":"2022-07-05T11:46:09.028691+0000","last_became_active":"2022-07-05T11:46:04.208135+0000","last_became_peered":"2022-07-05T11:46:04.208135+0000","last_unstale":"2022-07-05T11:46:09.028691+0000","last_undegraded":"2022-07-05T11:46:09.028691+0000","last_fullsized":"2022-07-05T11:46:09.028691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028400+0000","last_change":"2022-07-05T11:46:01.122048+0000","last_active":"2022-07-05T11:46:09.028400+0000","last_peered":"2022-07-05T11:46:09.028400+0000","last_clean":"2022-07-05T11:46:09.028400+0000","last_became_active":"2022-07-05T11:46:01.121724+0000","last_became_peered":"2022-07-05T11:46:01.121724+0000","last_unstale":"2022-07-05T11:46:09.028400+0000","last_undegraded":"2022-07-05T11:46:09.028400+0000","last_fullsized":"2022-07-05T11:46:09.028400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029610+0000","last_change":"2022-07-05T11:46:08.614936+0000","last_active":"2022-07-05T11:46:09.029610+0000","last_peered":"2022-07-05T11:46:09.029610+0000","last_clean":"2022-07-05T11:46:09.029610+0000","last_became_active":"2022-07-05T11:46:08.613212+0000","last_became_peered":"2022-07-05T11:46:08.613212+0000","last_unstale":"2022-07-05T11:46:09.029610+0000","last_undegraded":"2022-07-05T11:46:09.029610+0000","last_fullsized":"2022-07-05T11:46:09.029610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358743+0000","last_change":"2022-07-05T11:46:04.207235+0000","last_active":"2022-07-05T11:46:21.358743+0000","last_peered":"2022-07-05T11:46:21.358743+0000","last_clean":"2022-07-05T11:46:21.358743+0000","last_became_active":"2022-07-05T11:46:04.206912+0000","last_became_peered":"2022-07-05T11:46:04.206912+0000","last_unstale":"2022-07-05T11:46:21.358743+0000","last_undegraded":"2022-07-05T11:46:21.358743+0000","last_fullsized":"2022-07-05T11:46:21.358743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027868+0000","last_change":"2022-07-05T11:46:00.387606+0000","last_active":"2022-07-05T11:46:09.027868+0000","last_peered":"2022-07-05T11:46:09.027868+0000","last_clean":"2022-07-05T11:46:09.027868+0000","last_became_active":"2022-07-05T11:46:00.387285+0000","last_became_peered":"2022-07-05T11:46:00.387285+0000","last_unstale":"2022-07-05T11:46:09.027868+0000","last_undegraded":"2022-07-05T11:46:09.027868+0000","last_fullsized":"2022-07-05T11:46:09.027868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975087+0000","last_change":"2022-07-05T11:46:04.597434+0000","last_active":"2022-07-05T11:46:08.975087+0000","last_peered":"2022-07-05T11:46:08.975087+0000","last_clean":"2022-07-05T11:46:08.975087+0000","last_became_active":"2022-07-05T11:46:04.596283+0000","last_became_peered":"2022-07-05T11:46:04.596283+0000","last_unstale":"2022-07-05T11:46:08.975087+0000","last_undegraded":"2022-07-05T11:46:08.975087+0000","last_fullsized":"2022-07-05T11:46:08.975087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030525+0000","last_change":"2022-07-05T11:46:08.618008+0000","last_active":"2022-07-05T11:46:09.030525+0000","last_peered":"2022-07-05T11:46:09.030525+0000","last_clean":"2022-07-05T11:46:09.030525+0000","last_became_active":"2022-07-05T11:46:08.617640+0000","last_became_peered":"2022-07-05T11:46:08.617640+0000","last_unstale":"2022-07-05T11:46:09.030525+0000","last_undegraded":"2022-07-05T11:46:09.030525+0000","last_fullsized":"2022-07-05T11:46:09.030525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407205+0000","last_change":"2022-07-05T11:46:04.205557+0000","last_active":"2022-07-05T11:46:10.407205+0000","last_peered":"2022-07-05T11:46:10.407205+0000","last_clean":"2022-07-05T11:46:10.407205+0000","last_became_active":"2022-07-05T11:46:04.203760+0000","last_became_peered":"2022-07-05T11:46:04.203760+0000","last_unstale":"2022-07-05T11:46:10.407205+0000","last_undegraded":"2022-07-05T11:46:10.407205+0000","last_fullsized":"2022-07-05T11:46:10.407205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027789+0000","last_change":"2022-07-05T11:45:58.489958+0000","last_active":"2022-07-05T11:46:09.027789+0000","last_peered":"2022-07-05T11:46:09.027789+0000","last_clean":"2022-07-05T11:46:09.027789+0000","last_became_active":"2022-07-05T11:45:58.489710+0000","last_became_peered":"2022-07-05T11:45:58.489710+0000","last_unstale":"2022-07-05T11:46:09.027789+0000","last_undegraded":"2022-07-05T11:46:09.027789+0000","last_fullsized":"2022-07-05T11:46:09.027789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_clean_scrub_stamp":"2022-07-05T11:45:57.143009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012518+0000","last_change":"2022-07-05T11:46:01.154008+0000","last_active":"2022-07-05T11:46:09.012518+0000","last_peered":"2022-07-05T11:46:09.012518+0000","last_clean":"2022-07-05T11:46:09.012518+0000","last_became_active":"2022-07-05T11:46:01.153653+0000","last_became_peered":"2022-07-05T11:46:01.153653+0000","last_unstale":"2022-07-05T11:46:09.012518+0000","last_undegraded":"2022-07-05T11:46:09.012518+0000","last_fullsized":"2022-07-05T11:46:09.012518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029959+0000","last_change":"2022-07-05T11:46:04.597444+0000","last_active":"2022-07-05T11:46:09.029959+0000","last_peered":"2022-07-05T11:46:09.029959+0000","last_clean":"2022-07-05T11:46:09.029959+0000","last_became_active":"2022-07-05T11:46:04.597199+0000","last_became_peered":"2022-07-05T11:46:04.597199+0000","last_unstale":"2022-07-05T11:46:09.029959+0000","last_undegraded":"2022-07-05T11:46:09.029959+0000","last_fullsized":"2022-07-05T11:46:09.029959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028215+0000","last_change":"2022-07-05T11:46:09.017084+0000","last_active":"2022-07-05T11:46:09.028215+0000","last_peered":"2022-07-05T11:46:09.028215+0000","last_clean":"2022-07-05T11:46:09.028215+0000","last_became_active":"2022-07-05T11:46:09.016658+0000","last_became_peered":"2022-07-05T11:46:09.016658+0000","last_unstale":"2022-07-05T11:46:09.028215+0000","last_undegraded":"2022-07-05T11:46:09.028215+0000","last_fullsized":"2022-07-05T11:46:09.028215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358568+0000","last_change":"2022-07-05T11:46:04.209767+0000","last_active":"2022-07-05T11:46:21.358568+0000","last_peered":"2022-07-05T11:46:21.358568+0000","last_clean":"2022-07-05T11:46:21.358568+0000","last_became_active":"2022-07-05T11:46:04.209524+0000","last_became_peered":"2022-07-05T11:46:04.209524+0000","last_unstale":"2022-07-05T11:46:21.358568+0000","last_undegraded":"2022-07-05T11:46:21.358568+0000","last_fullsized":"2022-07-05T11:46:21.358568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028541+0000","last_change":"2022-07-05T11:46:01.118061+0000","last_active":"2022-07-05T11:46:09.028541+0000","last_peered":"2022-07-05T11:46:09.028541+0000","last_clean":"2022-07-05T11:46:09.028541+0000","last_became_active":"2022-07-05T11:46:01.117762+0000","last_became_peered":"2022-07-05T11:46:01.117762+0000","last_unstale":"2022-07-05T11:46:09.028541+0000","last_undegraded":"2022-07-05T11:46:09.028541+0000","last_fullsized":"2022-07-05T11:46:09.028541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028916+0000","last_change":"2022-07-05T11:46:04.594377+0000","last_active":"2022-07-05T11:46:09.028916+0000","last_peered":"2022-07-05T11:46:09.028916+0000","last_clean":"2022-07-05T11:46:09.028916+0000","last_became_active":"2022-07-05T11:46:04.594103+0000","last_became_peered":"2022-07-05T11:46:04.594103+0000","last_unstale":"2022-07-05T11:46:09.028916+0000","last_undegraded":"2022-07-05T11:46:09.028916+0000","last_fullsized":"2022-07-05T11:46:09.028916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017137+0000","last_change":"2022-07-05T11:46:09.014687+0000","last_active":"2022-07-05T11:46:09.017137+0000","last_peered":"2022-07-05T11:46:09.017137+0000","last_clean":"2022-07-05T11:46:09.017137+0000","last_became_active":"2022-07-05T11:46:09.014298+0000","last_became_peered":"2022-07-05T11:46:09.014298+0000","last_unstale":"2022-07-05T11:46:09.017137+0000","last_undegraded":"2022-07-05T11:46:09.017137+0000","last_fullsized":"2022-07-05T11:46:09.017137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028627+0000","last_change":"2022-07-05T11:46:04.593068+0000","last_active":"2022-07-05T11:46:09.028627+0000","last_peered":"2022-07-05T11:46:09.028627+0000","last_clean":"2022-07-05T11:46:09.028627+0000","last_became_active":"2022-07-05T11:46:04.592770+0000","last_became_peered":"2022-07-05T11:46:04.592770+0000","last_unstale":"2022-07-05T11:46:09.028627+0000","last_undegraded":"2022-07-05T11:46:09.028627+0000","last_fullsized":"2022-07-05T11:46:09.028627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:22.362211+0000","last_change":"2022-07-05T11:46:04.205846+0000","last_active":"2022-07-05T11:46:22.362211+0000","last_peered":"2022-07-05T11:46:22.362211+0000","last_clean":"2022-07-05T11:46:22.362211+0000","last_became_active":"2022-07-05T11:46:04.205358+0000","last_became_peered":"2022-07-05T11:46:04.205358+0000","last_unstale":"2022-07-05T11:46:22.362211+0000","last_undegraded":"2022-07-05T11:46:22.362211+0000","last_fullsized":"2022-07-05T11:46:22.362211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028856+0000","last_change":"2022-07-05T11:46:00.171709+0000","last_active":"2022-07-05T11:46:09.028856+0000","last_peered":"2022-07-05T11:46:09.028856+0000","last_clean":"2022-07-05T11:46:09.028856+0000","last_became_active":"2022-07-05T11:46:00.171328+0000","last_became_peered":"2022-07-05T11:46:00.171328+0000","last_unstale":"2022-07-05T11:46:09.028856+0000","last_undegraded":"2022-07-05T11:46:09.028856+0000","last_fullsized":"2022-07-05T11:46:09.028856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017640+0000","last_change":"2022-07-05T11:46:09.015332+0000","last_active":"2022-07-05T11:46:09.017640+0000","last_peered":"2022-07-05T11:46:09.017640+0000","last_clean":"2022-07-05T11:46:09.017640+0000","last_became_active":"2022-07-05T11:46:09.013688+0000","last_became_peered":"2022-07-05T11:46:09.013688+0000","last_unstale":"2022-07-05T11:46:09.017640+0000","last_undegraded":"2022-07-05T11:46:09.017640+0000","last_fullsized":"2022-07-05T11:46:09.017640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028419+0000","last_change":"2022-07-05T11:46:04.600986+0000","last_active":"2022-07-05T11:46:09.028419+0000","last_peered":"2022-07-05T11:46:09.028419+0000","last_clean":"2022-07-05T11:46:09.028419+0000","last_became_active":"2022-07-05T11:46:04.600619+0000","last_became_peered":"2022-07-05T11:46:04.600619+0000","last_unstale":"2022-07-05T11:46:09.028419+0000","last_undegraded":"2022-07-05T11:46:09.028419+0000","last_fullsized":"2022-07-05T11:46:09.028419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030201+0000","last_change":"2022-07-05T11:46:04.201044+0000","last_active":"2022-07-05T11:46:09.030201+0000","last_peered":"2022-07-05T11:46:09.030201+0000","last_clean":"2022-07-05T11:46:09.030201+0000","last_became_active":"2022-07-05T11:46:04.200743+0000","last_became_peered":"2022-07-05T11:46:04.200743+0000","last_unstale":"2022-07-05T11:46:09.030201+0000","last_undegraded":"2022-07-05T11:46:09.030201+0000","last_fullsized":"2022-07-05T11:46:09.030201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974024+0000","last_change":"2022-07-05T11:46:00.406891+0000","last_active":"2022-07-05T11:46:08.974024+0000","last_peered":"2022-07-05T11:46:08.974024+0000","last_clean":"2022-07-05T11:46:08.974024+0000","last_became_active":"2022-07-05T11:46:00.406555+0000","last_became_peered":"2022-07-05T11:46:00.406555+0000","last_unstale":"2022-07-05T11:46:08.974024+0000","last_undegraded":"2022-07-05T11:46:08.974024+0000","last_fullsized":"2022-07-05T11:46:08.974024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027228+0000","last_change":"2022-07-05T11:46:09.014076+0000","last_active":"2022-07-05T11:46:09.027228+0000","last_peered":"2022-07-05T11:46:09.027228+0000","last_clean":"2022-07-05T11:46:09.027228+0000","last_became_active":"2022-07-05T11:46:09.013674+0000","last_became_peered":"2022-07-05T11:46:09.013674+0000","last_unstale":"2022-07-05T11:46:09.027228+0000","last_undegraded":"2022-07-05T11:46:09.027228+0000","last_fullsized":"2022-07-05T11:46:09.027228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974896+0000","last_change":"2022-07-05T11:46:04.204890+0000","last_active":"2022-07-05T11:46:08.974896+0000","last_peered":"2022-07-05T11:46:08.974896+0000","last_clean":"2022-07-05T11:46:08.974896+0000","last_became_active":"2022-07-05T11:46:04.204615+0000","last_became_peered":"2022-07-05T11:46:04.204615+0000","last_unstale":"2022-07-05T11:46:08.974896+0000","last_undegraded":"2022-07-05T11:46:08.974896+0000","last_fullsized":"2022-07-05T11:46:08.974896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974109+0000","last_change":"2022-07-05T11:46:04.592359+0000","last_active":"2022-07-05T11:46:08.974109+0000","last_peered":"2022-07-05T11:46:08.974109+0000","last_clean":"2022-07-05T11:46:08.974109+0000","last_became_active":"2022-07-05T11:46:04.592112+0000","last_became_peered":"2022-07-05T11:46:04.592112+0000","last_unstale":"2022-07-05T11:46:08.974109+0000","last_undegraded":"2022-07-05T11:46:08.974109+0000","last_fullsized":"2022-07-05T11:46:08.974109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027403+0000","last_change":"2022-07-05T11:46:09.016814+0000","last_active":"2022-07-05T11:46:09.027403+0000","last_peered":"2022-07-05T11:46:09.027403+0000","last_clean":"2022-07-05T11:46:09.027403+0000","last_became_active":"2022-07-05T11:46:09.016282+0000","last_became_peered":"2022-07-05T11:46:09.016282+0000","last_unstale":"2022-07-05T11:46:09.027403+0000","last_undegraded":"2022-07-05T11:46:09.027403+0000","last_fullsized":"2022-07-05T11:46:09.027403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353211+0000","last_change":"2022-07-05T11:46:04.199484+0000","last_active":"2022-07-05T11:46:20.353211+0000","last_peered":"2022-07-05T11:46:20.353211+0000","last_clean":"2022-07-05T11:46:20.353211+0000","last_became_active":"2022-07-05T11:46:04.199190+0000","last_became_peered":"2022-07-05T11:46:04.199190+0000","last_unstale":"2022-07-05T11:46:20.353211+0000","last_undegraded":"2022-07-05T11:46:20.353211+0000","last_fullsized":"2022-07-05T11:46:20.353211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012845+0000","last_change":"2022-07-05T11:46:04.594175+0000","last_active":"2022-07-05T11:46:09.012845+0000","last_peered":"2022-07-05T11:46:09.012845+0000","last_clean":"2022-07-05T11:46:09.012845+0000","last_became_active":"2022-07-05T11:46:04.593700+0000","last_became_peered":"2022-07-05T11:46:04.593700+0000","last_unstale":"2022-07-05T11:46:09.012845+0000","last_undegraded":"2022-07-05T11:46:09.012845+0000","last_fullsized":"2022-07-05T11:46:09.012845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013139+0000","last_change":"2022-07-05T11:46:08.614509+0000","last_active":"2022-07-05T11:46:09.013139+0000","last_peered":"2022-07-05T11:46:09.013139+0000","last_clean":"2022-07-05T11:46:09.013139+0000","last_became_active":"2022-07-05T11:46:08.613935+0000","last_became_peered":"2022-07-05T11:46:08.613935+0000","last_unstale":"2022-07-05T11:46:09.013139+0000","last_undegraded":"2022-07-05T11:46:09.013139+0000","last_fullsized":"2022-07-05T11:46:09.013139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028943+0000","last_change":"2022-07-05T11:46:04.210344+0000","last_active":"2022-07-05T11:46:09.028943+0000","last_peered":"2022-07-05T11:46:09.028943+0000","last_clean":"2022-07-05T11:46:09.028943+0000","last_became_active":"2022-07-05T11:46:04.210054+0000","last_became_peered":"2022-07-05T11:46:04.210054+0000","last_unstale":"2022-07-05T11:46:09.028943+0000","last_undegraded":"2022-07-05T11:46:09.028943+0000","last_fullsized":"2022-07-05T11:46:09.028943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013018+0000","last_change":"2022-07-05T11:46:04.601851+0000","last_active":"2022-07-05T11:46:09.013018+0000","last_peered":"2022-07-05T11:46:09.013018+0000","last_clean":"2022-07-05T11:46:09.013018+0000","last_became_active":"2022-07-05T11:46:04.601528+0000","last_became_peered":"2022-07-05T11:46:04.601528+0000","last_unstale":"2022-07-05T11:46:09.013018+0000","last_undegraded":"2022-07-05T11:46:09.013018+0000","last_fullsized":"2022-07-05T11:46:09.013018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029283+0000","last_change":"2022-07-05T11:46:08.613389+0000","last_active":"2022-07-05T11:46:09.029283+0000","last_peered":"2022-07-05T11:46:09.029283+0000","last_clean":"2022-07-05T11:46:09.029283+0000","last_became_active":"2022-07-05T11:46:08.612988+0000","last_became_peered":"2022-07-05T11:46:08.612988+0000","last_unstale":"2022-07-05T11:46:09.029283+0000","last_undegraded":"2022-07-05T11:46:09.029283+0000","last_fullsized":"2022-07-05T11:46:09.029283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407358+0000","last_change":"2022-07-05T11:46:04.203173+0000","last_active":"2022-07-05T11:46:10.407358+0000","last_peered":"2022-07-05T11:46:10.407358+0000","last_clean":"2022-07-05T11:46:10.407358+0000","last_became_active":"2022-07-05T11:46:04.202879+0000","last_became_peered":"2022-07-05T11:46:04.202879+0000","last_unstale":"2022-07-05T11:46:10.407358+0000","last_undegraded":"2022-07-05T11:46:10.407358+0000","last_fullsized":"2022-07-05T11:46:10.407358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013005+0000","last_change":"2022-07-05T11:46:04.593203+0000","last_active":"2022-07-05T11:46:09.013005+0000","last_peered":"2022-07-05T11:46:09.013005+0000","last_clean":"2022-07-05T11:46:09.013005+0000","last_became_active":"2022-07-05T11:46:04.592953+0000","last_became_peered":"2022-07-05T11:46:04.592953+0000","last_unstale":"2022-07-05T11:46:09.013005+0000","last_undegraded":"2022-07-05T11:46:09.013005+0000","last_fullsized":"2022-07-05T11:46:09.013005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975419+0000","last_change":"2022-07-05T11:46:08.617348+0000","last_active":"2022-07-05T11:46:08.975419+0000","last_peered":"2022-07-05T11:46:08.975419+0000","last_clean":"2022-07-05T11:46:08.975419+0000","last_became_active":"2022-07-05T11:46:08.616964+0000","last_became_peered":"2022-07-05T11:46:08.616964+0000","last_unstale":"2022-07-05T11:46:08.975419+0000","last_undegraded":"2022-07-05T11:46:08.975419+0000","last_fullsized":"2022-07-05T11:46:08.975419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.213520+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.213132+0000","last_became_peered":"2022-07-05T11:46:04.213132+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027579+0000","last_change":"2022-07-05T11:46:04.589449+0000","last_active":"2022-07-05T11:46:09.027579+0000","last_peered":"2022-07-05T11:46:09.027579+0000","last_clean":"2022-07-05T11:46:09.027579+0000","last_became_active":"2022-07-05T11:46:04.589174+0000","last_became_peered":"2022-07-05T11:46:04.589174+0000","last_unstale":"2022-07-05T11:46:09.027579+0000","last_undegraded":"2022-07-05T11:46:09.027579+0000","last_fullsized":"2022-07-05T11:46:09.027579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027455+0000","last_change":"2022-07-05T11:46:08.617763+0000","last_active":"2022-07-05T11:46:09.027455+0000","last_peered":"2022-07-05T11:46:09.027455+0000","last_clean":"2022-07-05T11:46:09.027455+0000","last_became_active":"2022-07-05T11:46:08.617423+0000","last_became_peered":"2022-07-05T11:46:08.617423+0000","last_unstale":"2022-07-05T11:46:09.027455+0000","last_undegraded":"2022-07-05T11:46:09.027455+0000","last_fullsized":"2022-07-05T11:46:09.027455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030147+0000","last_change":"2022-07-05T11:46:04.211055+0000","last_active":"2022-07-05T11:46:09.030147+0000","last_peered":"2022-07-05T11:46:09.030147+0000","last_clean":"2022-07-05T11:46:09.030147+0000","last_became_active":"2022-07-05T11:46:04.210609+0000","last_became_peered":"2022-07-05T11:46:04.210609+0000","last_unstale":"2022-07-05T11:46:09.030147+0000","last_undegraded":"2022-07-05T11:46:09.030147+0000","last_fullsized":"2022-07-05T11:46:09.030147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028195+0000","last_change":"2022-07-05T11:46:04.583067+0000","last_active":"2022-07-05T11:46:09.028195+0000","last_peered":"2022-07-05T11:46:09.028195+0000","last_clean":"2022-07-05T11:46:09.028195+0000","last_became_active":"2022-07-05T11:46:04.582776+0000","last_became_peered":"2022-07-05T11:46:04.582776+0000","last_unstale":"2022-07-05T11:46:09.028195+0000","last_undegraded":"2022-07-05T11:46:09.028195+0000","last_fullsized":"2022-07-05T11:46:09.028195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975477+0000","last_change":"2022-07-05T11:46:08.619668+0000","last_active":"2022-07-05T11:46:08.975477+0000","last_peered":"2022-07-05T11:46:08.975477+0000","last_clean":"2022-07-05T11:46:08.975477+0000","last_became_active":"2022-07-05T11:46:08.619010+0000","last_became_peered":"2022-07-05T11:46:08.619010+0000","last_unstale":"2022-07-05T11:46:08.975477+0000","last_undegraded":"2022-07-05T11:46:08.975477+0000","last_fullsized":"2022-07-05T11:46:08.975477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975957+0000","last_change":"2022-07-05T11:46:04.202962+0000","last_active":"2022-07-05T11:46:08.975957+0000","last_peered":"2022-07-05T11:46:08.975957+0000","last_clean":"2022-07-05T11:46:08.975957+0000","last_became_active":"2022-07-05T11:46:04.202639+0000","last_became_peered":"2022-07-05T11:46:04.202639+0000","last_unstale":"2022-07-05T11:46:08.975957+0000","last_undegraded":"2022-07-05T11:46:08.975957+0000","last_fullsized":"2022-07-05T11:46:08.975957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975054+0000","last_change":"2022-07-05T11:46:04.595796+0000","last_active":"2022-07-05T11:46:08.975054+0000","last_peered":"2022-07-05T11:46:08.975054+0000","last_clean":"2022-07-05T11:46:08.975054+0000","last_became_active":"2022-07-05T11:46:04.595457+0000","last_became_peered":"2022-07-05T11:46:04.595457+0000","last_unstale":"2022-07-05T11:46:08.975054+0000","last_undegraded":"2022-07-05T11:46:08.975054+0000","last_fullsized":"2022-07-05T11:46:08.975054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027470+0000","last_change":"2022-07-05T11:46:08.617306+0000","last_active":"2022-07-05T11:46:09.027470+0000","last_peered":"2022-07-05T11:46:09.027470+0000","last_clean":"2022-07-05T11:46:09.027470+0000","last_became_active":"2022-07-05T11:46:08.616927+0000","last_became_peered":"2022-07-05T11:46:08.616927+0000","last_unstale":"2022-07-05T11:46:09.027470+0000","last_undegraded":"2022-07-05T11:46:09.027470+0000","last_fullsized":"2022-07-05T11:46:09.027470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.171485+0000","last_change":"2022-07-05T11:46:04.205780+0000","last_active":"2022-07-05T11:46:10.171485+0000","last_peered":"2022-07-05T11:46:10.171485+0000","last_clean":"2022-07-05T11:46:10.171485+0000","last_became_active":"2022-07-05T11:46:04.205486+0000","last_became_peered":"2022-07-05T11:46:04.205486+0000","last_unstale":"2022-07-05T11:46:10.171485+0000","last_undegraded":"2022-07-05T11:46:10.171485+0000","last_fullsized":"2022-07-05T11:46:10.171485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974611+0000","last_change":"2022-07-05T11:46:04.606819+0000","last_active":"2022-07-05T11:46:08.974611+0000","last_peered":"2022-07-05T11:46:08.974611+0000","last_clean":"2022-07-05T11:46:08.974611+0000","last_became_active":"2022-07-05T11:46:04.606484+0000","last_became_peered":"2022-07-05T11:46:04.606484+0000","last_unstale":"2022-07-05T11:46:08.974611+0000","last_undegraded":"2022-07-05T11:46:08.974611+0000","last_fullsized":"2022-07-05T11:46:08.974611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028555+0000","last_change":"2022-07-05T11:46:08.617224+0000","last_active":"2022-07-05T11:46:09.028555+0000","last_peered":"2022-07-05T11:46:09.028555+0000","last_clean":"2022-07-05T11:46:09.028555+0000","last_became_active":"2022-07-05T11:46:08.616821+0000","last_became_peered":"2022-07-05T11:46:08.616821+0000","last_unstale":"2022-07-05T11:46:09.028555+0000","last_undegraded":"2022-07-05T11:46:09.028555+0000","last_fullsized":"2022-07-05T11:46:09.028555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.170891+0000","last_change":"2022-07-05T11:46:04.204034+0000","last_active":"2022-07-05T11:46:10.170891+0000","last_peered":"2022-07-05T11:46:10.170891+0000","last_clean":"2022-07-05T11:46:10.170891+0000","last_became_active":"2022-07-05T11:46:04.203694+0000","last_became_peered":"2022-07-05T11:46:04.203694+0000","last_unstale":"2022-07-05T11:46:10.170891+0000","last_undegraded":"2022-07-05T11:46:10.170891+0000","last_fullsized":"2022-07-05T11:46:10.170891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974125+0000","last_change":"2022-07-05T11:46:04.593441+0000","last_active":"2022-07-05T11:46:08.974125+0000","last_peered":"2022-07-05T11:46:08.974125+0000","last_clean":"2022-07-05T11:46:08.974125+0000","last_became_active":"2022-07-05T11:46:04.593175+0000","last_became_peered":"2022-07-05T11:46:04.593175+0000","last_unstale":"2022-07-05T11:46:08.974125+0000","last_undegraded":"2022-07-05T11:46:08.974125+0000","last_fullsized":"2022-07-05T11:46:08.974125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028366+0000","last_change":"2022-07-05T11:46:09.016544+0000","last_active":"2022-07-05T11:46:09.028366+0000","last_peered":"2022-07-05T11:46:09.028366+0000","last_clean":"2022-07-05T11:46:09.028366+0000","last_became_active":"2022-07-05T11:46:09.016045+0000","last_became_peered":"2022-07-05T11:46:09.016045+0000","last_unstale":"2022-07-05T11:46:09.028366+0000","last_undegraded":"2022-07-05T11:46:09.028366+0000","last_fullsized":"2022-07-05T11:46:09.028366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'3","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371602+0000","last_change":"2022-07-05T11:46:04.207209+0000","last_active":"2022-07-05T11:46:25.371602+0000","last_peered":"2022-07-05T11:46:25.371602+0000","last_clean":"2022-07-05T11:46:25.371602+0000","last_became_active":"2022-07-05T11:46:04.206333+0000","last_became_peered":"2022-07-05T11:46:04.206333+0000","last_unstale":"2022-07-05T11:46:25.371602+0000","last_undegraded":"2022-07-05T11:46:25.371602+0000","last_fullsized":"2022-07-05T11:46:25.371602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029985+0000","last_change":"2022-07-05T11:46:04.591635+0000","last_active":"2022-07-05T11:46:09.029985+0000","last_peered":"2022-07-05T11:46:09.029985+0000","last_clean":"2022-07-05T11:46:09.029985+0000","last_became_active":"2022-07-05T11:46:04.591370+0000","last_became_peered":"2022-07-05T11:46:04.591370+0000","last_unstale":"2022-07-05T11:46:09.029985+0000","last_undegraded":"2022-07-05T11:46:09.029985+0000","last_fullsized":"2022-07-05T11:46:09.029985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029798+0000","last_change":"2022-07-05T11:46:08.617287+0000","last_active":"2022-07-05T11:46:09.029798+0000","last_peered":"2022-07-05T11:46:09.029798+0000","last_clean":"2022-07-05T11:46:09.029798+0000","last_became_active":"2022-07-05T11:46:08.616929+0000","last_became_peered":"2022-07-05T11:46:08.616929+0000","last_unstale":"2022-07-05T11:46:09.029798+0000","last_undegraded":"2022-07-05T11:46:09.029798+0000","last_fullsized":"2022-07-05T11:46:09.029798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352160+0000","last_change":"2022-07-05T11:46:04.207520+0000","last_active":"2022-07-05T11:46:20.352160+0000","last_peered":"2022-07-05T11:46:20.352160+0000","last_clean":"2022-07-05T11:46:20.352160+0000","last_became_active":"2022-07-05T11:46:04.207167+0000","last_became_peered":"2022-07-05T11:46:04.207167+0000","last_unstale":"2022-07-05T11:46:20.352160+0000","last_undegraded":"2022-07-05T11:46:20.352160+0000","last_fullsized":"2022-07-05T11:46:20.352160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975400+0000","last_change":"2022-07-05T11:46:04.606473+0000","last_active":"2022-07-05T11:46:08.975400+0000","last_peered":"2022-07-05T11:46:08.975400+0000","last_clean":"2022-07-05T11:46:08.975400+0000","last_became_active":"2022-07-05T11:46:04.606183+0000","last_became_peered":"2022-07-05T11:46:04.606183+0000","last_unstale":"2022-07-05T11:46:08.975400+0000","last_undegraded":"2022-07-05T11:46:08.975400+0000","last_fullsized":"2022-07-05T11:46:08.975400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029169+0000","last_change":"2022-07-05T11:46:08.615322+0000","last_active":"2022-07-05T11:46:09.029169+0000","last_peered":"2022-07-05T11:46:09.029169+0000","last_clean":"2022-07-05T11:46:09.029169+0000","last_became_active":"2022-07-05T11:46:08.614916+0000","last_became_peered":"2022-07-05T11:46:08.614916+0000","last_unstale":"2022-07-05T11:46:09.029169+0000","last_undegraded":"2022-07-05T11:46:09.029169+0000","last_fullsized":"2022-07-05T11:46:09.029169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352984+0000","last_change":"2022-07-05T11:46:04.207417+0000","last_active":"2022-07-05T11:46:20.352984+0000","last_peered":"2022-07-05T11:46:20.352984+0000","last_clean":"2022-07-05T11:46:20.352984+0000","last_became_active":"2022-07-05T11:46:04.207078+0000","last_became_peered":"2022-07-05T11:46:04.207078+0000","last_unstale":"2022-07-05T11:46:20.352984+0000","last_undegraded":"2022-07-05T11:46:20.352984+0000","last_fullsized":"2022-07-05T11:46:20.352984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976049+0000","last_change":"2022-07-05T11:46:04.597152+0000","last_active":"2022-07-05T11:46:08.976049+0000","last_peered":"2022-07-05T11:46:08.976049+0000","last_clean":"2022-07-05T11:46:08.976049+0000","last_became_active":"2022-07-05T11:46:04.596847+0000","last_became_peered":"2022-07-05T11:46:04.596847+0000","last_unstale":"2022-07-05T11:46:08.976049+0000","last_undegraded":"2022-07-05T11:46:08.976049+0000","last_fullsized":"2022-07-05T11:46:08.976049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029455+0000","last_change":"2022-07-05T11:46:08.615281+0000","last_active":"2022-07-05T11:46:09.029455+0000","last_peered":"2022-07-05T11:46:09.029455+0000","last_clean":"2022-07-05T11:46:09.029455+0000","last_became_active":"2022-07-05T11:46:08.614859+0000","last_became_peered":"2022-07-05T11:46:08.614859+0000","last_unstale":"2022-07-05T11:46:09.029455+0000","last_undegraded":"2022-07-05T11:46:09.029455+0000","last_fullsized":"2022-07-05T11:46:09.029455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.369437+0000","last_change":"2022-07-05T11:46:04.209548+0000","last_active":"2022-07-05T11:46:25.369437+0000","last_peered":"2022-07-05T11:46:25.369437+0000","last_clean":"2022-07-05T11:46:25.369437+0000","last_became_active":"2022-07-05T11:46:04.209278+0000","last_became_peered":"2022-07-05T11:46:04.209278+0000","last_unstale":"2022-07-05T11:46:25.369437+0000","last_undegraded":"2022-07-05T11:46:25.369437+0000","last_fullsized":"2022-07-05T11:46:25.369437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012545+0000","last_change":"2022-07-05T11:46:04.601803+0000","last_active":"2022-07-05T11:46:09.012545+0000","last_peered":"2022-07-05T11:46:09.012545+0000","last_clean":"2022-07-05T11:46:09.012545+0000","last_became_active":"2022-07-05T11:46:04.601475+0000","last_became_peered":"2022-07-05T11:46:04.601475+0000","last_unstale":"2022-07-05T11:46:09.012545+0000","last_undegraded":"2022-07-05T11:46:09.012545+0000","last_fullsized":"2022-07-05T11:46:09.012545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028752+0000","last_change":"2022-07-05T11:46:08.617939+0000","last_active":"2022-07-05T11:46:09.028752+0000","last_peered":"2022-07-05T11:46:09.028752+0000","last_clean":"2022-07-05T11:46:09.028752+0000","last_became_active":"2022-07-05T11:46:08.617538+0000","last_became_peered":"2022-07-05T11:46:08.617538+0000","last_unstale":"2022-07-05T11:46:09.028752+0000","last_undegraded":"2022-07-05T11:46:09.028752+0000","last_fullsized":"2022-07-05T11:46:09.028752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352085+0000","last_change":"2022-07-05T11:46:04.199561+0000","last_active":"2022-07-05T11:46:20.352085+0000","last_peered":"2022-07-05T11:46:20.352085+0000","last_clean":"2022-07-05T11:46:20.352085+0000","last_became_active":"2022-07-05T11:46:04.199232+0000","last_became_peered":"2022-07-05T11:46:04.199232+0000","last_unstale":"2022-07-05T11:46:20.352085+0000","last_undegraded":"2022-07-05T11:46:20.352085+0000","last_fullsized":"2022-07-05T11:46:20.352085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973881+0000","last_change":"2022-07-05T11:46:04.601813+0000","last_active":"2022-07-05T11:46:08.973881+0000","last_peered":"2022-07-05T11:46:08.973881+0000","last_clean":"2022-07-05T11:46:08.973881+0000","last_became_active":"2022-07-05T11:46:04.601595+0000","last_became_peered":"2022-07-05T11:46:04.601595+0000","last_unstale":"2022-07-05T11:46:08.973881+0000","last_undegraded":"2022-07-05T11:46:08.973881+0000","last_fullsized":"2022-07-05T11:46:08.973881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975282+0000","last_change":"2022-07-05T11:46:08.621246+0000","last_active":"2022-07-05T11:46:08.975282+0000","last_peered":"2022-07-05T11:46:08.975282+0000","last_clean":"2022-07-05T11:46:08.975282+0000","last_became_active":"2022-07-05T11:46:08.620839+0000","last_became_peered":"2022-07-05T11:46:08.620839+0000","last_unstale":"2022-07-05T11:46:08.975282+0000","last_undegraded":"2022-07-05T11:46:08.975282+0000","last_fullsized":"2022-07-05T11:46:08.975282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029752+0000","last_change":"2022-07-05T11:46:04.204062+0000","last_active":"2022-07-05T11:46:09.029752+0000","last_peered":"2022-07-05T11:46:09.029752+0000","last_clean":"2022-07-05T11:46:09.029752+0000","last_became_active":"2022-07-05T11:46:04.203763+0000","last_became_peered":"2022-07-05T11:46:04.203763+0000","last_unstale":"2022-07-05T11:46:09.029752+0000","last_undegraded":"2022-07-05T11:46:09.029752+0000","last_fullsized":"2022-07-05T11:46:09.029752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029094+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.029094+0000","last_peered":"2022-07-05T11:46:09.029094+0000","last_clean":"2022-07-05T11:46:09.029094+0000","last_became_active":"2022-07-05T11:46:04.595288+0000","last_became_peered":"2022-07-05T11:46:04.595288+0000","last_unstale":"2022-07-05T11:46:09.029094+0000","last_undegraded":"2022-07-05T11:46:09.029094+0000","last_fullsized":"2022-07-05T11:46:09.029094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027709+0000","last_change":"2022-07-05T11:46:08.617183+0000","last_active":"2022-07-05T11:46:09.027709+0000","last_peered":"2022-07-05T11:46:09.027709+0000","last_clean":"2022-07-05T11:46:09.027709+0000","last_became_active":"2022-07-05T11:46:08.616762+0000","last_became_peered":"2022-07-05T11:46:08.616762+0000","last_unstale":"2022-07-05T11:46:09.027709+0000","last_undegraded":"2022-07-05T11:46:09.027709+0000","last_fullsized":"2022-07-05T11:46:09.027709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:25.371041+0000","last_change":"2022-07-05T11:46:04.206938+0000","last_active":"2022-07-05T11:46:25.371041+0000","last_peered":"2022-07-05T11:46:25.371041+0000","last_clean":"2022-07-05T11:46:25.371041+0000","last_became_active":"2022-07-05T11:46:04.206676+0000","last_became_peered":"2022-07-05T11:46:04.206676+0000","last_unstale":"2022-07-05T11:46:25.371041+0000","last_undegraded":"2022-07-05T11:46:25.371041+0000","last_fullsized":"2022-07-05T11:46:25.371041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973848+0000","last_change":"2022-07-05T11:46:04.589404+0000","last_active":"2022-07-05T11:46:08.973848+0000","last_peered":"2022-07-05T11:46:08.973848+0000","last_clean":"2022-07-05T11:46:08.973848+0000","last_became_active":"2022-07-05T11:46:04.589158+0000","last_became_peered":"2022-07-05T11:46:04.589158+0000","last_unstale":"2022-07-05T11:46:08.973848+0000","last_undegraded":"2022-07-05T11:46:08.973848+0000","last_fullsized":"2022-07-05T11:46:08.973848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028490+0000","last_change":"2022-07-05T11:46:08.619220+0000","last_active":"2022-07-05T11:46:09.028490+0000","last_peered":"2022-07-05T11:46:09.028490+0000","last_clean":"2022-07-05T11:46:09.028490+0000","last_became_active":"2022-07-05T11:46:08.618815+0000","last_became_peered":"2022-07-05T11:46:08.618815+0000","last_unstale":"2022-07-05T11:46:09.028490+0000","last_undegraded":"2022-07-05T11:46:09.028490+0000","last_fullsized":"2022-07-05T11:46:09.028490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974161+0000","last_change":"2022-07-05T11:46:08.617688+0000","last_active":"2022-07-05T11:46:08.974161+0000","last_peered":"2022-07-05T11:46:08.974161+0000","last_clean":"2022-07-05T11:46:08.974161+0000","last_became_active":"2022-07-05T11:46:08.617331+0000","last_became_peered":"2022-07-05T11:46:08.617331+0000","last_unstale":"2022-07-05T11:46:08.974161+0000","last_undegraded":"2022-07-05T11:46:08.974161+0000","last_fullsized":"2022-07-05T11:46:08.974161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029067+0000","last_change":"2022-07-05T11:46:04.199672+0000","last_active":"2022-07-05T11:46:09.029067+0000","last_peered":"2022-07-05T11:46:09.029067+0000","last_clean":"2022-07-05T11:46:09.029067+0000","last_became_active":"2022-07-05T11:46:04.199366+0000","last_became_peered":"2022-07-05T11:46:04.199366+0000","last_unstale":"2022-07-05T11:46:09.029067+0000","last_undegraded":"2022-07-05T11:46:09.029067+0000","last_fullsized":"2022-07-05T11:46:09.029067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976202+0000","last_change":"2022-07-05T11:46:04.598274+0000","last_active":"2022-07-05T11:46:08.976202+0000","last_peered":"2022-07-05T11:46:08.976202+0000","last_clean":"2022-07-05T11:46:08.976202+0000","last_became_active":"2022-07-05T11:46:04.597995+0000","last_became_peered":"2022-07-05T11:46:04.597995+0000","last_unstale":"2022-07-05T11:46:08.976202+0000","last_undegraded":"2022-07-05T11:46:08.976202+0000","last_fullsized":"2022-07-05T11:46:08.976202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030310+0000","last_change":"2022-07-05T11:46:08.612501+0000","last_active":"2022-07-05T11:46:09.030310+0000","last_peered":"2022-07-05T11:46:09.030310+0000","last_clean":"2022-07-05T11:46:09.030310+0000","last_became_active":"2022-07-05T11:46:08.611956+0000","last_became_peered":"2022-07-05T11:46:08.611956+0000","last_unstale":"2022-07-05T11:46:09.030310+0000","last_undegraded":"2022-07-05T11:46:09.030310+0000","last_fullsized":"2022-07-05T11:46:09.030310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973916+0000","last_change":"2022-07-05T11:46:04.212557+0000","last_active":"2022-07-05T11:46:08.973916+0000","last_peered":"2022-07-05T11:46:08.973916+0000","last_clean":"2022-07-05T11:46:08.973916+0000","last_became_active":"2022-07-05T11:46:04.212259+0000","last_became_peered":"2022-07-05T11:46:04.212259+0000","last_unstale":"2022-07-05T11:46:08.973916+0000","last_undegraded":"2022-07-05T11:46:08.973916+0000","last_fullsized":"2022-07-05T11:46:08.973916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028001+0000","last_change":"2022-07-05T11:46:04.593690+0000","last_active":"2022-07-05T11:46:09.028001+0000","last_peered":"2022-07-05T11:46:09.028001+0000","last_clean":"2022-07-05T11:46:09.028001+0000","last_became_active":"2022-07-05T11:46:04.593427+0000","last_became_peered":"2022-07-05T11:46:04.593427+0000","last_unstale":"2022-07-05T11:46:09.028001+0000","last_undegraded":"2022-07-05T11:46:09.028001+0000","last_fullsized":"2022-07-05T11:46:09.028001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028319+0000","last_change":"2022-07-05T11:46:04.204419+0000","last_active":"2022-07-05T11:46:09.028319+0000","last_peered":"2022-07-05T11:46:09.028319+0000","last_clean":"2022-07-05T11:46:09.028319+0000","last_became_active":"2022-07-05T11:46:04.204078+0000","last_became_peered":"2022-07-05T11:46:04.204078+0000","last_unstale":"2022-07-05T11:46:09.028319+0000","last_undegraded":"2022-07-05T11:46:09.028319+0000","last_fullsized":"2022-07-05T11:46:09.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028300+0000","last_change":"2022-07-05T11:46:04.600858+0000","last_active":"2022-07-05T11:46:09.028300+0000","last_peered":"2022-07-05T11:46:09.028300+0000","last_clean":"2022-07-05T11:46:09.028300+0000","last_became_active":"2022-07-05T11:46:04.600564+0000","last_became_peered":"2022-07-05T11:46:04.600564+0000","last_unstale":"2022-07-05T11:46:09.028300+0000","last_undegraded":"2022-07-05T11:46:09.028300+0000","last_fullsized":"2022-07-05T11:46:09.028300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017952+0000","last_change":"2022-07-05T11:46:09.017127+0000","last_active":"2022-07-05T11:46:09.017952+0000","last_peered":"2022-07-05T11:46:09.017952+0000","last_clean":"2022-07-05T11:46:09.017952+0000","last_became_active":"2022-07-05T11:46:09.016451+0000","last_became_peered":"2022-07-05T11:46:09.016451+0000","last_unstale":"2022-07-05T11:46:09.017952+0000","last_undegraded":"2022-07-05T11:46:09.017952+0000","last_fullsized":"2022-07-05T11:46:09.017952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7144,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":50,"num_read_kb":37,"num_write":128,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5348,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366492,"statfs":{"total":96636764160,"available":96631287808,"internally_reserved":0,"allocated":356352,"data_stored":165443,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":166661,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164957,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":163725,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":6,"up_from":17,"seq":73014444041,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":164777,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163647,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163717,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444040,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":4,"up_from":17,"seq":73014444041,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":168453,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366500,"statfs":{"total":96636764160,"available":96631296000,"internally_reserved":0,"allocated":348160,"data_stored":164851,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-07-05T11:46:30.909 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-07-05T11:46:30.909 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-07-05T11:46:30.910 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-07-05T11:46:30.910 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-07-05T11:46:31.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.049+0000 7fdbe551f700 1 Processor -- start 2022-07-05T11:46:31.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.049+0000 7fdbe551f700 1 -- start start 2022-07-05T11:46:31.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.050+0000 7fdbe551f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbe00c7360 0x7fdbe017ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.050+0000 7fdbe551f700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe017c8e0 con 0x7fdbe017aa30 2022-07-05T11:46:31.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.050+0000 7fdbe551f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00c7ac0 con 0x7fdbe00edf20 2022-07-05T11:46:31.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.050+0000 7fdbe551f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe017c310 con 0x7fdbe00c7360 2022-07-05T11:46:31.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdf7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbe00c7360 0x7fdbe017ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdeffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fdbe017aa30 0x7fdbe017cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50218/0 (socket says 172.21.15.90:50218) 2022-07-05T11:46:31.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdf7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbe00c7360 0x7fdbe017ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57280/0 (socket says 172.21.15.90:57280) 2022-07-05T11:46:31.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdeffd700 1 -- 172.21.15.90:0/4234565243 learned_addr learned my addr 172.21.15.90:0/4234565243 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:31.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdf7fe700 1 -- 172.21.15.90:0/4234565243 >> v1:172.21.15.110:6789/0 conn(0x7fdbe00edf20 legacy=0x7fdbe017d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdf7fe700 1 -- 172.21.15.90:0/4234565243 >> v1:172.21.15.90:6789/0 conn(0x7fdbe017aa30 legacy=0x7fdbe017cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdf7fe700 1 -- 172.21.15.90:0/4234565243 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe00c7da0 con 0x7fdbe00c7360 2022-07-05T11:46:31.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbddffb700 1 -- 172.21.15.90:0/4234565243 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080133686 0 0) 0x7fdbe017c8e0 con 0x7fdbe017aa30 2022-07-05T11:46:31.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbdf7fe700 1 --2- 172.21.15.90:0/4234565243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00c7360 0x7fdbe017ae10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdbd8009e60 tx=0x7fdbd8009780).ready entity=mon.0 client_cookie=26dcb866ae2a6c4a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbddffb700 1 -- 172.21.15.90:0/4234565243 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800e070 con 0x7fdbe00c7360 2022-07-05T11:46:31.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbddffb700 1 -- 172.21.15.90:0/4234565243 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800bc30 con 0x7fdbe00c7360 2022-07-05T11:46:31.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.051+0000 7fdbddffb700 1 -- 172.21.15.90:0/4234565243 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8012410 con 0x7fdbe00c7360 2022-07-05T11:46:31.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.052+0000 7fdbe551f700 1 -- 172.21.15.90:0/4234565243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00c7360 msgr2=0x7fdbe017ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.052+0000 7fdbe551f700 1 --2- 172.21.15.90:0/4234565243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00c7360 0x7fdbe017ae10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdbd8009e60 tx=0x7fdbd8009780).stop 2022-07-05T11:46:31.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.052+0000 7fdbe551f700 1 -- 172.21.15.90:0/4234565243 shutdown_connections 2022-07-05T11:46:31.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.052+0000 7fdbe551f700 1 --2- 172.21.15.90:0/4234565243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00c7360 0x7fdbe017ae10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.052+0000 7fdbe551f700 1 -- 172.21.15.90:0/4234565243 >> 172.21.15.90:0/4234565243 conn(0x7fdbe00f2400 msgr2=0x7fdbe00ee3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:31.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.052+0000 7fdbe551f700 1 -- 172.21.15.90:0/4234565243 shutdown_connections 2022-07-05T11:46:31.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.052+0000 7fdbe551f700 1 -- 172.21.15.90:0/4234565243 wait complete. 2022-07-05T11:46:31.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.053+0000 7fdbe551f700 1 Processor -- start 2022-07-05T11:46:31.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.053+0000 7fdbe551f700 1 -- start start 2022-07-05T11:46:31.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbe551f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c7360 0x7fdbe0169070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbe551f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00edf20 0x7fdbe017f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbe551f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbe017aa30 0x7fdbe018c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbe551f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0169560 con 0x7fdbe00edf20 2022-07-05T11:46:31.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbe551f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe018e1c0 con 0x7fdbe017aa30 2022-07-05T11:46:31.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbe551f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe018d550 con 0x7fdbe00c7360 2022-07-05T11:46:31.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbde7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00edf20 0x7fdbe017f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbde7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00edf20 0x7fdbe017f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57284/0 (socket says 172.21.15.90:57284) 2022-07-05T11:46:31.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.054+0000 7fdbde7fc700 1 -- 172.21.15.90:0/3657634988 learned_addr learned my addr 172.21.15.90:0/3657634988 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:31.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbdf7fe700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbe017aa30 0x7fdbe018c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbdeffd700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c7360 0x7fdbe0169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbde7fc700 1 -- 172.21.15.90:0/3657634988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c7360 msgr2=0x7fdbe0169070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbde7fc700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c7360 0x7fdbe0169070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbde7fc700 1 -- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbe017aa30 msgr2=0x7fdbe018c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbde7fc700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbe017aa30 0x7fdbe018c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbde7fc700 1 -- 172.21.15.90:0/3657634988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8009a20 con 0x7fdbe00edf20 2022-07-05T11:46:31.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbde7fc700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00edf20 0x7fdbe017f080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fdbd400c440 tx=0x7fdbd4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbc6ffd700 1 -- 172.21.15.90:0/3657634988 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400ce40 con 0x7fdbe00edf20 2022-07-05T11:46:31.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbc6ffd700 1 -- 172.21.15.90:0/3657634988 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd400f470 con 0x7fdbe00edf20 2022-07-05T11:46:31.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe018cf90 con 0x7fdbe00edf20 2022-07-05T11:46:31.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbc6ffd700 1 -- 172.21.15.90:0/3657634988 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400f810 con 0x7fdbe00edf20 2022-07-05T11:46:31.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.055+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe018db70 con 0x7fdbe00edf20 2022-07-05T11:46:31.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.056+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe006be40 con 0x7fdbe00edf20 2022-07-05T11:46:31.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.057+0000 7fdbc6ffd700 1 -- 172.21.15.90:0/3657634988 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fdbd4019030 con 0x7fdbe00edf20 2022-07-05T11:46:31.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.057+0000 7fdbc6ffd700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdbc008ba10 0x7fdbc008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.057+0000 7fdbc6ffd700 1 -- 172.21.15.90:0/3657634988 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fdbd40afd70 con 0x7fdbe00edf20 2022-07-05T11:46:31.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.058+0000 7fdbdeffd700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdbc008ba10 0x7fdbc008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.058+0000 7fdbdeffd700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdbc008ba10 0x7fdbc008ded0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdbd0001650 tx=0x7fdbd0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.061+0000 7fdbc6ffd700 1 -- 172.21.15.90:0/3657634988 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fdbd4080a30 con 0x7fdbe00edf20 2022-07-05T11:46:31.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.259+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdbe0173150 con 0x7fdbe00edf20 2022-07-05T11:46:31.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.259+0000 7fdbc6ffd700 1 -- 172.21.15.90:0/3657634988 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fdbd4017030 con 0x7fdbe00edf20 2022-07-05T11:46:31.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:31.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdbc008ba10 msgr2=0x7fdbc008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdbc008ba10 0x7fdbc008ded0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdbd0001650 tx=0x7fdbd0009040).stop 2022-07-05T11:46:31.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00edf20 msgr2=0x7fdbe017f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00edf20 0x7fdbe017f080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fdbd400c440 tx=0x7fdbd4007db0).stop 2022-07-05T11:46:31.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 shutdown_connections 2022-07-05T11:46:31.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdbc008ba10 0x7fdbc008ded0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbe017aa30 0x7fdbe018c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c7360 0x7fdbe0169070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 --2- 172.21.15.90:0/3657634988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00edf20 0x7fdbe017f080 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 >> 172.21.15.90:0/3657634988 conn(0x7fdbe00f2400 msgr2=0x7fdbe005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:31.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 shutdown_connections 2022-07-05T11:46:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.261+0000 7fdbe551f700 1 -- 172.21.15.90:0/3657634988 wait complete. 2022-07-05T11:46:31.274 INFO:teuthology.orchestra.run.smithi090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-07-05T11:46:31.275 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-07-05T11:46:31.276 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:31.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.388+0000 7efc40d8d700 1 Processor -- start 2022-07-05T11:46:31.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.388+0000 7efc40d8d700 1 -- start start 2022-07-05T11:46:31.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.389+0000 7efc40d8d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc3c0ca5d0 0x7efc3c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.389+0000 7efc40d8d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c0cb010 con 0x7efc3c17dc20 2022-07-05T11:46:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.389+0000 7efc40d8d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c0cb2f0 con 0x7efc3c0c9f20 2022-07-05T11:46:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.389+0000 7efc40d8d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0cb5d0 con 0x7efc3c0ca5d0 2022-07-05T11:46:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.389+0000 7efc3a59c700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7efc3c17dc20 0x7efc3c17e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50232/0 (socket says 172.21.15.90:50232) 2022-07-05T11:46:31.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.389+0000 7efc3a59c700 1 -- 172.21.15.90:0/1872324412 learned_addr learned my addr 172.21.15.90:0/1872324412 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:31.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201987712 0 0) 0x7efc3c0cb010 con 0x7efc3c17dc20 2022-07-05T11:46:31.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc1c0033f0 con 0x7efc3c17dc20 2022-07-05T11:46:31.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc39d9b700 1 --2- 172.21.15.90:0/1872324412 >> v2:172.21.15.149:3300/0 conn(0x7efc3c0ca5d0 0x7efc3c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2890389850 0 0) 0x7efc1c0033f0 con 0x7efc3c17dc20 2022-07-05T11:46:31.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 >> v2:172.21.15.149:3300/0 conn(0x7efc3c0ca5d0 msgr2=0x7efc3c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:31.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 --2- 172.21.15.90:0/1872324412 >> v2:172.21.15.149:3300/0 conn(0x7efc3c0ca5d0 0x7efc3c0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 >> v1:172.21.15.110:6789/0 conn(0x7efc3c0c9f20 legacy=0x7efc3c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c0cb8b0 con 0x7efc3c17dc20 2022-07-05T11:46:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7efc2c0017f0 con 0x7efc3c17dc20 2022-07-05T11:46:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 >> v1:172.21.15.90:6789/0 conn(0x7efc3c17dc20 legacy=0x7efc3c17e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c0038e0 0x7efc1c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c004690 0x7efc1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc1c005000 0x7efc1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0cb5d0 con 0x7efc1c005000 2022-07-05T11:46:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c00bee0 con 0x7efc1c0038e0 2022-07-05T11:46:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c00c0a0 con 0x7efc1c004690 2022-07-05T11:46:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3a59c700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c0038e0 0x7efc1c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc39d9b700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c004690 0x7efc1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3ad9d700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc1c005000 0x7efc1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc39d9b700 1 -- 172.21.15.90:0/1872324412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c0038e0 msgr2=0x7efc1c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:31.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc39d9b700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c0038e0 0x7efc1c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc39d9b700 1 -- 172.21.15.90:0/1872324412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc1c005000 msgr2=0x7efc1c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:31.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc39d9b700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc1c005000 0x7efc1c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc39d9b700 1 -- 172.21.15.90:0/1872324412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0033f0 con 0x7efc1c004690 2022-07-05T11:46:31.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.390+0000 7efc3ad9d700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc1c005000 0x7efc1c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:31.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc3ad9d700 1 -- 172.21.15.90:0/1872324412 reap_dead start 2022-07-05T11:46:31.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc39d9b700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c004690 0x7efc1c004b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efc24009a60 tx=0x7efc24009060).ready entity=mon.2 client_cookie=c88e28e43807dc1d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24009ea0 con 0x7efc1c004690 2022-07-05T11:46:31.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24009430 con 0x7efc1c004690 2022-07-05T11:46:31.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc3959a700 1 -- 172.21.15.90:0/1872324412 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400e870 con 0x7efc1c004690 2022-07-05T11:46:31.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc40d8d700 1 -- 172.21.15.90:0/1872324412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c004690 msgr2=0x7efc1c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc40d8d700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c004690 0x7efc1c004b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efc24009a60 tx=0x7efc24009060).stop 2022-07-05T11:46:31.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc40d8d700 1 -- 172.21.15.90:0/1872324412 shutdown_connections 2022-07-05T11:46:31.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc40d8d700 1 --2- 172.21.15.90:0/1872324412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c004690 0x7efc1c004b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc40d8d700 1 -- 172.21.15.90:0/1872324412 >> 172.21.15.90:0/1872324412 conn(0x7efc3c0f2100 msgr2=0x7efc3c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:31.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc40d8d700 1 -- 172.21.15.90:0/1872324412 shutdown_connections 2022-07-05T11:46:31.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.391+0000 7efc40d8d700 1 -- 172.21.15.90:0/1872324412 wait complete. 2022-07-05T11:46:31.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.393+0000 7efc40d8d700 1 Processor -- start 2022-07-05T11:46:31.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.393+0000 7efc40d8d700 1 -- start start 2022-07-05T11:46:31.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c004690 0x7efc3c172e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc3c0ebf10 0x7efc3c0ec390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc3c18ed50 0x7efc3c18f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c18fc80 con 0x7efc3c18ed50 2022-07-05T11:46:31.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c064410 con 0x7efc1c004690 2022-07-05T11:46:31.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c063f80 con 0x7efc3c0ebf10 2022-07-05T11:46:31.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc3c18ed50 0x7efc3c18f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc3c18ed50 0x7efc3c18f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57308/0 (socket says 172.21.15.90:57308) 2022-07-05T11:46:31.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 -- 172.21.15.90:0/153921961 learned_addr learned my addr 172.21.15.90:0/153921961 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:31.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc39d9b700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc3c0ebf10 0x7efc3c0ec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3a59c700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c004690 0x7efc3c172e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 -- 172.21.15.90:0/153921961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc3c0ebf10 msgr2=0x7efc3c0ec390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc3c0ebf10 0x7efc3c0ec390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 -- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c004690 msgr2=0x7efc3c172e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c004690 0x7efc3c172e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 -- 172.21.15.90:0/153921961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c173380 con 0x7efc3c18ed50 2022-07-05T11:46:31.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3a59c700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c004690 0x7efc3c172e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:31.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc3ad9d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc3c18ed50 0x7efc3c18f1d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efc3c0c7b80 tx=0x7efc34009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc327fc700 1 -- 172.21.15.90:0/153921961 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34011590 con 0x7efc3c18ed50 2022-07-05T11:46:31.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc327fc700 1 -- 172.21.15.90:0/153921961 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc340116f0 con 0x7efc3c18ed50 2022-07-05T11:46:31.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc327fc700 1 -- 172.21.15.90:0/153921961 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34011ab0 con 0x7efc3c18ed50 2022-07-05T11:46:31.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c063370 con 0x7efc3c18ed50 2022-07-05T11:46:31.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.394+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c063930 con 0x7efc3c18ed50 2022-07-05T11:46:31.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.395+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c0eb700 con 0x7efc3c18ed50 2022-07-05T11:46:31.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.396+0000 7efc327fc700 1 -- 172.21.15.90:0/153921961 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7efc3401a030 con 0x7efc3c18ed50 2022-07-05T11:46:31.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.397+0000 7efc327fc700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efc2008ba40 0x7efc2008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.397+0000 7efc327fc700 1 -- 172.21.15.90:0/153921961 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efc340afea0 con 0x7efc3c18ed50 2022-07-05T11:46:31.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.397+0000 7efc3a59c700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efc2008ba40 0x7efc2008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.398+0000 7efc3a59c700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efc2008ba40 0x7efc2008df00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7efc2c001920 tx=0x7efc2c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.401+0000 7efc327fc700 1 -- 172.21.15.90:0/153921961 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7efc34080b60 con 0x7efc3c18ed50 2022-07-05T11:46:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.563+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc3c065000 con 0x7efc3c18ed50 2022-07-05T11:46:31.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.564+0000 7efc327fc700 1 -- 172.21.15.90:0/153921961 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7efc34018070 con 0x7efc3c18ed50 2022-07-05T11:46:31.569 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:31.569 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:31.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efc2008ba40 msgr2=0x7efc2008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efc2008ba40 0x7efc2008df00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7efc2c001920 tx=0x7efc2c009040).stop 2022-07-05T11:46:31.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc3c18ed50 msgr2=0x7efc3c18f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc3c18ed50 0x7efc3c18f1d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efc3c0c7b80 tx=0x7efc34009040).stop 2022-07-05T11:46:31.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 shutdown_connections 2022-07-05T11:46:31.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efc2008ba40 0x7efc2008df00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc3c18ed50 0x7efc3c18f1d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc1c004690 0x7efc3c172e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 --2- 172.21.15.90:0/153921961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc3c0ebf10 0x7efc3c0ec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 >> 172.21.15.90:0/153921961 conn(0x7efc3c0f2100 msgr2=0x7efc3c173870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:31.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 shutdown_connections 2022-07-05T11:46:31.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.566+0000 7efc40d8d700 1 -- 172.21.15.90:0/153921961 wait complete. 2022-07-05T11:46:31.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-07-05T11:46:03.055092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-07-05T11:46:03.515295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-07-05T11:46:06.613134+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-07-05T11:46:31.580 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:31.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.702+0000 7efd3ba4c700 1 Processor -- start 2022-07-05T11:46:31.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.702+0000 7efd3ba4c700 1 -- start start 2022-07-05T11:46:31.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.703+0000 7efd3ba4c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efd34172100 0x7efd3417c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.703+0000 7efd3ba4c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd3417ce30 0x7efd3417ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd3ba4c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd34084500 con 0x7efd34171d20 2022-07-05T11:46:31.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd3ba4c700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd34083610 con 0x7efd34172100 2022-07-05T11:46:31.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd3ba4c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd340838f0 con 0x7efd3417ce30 2022-07-05T11:46:31.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efd34172100 0x7efd3417c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efd34172100 0x7efd3417c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57316/0 (socket says 172.21.15.90:57316) 2022-07-05T11:46:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 -- 172.21.15.90:0/2786317213 learned_addr learned my addr 172.21.15.90:0/2786317213 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd39fe9700 1 --2- 172.21.15.90:0/2786317213 >> v2:172.21.15.149:3300/0 conn(0x7efd3417ce30 0x7efd3417ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 -- 172.21.15.90:0/2786317213 >> v2:172.21.15.149:3300/0 conn(0x7efd3417ce30 msgr2=0x7efd3417ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:31.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 --2- 172.21.15.90:0/2786317213 >> v2:172.21.15.149:3300/0 conn(0x7efd3417ce30 0x7efd3417ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 -- 172.21.15.90:0/2786317213 >> v1:172.21.15.149:6789/0 conn(0x7efd34171d20 legacy=0x7efd3417bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 -- 172.21.15.90:0/2786317213 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd34083bd0 con 0x7efd34172100 2022-07-05T11:46:31.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd38fe7700 1 --2- 172.21.15.90:0/2786317213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd34172100 0x7efd3417c940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7efd340c9700 tx=0x7efd280090f0).ready entity=mon.0 client_cookie=b0856b19cc6205c6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd33fff700 1 -- 172.21.15.90:0/2786317213 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800b520 con 0x7efd34172100 2022-07-05T11:46:31.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd33fff700 1 -- 172.21.15.90:0/2786317213 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2800b680 con 0x7efd34172100 2022-07-05T11:46:31.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.704+0000 7efd33fff700 1 -- 172.21.15.90:0/2786317213 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800ba00 con 0x7efd34172100 2022-07-05T11:46:31.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 -- 172.21.15.90:0/2786317213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd34172100 msgr2=0x7efd3417c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/2786317213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd34172100 0x7efd3417c940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7efd340c9700 tx=0x7efd280090f0).stop 2022-07-05T11:46:31.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 -- 172.21.15.90:0/2786317213 shutdown_connections 2022-07-05T11:46:31.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/2786317213 >> v2:172.21.15.149:3300/0 conn(0x7efd3417ce30 0x7efd3417ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/2786317213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd34172100 0x7efd3417c940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 -- 172.21.15.90:0/2786317213 >> 172.21.15.90:0/2786317213 conn(0x7efd3405d9a0 msgr2=0x7efd3405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:31.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 -- 172.21.15.90:0/2786317213 shutdown_connections 2022-07-05T11:46:31.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.705+0000 7efd3ba4c700 1 -- 172.21.15.90:0/2786317213 wait complete. 2022-07-05T11:46:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.706+0000 7efd3ba4c700 1 Processor -- start 2022-07-05T11:46:31.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.706+0000 7efd3ba4c700 1 -- start start 2022-07-05T11:46:31.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.707+0000 7efd3ba4c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd34171d20 0x7efd340c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.707+0000 7efd3ba4c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd34172100 0x7efd340c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.707+0000 7efd3ba4c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3417ce30 0x7efd340c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.707+0000 7efd3ba4c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340c8f00 con 0x7efd3417ce30 2022-07-05T11:46:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.707+0000 7efd3ba4c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340c91e0 con 0x7efd34172100 2022-07-05T11:46:31.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.707+0000 7efd3ba4c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340c94c0 con 0x7efd34171d20 2022-07-05T11:46:31.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.707+0000 7efd39fe9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3417ce30 0x7efd340c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3417ce30 0x7efd340c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57322/0 (socket says 172.21.15.90:57322) 2022-07-05T11:46:31.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 -- 172.21.15.90:0/332373530 learned_addr learned my addr 172.21.15.90:0/332373530 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:31.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd38fe7700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd34172100 0x7efd340c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 -- 172.21.15.90:0/332373530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd34171d20 msgr2=0x7efd340c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd397e8700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd34171d20 0x7efd340c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd34171d20 0x7efd340c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 -- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd34172100 msgr2=0x7efd340c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd34172100 0x7efd340c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 -- 172.21.15.90:0/332373530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009370 con 0x7efd3417ce30 2022-07-05T11:46:31.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd38fe7700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd34172100 0x7efd340c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:31.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd39fe9700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3417ce30 0x7efd340c28d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7efd2c00e900 tx=0x7efd2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd317fa700 1 -- 172.21.15.90:0/332373530 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00c640 con 0x7efd3417ce30 2022-07-05T11:46:31.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd317fa700 1 -- 172.21.15.90:0/332373530 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c00c7a0 con 0x7efd3417ce30 2022-07-05T11:46:31.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd340671d0 con 0x7efd3417ce30 2022-07-05T11:46:31.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd317fa700 1 -- 172.21.15.90:0/332373530 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00cb20 con 0x7efd3417ce30 2022-07-05T11:46:31.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.708+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd34067790 con 0x7efd3417ce30 2022-07-05T11:46:31.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.709+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3406be40 con 0x7efd3417ce30 2022-07-05T11:46:31.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.710+0000 7efd317fa700 1 -- 172.21.15.90:0/332373530 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7efd2c022070 con 0x7efd3417ce30 2022-07-05T11:46:31.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.710+0000 7efd317fa700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd1408ba40 0x7efd1408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:31.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.710+0000 7efd317fa700 1 -- 172.21.15.90:0/332373530 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efd2c0b0b30 con 0x7efd3417ce30 2022-07-05T11:46:31.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.710+0000 7efd397e8700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd1408ba40 0x7efd1408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:31.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.711+0000 7efd397e8700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd1408ba40 0x7efd1408df00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7efd24000f80 tx=0x7efd24009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:31.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.714+0000 7efd317fa700 1 -- 172.21.15.90:0/332373530 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7efd2c0817f0 con 0x7efd3417ce30 2022-07-05T11:46:31.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.872+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efd340ecef0 con 0x7efd3417ce30 2022-07-05T11:46:31.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.873+0000 7efd317fa700 1 -- 172.21.15.90:0/332373530 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7efd2c016030 con 0x7efd3417ce30 2022-07-05T11:46:31.876 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:31.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd1408ba40 msgr2=0x7efd1408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd1408ba40 0x7efd1408df00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7efd24000f80 tx=0x7efd24009040).stop 2022-07-05T11:46:31.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3417ce30 msgr2=0x7efd340c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:31.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3417ce30 0x7efd340c28d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7efd2c00e900 tx=0x7efd2c009060).stop 2022-07-05T11:46:31.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 shutdown_connections 2022-07-05T11:46:31.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd1408ba40 0x7efd1408df00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3417ce30 0x7efd340c28d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd34171d20 0x7efd340c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 --2- 172.21.15.90:0/332373530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd34172100 0x7efd340c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:31.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 >> 172.21.15.90:0/332373530 conn(0x7efd3405d9a0 msgr2=0x7efd340f0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:31.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 shutdown_connections 2022-07-05T11:46:31.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:31.875+0000 7efd3ba4c700 1 -- 172.21.15.90:0/332373530 wait complete. 2022-07-05T11:46:31.888 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:32.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.002+0000 7faa6a8ff700 1 Processor -- start 2022-07-05T11:46:32.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.002+0000 7faa6a8ff700 1 -- start start 2022-07-05T11:46:32.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa6a8ff700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6417b900 con 0x7faa640c7f90 2022-07-05T11:46:32.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa6a8ff700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6417a0e0 con 0x7faa64174750 2022-07-05T11:46:32.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa6a8ff700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa641791f0 con 0x7faa64178c90 2022-07-05T11:46:32.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa690fc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7faa640c7f90 0x7faa64178580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50270/0 (socket says 172.21.15.90:50270) 2022-07-05T11:46:32.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa690fc700 1 -- 172.21.15.90:0/2395870163 learned_addr learned my addr 172.21.15.90:0/2395870163 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:32.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197862720 0 0) 0x7faa6417b900 con 0x7faa640c7f90 2022-07-05T11:46:32.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c0033f0 con 0x7faa640c7f90 2022-07-05T11:46:32.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160901518 0 0) 0x7faa6417a0e0 con 0x7faa64174750 2022-07-05T11:46:32.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa6417b900 con 0x7faa64174750 2022-07-05T11:46:32.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037375295 0 0) 0x7faa4c0033f0 con 0x7faa640c7f90 2022-07-05T11:46:32.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 >> v1:172.21.15.149:6789/0 conn(0x7faa64178c90 legacy=0x7faa64182270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 >> v1:172.21.15.110:6789/0 conn(0x7faa64174750 legacy=0x7faa640c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa641794d0 con 0x7faa640c7f90 2022-07-05T11:46:32.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7faa54001470 con 0x7faa640c7f90 2022-07-05T11:46:32.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 >> v1:172.21.15.90:6789/0 conn(0x7faa640c7f90 legacy=0x7faa64178580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c003af0 0x7faa4c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa4c004690 0x7faa4c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4c005200 0x7faa4c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00c050 con 0x7faa4c005200 2022-07-05T11:46:32.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00c1c0 con 0x7faa4c004690 2022-07-05T11:46:32.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00c380 con 0x7faa4c003af0 2022-07-05T11:46:32.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa6a0fe700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4c005200 0x7faa4c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa698fd700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c003af0 0x7faa4c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.004+0000 7faa690fc700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa4c004690 0x7faa4c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a0fe700 1 -- 172.21.15.90:0/2395870163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c003af0 msgr2=0x7faa4c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:32.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a0fe700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c003af0 0x7faa4c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a0fe700 1 -- 172.21.15.90:0/2395870163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa4c004690 msgr2=0x7faa4c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:32.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a0fe700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa4c004690 0x7faa4c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a0fe700 1 -- 172.21.15.90:0/2395870163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0033f0 con 0x7faa4c005200 2022-07-05T11:46:32.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a0fe700 1 -- 172.21.15.90:0/2395870163 reap_dead start 2022-07-05T11:46:32.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a0fe700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4c005200 0x7faa4c00b8e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7faa5c001730 tx=0x7faa5c007bb0).ready entity=mon.0 client_cookie=ee305333948f2dd8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c007020 con 0x7faa4c005200 2022-07-05T11:46:32.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c007180 con 0x7faa4c005200 2022-07-05T11:46:32.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa688fb700 1 -- 172.21.15.90:0/2395870163 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c007500 con 0x7faa4c005200 2022-07-05T11:46:32.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a8ff700 1 -- 172.21.15.90:0/2395870163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4c005200 msgr2=0x7faa4c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4c005200 0x7faa4c00b8e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7faa5c001730 tx=0x7faa5c007bb0).stop 2022-07-05T11:46:32.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a8ff700 1 -- 172.21.15.90:0/2395870163 shutdown_connections 2022-07-05T11:46:32.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/2395870163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4c005200 0x7faa4c00b8e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a8ff700 1 -- 172.21.15.90:0/2395870163 >> 172.21.15.90:0/2395870163 conn(0x7faa64083570 msgr2=0x7faa64083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:32.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a8ff700 1 -- 172.21.15.90:0/2395870163 shutdown_connections 2022-07-05T11:46:32.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.005+0000 7faa6a8ff700 1 -- 172.21.15.90:0/2395870163 wait complete. 2022-07-05T11:46:32.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.007+0000 7faa6a8ff700 1 Processor -- start 2022-07-05T11:46:32.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.007+0000 7faa6a8ff700 1 -- start start 2022-07-05T11:46:32.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a8ff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c005200 0x7faa640c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a8ff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa640c5d20 0x7faa641636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a8ff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa64163bc0 0x7faa6418c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a8ff700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640c47e0 con 0x7faa640c5d20 2022-07-05T11:46:32.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a8ff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6418bd90 con 0x7faa64163bc0 2022-07-05T11:46:32.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a8ff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640c3980 con 0x7faa4c005200 2022-07-05T11:46:32.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa640c5d20 0x7faa641636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa640c5d20 0x7faa641636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57340/0 (socket says 172.21.15.90:57340) 2022-07-05T11:46:32.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 -- 172.21.15.90:0/395707822 learned_addr learned my addr 172.21.15.90:0/395707822 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:32.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a0fe700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa64163bc0 0x7faa6418c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 -- 172.21.15.90:0/395707822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c005200 msgr2=0x7faa640c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c005200 0x7faa640c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:32.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 -- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa64163bc0 msgr2=0x7faa6418c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa64163bc0 0x7faa6418c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 -- 172.21.15.90:0/395707822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640c3c60 con 0x7faa640c5d20 2022-07-05T11:46:32.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a0fe700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa64163bc0 0x7faa6418c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:32.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa690fc700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa640c5d20 0x7faa641636d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7faa54007710 tx=0x7faa54001db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa51ffb700 1 -- 172.21.15.90:0/395707822 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54011590 con 0x7faa640c5d20 2022-07-05T11:46:32.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa51ffb700 1 -- 172.21.15.90:0/395707822 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa540116f0 con 0x7faa640c5d20 2022-07-05T11:46:32.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa640c3f40 con 0x7faa640c5d20 2022-07-05T11:46:32.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.008+0000 7faa51ffb700 1 -- 172.21.15.90:0/395707822 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54011a90 con 0x7faa640c5d20 2022-07-05T11:46:32.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.009+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa640c4500 con 0x7faa640c5d20 2022-07-05T11:46:32.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.009+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6406be40 con 0x7faa640c5d20 2022-07-05T11:46:32.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.010+0000 7faa51ffb700 1 -- 172.21.15.90:0/395707822 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7faa5401b030 con 0x7faa640c5d20 2022-07-05T11:46:32.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.011+0000 7faa51ffb700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa4408ba40 0x7faa4408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.011+0000 7faa51ffb700 1 -- 172.21.15.90:0/395707822 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7faa540afff0 con 0x7faa640c5d20 2022-07-05T11:46:32.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.011+0000 7faa698fd700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa4408ba40 0x7faa4408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.011+0000 7faa698fd700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa4408ba40 0x7faa4408df00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7faa60004290 tx=0x7faa60007f30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.015+0000 7faa51ffb700 1 -- 172.21.15.90:0/395707822 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7faa54080cb0 con 0x7faa640c5d20 2022-07-05T11:46:32.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.175+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa6418bf00 con 0x7faa640c5d20 2022-07-05T11:46:32.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.175+0000 7faa51ffb700 1 -- 172.21.15.90:0/395707822 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa6418bf00 con 0x7faa640c5d20 2022-07-05T11:46:32.179 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:32.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.177+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa4408ba40 msgr2=0x7faa4408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.177+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa4408ba40 0x7faa4408df00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7faa60004290 tx=0x7faa60007f30).stop 2022-07-05T11:46:32.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.177+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa640c5d20 msgr2=0x7faa641636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.177+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa640c5d20 0x7faa641636d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7faa54007710 tx=0x7faa54001db0).stop 2022-07-05T11:46:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 shutdown_connections 2022-07-05T11:46:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa4408ba40 0x7faa4408df00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa64163bc0 0x7faa6418c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c005200 0x7faa640c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 --2- 172.21.15.90:0/395707822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa640c5d20 0x7faa641636d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 >> 172.21.15.90:0/395707822 conn(0x7faa64083570 msgr2=0x7faa640c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:32.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 shutdown_connections 2022-07-05T11:46:32.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.178+0000 7faa6a8ff700 1 -- 172.21.15.90:0/395707822 wait complete. 2022-07-05T11:46:32.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-07-05T11:46:32.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.304+0000 7f6dda3f3700 1 Processor -- start 2022-07-05T11:46:32.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.304+0000 7f6dda3f3700 1 -- start start 2022-07-05T11:46:32.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dda3f3700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6dd4172100 0x7f6dd417c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dda3f3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6dd417ce30 0x7f6dd417ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dda3f3700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd4084500 con 0x7f6dd4171d20 2022-07-05T11:46:32.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dda3f3700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd4083610 con 0x7f6dd417ce30 2022-07-05T11:46:32.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dda3f3700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40838f0 con 0x7f6dd4172100 2022-07-05T11:46:32.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd8990700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6dd417ce30 0x7f6dd417ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd3fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6dd4171d20 0x7f6dd417bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50286/0 (socket says 172.21.15.90:50286) 2022-07-05T11:46:32.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd3fff700 1 -- 172.21.15.90:0/4269498770 learned_addr learned my addr 172.21.15.90:0/4269498770 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:32.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd37fe700 1 --2- 172.21.15.90:0/4269498770 >> v2:172.21.15.110:3300/0 conn(0x7f6dd4172100 0x7f6dd417c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd8990700 1 -- 172.21.15.90:0/4269498770 >> v2:172.21.15.110:3300/0 conn(0x7f6dd4172100 msgr2=0x7f6dd417c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:32.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd8990700 1 --2- 172.21.15.90:0/4269498770 >> v2:172.21.15.110:3300/0 conn(0x7f6dd4172100 0x7f6dd417c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd8990700 1 -- 172.21.15.90:0/4269498770 >> v1:172.21.15.90:6789/0 conn(0x7f6dd4171d20 legacy=0x7f6dd417bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd2ffd700 1 -- 172.21.15.90:0/4269498770 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437149444 0 0) 0x7f6dd4084500 con 0x7f6dd4171d20 2022-07-05T11:46:32.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd8990700 1 -- 172.21.15.90:0/4269498770 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4083bd0 con 0x7f6dd417ce30 2022-07-05T11:46:32.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd8990700 1 --2- 172.21.15.90:0/4269498770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd417ce30 0x7f6dd417ea40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f6dd40c3b20 tx=0x7f6dcc009780).ready entity=mon.0 client_cookie=fa7cecd6d5524e39 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd2ffd700 1 -- 172.21.15.90:0/4269498770 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00e070 con 0x7f6dd417ce30 2022-07-05T11:46:32.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd2ffd700 1 -- 172.21.15.90:0/4269498770 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00bc30 con 0x7f6dd417ce30 2022-07-05T11:46:32.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.305+0000 7f6dd2ffd700 1 -- 172.21.15.90:0/4269498770 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc012410 con 0x7f6dd417ce30 2022-07-05T11:46:32.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 -- 172.21.15.90:0/4269498770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd417ce30 msgr2=0x7f6dd417ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/4269498770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd417ce30 0x7f6dd417ea40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f6dd40c3b20 tx=0x7f6dcc009780).stop 2022-07-05T11:46:32.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 -- 172.21.15.90:0/4269498770 shutdown_connections 2022-07-05T11:46:32.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/4269498770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd417ce30 0x7f6dd417ea40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/4269498770 >> v2:172.21.15.110:3300/0 conn(0x7f6dd4172100 0x7f6dd417c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 -- 172.21.15.90:0/4269498770 >> 172.21.15.90:0/4269498770 conn(0x7f6dd405d9a0 msgr2=0x7f6dd405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:32.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 -- 172.21.15.90:0/4269498770 shutdown_connections 2022-07-05T11:46:32.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.306+0000 7f6dda3f3700 1 -- 172.21.15.90:0/4269498770 wait complete. 2022-07-05T11:46:32.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.307+0000 7f6dda3f3700 1 Processor -- start 2022-07-05T11:46:32.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.308+0000 7f6dda3f3700 1 -- start start 2022-07-05T11:46:32.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.308+0000 7f6dda3f3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd4171d20 0x7f6dd41610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.308+0000 7f6dda3f3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd4172100 0x7f6dd418e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.308+0000 7f6dda3f3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd417ce30 0x7f6dd418eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.308+0000 7f6dda3f3700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40c7720 con 0x7f6dd4172100 2022-07-05T11:46:32.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.308+0000 7f6dda3f3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd417c620 con 0x7f6dd4171d20 2022-07-05T11:46:32.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.308+0000 7f6dda3f3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4179040 con 0x7f6dd417ce30 2022-07-05T11:46:32.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd4172100 0x7f6dd418e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd4172100 0x7f6dd418e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57354/0 (socket says 172.21.15.90:57354) 2022-07-05T11:46:32.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 -- 172.21.15.90:0/3639398047 learned_addr learned my addr 172.21.15.90:0/3639398047 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:32.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd3fff700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd4171d20 0x7f6dd41610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd8990700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd417ce30 0x7f6dd418eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 -- 172.21.15.90:0/3639398047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd417ce30 msgr2=0x7f6dd418eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd417ce30 0x7f6dd418eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 -- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd4171d20 msgr2=0x7f6dd41610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd4171d20 0x7f6dd41610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 -- 172.21.15.90:0/3639398047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009a20 con 0x7f6dd4172100 2022-07-05T11:46:32.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd8990700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd417ce30 0x7f6dd418eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:32.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dd37fe700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd4172100 0x7f6dd418e9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6dc800d890 tx=0x7f6dc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dbbfff700 1 -- 172.21.15.90:0/3639398047 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80125f0 con 0x7f6dd4172100 2022-07-05T11:46:32.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dbbfff700 1 -- 172.21.15.90:0/3639398047 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8012750 con 0x7f6dd4172100 2022-07-05T11:46:32.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd4179bc0 con 0x7f6dd4172100 2022-07-05T11:46:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dbbfff700 1 -- 172.21.15.90:0/3639398047 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8012ad0 con 0x7f6dd4172100 2022-07-05T11:46:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.309+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4179290 con 0x7f6dd4172100 2022-07-05T11:46:32.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.310+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd406be40 con 0x7f6dd4172100 2022-07-05T11:46:32.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.311+0000 7f6dbbfff700 1 -- 172.21.15.90:0/3639398047 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6dc8013480 con 0x7f6dd4172100 2022-07-05T11:46:32.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.311+0000 7f6dbbfff700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6db408ba40 0x7f6db408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.311+0000 7f6dbbfff700 1 -- 172.21.15.90:0/3639398047 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6dc80b0b70 con 0x7f6dd4172100 2022-07-05T11:46:32.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.312+0000 7f6dd3fff700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6db408ba40 0x7f6db408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.312+0000 7f6dd3fff700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6db408ba40 0x7f6db408df00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f6dc4007fd0 tx=0x7f6dc4007db0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.315+0000 7f6dbbfff700 1 -- 172.21.15.90:0/3639398047 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f6dc80817b0 con 0x7f6dd4172100 2022-07-05T11:46:32.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.475+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6dd4066f10 con 0x7f6dd4172100 2022-07-05T11:46:32.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.475+0000 7f6dbbfff700 1 -- 172.21.15.90:0/3639398047 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6dc8084dd0 con 0x7f6dd4172100 2022-07-05T11:46:32.477 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:32.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6db408ba40 msgr2=0x7f6db408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6db408ba40 0x7f6db408df00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f6dc4007fd0 tx=0x7f6dc4007db0).stop 2022-07-05T11:46:32.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd4172100 msgr2=0x7f6dd418e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd4172100 0x7f6dd418e9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6dc800d890 tx=0x7f6dc8008040).stop 2022-07-05T11:46:32.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 shutdown_connections 2022-07-05T11:46:32.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6db408ba40 0x7f6db408df00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd417ce30 0x7f6dd418eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dd4171d20 0x7f6dd41610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 --2- 172.21.15.90:0/3639398047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd4172100 0x7f6dd418e9e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 >> 172.21.15.90:0/3639398047 conn(0x7f6dd405d9a0 msgr2=0x7f6dd40edbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:32.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 shutdown_connections 2022-07-05T11:46:32.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.477+0000 7f6dda3f3700 1 -- 172.21.15.90:0/3639398047 wait complete. 2022-07-05T11:46:32.490 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-07-05T11:46:32.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.604+0000 7f0debcb9700 1 Processor -- start 2022-07-05T11:46:32.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.604+0000 7f0debcb9700 1 -- start start 2022-07-05T11:46:32.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.605+0000 7f0debcb9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0de417aba0 0x7f0de417af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.605+0000 7f0debcb9700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de40c5dd0 con 0x7f0de417bd40 2022-07-05T11:46:32.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.605+0000 7f0debcb9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de40c6c80 con 0x7f0de417c1c0 2022-07-05T11:46:32.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.605+0000 7f0debcb9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de40ec1a0 con 0x7f0de417aba0 2022-07-05T11:46:32.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de9a55700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0de417aba0 0x7f0de417af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de9a55700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0de417aba0 0x7f0de417af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57364/0 (socket says 172.21.15.90:57364) 2022-07-05T11:46:32.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de9a55700 1 -- 172.21.15.90:0/2549485851 learned_addr learned my addr 172.21.15.90:0/2549485851 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:32.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de9a55700 1 -- 172.21.15.90:0/2549485851 >> v1:172.21.15.149:6789/0 conn(0x7f0de417c1c0 legacy=0x7f0de40c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de9a55700 1 -- 172.21.15.90:0/2549485851 >> v1:172.21.15.110:6789/0 conn(0x7f0de417bd40 legacy=0x7f0de40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de9a55700 1 -- 172.21.15.90:0/2549485851 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40c5af0 con 0x7f0de417aba0 2022-07-05T11:46:32.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de9a55700 1 --2- 172.21.15.90:0/2549485851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de417af80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f0dd4009f20 tx=0x7f0dd4009840).ready entity=mon.0 client_cookie=ba4a4da75f39f532 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de8a53700 1 -- 172.21.15.90:0/2549485851 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400e070 con 0x7f0de417aba0 2022-07-05T11:46:32.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de8a53700 1 -- 172.21.15.90:0/2549485851 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400ba80 con 0x7f0de417aba0 2022-07-05T11:46:32.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.606+0000 7f0de8a53700 1 -- 172.21.15.90:0/2549485851 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400be00 con 0x7f0de417aba0 2022-07-05T11:46:32.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.607+0000 7f0debcb9700 1 -- 172.21.15.90:0/2549485851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 msgr2=0x7f0de417af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.607+0000 7f0debcb9700 1 --2- 172.21.15.90:0/2549485851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de417af80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f0dd4009f20 tx=0x7f0dd4009840).stop 2022-07-05T11:46:32.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.607+0000 7f0debcb9700 1 -- 172.21.15.90:0/2549485851 shutdown_connections 2022-07-05T11:46:32.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.607+0000 7f0debcb9700 1 --2- 172.21.15.90:0/2549485851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de417af80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.607+0000 7f0debcb9700 1 -- 172.21.15.90:0/2549485851 >> 172.21.15.90:0/2549485851 conn(0x7f0de40edd10 msgr2=0x7f0de405d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:32.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.607+0000 7f0debcb9700 1 -- 172.21.15.90:0/2549485851 shutdown_connections 2022-07-05T11:46:32.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.607+0000 7f0debcb9700 1 -- 172.21.15.90:0/2549485851 wait complete. 2022-07-05T11:46:32.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.608+0000 7f0debcb9700 1 Processor -- start 2022-07-05T11:46:32.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.608+0000 7f0debcb9700 1 -- start start 2022-07-05T11:46:32.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0debcb9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de4159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0debcb9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0de417bd40 0x7f0de4159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0debcb9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de417c1c0 0x7f0de4066040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0debcb9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de417f2b0 con 0x7f0de417aba0 2022-07-05T11:46:32.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0debcb9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de417f740 con 0x7f0de417bd40 2022-07-05T11:46:32.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0debcb9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de417e6a0 con 0x7f0de417c1c0 2022-07-05T11:46:32.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de4159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57366/0 (socket says 172.21.15.90:57366) 2022-07-05T11:46:32.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 -- 172.21.15.90:0/1213059686 learned_addr learned my addr 172.21.15.90:0/1213059686 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:32.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 -- 172.21.15.90:0/1213059686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de417c1c0 msgr2=0x7f0de4066040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9254700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0de417bd40 0x7f0de4159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de417c1c0 0x7f0de4066040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:32.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 -- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0de417bd40 msgr2=0x7f0de4159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0de417bd40 0x7f0de4159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.609+0000 7f0de9a55700 1 -- 172.21.15.90:0/1213059686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4009ae0 con 0x7f0de417aba0 2022-07-05T11:46:32.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.610+0000 7f0de9a55700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de4159670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f0dd4009590 tx=0x7f0dd4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.610+0000 7f0de1ffb700 1 -- 172.21.15.90:0/1213059686 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4013d70 con 0x7f0de417aba0 2022-07-05T11:46:32.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.610+0000 7f0de1ffb700 1 -- 172.21.15.90:0/1213059686 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd401c400 con 0x7f0de417aba0 2022-07-05T11:46:32.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.610+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de417e980 con 0x7f0de417aba0 2022-07-05T11:46:32.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.610+0000 7f0de1ffb700 1 -- 172.21.15.90:0/1213059686 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd401c7a0 con 0x7f0de417aba0 2022-07-05T11:46:32.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.610+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de417ef40 con 0x7f0de417aba0 2022-07-05T11:46:32.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.611+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de417f590 con 0x7f0de417aba0 2022-07-05T11:46:32.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.612+0000 7f0de1ffb700 1 -- 172.21.15.90:0/1213059686 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f0dd401cbd0 con 0x7f0de417aba0 2022-07-05T11:46:32.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.612+0000 7f0de1ffb700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0dc408ba40 0x7f0dc408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.612+0000 7f0de1ffb700 1 -- 172.21.15.90:0/1213059686 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0dd40b2f20 con 0x7f0de417aba0 2022-07-05T11:46:32.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.612+0000 7f0de9254700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0dc408ba40 0x7f0dc408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.613+0000 7f0de9254700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0dc408ba40 0x7f0dc408df00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0de40e6850 tx=0x7f0dd8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.616+0000 7f0de1ffb700 1 -- 172.21.15.90:0/1213059686 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f0dd4083be0 con 0x7f0de417aba0 2022-07-05T11:46:32.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.776+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0de406be40 con 0x7f0de417aba0 2022-07-05T11:46:32.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.777+0000 7f0de1ffb700 1 -- 172.21.15.90:0/1213059686 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dd401ce60 con 0x7f0de417aba0 2022-07-05T11:46:32.778 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:32.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0dc408ba40 msgr2=0x7f0dc408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0dc408ba40 0x7f0dc408df00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0de40e6850 tx=0x7f0dd8009040).stop 2022-07-05T11:46:32.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 msgr2=0x7f0de4159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de4159670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f0dd4009590 tx=0x7f0dd4009840).stop 2022-07-05T11:46:32.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 shutdown_connections 2022-07-05T11:46:32.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0dc408ba40 0x7f0dc408df00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de417c1c0 0x7f0de4066040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:32.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de417aba0 0x7f0de4159670 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 --2- 172.21.15.90:0/1213059686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0de417bd40 0x7f0de4159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 >> 172.21.15.90:0/1213059686 conn(0x7f0de40edd10 msgr2=0x7f0de40c2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:32.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 shutdown_connections 2022-07-05T11:46:32.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.779+0000 7f0debcb9700 1 -- 172.21.15.90:0/1213059686 wait complete. 2022-07-05T11:46:32.797 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-07-05T11:46:32.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.911+0000 7f1596f14700 1 Processor -- start 2022-07-05T11:46:32.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.911+0000 7f1596f14700 1 -- start start 2022-07-05T11:46:32.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.912+0000 7f1596f14700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f159017e030 0x7f1590068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.912+0000 7f1596f14700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1590068fd0 0x7f1590181c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.912+0000 7f1596f14700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1590068650 con 0x7f1590069480 2022-07-05T11:46:32.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.912+0000 7f1596f14700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1590067d60 con 0x7f1590068fd0 2022-07-05T11:46:32.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.912+0000 7f1596f14700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15900ecab0 con 0x7f159017e030 2022-07-05T11:46:32.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1590068fd0 0x7f1590181c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1590068fd0 0x7f1590181c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57378/0 (socket says 172.21.15.90:57378) 2022-07-05T11:46:32.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 -- 172.21.15.90:0/2220941181 learned_addr learned my addr 172.21.15.90:0/2220941181 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:32.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f1594cb0700 1 --2- 172.21.15.90:0/2220941181 >> v2:172.21.15.149:3300/0 conn(0x7f159017e030 0x7f1590068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 -- 172.21.15.90:0/2220941181 >> v2:172.21.15.149:3300/0 conn(0x7f159017e030 msgr2=0x7f1590068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:32.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 --2- 172.21.15.90:0/2220941181 >> v2:172.21.15.149:3300/0 conn(0x7f159017e030 0x7f1590068ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 -- 172.21.15.90:0/2220941181 >> v1:172.21.15.110:6789/0 conn(0x7f1590069480 legacy=0x7f1590182110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 -- 172.21.15.90:0/2220941181 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590068000 con 0x7f1590068fd0 2022-07-05T11:46:32.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f1594cb0700 1 --2- 172.21.15.90:0/2220941181 >> v2:172.21.15.149:3300/0 conn(0x7f159017e030 0x7f1590068ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:32.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158ffff700 1 --2- 172.21.15.90:0/2220941181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590181c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f15900eec60 tx=0x7f157c0090f0).ready entity=mon.0 client_cookie=70b75e8aea64310b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158f7fe700 1 -- 172.21.15.90:0/2220941181 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00b600 con 0x7f1590068fd0 2022-07-05T11:46:32.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158f7fe700 1 -- 172.21.15.90:0/2220941181 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00b760 con 0x7f1590068fd0 2022-07-05T11:46:32.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.913+0000 7f158f7fe700 1 -- 172.21.15.90:0/2220941181 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00bae0 con 0x7f1590068fd0 2022-07-05T11:46:32.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 -- 172.21.15.90:0/2220941181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 msgr2=0x7f1590181c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 --2- 172.21.15.90:0/2220941181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590181c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f15900eec60 tx=0x7f157c0090f0).stop 2022-07-05T11:46:32.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 -- 172.21.15.90:0/2220941181 shutdown_connections 2022-07-05T11:46:32.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 --2- 172.21.15.90:0/2220941181 >> v2:172.21.15.149:3300/0 conn(0x7f159017e030 0x7f1590068ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 --2- 172.21.15.90:0/2220941181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590181c20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 -- 172.21.15.90:0/2220941181 >> 172.21.15.90:0/2220941181 conn(0x7f15900ef4b0 msgr2=0x7f15900ef8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:32.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 -- 172.21.15.90:0/2220941181 shutdown_connections 2022-07-05T11:46:32.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.914+0000 7f1596f14700 1 -- 172.21.15.90:0/2220941181 wait complete. 2022-07-05T11:46:32.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.915+0000 7f1596f14700 1 Processor -- start 2022-07-05T11:46:32.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.915+0000 7f1596f14700 1 -- start start 2022-07-05T11:46:32.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1596f14700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1596f14700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1590069480 0x7f1590175fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1596f14700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f159017e030 0x7f15901764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1596f14700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590175b40 con 0x7f1590068fd0 2022-07-05T11:46:32.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1596f14700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590191e20 con 0x7f159017e030 2022-07-05T11:46:32.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1596f14700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590174f30 con 0x7f1590069480 2022-07-05T11:46:32.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1594cb0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1594cb0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57380/0 (socket says 172.21.15.90:57380) 2022-07-05T11:46:32.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f1594cb0700 1 -- 172.21.15.90:0/192563549 learned_addr learned my addr 172.21.15.90:0/192563549 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:32.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.916+0000 7f15954b1700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f159017e030 0x7f15901764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f158ffff700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1590069480 0x7f1590175fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1594cb0700 1 -- 172.21.15.90:0/192563549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1590069480 msgr2=0x7f1590175fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1594cb0700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1590069480 0x7f1590175fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1594cb0700 1 -- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f159017e030 msgr2=0x7f15901764c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:32.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1594cb0700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f159017e030 0x7f15901764c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:32.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1594cb0700 1 -- 172.21.15.90:0/192563549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c009370 con 0x7f1590068fd0 2022-07-05T11:46:32.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f158ffff700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1590069480 0x7f1590175fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:32.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f15954b1700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f159017e030 0x7f15901764c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:32.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1594cb0700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590154b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f158400c880 tx=0x7f1584008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f158cff9700 1 -- 172.21.15.90:0/192563549 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584010580 con 0x7f1590068fd0 2022-07-05T11:46:32.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f158cff9700 1 -- 172.21.15.90:0/192563549 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15840106e0 con 0x7f1590068fd0 2022-07-05T11:46:32.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1590175210 con 0x7f1590068fd0 2022-07-05T11:46:32.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f158cff9700 1 -- 172.21.15.90:0/192563549 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584010a80 con 0x7f1590068fd0 2022-07-05T11:46:32.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.917+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15901757d0 con 0x7f1590068fd0 2022-07-05T11:46:32.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.918+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159006b1e0 con 0x7f1590068fd0 2022-07-05T11:46:32.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.919+0000 7f158cff9700 1 -- 172.21.15.90:0/192563549 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f158401b460 con 0x7f1590068fd0 2022-07-05T11:46:32.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.919+0000 7f158cff9700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157808ba40 0x7f157808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:32.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.919+0000 7f158cff9700 1 -- 172.21.15.90:0/192563549 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f15840b09f0 con 0x7f1590068fd0 2022-07-05T11:46:32.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.920+0000 7f158ffff700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157808ba40 0x7f157808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:32.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.920+0000 7f158ffff700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157808ba40 0x7f157808df00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f157c009130 tx=0x7f157c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:32.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:32.923+0000 7f158cff9700 1 -- 172.21.15.90:0/192563549 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f1584081630 con 0x7f1590068fd0 2022-07-05T11:46:33.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.085+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f159006be40 con 0x7f1590068fd0 2022-07-05T11:46:33.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.085+0000 7f158cff9700 1 -- 172.21.15.90:0/192563549 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1584084c50 con 0x7f1590068fd0 2022-07-05T11:46:33.088 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2022-07-05T11:46:33.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157808ba40 msgr2=0x7f157808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157808ba40 0x7f157808df00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f157c009130 tx=0x7f157c017000).stop 2022-07-05T11:46:33.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 msgr2=0x7f1590154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590154b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f158400c880 tx=0x7f1584008040).stop 2022-07-05T11:46:33.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 shutdown_connections 2022-07-05T11:46:33.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f157808ba40 0x7f157808df00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f159017e030 0x7f15901764c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1590068fd0 0x7f1590154b30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 --2- 172.21.15.90:0/192563549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1590069480 0x7f1590175fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 >> 172.21.15.90:0/192563549 conn(0x7f15900ef4b0 msgr2=0x7f15900ee030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:33.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 shutdown_connections 2022-07-05T11:46:33.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.087+0000 7f1596f14700 1 -- 172.21.15.90:0/192563549 wait complete. 2022-07-05T11:46:33.100 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:33.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.212+0000 7f7adb62d700 1 Processor -- start 2022-07-05T11:46:33.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.212+0000 7f7adb62d700 1 -- start start 2022-07-05T11:46:33.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7adb62d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7ad40c7d00 0x7f7ad417de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:33.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7adb62d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ad40c9520 0x7f7ad40c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:33.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7adb62d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad40c9090 con 0x7f7ad417da60 2022-07-05T11:46:33.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7adb62d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40c81a0 con 0x7f7ad40c7d00 2022-07-05T11:46:33.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7adb62d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40c8480 con 0x7f7ad40c9520 2022-07-05T11:46:33.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7ad40c7d00 0x7f7ad417de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:33.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7ad40c7d00 0x7f7ad417de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57388/0 (socket says 172.21.15.90:57388) 2022-07-05T11:46:33.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/1277336213 learned_addr learned my addr 172.21.15.90:0/1277336213 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:33.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad9bca700 1 --2- 172.21.15.90:0/1277336213 >> v2:172.21.15.110:3300/0 conn(0x7f7ad40c9520 0x7f7ad40c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:33.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/1277336213 >> v2:172.21.15.110:3300/0 conn(0x7f7ad40c9520 msgr2=0x7f7ad40c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:33.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 --2- 172.21.15.90:0/1277336213 >> v2:172.21.15.110:3300/0 conn(0x7f7ad40c9520 0x7f7ad40c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/1277336213 >> v1:172.21.15.149:6789/0 conn(0x7f7ad417da60 legacy=0x7f7ad417eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/1277336213 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40c8760 con 0x7f7ad40c7d00 2022-07-05T11:46:33.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad9bca700 1 --2- 172.21.15.90:0/1277336213 >> v2:172.21.15.110:3300/0 conn(0x7f7ad40c9520 0x7f7ad40c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:33.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.213+0000 7f7ad8bc8700 1 --2- 172.21.15.90:0/1277336213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c7d00 0x7f7ad417de40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f7ad40ca5a0 tx=0x7f7ac40090f0).ready entity=mon.0 client_cookie=f0bb6c44fe986403 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:33.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7ac3fff700 1 -- 172.21.15.90:0/1277336213 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400b600 con 0x7f7ad40c7d00 2022-07-05T11:46:33.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7ac3fff700 1 -- 172.21.15.90:0/1277336213 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400b760 con 0x7f7ad40c7d00 2022-07-05T11:46:33.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7ac3fff700 1 -- 172.21.15.90:0/1277336213 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400bae0 con 0x7f7ad40c7d00 2022-07-05T11:46:33.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 -- 172.21.15.90:0/1277336213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c7d00 msgr2=0x7f7ad417de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 --2- 172.21.15.90:0/1277336213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c7d00 0x7f7ad417de40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f7ad40ca5a0 tx=0x7f7ac40090f0).stop 2022-07-05T11:46:33.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 -- 172.21.15.90:0/1277336213 shutdown_connections 2022-07-05T11:46:33.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 --2- 172.21.15.90:0/1277336213 >> v2:172.21.15.110:3300/0 conn(0x7f7ad40c9520 0x7f7ad40c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 --2- 172.21.15.90:0/1277336213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c7d00 0x7f7ad417de40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 -- 172.21.15.90:0/1277336213 >> 172.21.15.90:0/1277336213 conn(0x7f7ad40f4b70 msgr2=0x7f7ad40f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:33.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 -- 172.21.15.90:0/1277336213 shutdown_connections 2022-07-05T11:46:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.214+0000 7f7adb62d700 1 -- 172.21.15.90:0/1277336213 wait complete. 2022-07-05T11:46:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.216+0000 7f7adb62d700 1 Processor -- start 2022-07-05T11:46:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.216+0000 7f7adb62d700 1 -- start start 2022-07-05T11:46:33.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7adb62d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad40c7d00 0x7f7ad418f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:33.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7adb62d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c9520 0x7f7ad418fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:33.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7adb62d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad417da60 0x7f7ad4191fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:33.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7adb62d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4191730 con 0x7f7ad40c9520 2022-07-05T11:46:33.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7adb62d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41903b0 con 0x7f7ad417da60 2022-07-05T11:46:33.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7adb62d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4190690 con 0x7f7ad40c7d00 2022-07-05T11:46:33.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c9520 0x7f7ad418fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:33.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c9520 0x7f7ad418fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57396/0 (socket says 172.21.15.90:57396) 2022-07-05T11:46:33.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/2141517898 learned_addr learned my addr 172.21.15.90:0/2141517898 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:33.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad9bca700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad417da60 0x7f7ad4191fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:33.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad93c9700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad40c7d00 0x7f7ad418f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:33.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/2141517898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad40c7d00 msgr2=0x7f7ad418f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad40c7d00 0x7f7ad418f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad417da60 msgr2=0x7f7ad4191fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad417da60 0x7f7ad4191fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 -- 172.21.15.90:0/2141517898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009370 con 0x7f7ad40c9520 2022-07-05T11:46:33.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ad8bc8700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c9520 0x7f7ad418fdf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f7ac4009fd0 tx=0x7f7ac4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:33.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.217+0000 7f7ac17fa700 1 -- 172.21.15.90:0/2141517898 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400b8d0 con 0x7f7ad40c9520 2022-07-05T11:46:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.218+0000 7f7ac17fa700 1 -- 172.21.15.90:0/2141517898 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400ba30 con 0x7f7ad40c9520 2022-07-05T11:46:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.218+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad4190970 con 0x7f7ad40c9520 2022-07-05T11:46:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.218+0000 7f7ac17fa700 1 -- 172.21.15.90:0/2141517898 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac401b690 con 0x7f7ad40c9520 2022-07-05T11:46:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.218+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad4190f30 con 0x7f7ad40c9520 2022-07-05T11:46:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.218+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad4191580 con 0x7f7ad40c9520 2022-07-05T11:46:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.219+0000 7f7ac17fa700 1 -- 172.21.15.90:0/2141517898 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7ac400f070 con 0x7f7ad40c9520 2022-07-05T11:46:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.220+0000 7f7ac17fa700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7ab408ba40 0x7f7ab408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:33.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.220+0000 7f7ac17fa700 1 -- 172.21.15.90:0/2141517898 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7ac40b2930 con 0x7f7ad40c9520 2022-07-05T11:46:33.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.220+0000 7f7ad93c9700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7ab408ba40 0x7f7ab408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:33.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.220+0000 7f7ad93c9700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7ab408ba40 0x7f7ab408df00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f7ad0003900 tx=0x7f7ad0000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:33.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.223+0000 7f7ac17fa700 1 -- 172.21.15.90:0/2141517898 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f7ac40835f0 con 0x7f7ad40c9520 2022-07-05T11:46:33.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.429+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ad406be40 con 0x7f7ad40c9520 2022-07-05T11:46:33.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.430+0000 7f7ac17fa700 1 -- 172.21.15.90:0/2141517898 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+10607 (secure 0 0 0) 0x7f7ac4086c10 con 0x7f7ad40c9520 2022-07-05T11:46:33.434 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:33.434 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:22.354922+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4371,"mds_1":4362,"mds_2":4346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4340":{"gid":4340,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4341":{"gid":4341,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4344":{"gid":4344,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4346":{"gid":4346,"name":"l","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4362":{"gid":4362,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-07-05T11:46:33.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7ab408ba40 msgr2=0x7f7ab408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7ab408ba40 0x7f7ab408df00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f7ad0003900 tx=0x7f7ad0000bc0).stop 2022-07-05T11:46:33.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c9520 msgr2=0x7f7ad418fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:33.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c9520 0x7f7ad418fdf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f7ac4009fd0 tx=0x7f7ac4017000).stop 2022-07-05T11:46:33.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 shutdown_connections 2022-07-05T11:46:33.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7ab408ba40 0x7f7ab408df00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad417da60 0x7f7ad4191fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad40c7d00 0x7f7ad418f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 --2- 172.21.15.90:0/2141517898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ad40c9520 0x7f7ad418fdf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:33.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 >> 172.21.15.90:0/2141517898 conn(0x7f7ad40f4b70 msgr2=0x7f7ad4087910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:33.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 shutdown_connections 2022-07-05T11:46:33.442 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:33.432+0000 7f7adb62d700 1 -- 172.21.15.90:0/2141517898 wait complete. 2022-07-05T11:46:33.442 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2022-07-05T11:46:34.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 50, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2022-07-05T11:46:04.574721+0000', 'modified': '2022-07-05T11:46:22.354922+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4371, 'mds_1': 4362, 'mds_2': 4346}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4340': {'gid': 4340, 'name': 'i', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.149:6835/2788360445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 2788360445}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 2788360445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4341': {'gid': 4341, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.110:6836/701705434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 701705434}, {'type': 'v1', 'addr': '172.21.15.110:6836', 'nonce': 701705434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4344': {'gid': 4344, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.110:6837/3239498851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 3239498851}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 3239498851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4346': {'gid': 4346, 'name': 'l', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.149:6839/4158465025', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6838', 'nonce': 4158465025}, {'type': 'v1', 'addr': '172.21.15.149:6839', 'nonce': 4158465025}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4362': {'gid': 4362, 'name': 'c', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.149:6833/4013403095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6832', 'nonce': 4013403095}, {'type': 'v1', 'addr': '172.21.15.149:6833', 'nonce': 4013403095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4371': {'gid': 4371, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/3440068716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 3440068716}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3440068716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-07-05T11:46:34.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2022-07-05T11:46:34.659 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2022-07-05T11:46:34.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.784+0000 7f6dc8f0e700 1 Processor -- start 2022-07-05T11:46:34.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.784+0000 7f6dc8f0e700 1 -- start start 2022-07-05T11:46:34.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc8f0e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6dc40c7d00 0x7f6dc417de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc8f0e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc40c9090 con 0x7f6dc40c9520 2022-07-05T11:46:34.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc8f0e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc40c81a0 con 0x7f6dc417da60 2022-07-05T11:46:34.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc8f0e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc40c8480 con 0x7f6dc40c7d00 2022-07-05T11:46:34.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc1d9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6dc40c7d00 0x7f6dc417de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc2d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6dc40c9520 0x7f6dc40c99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50346/0 (socket says 172.21.15.90:50346) 2022-07-05T11:46:34.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/4159256128 learned_addr learned my addr 172.21.15.90:0/4159256128 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:34.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc1d9b700 1 -- 172.21.15.90:0/4159256128 >> v1:172.21.15.110:6789/0 conn(0x7f6dc417da60 legacy=0x7f6dc417eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc1d9b700 1 -- 172.21.15.90:0/4159256128 >> v1:172.21.15.90:6789/0 conn(0x7f6dc40c9520 legacy=0x7f6dc40c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc1d9b700 1 -- 172.21.15.90:0/4159256128 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc40c8760 con 0x7f6dc40c7d00 2022-07-05T11:46:34.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc159a700 1 -- 172.21.15.90:0/4159256128 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466155711 0 0) 0x7f6dc40c9090 con 0x7f6dc40c9520 2022-07-05T11:46:34.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/4159256128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc417de40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f6dac009760 tx=0x7f6dac009060).ready entity=mon.0 client_cookie=7892b985ef5ab51 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc159a700 1 -- 172.21.15.90:0/4159256128 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00b520 con 0x7f6dc40c7d00 2022-07-05T11:46:34.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc159a700 1 -- 172.21.15.90:0/4159256128 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac00b680 con 0x7f6dc40c7d00 2022-07-05T11:46:34.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.786+0000 7f6dc159a700 1 -- 172.21.15.90:0/4159256128 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00ba00 con 0x7f6dc40c7d00 2022-07-05T11:46:34.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.787+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/4159256128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 msgr2=0x7f6dc417de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.787+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/4159256128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc417de40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f6dac009760 tx=0x7f6dac009060).stop 2022-07-05T11:46:34.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.787+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/4159256128 shutdown_connections 2022-07-05T11:46:34.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.787+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/4159256128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc417de40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.787+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/4159256128 >> 172.21.15.90:0/4159256128 conn(0x7f6dc40f4b70 msgr2=0x7f6dc40f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:34.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.787+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/4159256128 shutdown_connections 2022-07-05T11:46:34.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.787+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/4159256128 wait complete. 2022-07-05T11:46:34.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.788+0000 7f6dc8f0e700 1 Processor -- start 2022-07-05T11:46:34.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.788+0000 7f6dc8f0e700 1 -- start start 2022-07-05T11:46:34.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc8f0e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc8f0e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc40c9520 0x7f6dc418fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc8f0e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dc417da60 0x7f6dc41903c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc8f0e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4191c70 con 0x7f6dc40c7d00 2022-07-05T11:46:34.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc8f0e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4190d10 con 0x7f6dc417da60 2022-07-05T11:46:34.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc8f0e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4190ff0 con 0x7f6dc40c9520 2022-07-05T11:46:34.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57408/0 (socket says 172.21.15.90:57408) 2022-07-05T11:46:34.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.789+0000 7f6dc259c700 1 -- 172.21.15.90:0/2909897326 learned_addr learned my addr 172.21.15.90:0/2909897326 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:34.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dc417da60 0x7f6dc41903c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc259c700 1 -- 172.21.15.90:0/2909897326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc40c9520 msgr2=0x7f6dc418fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc259c700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc40c9520 0x7f6dc418fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:34.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc259c700 1 -- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dc417da60 msgr2=0x7f6dc41903c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc259c700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dc417da60 0x7f6dc41903c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc259c700 1 -- 172.21.15.90:0/2909897326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0092a0 con 0x7f6dc40c7d00 2022-07-05T11:46:34.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dc417da60 0x7f6dc41903c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:34.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc259c700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc415cb80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f6db400c810 tx=0x7f6db40025e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dba7fc700 1 -- 172.21.15.90:0/2909897326 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400a580 con 0x7f6dc40c7d00 2022-07-05T11:46:34.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dba7fc700 1 -- 172.21.15.90:0/2909897326 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db400a720 con 0x7f6dc40c7d00 2022-07-05T11:46:34.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dba7fc700 1 -- 172.21.15.90:0/2909897326 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400aae0 con 0x7f6dc40c7d00 2022-07-05T11:46:34.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc41912d0 con 0x7f6dc40c7d00 2022-07-05T11:46:34.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.790+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc4191890 con 0x7f6dc40c7d00 2022-07-05T11:46:34.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.792+0000 7f6dba7fc700 1 -- 172.21.15.90:0/2909897326 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6db4010070 con 0x7f6dc40c7d00 2022-07-05T11:46:34.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.793+0000 7f6dba7fc700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6da808ba70 0x7f6da808df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.793+0000 7f6dba7fc700 1 -- 172.21.15.90:0/2909897326 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6db40b05d0 con 0x7f6dc40c7d00 2022-07-05T11:46:34.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.793+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6da808ba70 0x7f6da808df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.793+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6da808ba70 0x7f6da808df30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6dc418c870 tx=0x7f6dac017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.794+0000 7f6dda89ab80 1 Processor -- start 2022-07-05T11:46:34.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.794+0000 7f6dda89ab80 1 -- start start 2022-07-05T11:46:34.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e99d5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a23940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e999f280 con 0x5562e9a19750 2022-07-05T11:46:34.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e9916a50 con 0x5562e99d5c60 2022-07-05T11:46:34.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e992b900 con 0x5562e9a19370 2022-07-05T11:46:34.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dc2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dc2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57418/0 (socket says 172.21.15.90:57418) 2022-07-05T11:46:34.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/2661982966 learned_addr learned my addr 172.21.15.90:0/2661982966 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:34.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.795+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a23940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc259c700 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e99d5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/2661982966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 msgr2=0x5562e99d5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e99d5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/2661982966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 msgr2=0x5562e9a23940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a23940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/2661982966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e975d990 con 0x5562e9a19750 2022-07-05T11:46:34.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc259c700 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e99d5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:34.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19bd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6dbc001610 tx=0x7f6dbc009040).ready entity=mon.0 client_cookie=c9b60ed37839e308 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6da37fe700 1 -- 172.21.15.90:0/2661982966 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005990 con 0x5562e9a19750 2022-07-05T11:46:34.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6da37fe700 1 -- 172.21.15.90:0/2661982966 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc005af0 con 0x5562e9a19750 2022-07-05T11:46:34.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6da37fe700 1 -- 172.21.15.90:0/2661982966 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005e70 con 0x5562e9a19750 2022-07-05T11:46:34.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dda89ab80 1 -- 172.21.15.90:0/2661982966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 msgr2=0x5562e9a19bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.796+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19bd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6dbc001610 tx=0x7f6dbc009040).stop 2022-07-05T11:46:34.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 -- 172.21.15.90:0/2661982966 shutdown_connections 2022-07-05T11:46:34.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19bd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e99d5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/2661982966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a23940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 -- 172.21.15.90:0/2661982966 >> 172.21.15.90:0/2661982966 conn(0x5562e9844170 msgr2=0x5562e99d8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:34.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 -- 172.21.15.90:0/2661982966 shutdown_connections 2022-07-05T11:46:34.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 -- 172.21.15.90:0/2661982966 wait complete. 2022-07-05T11:46:34.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 -- start start 2022-07-05T11:46:34.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.797+0000 7f6dda89ab80 1 Processor -- start 2022-07-05T11:46:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a0e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e9a588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e99e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e98f30d0 con 0x5562e9a19750 2022-07-05T11:46:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e9a4c9f0 con 0x5562e99d5c60 2022-07-05T11:46:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e9a0e9e0 con 0x5562e9a19370 2022-07-05T11:46:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 10 client.0 ll_register_callbacks cb 0x5562e9999160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e99e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e99e04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57426/0 (socket says 172.21.15.90:57426) 2022-07-05T11:46:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/506313668 learned_addr learned my addr 172.21.15.90:0/506313668 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e9a588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc259c700 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a0e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 msgr2=0x5562e9a588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e9a588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/506313668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 msgr2=0x5562e9a0e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a0e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/506313668 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc00f040 con 0x5562e9a19750 2022-07-05T11:46:34.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e99e04f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6dbc000c00 tx=0x5562e9a247f0).ready entity=mon.0 client_cookie=521d96aee0aa766a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6da0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:34.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6da0ff9700 1 -- 172.21.15.90:0/506313668 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0074f0 con 0x5562e9a19750 2022-07-05T11:46:34.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562e99d33f0 con 0x5562e9a19750 2022-07-05T11:46:34.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6da0ff9700 1 -- 172.21.15.90:0/506313668 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6dbc007650 con 0x5562e9a19750 2022-07-05T11:46:34.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6da0ff9700 1 -- 172.21.15.90:0/506313668 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dbc01f690 con 0x5562e9a19750 2022-07-05T11:46:34.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 10 client.4893 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:34.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.799+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5562e97ccc80 con 0x5562e9a19750 2022-07-05T11:46:34.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6da0ff9700 1 -- 172.21.15.90:0/506313668 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc029020 con 0x5562e9a19750 2022-07-05T11:46:34.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6da0ff9700 1 -- 172.21.15.90:0/506313668 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f6dbc01f7f0 con 0x5562e9a19750 2022-07-05T11:46:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dda89ab80 10 client.4893 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dda89ab80 10 client.4893 resolve_mds: resolved name 'l' to daemon mds.l 2022-07-05T11:46:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dda89ab80 20 client.4893 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9a5ad10 0x5562e9a58f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dda89ab80 4 client.4893 mds_command: new command op to 4346 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:34.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 --> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562e99217a0 con 0x5562e9a5ad10 2022-07-05T11:46:34.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dc259c700 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9a5ad10 0x5562e9a58f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6da0ff9700 10 client.4893 ms_handle_connect on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.800+0000 7f6dc259c700 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9a5ad10 0x5562e9a58f60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.2 client_cookie=b1f16547769da0e2 server_cookie=8ae48d7b1a793091 in_seq=0 out_seq=0 2022-07-05T11:46:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6da0ff9700 1 -- 172.21.15.90:0/506313668 <== mds.2 v2:172.21.15.149:6838/4158465025 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5562e99217a0 con 0x5562e9a5ad10 2022-07-05T11:46:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6da0ff9700 10 client.4893 handle_command_reply: tid=0 2022-07-05T11:46:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 client.4893 shutdown 2022-07-05T11:46:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 msgr2=0x5562e99e04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e99e04f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6dbc000c00 tx=0x5562e9a247f0).stop 2022-07-05T11:46:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 shutdown_connections 2022-07-05T11:46:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e99e04f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9a0e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9a5ad10 0x5562e9a58f60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/506313668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19370 0x5562e9a588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6da0ff9700 0 client.4893 ms_handle_reset on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:34.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 >> 172.21.15.90:0/506313668 conn(0x5562e9844170 msgr2=0x5562e9a46100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:34.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 shutdown_connections 2022-07-05T11:46:34.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.801+0000 7f6dda89ab80 1 -- 172.21.15.90:0/506313668 wait complete. 2022-07-05T11:46:34.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.802+0000 7f6dda89ab80 20 client.4893 trim_cache size 0 max 16384 2022-07-05T11:46:34.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.818+0000 7f6dda89ab80 1 Processor -- start 2022-07-05T11:46:34.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.818+0000 7f6dda89ab80 1 -- start start 2022-07-05T11:46:34.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9aa1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19370 0x5562e9aa1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19750 0x5562e9a0eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e99d7c30 con 0x5562e9a19370 2022-07-05T11:46:34.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e9a21570 con 0x5562e99d5c60 2022-07-05T11:46:34.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e99cd770 con 0x5562e9a19750 2022-07-05T11:46:34.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19370 0x5562e9aa1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19370 0x5562e9aa1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57432/0 (socket says 172.21.15.90:57432) 2022-07-05T11:46:34.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 -- 172.21.15.90:0/3189622598 learned_addr learned my addr 172.21.15.90:0/3189622598 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:34.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc259c700 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9aa1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 -- 172.21.15.90:0/3189622598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19750 msgr2=0x5562e9a0eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19750 0x5562e9a0eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:34.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 -- 172.21.15.90:0/3189622598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 msgr2=0x5562e9aa1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9aa1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 -- 172.21.15.90:0/3189622598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e979af80 con 0x5562e9a19370 2022-07-05T11:46:34.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc259c700 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9aa1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:34.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.819+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19370 0x5562e9aa1f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f6dac009eb0 tx=0x7f6dac01b000).ready entity=mon.0 client_cookie=998b4287a54f3c5b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6da3fff700 1 -- 172.21.15.90:0/3189622598 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00b970 con 0x5562e9a19370 2022-07-05T11:46:34.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6da3fff700 1 -- 172.21.15.90:0/3189622598 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac01bc60 con 0x5562e9a19370 2022-07-05T11:46:34.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6da3fff700 1 -- 172.21.15.90:0/3189622598 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac01bdd0 con 0x5562e9a19370 2022-07-05T11:46:34.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 -- 172.21.15.90:0/3189622598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19370 msgr2=0x5562e9aa1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19370 0x5562e9aa1f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f6dac009eb0 tx=0x7f6dac01b000).stop 2022-07-05T11:46:34.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 -- 172.21.15.90:0/3189622598 shutdown_connections 2022-07-05T11:46:34.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e9a19750 0x5562e9a0eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:34.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e99d5c60 0x5562e9aa1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/3189622598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19370 0x5562e9aa1f40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 -- 172.21.15.90:0/3189622598 >> 172.21.15.90:0/3189622598 conn(0x5562e9844170 msgr2=0x5562e99d89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:34.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 -- 172.21.15.90:0/3189622598 shutdown_connections 2022-07-05T11:46:34.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.820+0000 7f6dda89ab80 1 -- 172.21.15.90:0/3189622598 wait complete. 2022-07-05T11:46:34.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.821+0000 7f6dda89ab80 1 -- start start 2022-07-05T11:46:34.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.821+0000 7f6dda89ab80 1 Processor -- start 2022-07-05T11:46:34.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e99d5c60 0x5562e9a23ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e9a19370 0x5562e9a12840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dda89ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e99dfb30 con 0x5562e9a19750 2022-07-05T11:46:34.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e9ab2120 con 0x5562e9a19370 2022-07-05T11:46:34.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dda89ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e9a13140 con 0x5562e99d5c60 2022-07-05T11:46:34.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dda89ab80 10 client.0 ll_register_callbacks cb 0x5562e9999160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:34.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57440/0 (socket says 172.21.15.90:57440) 2022-07-05T11:46:34.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/1187798318 learned_addr learned my addr 172.21.15.90:0/1187798318 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:34.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc1d9b700 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e9a19370 0x5562e9a12840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e99d5c60 msgr2=0x5562e9a23ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc259c700 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e99d5c60 0x5562e9a23ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e99d5c60 0x5562e9a23ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/1187798318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e9a19370 msgr2=0x5562e9a12840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:34.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e9a19370 0x5562e9a12840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.822+0000 7f6dc2d9d700 1 -- 172.21.15.90:0/1187798318 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc40c8760 con 0x5562e9a19750 2022-07-05T11:46:34.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dc2d9d700 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f6dbc001500 tx=0x7f6dbc01e000).ready entity=mon.0 client_cookie=8f9152f7dd79427f server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6da0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:34.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6da0ff9700 1 -- 172.21.15.90:0/1187798318 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005c60 con 0x5562e9a19750 2022-07-05T11:46:34.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6da0ff9700 1 -- 172.21.15.90:0/1187798318 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6dbc02a080 con 0x5562e9a19750 2022-07-05T11:46:34.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6dbc005af0 con 0x5562e9a19750 2022-07-05T11:46:34.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6da0ff9700 1 -- 172.21.15.90:0/1187798318 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dbc01f690 con 0x5562e9a19750 2022-07-05T11:46:34.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 10 client.4899 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:34.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5562e99da070 con 0x5562e9a19750 2022-07-05T11:46:34.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6da0ff9700 1 -- 172.21.15.90:0/1187798318 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc005af0 con 0x5562e9a19750 2022-07-05T11:46:34.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6da0ff9700 1 -- 172.21.15.90:0/1187798318 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f6dbc01f7f0 con 0x5562e9a19750 2022-07-05T11:46:34.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 10 client.4899 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:34.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 10 client.4899 resolve_mds: resolved name 'l' to daemon mds.l 2022-07-05T11:46:34.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 20 client.4899 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:34.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9aa1480 0x5562e9a0eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 4 client.4899 mds_command: new command op to 4346 tid=0[{"prefix": "status"}] 2022-07-05T11:46:34.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.823+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 --> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5562e9918640 con 0x5562e9aa1480 2022-07-05T11:46:34.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dc259c700 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9aa1480 0x5562e9a0eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dc259c700 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9aa1480 0x5562e9a0eb20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.2 client_cookie=c51a7a5b86478b9e server_cookie=92d26aac1d6b7d9 in_seq=0 out_seq=0 2022-07-05T11:46:34.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6da0ff9700 10 client.4899 ms_handle_connect on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:34.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6da0ff9700 1 -- 172.21.15.90:0/1187798318 <== mds.2 v2:172.21.15.149:6838/4158465025 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5562e9918640 con 0x5562e9aa1480 2022-07-05T11:46:34.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6da0ff9700 10 client.4899 handle_command_reply: tid=0 2022-07-05T11:46:34.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 client.4899 shutdown 2022-07-05T11:46:34.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 msgr2=0x5562e9a19b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f6dbc001500 tx=0x7f6dbc01e000).stop 2022-07-05T11:46:34.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 shutdown_connections 2022-07-05T11:46:34.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5562e9a19750 0x5562e9a19b30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x5562e9aa1480 0x5562e9a0eb20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562e99d5c60 0x5562e9a23ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6da0ff9700 0 client.4899 ms_handle_reset on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:34.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 --2- 172.21.15.90:0/1187798318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562e9a19370 0x5562e9a12840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 >> 172.21.15.90:0/1187798318 conn(0x5562e9844170 msgr2=0x5562e99d89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:34.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 shutdown_connections 2022-07-05T11:46:34.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.824+0000 7f6dda89ab80 1 -- 172.21.15.90:0/1187798318 wait complete. 2022-07-05T11:46:34.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dda89ab80 20 client.4899 trim_cache size 0 max 16384 2022-07-05T11:46:34.859 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 2, 2022-07-05T11:46:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4346, 2022-07-05T11:46:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 13.472929315, 2022-07-05T11:46:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2022-07-05T11:46:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 31, 2022-07-05T11:46:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 34.509393135000003 2022-07-05T11:46:34.861 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:34.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6da808ba70 msgr2=0x7f6da808df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6da808ba70 0x7f6da808df30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6dc418c870 tx=0x7f6dac017000).stop 2022-07-05T11:46:34.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 msgr2=0x7f6dc415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc415cb80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f6db400c810 tx=0x7f6db40025e0).stop 2022-07-05T11:46:34.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 shutdown_connections 2022-07-05T11:46:34.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6da808ba70 0x7f6da808df30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dc417da60 0x7f6dc41903c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc40c7d00 0x7f6dc415cb80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 --2- 172.21.15.90:0/2909897326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc40c9520 0x7f6dc418fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:34.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 >> 172.21.15.90:0/2909897326 conn(0x7f6dc40f4b70 msgr2=0x7f6dc40c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:34.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 shutdown_connections 2022-07-05T11:46:34.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.825+0000 7f6dc8f0e700 1 -- 172.21.15.90:0/2909897326 wait complete. 2022-07-05T11:46:34.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-07-05T11:46:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.978+0000 7fc35145f700 1 Processor -- start 2022-07-05T11:46:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.978+0000 7fc35145f700 1 -- start start 2022-07-05T11:46:34.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.979+0000 7fc35145f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc34c17da60 0x7fc34c17de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.979+0000 7fc35145f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0c9090 con 0x7fc34c0c9520 2022-07-05T11:46:34.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.979+0000 7fc35145f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0c81a0 con 0x7fc34c0c7d00 2022-07-05T11:46:34.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.979+0000 7fc35145f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0c8480 con 0x7fc34c17da60 2022-07-05T11:46:34.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34affd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc34c17da60 0x7fc34c17de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:34.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34affd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc34c17da60 0x7fc34c17de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:33766/0 (socket says 172.21.15.90:33766) 2022-07-05T11:46:34.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34a7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc34c0c7d00 0x7fc34c17eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:46626/0 (socket says 172.21.15.90:46626) 2022-07-05T11:46:34.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34affd700 1 -- 172.21.15.90:0/1937725373 learned_addr learned my addr 172.21.15.90:0/1937725373 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:34.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34b7fe700 1 --1- 172.21.15.90:0/1937725373 >> v1:172.21.15.110:6789/0 conn(0x7fc34c0c9520 0x7fc34c0c99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:59984/0 (socket says 172.21.15.90:59984) 2022-07-05T11:46:34.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34affd700 1 -- 172.21.15.90:0/1937725373 >> v1:172.21.15.149:6789/0 conn(0x7fc34c0c7d00 legacy=0x7fc34c17eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc349ffb700 1 -- 172.21.15.90:0/1937725373 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551562830 0 0) 0x7fc34c0c81a0 con 0x7fc34c0c7d00 2022-07-05T11:46:34.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34affd700 1 -- 172.21.15.90:0/1937725373 >> v1:172.21.15.110:6789/0 conn(0x7fc34c0c9520 legacy=0x7fc34c0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34affd700 1 -- 172.21.15.90:0/1937725373 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0c8760 con 0x7fc34c17da60 2022-07-05T11:46:34.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc34affd700 1 --2- 172.21.15.90:0/1937725373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c17da60 0x7fc34c17de40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc33c009f20 tx=0x7fc33c009840).ready entity=mon.1 client_cookie=52acce2e53767ec server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:34.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc349ffb700 1 -- 172.21.15.90:0/1937725373 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00e070 con 0x7fc34c17da60 2022-07-05T11:46:34.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc349ffb700 1 -- 172.21.15.90:0/1937725373 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c00ba80 con 0x7fc34c17da60 2022-07-05T11:46:34.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.980+0000 7fc349ffb700 1 -- 172.21.15.90:0/1937725373 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00be00 con 0x7fc34c17da60 2022-07-05T11:46:34.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.981+0000 7fc35145f700 1 -- 172.21.15.90:0/1937725373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c17da60 msgr2=0x7fc34c17de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:34.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.981+0000 7fc35145f700 1 --2- 172.21.15.90:0/1937725373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c17da60 0x7fc34c17de40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc33c009f20 tx=0x7fc33c009840).stop 2022-07-05T11:46:34.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.981+0000 7fc35145f700 1 -- 172.21.15.90:0/1937725373 shutdown_connections 2022-07-05T11:46:34.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.981+0000 7fc35145f700 1 --2- 172.21.15.90:0/1937725373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c17da60 0x7fc34c17de40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:34.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.981+0000 7fc35145f700 1 -- 172.21.15.90:0/1937725373 >> 172.21.15.90:0/1937725373 conn(0x7fc34c0f4b70 msgr2=0x7fc34c0f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:34.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.981+0000 7fc35145f700 1 -- 172.21.15.90:0/1937725373 shutdown_connections 2022-07-05T11:46:34.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.981+0000 7fc35145f700 1 -- 172.21.15.90:0/1937725373 wait complete. 2022-07-05T11:46:34.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.982+0000 7fc35145f700 1 Processor -- start 2022-07-05T11:46:34.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.983+0000 7fc35145f700 1 -- start start 2022-07-05T11:46:34.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.983+0000 7fc35145f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc34c0c7d00 0x7fc34c0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.983+0000 7fc35145f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c0c9520 0x7fc34c176170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:34.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.983+0000 7fc35145f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc34c17da60 0x7fc34c176660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.983+0000 7fc35145f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0cc0e0 con 0x7fc34c17da60 2022-07-05T11:46:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.983+0000 7fc35145f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c17eb40 con 0x7fc34c0c9520 2022-07-05T11:46:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.983+0000 7fc35145f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0cbb20 con 0x7fc34c0c7d00 2022-07-05T11:46:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc34c17da60 0x7fc34c176660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc34c17da60 0x7fc34c176660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57454/0 (socket says 172.21.15.90:57454) 2022-07-05T11:46:35.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 -- 172.21.15.90:0/2652362890 learned_addr learned my addr 172.21.15.90:0/2652362890 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34affd700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc34c0c7d00 0x7fc34c0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c0c9520 0x7fc34c176170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 -- 172.21.15.90:0/2652362890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc34c0c7d00 msgr2=0x7fc34c0cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc34c0c7d00 0x7fc34c0cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 -- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c0c9520 msgr2=0x7fc34c176170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c0c9520 0x7fc34c176170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 -- 172.21.15.90:0/2652362890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c009ae0 con 0x7fc34c17da60 2022-07-05T11:46:35.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc34c17da60 0x7fc34c176660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fc34400c470 tx=0x7fc344007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc342ffd700 1 -- 172.21.15.90:0/2652362890 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440070d0 con 0x7fc34c17da60 2022-07-05T11:46:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc342ffd700 1 -- 172.21.15.90:0/2652362890 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344007230 con 0x7fc34c17da60 2022-07-05T11:46:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c0cbe00 con 0x7fc34c17da60 2022-07-05T11:46:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc342ffd700 1 -- 172.21.15.90:0/2652362890 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440075b0 con 0x7fc34c17da60 2022-07-05T11:46:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.984+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c17e7d0 con 0x7fc34c17da60 2022-07-05T11:46:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.986+0000 7fc342ffd700 1 -- 172.21.15.90:0/2652362890 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc34401a060 con 0x7fc34c17da60 2022-07-05T11:46:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.986+0000 7fc342ffd700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc33008ba40 0x7fc33008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.986+0000 7fc342ffd700 1 -- 172.21.15.90:0/2652362890 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc3440af9b0 con 0x7fc34c17da60 2022-07-05T11:46:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.987+0000 7fc34affd700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc33008ba40 0x7fc33008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.987+0000 7fc34affd700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc33008ba40 0x7fc33008df00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc33c009590 tx=0x7fc33c009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.988+0000 7fc362debb80 1 Processor -- start 2022-07-05T11:46:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.988+0000 7fc362debb80 1 -- start start 2022-07-05T11:46:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc362debb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69370 0x55c030a25770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc362debb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a25c60 0x55c030a73940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc362debb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69750 0x55c030a69bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc362debb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0309ef280 con 0x55c030a69370 2022-07-05T11:46:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc362debb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030966a50 con 0x55c030a25c60 2022-07-05T11:46:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc362debb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03097b900 con 0x55c030a69750 2022-07-05T11:46:35.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69370 0x55c030a25770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69370 0x55c030a25770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57458/0 (socket says 172.21.15.90:57458) 2022-07-05T11:46:35.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 -- 172.21.15.90:0/1540880171 learned_addr learned my addr 172.21.15.90:0/1540880171 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a25c60 0x55c030a73940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 -- 172.21.15.90:0/1540880171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69750 msgr2=0x55c030a69bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69750 0x55c030a69bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 -- 172.21.15.90:0/1540880171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a25c60 msgr2=0x55c030a73940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a25c60 0x55c030a73940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34affd700 1 -- 172.21.15.90:0/1540880171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0307ad990 con 0x55c030a69370 2022-07-05T11:46:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.989+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a25c60 0x55c030a73940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc34affd700 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69370 0x55c030a25770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fc33c00b6c0 tx=0x7fc33c020000).ready entity=mon.0 client_cookie=b8dbaba5d85b6ea server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc32bfff700 1 -- 172.21.15.90:0/1540880171 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c02e070 con 0x55c030a69370 2022-07-05T11:46:35.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc32bfff700 1 -- 172.21.15.90:0/1540880171 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c02a440 con 0x55c030a69370 2022-07-05T11:46:35.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc32bfff700 1 -- 172.21.15.90:0/1540880171 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c02a5b0 con 0x55c030a69370 2022-07-05T11:46:35.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 -- 172.21.15.90:0/1540880171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69370 msgr2=0x55c030a25770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69370 0x55c030a25770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fc33c00b6c0 tx=0x7fc33c020000).stop 2022-07-05T11:46:35.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 -- 172.21.15.90:0/1540880171 shutdown_connections 2022-07-05T11:46:35.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69750 0x55c030a69bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:35.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69370 0x55c030a25770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 --2- 172.21.15.90:0/1540880171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a25c60 0x55c030a73940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 -- 172.21.15.90:0/1540880171 >> 172.21.15.90:0/1540880171 conn(0x55c030894170 msgr2=0x55c030a28a60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.990+0000 7fc362debb80 1 -- 172.21.15.90:0/1540880171 shutdown_connections 2022-07-05T11:46:35.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.991+0000 7fc362debb80 1 -- 172.21.15.90:0/1540880171 wait complete. 2022-07-05T11:46:35.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.991+0000 7fc362debb80 1 -- start start 2022-07-05T11:46:35.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.991+0000 7fc362debb80 1 Processor -- start 2022-07-05T11:46:35.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.992+0000 7fc362debb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a25c60 0x55c030a98a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.992+0000 7fc362debb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69370 0x55c030a96d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.992+0000 7fc362debb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69750 0x55c030a91f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.992+0000 7fc362debb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0309430d0 con 0x55c030a69750 2022-07-05T11:46:35.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.992+0000 7fc362debb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a67100 con 0x55c030a69370 2022-07-05T11:46:35.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.992+0000 7fc362debb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a98580 con 0x55c030a25c60 2022-07-05T11:46:35.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc362debb80 10 client.0 ll_register_callbacks cb 0x55c0309e9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:35.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69750 0x55c030a91f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69750 0x55c030a91f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57468/0 (socket says 172.21.15.90:57468) 2022-07-05T11:46:35.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 -- 172.21.15.90:0/535848088 learned_addr learned my addr 172.21.15.90:0/535848088 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34affd700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a25c60 0x55c030a98a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69370 0x55c030a96d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 -- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a25c60 msgr2=0x55c030a98a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a25c60 0x55c030a98a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 -- 172.21.15.90:0/535848088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69370 msgr2=0x55c030a96d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69370 0x55c030a96d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 -- 172.21.15.90:0/535848088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c017040 con 0x55c030a69750 2022-07-05T11:46:35.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34affd700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a25c60 0x55c030a98a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:35.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69750 0x55c030a91f70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc344084030 tx=0x7fc344001e10).ready entity=mon.0 client_cookie=5d763299001051b1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc3297fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:35.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc3297fa700 1 -- 172.21.15.90:0/535848088 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344083820 con 0x55c030a69750 2022-07-05T11:46:35.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc3297fa700 1 -- 172.21.15.90:0/535848088 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc344083980 con 0x55c030a69750 2022-07-05T11:46:35.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c030a233f0 con 0x55c030a69750 2022-07-05T11:46:35.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc3297fa700 1 -- 172.21.15.90:0/535848088 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc344089990 con 0x55c030a69750 2022-07-05T11:46:35.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc362debb80 10 client.4908 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:35.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55c03081cc80 con 0x55c030a69750 2022-07-05T11:46:35.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc3297fa700 1 -- 172.21.15.90:0/535848088 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c030a233f0 con 0x55c030a69750 2022-07-05T11:46:35.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc3297fa700 1 -- 172.21.15.90:0/535848088 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fc34401bbf0 con 0x55c030a69750 2022-07-05T11:46:35.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.993+0000 7fc362debb80 10 client.4908 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:35.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc362debb80 10 client.4908 resolve_mds: resolved name 'c' to daemon mds.c 2022-07-05T11:46:35.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc362debb80 20 client.4908 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:35.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc362debb80 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030a92460 0x55c030a66b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc362debb80 4 client.4908 mds_command: new command op to 4362 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:35.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 --> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0309717a0 con 0x55c030a92460 2022-07-05T11:46:35.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc34affd700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030a92460 0x55c030a66b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc3297fa700 10 client.4908 ms_handle_connect on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:35.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.994+0000 7fc34affd700 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030a92460 0x55c030a66b60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.1 client_cookie=2900ccc94306ba75 server_cookie=f086ff709bc030e0 in_seq=0 out_seq=0 2022-07-05T11:46:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc3297fa700 1 -- 172.21.15.90:0/535848088 <== mds.1 v2:172.21.15.149:6832/4013403095 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55c0309717a0 con 0x55c030a92460 2022-07-05T11:46:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc3297fa700 10 client.4908 handle_command_reply: tid=0 2022-07-05T11:46:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 client.4908 shutdown 2022-07-05T11:46:35.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69750 msgr2=0x55c030a91f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69750 0x55c030a91f70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc344084030 tx=0x7fc344001e10).stop 2022-07-05T11:46:35.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 shutdown_connections 2022-07-05T11:46:35.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a69750 0x55c030a91f70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a25c60 0x55c030a98a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030a92460 0x55c030a66b60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 --2- 172.21.15.90:0/535848088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69370 0x55c030a96d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc3297fa700 0 client.4908 ms_handle_reset on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:35.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 >> 172.21.15.90:0/535848088 conn(0x55c030894170 msgr2=0x55c030a266c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 shutdown_connections 2022-07-05T11:46:35.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 1 -- 172.21.15.90:0/535848088 wait complete. 2022-07-05T11:46:35.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:34.995+0000 7fc362debb80 20 client.4908 trim_cache size 0 max 16384 2022-07-05T11:46:35.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.011+0000 7fc362debb80 1 Processor -- start 2022-07-05T11:46:35.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.012+0000 7fc362debb80 1 -- start start 2022-07-05T11:46:35.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc362debb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030aa6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc362debb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030af1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc362debb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030af1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc362debb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a28ef0 con 0x55c030a25c60 2022-07-05T11:46:35.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc362debb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a65d90 con 0x55c030a69750 2022-07-05T11:46:35.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc362debb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a65fe0 con 0x55c030a69370 2022-07-05T11:46:35.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030aa6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030aa6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57472/0 (socket says 172.21.15.90:57472) 2022-07-05T11:46:35.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 -- 172.21.15.90:0/3489186982 learned_addr learned my addr 172.21.15.90:0/3489186982 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030af1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030af1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 -- 172.21.15.90:0/3489186982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 msgr2=0x55c030af1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030af1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 -- 172.21.15.90:0/3489186982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 msgr2=0x55c030af1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030af1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 -- 172.21.15.90:0/3489186982 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0307eaf80 con 0x55c030a25c60 2022-07-05T11:46:35.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030af1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:35.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc34affd700 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030aa6fd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fc33c009910 tx=0x7fc33c039280).ready entity=mon.0 client_cookie=64ba60b7fd5fccc1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc340ff9700 1 -- 172.21.15.90:0/3489186982 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c02e040 con 0x55c030a25c60 2022-07-05T11:46:35.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc340ff9700 1 -- 172.21.15.90:0/3489186982 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c02a920 con 0x55c030a25c60 2022-07-05T11:46:35.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.013+0000 7fc340ff9700 1 -- 172.21.15.90:0/3489186982 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00bd70 con 0x55c030a25c60 2022-07-05T11:46:35.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 -- 172.21.15.90:0/3489186982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 msgr2=0x55c030aa6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030aa6fd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fc33c009910 tx=0x7fc33c039280).stop 2022-07-05T11:46:35.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 -- 172.21.15.90:0/3489186982 shutdown_connections 2022-07-05T11:46:35.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030af1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030aa6fd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 --2- 172.21.15.90:0/3489186982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030af1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 -- 172.21.15.90:0/3489186982 >> 172.21.15.90:0/3489186982 conn(0x55c030894170 msgr2=0x55c030a69bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 -- 172.21.15.90:0/3489186982 shutdown_connections 2022-07-05T11:46:35.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 -- 172.21.15.90:0/3489186982 wait complete. 2022-07-05T11:46:35.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 -- start start 2022-07-05T11:46:35.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.014+0000 7fc362debb80 1 Processor -- start 2022-07-05T11:46:35.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030a95cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030a61d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030aed200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a629c0 con 0x55c030a25c60 2022-07-05T11:46:35.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a62280 con 0x55c030a69750 2022-07-05T11:46:35.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c030a90ce0 con 0x55c030a69370 2022-07-05T11:46:35.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 10 client.0 ll_register_callbacks cb 0x55c030aaaad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:35.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030a95cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030a95cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57478/0 (socket says 172.21.15.90:57478) 2022-07-05T11:46:35.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 -- 172.21.15.90:0/331466452 learned_addr learned my addr 172.21.15.90:0/331466452 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030a61d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34b7fe700 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030aed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 -- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 msgr2=0x55c030a61d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030a61d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 -- 172.21.15.90:0/331466452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 msgr2=0x55c030aed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030aed200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 -- 172.21.15.90:0/331466452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0307ad990 con 0x55c030a25c60 2022-07-05T11:46:35.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc34affd700 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030a95cf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc33c00b6c0 tx=0x7fc33c037040).ready entity=mon.0 client_cookie=a8678cbf2af72624 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc3297fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:35.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc3297fa700 1 -- 172.21.15.90:0/331466452 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c02e070 con 0x55c030a25c60 2022-07-05T11:46:35.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc3297fa700 1 -- 172.21.15.90:0/331466452 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc33c01fb50 con 0x55c030a25c60 2022-07-05T11:46:35.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc33c02a440 con 0x55c030a25c60 2022-07-05T11:46:35.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc3297fa700 1 -- 172.21.15.90:0/331466452 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc33c00bd70 con 0x55c030a25c60 2022-07-05T11:46:35.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 10 client.4914 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:35.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55c030af5200 con 0x55c030a25c60 2022-07-05T11:46:35.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.016+0000 7fc3297fa700 1 -- 172.21.15.90:0/331466452 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c02a440 con 0x55c030a25c60 2022-07-05T11:46:35.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc3297fa700 1 -- 172.21.15.90:0/331466452 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fc33c027030 con 0x55c030a25c60 2022-07-05T11:46:35.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 10 client.4914 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:35.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 10 client.4914 resolve_mds: resolved name 'c' to daemon mds.c 2022-07-05T11:46:35.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 20 client.4914 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:35.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030aaab80 0x55c030aaaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 4 client.4914 mds_command: new command op to 4362 tid=0[{"prefix": "status"}] 2022-07-05T11:46:35.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 --> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c030968640 con 0x55c030aaab80 2022-07-05T11:46:35.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030aaab80 0x55c030aaaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc3297fa700 10 client.4914 ms_handle_connect on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:35.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc34a7fc700 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030aaab80 0x55c030aaaf60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.1 client_cookie=e87c8e23f0c14304 server_cookie=692a386b0114c40c in_seq=0 out_seq=0 2022-07-05T11:46:35.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc3297fa700 1 -- 172.21.15.90:0/331466452 <== mds.1 v2:172.21.15.149:6832/4013403095 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c030968640 con 0x55c030aaab80 2022-07-05T11:46:35.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc3297fa700 10 client.4914 handle_command_reply: tid=0 2022-07-05T11:46:35.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 1 client.4914 shutdown 2022-07-05T11:46:35.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 msgr2=0x55c030a95cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.017+0000 7fc362debb80 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030a95cf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc33c00b6c0 tx=0x7fc33c037040).stop 2022-07-05T11:46:35.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 shutdown_connections 2022-07-05T11:46:35.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x55c030aaab80 0x55c030aaaf60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c030a69750 0x55c030aed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c030a25c60 0x55c030a95cf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 --2- 172.21.15.90:0/331466452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c030a69370 0x55c030a61d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc3297fa700 0 client.4914 ms_handle_reset on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:35.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 >> 172.21.15.90:0/331466452 conn(0x55c030894170 msgr2=0x55c030a69b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 shutdown_connections 2022-07-05T11:46:35.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 1 -- 172.21.15.90:0/331466452 wait complete. 2022-07-05T11:46:35.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc362debb80 20 client.4914 trim_cache size 0 max 16384 2022-07-05T11:46:35.056 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:35.056 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:35.056 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 1, 2022-07-05T11:46:35.057 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4362, 2022-07-05T11:46:35.057 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:35.057 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:35.057 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:35.058 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 14.67348243, 2022-07-05T11:46:35.058 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2022-07-05T11:46:35.058 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:35.058 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 31, 2022-07-05T11:46:35.059 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 34.711187533999997 2022-07-05T11:46:35.059 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:35.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc33008ba40 msgr2=0x7fc33008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc33008ba40 0x7fc33008df00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc33c009590 tx=0x7fc33c009840).stop 2022-07-05T11:46:35.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc34c17da60 msgr2=0x7fc34c176660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc34c17da60 0x7fc34c176660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fc34400c470 tx=0x7fc344007dd0).stop 2022-07-05T11:46:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 shutdown_connections 2022-07-05T11:46:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc33008ba40 0x7fc33008df00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc34c17da60 0x7fc34c176660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc34c0c7d00 0x7fc34c0cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 --2- 172.21.15.90:0/2652362890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc34c0c9520 0x7fc34c176170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 >> 172.21.15.90:0/2652362890 conn(0x7fc34c0f4b70 msgr2=0x7fc34c0f2770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 shutdown_connections 2022-07-05T11:46:35.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.018+0000 7fc35145f700 1 -- 172.21.15.90:0/2652362890 wait complete. 2022-07-05T11:46:35.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-07-05T11:46:35.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.176+0000 7f23985bd700 1 Processor -- start 2022-07-05T11:46:35.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.176+0000 7f23985bd700 1 -- start start 2022-07-05T11:46:35.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f23985bd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f239017dc20 0x7f239017e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f23985bd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23900c9f20 0x7f23900caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f23985bd700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900cb010 con 0x7f23900ca5d0 2022-07-05T11:46:35.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f23985bd700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900cb2f0 con 0x7f23900c9f20 2022-07-05T11:46:35.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f23985bd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900cb5d0 con 0x7f239017dc20 2022-07-05T11:46:35.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23900c9f20 0x7f23900caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23900c9f20 0x7f23900caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:33808/0 (socket says 172.21.15.90:33808) 2022-07-05T11:46:35.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2395b58700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f23900ca5d0 0x7f23900cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:60024/0 (socket says 172.21.15.90:60024) 2022-07-05T11:46:35.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 -- 172.21.15.90:0/4202577 learned_addr learned my addr 172.21.15.90:0/4202577 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396359700 1 --2- 172.21.15.90:0/4202577 >> v2:172.21.15.149:3300/0 conn(0x7f239017dc20 0x7f239017e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 -- 172.21.15.90:0/4202577 >> v2:172.21.15.149:3300/0 conn(0x7f239017dc20 msgr2=0x7f239017e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 --2- 172.21.15.90:0/4202577 >> v2:172.21.15.149:3300/0 conn(0x7f239017dc20 0x7f239017e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 -- 172.21.15.90:0/4202577 >> v1:172.21.15.110:6789/0 conn(0x7f23900ca5d0 legacy=0x7f23900cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 -- 172.21.15.90:0/4202577 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900cb8b0 con 0x7f23900c9f20 2022-07-05T11:46:35.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.178+0000 7f2396b5a700 1 --2- 172.21.15.90:0/4202577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 0x7f23900caa80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f23900f4ab0 tx=0x7f23880090f0).ready entity=mon.1 client_cookie=96e4d778386b58a8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f2395357700 1 -- 172.21.15.90:0/4202577 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800b520 con 0x7f23900c9f20 2022-07-05T11:46:35.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f2395357700 1 -- 172.21.15.90:0/4202577 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238800b680 con 0x7f23900c9f20 2022-07-05T11:46:35.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f2395357700 1 -- 172.21.15.90:0/4202577 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800ba00 con 0x7f23900c9f20 2022-07-05T11:46:35.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 -- 172.21.15.90:0/4202577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 msgr2=0x7f23900caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 --2- 172.21.15.90:0/4202577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 0x7f23900caa80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f23900f4ab0 tx=0x7f23880090f0).stop 2022-07-05T11:46:35.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 -- 172.21.15.90:0/4202577 shutdown_connections 2022-07-05T11:46:35.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 --2- 172.21.15.90:0/4202577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 0x7f23900caa80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 --2- 172.21.15.90:0/4202577 >> v2:172.21.15.149:3300/0 conn(0x7f239017dc20 0x7f239017e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 -- 172.21.15.90:0/4202577 >> 172.21.15.90:0/4202577 conn(0x7f23900f2100 msgr2=0x7f2390069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 -- 172.21.15.90:0/4202577 shutdown_connections 2022-07-05T11:46:35.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.179+0000 7f23985bd700 1 -- 172.21.15.90:0/4202577 wait complete. 2022-07-05T11:46:35.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.180+0000 7f23985bd700 1 Processor -- start 2022-07-05T11:46:35.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.181+0000 7f23985bd700 1 -- start start 2022-07-05T11:46:35.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.181+0000 7f23985bd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 0x7f239016aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.181+0000 7f23985bd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23900ca5d0 0x7f239016b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.181+0000 7f23985bd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f239017dc20 0x7f2390063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.181+0000 7f23985bd700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239016a810 con 0x7f23900ca5d0 2022-07-05T11:46:35.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.181+0000 7f23985bd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239016b680 con 0x7f23900c9f20 2022-07-05T11:46:35.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.181+0000 7f23985bd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390169920 con 0x7f239017dc20 2022-07-05T11:46:35.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23900ca5d0 0x7f239016b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23900ca5d0 0x7f239016b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57494/0 (socket says 172.21.15.90:57494) 2022-07-05T11:46:35.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 -- 172.21.15.90:0/1605644615 learned_addr learned my addr 172.21.15.90:0/1605644615 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2396b5a700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f239017dc20 0x7f2390063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2396359700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 0x7f239016aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 -- 172.21.15.90:0/1605644615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f239017dc20 msgr2=0x7f2390063ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f239017dc20 0x7f2390063ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 -- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 msgr2=0x7f239016aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 0x7f239016aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 -- 172.21.15.90:0/1605644615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388009370 con 0x7f23900ca5d0 2022-07-05T11:46:35.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f2395b58700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23900ca5d0 0x7f239016b190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f238400c4c0 tx=0x7f2384007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f238e7fc700 1 -- 172.21.15.90:0/1605644615 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840072e0 con 0x7f23900ca5d0 2022-07-05T11:46:35.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f238e7fc700 1 -- 172.21.15.90:0/1605644615 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384007440 con 0x7f23900ca5d0 2022-07-05T11:46:35.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f238e7fc700 1 -- 172.21.15.90:0/1605644615 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840058f0 con 0x7f23900ca5d0 2022-07-05T11:46:35.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2390169c00 con 0x7f23900ca5d0 2022-07-05T11:46:35.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.182+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239016a1c0 con 0x7f23900ca5d0 2022-07-05T11:46:35.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.184+0000 7f238e7fc700 1 -- 172.21.15.90:0/1605644615 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2384010070 con 0x7f23900ca5d0 2022-07-05T11:46:35.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.185+0000 7f238e7fc700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f237008ba40 0x7f237008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.185+0000 7f238e7fc700 1 -- 172.21.15.90:0/1605644615 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f23840afe70 con 0x7f23900ca5d0 2022-07-05T11:46:35.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.185+0000 7f2396359700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f237008ba40 0x7f237008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.185+0000 7f2396359700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f237008ba40 0x7f237008df00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f2380007600 tx=0x7f238000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.186+0000 7f23a9f49b80 1 Processor -- start 2022-07-05T11:46:35.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.187+0000 7f23a9f49b80 1 -- start start 2022-07-05T11:46:35.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.187+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff1d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.187+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff1dc60 0x5642bff6b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.187+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61750 0x5642bff61bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.187+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bfee7280 con 0x5642bff61750 2022-07-05T11:46:35.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.187+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bfe5ea50 con 0x5642bff61370 2022-07-05T11:46:35.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.187+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bfe73900 con 0x5642bff1dc60 2022-07-05T11:46:35.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61750 0x5642bff61bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61750 0x5642bff61bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57502/0 (socket says 172.21.15.90:57502) 2022-07-05T11:46:35.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 -- 172.21.15.90:0/1227592836 learned_addr learned my addr 172.21.15.90:0/1227592836 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2395b58700 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff1dc60 0x5642bff6b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396359700 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff1d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 -- 172.21.15.90:0/1227592836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff1dc60 msgr2=0x5642bff6b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff1dc60 0x5642bff6b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 -- 172.21.15.90:0/1227592836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 msgr2=0x5642bff1d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff1d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 -- 172.21.15.90:0/1227592836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642bfca5990 con 0x5642bff61750 2022-07-05T11:46:35.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396359700 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff1d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:35.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f2396b5a700 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61750 0x5642bff61bd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f2390088680 tx=0x7f2388017000).ready entity=mon.0 client_cookie=92fceafc695d84ce server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f236f7fe700 1 -- 172.21.15.90:0/1227592836 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800be90 con 0x5642bff61750 2022-07-05T11:46:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f236f7fe700 1 -- 172.21.15.90:0/1227592836 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388021070 con 0x5642bff61750 2022-07-05T11:46:35.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.188+0000 7f236f7fe700 1 -- 172.21.15.90:0/1227592836 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800b7f0 con 0x5642bff61750 2022-07-05T11:46:35.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 -- 172.21.15.90:0/1227592836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61750 msgr2=0x5642bff61bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61750 0x5642bff61bd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f2390088680 tx=0x7f2388017000).stop 2022-07-05T11:46:35.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 -- 172.21.15.90:0/1227592836 shutdown_connections 2022-07-05T11:46:35.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61750 0x5642bff61bd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff1d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/1227592836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff1dc60 0x5642bff6b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 -- 172.21.15.90:0/1227592836 >> 172.21.15.90:0/1227592836 conn(0x5642bfd8c170 msgr2=0x5642bff20a60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 -- 172.21.15.90:0/1227592836 shutdown_connections 2022-07-05T11:46:35.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.189+0000 7f23a9f49b80 1 -- 172.21.15.90:0/1227592836 wait complete. 2022-07-05T11:46:35.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.190+0000 7f23a9f49b80 1 -- start start 2022-07-05T11:46:35.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.190+0000 7f23a9f49b80 1 Processor -- start 2022-07-05T11:46:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff1dc60 0x5642bff8fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff5d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bff5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bfe3b0d0 con 0x5642bff1dc60 2022-07-05T11:46:35.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bff909b0 con 0x5642bff61370 2022-07-05T11:46:35.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bff8f850 con 0x5642bff61750 2022-07-05T11:46:35.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f23a9f49b80 10 client.0 ll_register_callbacks cb 0x5642bfee1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:35.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff1dc60 0x5642bff8fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff1dc60 0x5642bff8fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57504/0 (socket says 172.21.15.90:57504) 2022-07-05T11:46:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 -- 172.21.15.90:0/3895624164 learned_addr learned my addr 172.21.15.90:0/3895624164 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2395b58700 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff5d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 -- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 msgr2=0x5642bff5c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396b5a700 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bff5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bff5c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 -- 172.21.15.90:0/3895624164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 msgr2=0x5642bff5d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff5d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 -- 172.21.15.90:0/3895624164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23900cb8b0 con 0x5642bff1dc60 2022-07-05T11:46:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f2396359700 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff1dc60 0x5642bff8fce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2380014380 tx=0x7f2380018040).ready entity=mon.0 client_cookie=52ad5ef01db39cc7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.191+0000 7f236cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f236cff9700 1 -- 172.21.15.90:0/3895624164 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380014bd0 con 0x5642bff1dc60 2022-07-05T11:46:35.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f236cff9700 1 -- 172.21.15.90:0/3895624164 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f2380014d30 con 0x5642bff1dc60 2022-07-05T11:46:35.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642bff1b3f0 con 0x5642bff1dc60 2022-07-05T11:46:35.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f236cff9700 1 -- 172.21.15.90:0/3895624164 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2380022690 con 0x5642bff1dc60 2022-07-05T11:46:35.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 10 client.4923 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5642bfd14c80 con 0x5642bff1dc60 2022-07-05T11:46:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f236cff9700 1 -- 172.21.15.90:0/3895624164 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5642bff1b3f0 con 0x5642bff1dc60 2022-07-05T11:46:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f236cff9700 1 -- 172.21.15.90:0/3895624164 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f23800227f0 con 0x5642bff1dc60 2022-07-05T11:46:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 10 client.4923 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 10 client.4923 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 20 client.4923 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bff55bb0 0x5642bff575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 4 client.4923 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642bfe697a0 con 0x5642bff55bb0 2022-07-05T11:46:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.192+0000 7f2395b58700 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bff55bb0 0x5642bff575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.193+0000 7f236cff9700 10 client.4923 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.193+0000 7f2395b58700 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bff55bb0 0x5642bff575d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d679be364b8c9aa server_cookie=9ae531e28ec9bd66 in_seq=0 out_seq=0 2022-07-05T11:46:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.193+0000 7f236cff9700 1 -- 172.21.15.90:0/3895624164 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5642bfe697a0 con 0x5642bff55bb0 2022-07-05T11:46:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.193+0000 7f236cff9700 10 client.4923 handle_command_reply: tid=0 2022-07-05T11:46:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.193+0000 7f23a9f49b80 1 client.4923 shutdown 2022-07-05T11:46:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.193+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff1dc60 msgr2=0x5642bff8fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.193+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff1dc60 0x5642bff8fce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2380014380 tx=0x7f2380018040).stop 2022-07-05T11:46:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 shutdown_connections 2022-07-05T11:46:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bff55bb0 0x5642bff575d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bff5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff1dc60 0x5642bff8fce0 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0x7f2380014380 tx=0x7f2380018040).stop 2022-07-05T11:46:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f236cff9700 0 client.4923 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/3895624164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bff5d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 >> 172.21.15.90:0/3895624164 conn(0x5642bfd8c170 msgr2=0x5642bff1d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 shutdown_connections 2022-07-05T11:46:35.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 1 -- 172.21.15.90:0/3895624164 wait complete. 2022-07-05T11:46:35.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.194+0000 7f23a9f49b80 20 client.4923 trim_cache size 0 max 16384 2022-07-05T11:46:35.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.210+0000 7f23a9f49b80 1 Processor -- start 2022-07-05T11:46:35.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.210+0000 7f23a9f49b80 1 -- start start 2022-07-05T11:46:35.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61370 0x5642bff92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61750 0x5642bff5fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff602e0 0x5642bffebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bff90180 con 0x5642bff61370 2022-07-05T11:46:35.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bffe7420 con 0x5642bff61750 2022-07-05T11:46:35.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bff57740 con 0x5642bff602e0 2022-07-05T11:46:35.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61370 0x5642bff92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61370 0x5642bff92b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57510/0 (socket says 172.21.15.90:57510) 2022-07-05T11:46:35.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 -- 172.21.15.90:0/693982952 learned_addr learned my addr 172.21.15.90:0/693982952 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2395b58700 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61750 0x5642bff5fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 -- 172.21.15.90:0/693982952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff602e0 msgr2=0x5642bffebaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff602e0 0x5642bffebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:35.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 -- 172.21.15.90:0/693982952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61750 msgr2=0x5642bff5fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61750 0x5642bff5fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 -- 172.21.15.90:0/693982952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642bfce2f80 con 0x5642bff61370 2022-07-05T11:46:35.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2395b58700 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61750 0x5642bff5fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:35.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f2396359700 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61370 0x5642bff92b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2380014350 tx=0x7f2380019000).ready entity=mon.0 client_cookie=3e129b4476d5b245 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.211+0000 7f236ffff700 1 -- 172.21.15.90:0/693982952 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380015c70 con 0x5642bff61370 2022-07-05T11:46:35.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f236ffff700 1 -- 172.21.15.90:0/693982952 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238000f030 con 0x5642bff61370 2022-07-05T11:46:35.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f236ffff700 1 -- 172.21.15.90:0/693982952 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380014bd0 con 0x5642bff61370 2022-07-05T11:46:35.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 -- 172.21.15.90:0/693982952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61370 msgr2=0x5642bff92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61370 0x5642bff92b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2380014350 tx=0x7f2380019000).stop 2022-07-05T11:46:35.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 -- 172.21.15.90:0/693982952 shutdown_connections 2022-07-05T11:46:35.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff602e0 0x5642bffebaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff61370 0x5642bff92b00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/693982952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61750 0x5642bff5fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 -- 172.21.15.90:0/693982952 >> 172.21.15.90:0/693982952 conn(0x5642bfd8c170 msgr2=0x5642bff5c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 -- 172.21.15.90:0/693982952 shutdown_connections 2022-07-05T11:46:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.212+0000 7f23a9f49b80 1 -- 172.21.15.90:0/693982952 wait complete. 2022-07-05T11:46:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.213+0000 7f23a9f49b80 1 -- start start 2022-07-05T11:46:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.213+0000 7f23a9f49b80 1 Processor -- start 2022-07-05T11:46:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff602e0 0x5642bfffa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bffec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f23a9f49b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bffe41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bffe4eb0 con 0x5642bff602e0 2022-07-05T11:46:35.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bff8d130 con 0x5642bff61370 2022-07-05T11:46:35.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f23a9f49b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642bfff9570 con 0x5642bff61750 2022-07-05T11:46:35.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f23a9f49b80 10 client.0 ll_register_callbacks cb 0x5642bfee1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:35.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff602e0 0x5642bfffa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff602e0 0x5642bfffa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57516/0 (socket says 172.21.15.90:57516) 2022-07-05T11:46:35.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 -- 172.21.15.90:0/521474448 learned_addr learned my addr 172.21.15.90:0/521474448 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:35.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396b5a700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bffe41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2395b58700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bffec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 -- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 msgr2=0x5642bffe41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bffe41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 -- 172.21.15.90:0/521474448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 msgr2=0x5642bffec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:35.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bffec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 -- 172.21.15.90:0/521474448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642bfd14c80 con 0x5642bff602e0 2022-07-05T11:46:35.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2395b58700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bffec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:35.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f2396359700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff602e0 0x5642bfffa020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f2380025040 tx=0x7f2380032000).ready entity=mon.0 client_cookie=a1fae2363449b8f3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:35.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.214+0000 7f236cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:35.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f236cff9700 1 -- 172.21.15.90:0/521474448 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380022480 con 0x5642bff602e0 2022-07-05T11:46:35.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f236cff9700 1 -- 172.21.15.90:0/521474448 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f23800225e0 con 0x5642bff602e0 2022-07-05T11:46:35.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2388021070 con 0x5642bff602e0 2022-07-05T11:46:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f236cff9700 1 -- 172.21.15.90:0/521474448 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2380032430 con 0x5642bff602e0 2022-07-05T11:46:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 10 client.4929 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5642bff68f40 con 0x5642bff602e0 2022-07-05T11:46:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f236cff9700 1 -- 172.21.15.90:0/521474448 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2380044080 con 0x5642bff602e0 2022-07-05T11:46:35.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f236cff9700 1 -- 172.21.15.90:0/521474448 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f2380014070 con 0x5642bff602e0 2022-07-05T11:46:35.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 10 client.4929 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:35.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 10 client.4929 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:35.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 20 client.4929 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:35.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bfff6030 0x5642bfff6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:35.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 4 client.4929 mds_command: new command op to 4371 tid=0[{"prefix": "status"}] 2022-07-05T11:46:35.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5642bfe60640 con 0x5642bfff6030 2022-07-05T11:46:35.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.215+0000 7f2395b58700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bfff6030 0x5642bfff6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:35.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f236cff9700 10 client.4929 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:35.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f2395b58700 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bfff6030 0x5642bfff6410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f3ad45629a9b420f server_cookie=ea41fe33fc2bd975 in_seq=0 out_seq=0 2022-07-05T11:46:35.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f236cff9700 1 -- 172.21.15.90:0/521474448 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5642bfe60640 con 0x5642bfff6030 2022-07-05T11:46:35.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f236cff9700 10 client.4929 handle_command_reply: tid=0 2022-07-05T11:46:35.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 client.4929 shutdown 2022-07-05T11:46:35.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff602e0 msgr2=0x5642bfffa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff602e0 0x5642bfffa020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f2380025040 tx=0x7f2380032000).stop 2022-07-05T11:46:35.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 shutdown_connections 2022-07-05T11:46:35.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5642bfff6030 0x5642bfff6410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5642bff61750 0x5642bffe41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5642bff602e0 0x5642bfffa020 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 --2- 172.21.15.90:0/521474448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5642bff61370 0x5642bffec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f236cff9700 0 client.4929 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:35.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 >> 172.21.15.90:0/521474448 conn(0x5642bfd8c170 msgr2=0x5642bffe5230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 shutdown_connections 2022-07-05T11:46:35.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 1 -- 172.21.15.90:0/521474448 wait complete. 2022-07-05T11:46:35.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.216+0000 7f23a9f49b80 20 client.4929 trim_cache size 0 max 16384 2022-07-05T11:46:35.277 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:35.277 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:35.277 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2022-07-05T11:46:35.278 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4371, 2022-07-05T11:46:35.278 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:35.278 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:35.279 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:35.279 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 30.640012624000001, 2022-07-05T11:46:35.279 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2022-07-05T11:46:35.280 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:35.280 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 31, 2022-07-05T11:46:35.280 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 34.904749414000001 2022-07-05T11:46:35.280 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:35.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f237008ba40 msgr2=0x7f237008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f237008ba40 0x7f237008df00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f2380007600 tx=0x7f238000b040).stop 2022-07-05T11:46:35.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23900ca5d0 msgr2=0x7f239016b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:35.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23900ca5d0 0x7f239016b190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f238400c4c0 tx=0x7f2384007db0).stop 2022-07-05T11:46:35.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 shutdown_connections 2022-07-05T11:46:35.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f237008ba40 0x7f237008df00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f239017dc20 0x7f2390063ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23900c9f20 0x7f239016aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 --2- 172.21.15.90:0/1605644615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23900ca5d0 0x7f239016b190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:35.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 >> 172.21.15.90:0/1605644615 conn(0x7f23900f2100 msgr2=0x7f23900c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:35.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 shutdown_connections 2022-07-05T11:46:35.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:35.217+0000 7f23985bd700 1 -- 172.21.15.90:0/1605644615 wait complete. 2022-07-05T11:46:35.286 INFO:teuthology.run_tasks:Running task kclient... 2022-07-05T11:46:35.298 INFO:tasks.kclient:Mounting kernel clients... 2022-07-05T11:46:35.298 INFO:tasks.kclient:config is {'client.0': {}} 2022-07-05T11:46:35.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.299 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2022-07-05T11:46:35.315 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2022-07-05T11:46:35.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.316 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-07-05T11:46:35.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.387 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2022-07-05T11:46:35.488 INFO:tasks.kclient:client.0 config is {'mntopts': ['nowsync']} 2022-07-05T11:46:35.488 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-07-05T11:46:35.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2022-07-05T11:46:35.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-07-05T11:46:35.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-07-05T11:46:35.490 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-07-05T11:46:35.490 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-07-05T11:46:35.491 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-07-05T11:46:35.491 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-07-05T11:46:35.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.492 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2022-07-05T11:46:35.508 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-07-05T11:46:35.509 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-07-05T11:46:35.509 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2022-07-05T11:46:35.509 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2022-07-05T11:46:35.510 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2022-07-05T11:46:35.510 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2022-07-05T11:46:35.511 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-07-05T11:46:35.511 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:35.511 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-07-05T11:46:35.511 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:35.512 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-07-05T11:46:35.512 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:35.512 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-07-05T11:46:35.512 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2022-07-05T11:46:35.512 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-07-05T11:46:35.513 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42681sec preferred_lft 42681sec 2022-07-05T11:46:35.513 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2022-07-05T11:46:35.513 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2022-07-05T11:46:35.514 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-07-05T11:46:35.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.515 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:35.515 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:35.515 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2022-07-05T11:46:35.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2022-07-05T11:46:35.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2022-07-05T11:46:35.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-07-05T11:46:35.517 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:35.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.619 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-07-05T11:46:35.643 INFO:teuthology.orchestra.run.smithi090.stdout:1 2022-07-05T11:46:35.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.645 DEBUG:teuthology.orchestra.run.smithi090:> route 2022-07-05T11:46:35.703 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2022-07-05T11:46:35.704 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-07-05T11:46:35.705 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-07-05T11:46:35.705 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-07-05T11:46:35.705 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-07-05T11:46:35.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.707 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:35.708 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:35.709 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-07-05T11:46:35.709 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-07-05T11:46:35.710 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-07-05T11:46:35.711 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:35.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.806 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2022-07-05T11:46:35.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.822 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2022-07-05T11:46:35.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.880 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:35.881 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:35.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-07-05T11:46:35.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-07-05T11:46:35.883 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:35.967 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-07-05T11:46:35.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:35.969 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:35.970 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:35.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-07-05T11:46:35.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-07-05T11:46:35.973 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-07-05T11:46:35.973 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-07-05T11:46:35.973 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-07-05T11:46:35.974 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:36.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:36.145 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2022-07-05T11:46:36.146 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2022-07-05T11:46:36.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2022-07-05T11:46:36.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2022-07-05T11:46:36.147 DEBUG:teuthology.orchestra.run.smithi090:> ') 2022-07-05T11:46:36.242 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.360+0000 7fc4ff3d2700 1 Processor -- start 2022-07-05T11:46:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.360+0000 7fc4ff3d2700 1 -- start start 2022-07-05T11:46:36.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.361+0000 7fc4ff3d2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4f8171cf0 0x7fc4f817c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.361+0000 7fc4ff3d2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4f817cae0 0x7fc4f80c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.361+0000 7fc4ff3d2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc4f80c4c30 0x7fc4f805d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.361+0000 7fc4ff3d2700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f81720d0 con 0x7fc4f817cae0 2022-07-05T11:46:36.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.361+0000 7fc4ff3d2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f80c19a0 con 0x7fc4f8171cf0 2022-07-05T11:46:36.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.361+0000 7fc4ff3d2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f817cf60 con 0x7fc4f80c4c30 2022-07-05T11:46:36.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4f817cae0 0x7fc4f80c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4f817cae0 0x7fc4f80c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57524/0 (socket says 172.21.15.90:57524) 2022-07-05T11:46:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 -- 172.21.15.90:0/1217658302 learned_addr learned my addr 172.21.15.90:0/1217658302 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fd96f700 1 --2- 172.21.15.90:0/1217658302 >> v2:172.21.15.149:3300/0 conn(0x7fc4f80c4c30 0x7fc4f805d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fd16e700 1 --2- 172.21.15.90:0/1217658302 >> v2:172.21.15.110:3300/0 conn(0x7fc4f8171cf0 0x7fc4f817c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 -- 172.21.15.90:0/1217658302 >> v2:172.21.15.149:3300/0 conn(0x7fc4f80c4c30 msgr2=0x7fc4f805d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:36.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 --2- 172.21.15.90:0/1217658302 >> v2:172.21.15.149:3300/0 conn(0x7fc4f80c4c30 0x7fc4f805d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 -- 172.21.15.90:0/1217658302 >> v2:172.21.15.110:3300/0 conn(0x7fc4f8171cf0 msgr2=0x7fc4f817c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:36.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 --2- 172.21.15.90:0/1217658302 >> v2:172.21.15.110:3300/0 conn(0x7fc4f8171cf0 0x7fc4f817c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 -- 172.21.15.90:0/1217658302 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f80c0ab0 con 0x7fc4f817cae0 2022-07-05T11:46:36.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fd16e700 1 --2- 172.21.15.90:0/1217658302 >> v2:172.21.15.110:3300/0 conn(0x7fc4f8171cf0 0x7fc4f817c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:36.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4fc96d700 1 --2- 172.21.15.90:0/1217658302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80c4740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fc4f8065940 tx=0x7fc4ec0090f0).ready entity=mon.0 client_cookie=56318406c0e11e09 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4f7fff700 1 -- 172.21.15.90:0/1217658302 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00b600 con 0x7fc4f817cae0 2022-07-05T11:46:36.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4f7fff700 1 -- 172.21.15.90:0/1217658302 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec00b760 con 0x7fc4f817cae0 2022-07-05T11:46:36.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.362+0000 7fc4f7fff700 1 -- 172.21.15.90:0/1217658302 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00bae0 con 0x7fc4f817cae0 2022-07-05T11:46:36.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/1217658302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 msgr2=0x7fc4f80c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/1217658302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80c4740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fc4f8065940 tx=0x7fc4ec0090f0).stop 2022-07-05T11:46:36.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/1217658302 shutdown_connections 2022-07-05T11:46:36.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/1217658302 >> v2:172.21.15.149:3300/0 conn(0x7fc4f80c4c30 0x7fc4f805d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/1217658302 >> v2:172.21.15.110:3300/0 conn(0x7fc4f8171cf0 0x7fc4f817c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/1217658302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80c4740 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/1217658302 >> 172.21.15.90:0/1217658302 conn(0x7fc4f80f0740 msgr2=0x7fc4f80f0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:36.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/1217658302 shutdown_connections 2022-07-05T11:46:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.363+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/1217658302 wait complete. 2022-07-05T11:46:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.364+0000 7fc4ff3d2700 1 Processor -- start 2022-07-05T11:46:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.364+0000 7fc4ff3d2700 1 -- start start 2022-07-05T11:46:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4ff3d2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f80c4c30 0x7fc4f8163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4ff3d2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4f8171cf0 0x7fc4f8163c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4ff3d2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80eb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4ff3d2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80eb050 con 0x7fc4f817cae0 2022-07-05T11:46:36.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4ff3d2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80ead00 con 0x7fc4f8171cf0 2022-07-05T11:46:36.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4ff3d2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f818a930 con 0x7fc4f80c4c30 2022-07-05T11:46:36.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4fd96f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80eb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4fd96f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80eb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57532/0 (socket says 172.21.15.90:57532) 2022-07-05T11:46:36.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.365+0000 7fc4fd96f700 1 -- 172.21.15.90:0/2731786555 learned_addr learned my addr 172.21.15.90:0/2731786555 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:36.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fc96d700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4f8171cf0 0x7fc4f8163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd16e700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f80c4c30 0x7fc4f8163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd96f700 1 -- 172.21.15.90:0/2731786555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f80c4c30 msgr2=0x7fc4f8163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd96f700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f80c4c30 0x7fc4f8163760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd96f700 1 -- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4f8171cf0 msgr2=0x7fc4f8163c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd96f700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4f8171cf0 0x7fc4f8163c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd96f700 1 -- 172.21.15.90:0/2731786555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec009370 con 0x7fc4f817cae0 2022-07-05T11:46:36.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd16e700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f80c4c30 0x7fc4f8163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:36.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4fd96f700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80eb4e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fc4f000d890 tx=0x7fc4f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4f57fa700 1 -- 172.21.15.90:0/2731786555 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0011590 con 0x7fc4f817cae0 2022-07-05T11:46:36.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4f57fa700 1 -- 172.21.15.90:0/2731786555 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f00116f0 con 0x7fc4f817cae0 2022-07-05T11:46:36.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f818ac10 con 0x7fc4f817cae0 2022-07-05T11:46:36.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4f57fa700 1 -- 172.21.15.90:0/2731786555 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0011a70 con 0x7fc4f817cae0 2022-07-05T11:46:36.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.366+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f818b1d0 con 0x7fc4f817cae0 2022-07-05T11:46:36.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.367+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f80eb200 con 0x7fc4f817cae0 2022-07-05T11:46:36.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.368+0000 7fc4f57fa700 1 -- 172.21.15.90:0/2731786555 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc4f001c460 con 0x7fc4f817cae0 2022-07-05T11:46:36.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.368+0000 7fc4f57fa700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc4d808ba40 0x7fc4d808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.368+0000 7fc4f57fa700 1 -- 172.21.15.90:0/2731786555 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc4f00b0720 con 0x7fc4f817cae0 2022-07-05T11:46:36.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.368+0000 7fc4fd16e700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc4d808ba40 0x7fc4d808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.369+0000 7fc4fd16e700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc4d808ba40 0x7fc4d808df00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc4f80bfc90 tx=0x7fc4e80077a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.372+0000 7fc4f57fa700 1 -- 172.21.15.90:0/2731786555 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fc4f80eb200 con 0x7fc4f817cae0 2022-07-05T11:46:36.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.534+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f806be40 con 0x7fc4f817cae0 2022-07-05T11:46:36.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.535+0000 7fc4f57fa700 1 -- 172.21.15.90:0/2731786555 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7fc4f00813e0 con 0x7fc4f817cae0 2022-07-05T11:46:36.536 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:36.537 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:36.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc4d808ba40 msgr2=0x7fc4d808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc4d808ba40 0x7fc4d808df00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc4f80bfc90 tx=0x7fc4e80077a0).stop 2022-07-05T11:46:36.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 msgr2=0x7fc4f80eb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80eb4e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fc4f000d890 tx=0x7fc4f0008040).stop 2022-07-05T11:46:36.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 shutdown_connections 2022-07-05T11:46:36.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc4d808ba40 0x7fc4d808df00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4f817cae0 0x7fc4f80eb4e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f80c4c30 0x7fc4f8163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 --2- 172.21.15.90:0/2731786555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4f8171cf0 0x7fc4f8163c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 >> 172.21.15.90:0/2731786555 conn(0x7fc4f80f0740 msgr2=0x7fc4f80636e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:36.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 shutdown_connections 2022-07-05T11:46:36.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.537+0000 7fc4ff3d2700 1 -- 172.21.15.90:0/2731786555 wait complete. 2022-07-05T11:46:36.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-07-05T11:46:03.055092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-07-05T11:46:03.515295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-07-05T11:46:06.613134+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-07-05T11:46:36.551 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:36.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.667+0000 7fc46d2d6700 1 Processor -- start 2022-07-05T11:46:36.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.667+0000 7fc46d2d6700 1 -- start start 2022-07-05T11:46:36.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.668+0000 7fc46d2d6700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4680ee170 con 0x7fc46817bda0 2022-07-05T11:46:36.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.668+0000 7fc46d2d6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46817c3f0 con 0x7fc4680eed10 2022-07-05T11:46:36.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.668+0000 7fc46d2d6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4680ed280 con 0x7fc468182a30 2022-07-05T11:46:36.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.668+0000 7fc466ffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc46817bda0 0x7fc4680ee600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50476/0 (socket says 172.21.15.90:50476) 2022-07-05T11:46:36.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.668+0000 7fc466ffd700 1 -- 172.21.15.90:0/1958698672 learned_addr learned my addr 172.21.15.90:0/1958698672 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:36.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298149906 0 0) 0x7fc4680ee170 con 0x7fc46817bda0 2022-07-05T11:46:36.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4480033f0 con 0x7fc46817bda0 2022-07-05T11:46:36.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981357447 0 0) 0x7fc4480033f0 con 0x7fc46817bda0 2022-07-05T11:46:36.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 >> v1:172.21.15.149:6789/0 conn(0x7fc468182a30 legacy=0x7fc46817e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 >> v1:172.21.15.110:6789/0 conn(0x7fc4680eed10 legacy=0x7fc468064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680ed560 con 0x7fc46817bda0 2022-07-05T11:46:36.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fc4580017f0 con 0x7fc46817bda0 2022-07-05T11:46:36.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 >> v1:172.21.15.90:6789/0 conn(0x7fc46817bda0 legacy=0x7fc4680ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448003910 0x7fc448003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc448004690 0x7fc448004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc448005200 0x7fc44800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44800c000 con 0x7fc448004690 2022-07-05T11:46:36.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44800c170 con 0x7fc448005200 2022-07-05T11:46:36.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44800c330 con 0x7fc448003910 2022-07-05T11:46:36.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4667fc700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc448004690 0x7fc448004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4677fe700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc448005200 0x7fc44800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc466ffd700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448003910 0x7fc448003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4667fc700 1 -- 172.21.15.90:0/1958698672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448003910 msgr2=0x7fc448003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:36.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4667fc700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448003910 0x7fc448003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4667fc700 1 -- 172.21.15.90:0/1958698672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc448005200 msgr2=0x7fc44800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:36.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4667fc700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc448005200 0x7fc44800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4667fc700 1 -- 172.21.15.90:0/1958698672 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480033f0 con 0x7fc448004690 2022-07-05T11:46:36.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4677fe700 1 -- 172.21.15.90:0/1958698672 reap_dead start 2022-07-05T11:46:36.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc4667fc700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc448004690 0x7fc448004b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fc450001730 tx=0x7fc450007bb0).ready entity=mon.0 client_cookie=5b3426728cc118bf server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450007020 con 0x7fc448004690 2022-07-05T11:46:36.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450007180 con 0x7fc448004690 2022-07-05T11:46:36.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.669+0000 7fc465ffb700 1 -- 172.21.15.90:0/1958698672 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450007520 con 0x7fc448004690 2022-07-05T11:46:36.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.670+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1958698672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc448004690 msgr2=0x7fc448004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.670+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc448004690 0x7fc448004b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fc450001730 tx=0x7fc450007bb0).stop 2022-07-05T11:46:36.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.670+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1958698672 shutdown_connections 2022-07-05T11:46:36.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.670+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1958698672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc448004690 0x7fc448004b10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.670+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1958698672 >> 172.21.15.90:0/1958698672 conn(0x7fc4680f21d0 msgr2=0x7fc468069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:36.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.670+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1958698672 shutdown_connections 2022-07-05T11:46:36.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.670+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1958698672 wait complete. 2022-07-05T11:46:36.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.671+0000 7fc46d2d6700 1 Processor -- start 2022-07-05T11:46:36.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.672+0000 7fc46d2d6700 1 -- start start 2022-07-05T11:46:36.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.672+0000 7fc46d2d6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448004690 0x7fc4681687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.672+0000 7fc46d2d6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc468172f40 0x7fc46817d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc46d2d6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4681733c0 0x7fc46817dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc46d2d6700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46817f3a0 con 0x7fc4681733c0 2022-07-05T11:46:36.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc46d2d6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46817e170 con 0x7fc468172f40 2022-07-05T11:46:36.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc46d2d6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46817e440 con 0x7fc448004690 2022-07-05T11:46:36.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4681733c0 0x7fc46817dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4681733c0 0x7fc46817dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57552/0 (socket says 172.21.15.90:57552) 2022-07-05T11:46:36.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 -- 172.21.15.90:0/1826019214 learned_addr learned my addr 172.21.15.90:0/1826019214 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:36.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc466ffd700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448004690 0x7fc4681687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4667fc700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc468172f40 0x7fc46817d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 -- 172.21.15.90:0/1826019214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448004690 msgr2=0x7fc4681687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448004690 0x7fc4681687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 -- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc468172f40 msgr2=0x7fc46817d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc468172f40 0x7fc46817d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 -- 172.21.15.90:0/1826019214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46817e720 con 0x7fc4681733c0 2022-07-05T11:46:36.702 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4667fc700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc468172f40 0x7fc46817d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc466ffd700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448004690 0x7fc4681687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc4677fe700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4681733c0 0x7fc46817dc80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fc468088d60 tx=0x7fc460007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc45effd700 1 -- 172.21.15.90:0/1826019214 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460007240 con 0x7fc4681733c0 2022-07-05T11:46:36.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc45effd700 1 -- 172.21.15.90:0/1826019214 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4600073a0 con 0x7fc4681733c0 2022-07-05T11:46:36.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46817ea00 con 0x7fc4681733c0 2022-07-05T11:46:36.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc45effd700 1 -- 172.21.15.90:0/1826019214 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600066a0 con 0x7fc4681733c0 2022-07-05T11:46:36.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.673+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46817efc0 con 0x7fc4681733c0 2022-07-05T11:46:36.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.674+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46806b1e0 con 0x7fc4681733c0 2022-07-05T11:46:36.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.675+0000 7fc45effd700 1 -- 172.21.15.90:0/1826019214 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc46001d060 con 0x7fc4681733c0 2022-07-05T11:46:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.675+0000 7fc45effd700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc44c08ba40 0x7fc44c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.675+0000 7fc45effd700 1 -- 172.21.15.90:0/1826019214 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc4600b0be0 con 0x7fc4681733c0 2022-07-05T11:46:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.676+0000 7fc466ffd700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc44c08ba40 0x7fc44c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.676+0000 7fc466ffd700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc44c08ba40 0x7fc44c08df00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc458001190 tx=0x7fc458009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.678+0000 7fc45effd700 1 -- 172.21.15.90:0/1826019214 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fc460081820 con 0x7fc4681733c0 2022-07-05T11:46:36.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.838+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc46806be40 con 0x7fc4681733c0 2022-07-05T11:46:36.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.839+0000 7fc45effd700 1 -- 172.21.15.90:0/1826019214 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc46001b030 con 0x7fc4681733c0 2022-07-05T11:46:36.842 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:36.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc44c08ba40 msgr2=0x7fc44c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc44c08ba40 0x7fc44c08df00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc458001190 tx=0x7fc458009040).stop 2022-07-05T11:46:36.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4681733c0 msgr2=0x7fc46817dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4681733c0 0x7fc46817dc80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fc468088d60 tx=0x7fc460007b90).stop 2022-07-05T11:46:36.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 shutdown_connections 2022-07-05T11:46:36.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc44c08ba40 0x7fc44c08df00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4681733c0 0x7fc46817dc80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc448004690 0x7fc4681687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 --2- 172.21.15.90:0/1826019214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc468172f40 0x7fc46817d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 >> 172.21.15.90:0/1826019214 conn(0x7fc4680f21d0 msgr2=0x7fc4680c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:36.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 shutdown_connections 2022-07-05T11:46:36.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.841+0000 7fc46d2d6700 1 -- 172.21.15.90:0/1826019214 wait complete. 2022-07-05T11:46:36.857 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:36.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.977+0000 7f0d03963700 1 Processor -- start 2022-07-05T11:46:36.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.977+0000 7f0d03963700 1 -- start start 2022-07-05T11:46:36.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d03963700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0cfc17bda0 0x7f0cfc0ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d03963700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0cfc182a30 0x7f0cfc0eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d03963700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0ee170 con 0x7f0cfc061f10 2022-07-05T11:46:36.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d03963700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc17f760 con 0x7f0cfc182a30 2022-07-05T11:46:36.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d03963700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc17c3f0 con 0x7f0cfc17bda0 2022-07-05T11:46:36.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d00efe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0cfc182a30 0x7f0cfc0eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d01f00700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0cfc061f10 0x7f0cfc0623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:60096/0 (socket says 172.21.15.90:60096) 2022-07-05T11:46:36.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d01f00700 1 -- 172.21.15.90:0/3522751495 learned_addr learned my addr 172.21.15.90:0/3522751495 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:36.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.978+0000 7f0d016ff700 1 --2- 172.21.15.90:0/3522751495 >> v2:172.21.15.149:3300/0 conn(0x7f0cfc17bda0 0x7f0cfc0ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0d00efe700 1 -- 172.21.15.90:0/3522751495 >> v2:172.21.15.149:3300/0 conn(0x7f0cfc17bda0 msgr2=0x7f0cfc0ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:36.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0d00efe700 1 --2- 172.21.15.90:0/3522751495 >> v2:172.21.15.149:3300/0 conn(0x7f0cfc17bda0 0x7f0cfc0ee600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0d00efe700 1 -- 172.21.15.90:0/3522751495 >> v1:172.21.15.110:6789/0 conn(0x7f0cfc061f10 legacy=0x7f0cfc0623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0d00efe700 1 -- 172.21.15.90:0/3522751495 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0ed280 con 0x7f0cfc182a30 2022-07-05T11:46:36.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0cebfff700 1 -- 172.21.15.90:0/3522751495 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180294326 0 0) 0x7f0cfc0ee170 con 0x7f0cfc061f10 2022-07-05T11:46:36.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0d00efe700 1 --2- 172.21.15.90:0/3522751495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc182a30 0x7f0cfc0eeaf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0cfc06b170 tx=0x7f0cec009060).ready entity=mon.1 client_cookie=ee23d49fac2cdb03 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0cebfff700 1 -- 172.21.15.90:0/3522751495 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00f510 con 0x7f0cfc182a30 2022-07-05T11:46:36.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0cebfff700 1 -- 172.21.15.90:0/3522751495 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00f670 con 0x7f0cfc182a30 2022-07-05T11:46:36.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.979+0000 7f0cebfff700 1 -- 172.21.15.90:0/3522751495 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00f9f0 con 0x7f0cfc182a30 2022-07-05T11:46:36.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 -- 172.21.15.90:0/3522751495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc182a30 msgr2=0x7f0cfc0eeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 --2- 172.21.15.90:0/3522751495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc182a30 0x7f0cfc0eeaf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0cfc06b170 tx=0x7f0cec009060).stop 2022-07-05T11:46:36.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 -- 172.21.15.90:0/3522751495 shutdown_connections 2022-07-05T11:46:36.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 --2- 172.21.15.90:0/3522751495 >> v2:172.21.15.149:3300/0 conn(0x7f0cfc17bda0 0x7f0cfc0ee600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 --2- 172.21.15.90:0/3522751495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc182a30 0x7f0cfc0eeaf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 -- 172.21.15.90:0/3522751495 >> 172.21.15.90:0/3522751495 conn(0x7f0cfc0f21d0 msgr2=0x7f0cfc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:36.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 -- 172.21.15.90:0/3522751495 shutdown_connections 2022-07-05T11:46:36.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.980+0000 7f0d03963700 1 -- 172.21.15.90:0/3522751495 wait complete. 2022-07-05T11:46:36.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.981+0000 7f0d03963700 1 Processor -- start 2022-07-05T11:46:36.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.981+0000 7f0d03963700 1 -- start start 2022-07-05T11:46:36.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d03963700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc061f10 0x7f0cfc174790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d03963700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc17bda0 0x7f0cfc17ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d03963700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cfc182a30 0x7f0cfc17b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d03963700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc17c5c0 con 0x7f0cfc17bda0 2022-07-05T11:46:36.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d03963700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc17cb80 con 0x7f0cfc061f10 2022-07-05T11:46:36.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d03963700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc17b620 con 0x7f0cfc182a30 2022-07-05T11:46:36.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d00efe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc17bda0 0x7f0cfc17ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d00efe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc17bda0 0x7f0cfc17ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57564/0 (socket says 172.21.15.90:57564) 2022-07-05T11:46:36.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d00efe700 1 -- 172.21.15.90:0/1758820349 learned_addr learned my addr 172.21.15.90:0/1758820349 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:36.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.982+0000 7f0d016ff700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc061f10 0x7f0cfc174790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d00efe700 1 -- 172.21.15.90:0/1758820349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cfc182a30 msgr2=0x7f0cfc17b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d00efe700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cfc182a30 0x7f0cfc17b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:36.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d00efe700 1 -- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc061f10 msgr2=0x7f0cfc174790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:36.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d00efe700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc061f10 0x7f0cfc174790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:36.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d00efe700 1 -- 172.21.15.90:0/1758820349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0092a0 con 0x7f0cfc17bda0 2022-07-05T11:46:36.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d00efe700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc17bda0 0x7f0cfc17ac40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f0cec006df0 tx=0x7f0cec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0ce97fa700 1 -- 172.21.15.90:0/1758820349 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00f9f0 con 0x7f0cfc17bda0 2022-07-05T11:46:36.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0ce97fa700 1 -- 172.21.15.90:0/1758820349 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec000c90 con 0x7f0cfc17bda0 2022-07-05T11:46:36.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc178ab0 con 0x7f0cfc17bda0 2022-07-05T11:46:36.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0ce97fa700 1 -- 172.21.15.90:0/1758820349 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec01b690 con 0x7f0cfc17bda0 2022-07-05T11:46:36.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.983+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc179070 con 0x7f0cfc17bda0 2022-07-05T11:46:36.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.984+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc06b1e0 con 0x7f0cfc17bda0 2022-07-05T11:46:36.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.985+0000 7f0ce97fa700 1 -- 172.21.15.90:0/1758820349 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f0cec00f070 con 0x7f0cfc17bda0 2022-07-05T11:46:36.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.985+0000 7f0ce97fa700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0cdc08ba40 0x7f0cdc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:36.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.985+0000 7f0ce97fa700 1 -- 172.21.15.90:0/1758820349 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0cec0b29a0 con 0x7f0cfc17bda0 2022-07-05T11:46:36.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.985+0000 7f0d016ff700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0cdc08ba40 0x7f0cdc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:36.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.986+0000 7f0d016ff700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0cdc08ba40 0x7f0cdc08df00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0cf8009bc0 tx=0x7f0cf8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:36.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:36.988+0000 7f0ce97fa700 1 -- 172.21.15.90:0/1758820349 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f0cec083660 con 0x7f0cfc17bda0 2022-07-05T11:46:37.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.151+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0cfc06be40 con 0x7f0cfc17bda0 2022-07-05T11:46:37.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.152+0000 7f0ce97fa700 1 -- 172.21.15.90:0/1758820349 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0cec086c80 con 0x7f0cfc17bda0 2022-07-05T11:46:37.158 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:37.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.153+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0cdc08ba40 msgr2=0x7f0cdc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.153+0000 7f0d03963700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0cdc08ba40 0x7f0cdc08df00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0cf8009bc0 tx=0x7f0cf8008040).stop 2022-07-05T11:46:37.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.153+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc17bda0 msgr2=0x7f0cfc17ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.153+0000 7f0d03963700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc17bda0 0x7f0cfc17ac40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f0cec006df0 tx=0x7f0cec017000).stop 2022-07-05T11:46:37.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 shutdown_connections 2022-07-05T11:46:37.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0cdc08ba40 0x7f0cdc08df00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cfc182a30 0x7f0cfc17b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:37.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cfc061f10 0x7f0cfc174790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 --2- 172.21.15.90:0/1758820349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc17bda0 0x7f0cfc17ac40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 >> 172.21.15.90:0/1758820349 conn(0x7f0cfc0f21d0 msgr2=0x7f0cfc0f43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:37.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 shutdown_connections 2022-07-05T11:46:37.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.154+0000 7f0d03963700 1 -- 172.21.15.90:0/1758820349 wait complete. 2022-07-05T11:46:37.173 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-07-05T11:46:37.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.287+0000 7fb2f2ee7700 1 Processor -- start 2022-07-05T11:46:37.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.287+0000 7fb2f2ee7700 1 -- start start 2022-07-05T11:46:37.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.288+0000 7fb2f2ee7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2ec17bda0 0x7fb2ec0ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.288+0000 7fb2f2ee7700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0ee170 con 0x7fb2ec182a30 2022-07-05T11:46:37.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.288+0000 7fb2f2ee7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec17c3f0 con 0x7fb2ec17e750 2022-07-05T11:46:37.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.288+0000 7fb2f2ee7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0ed280 con 0x7fb2ec17bda0 2022-07-05T11:46:37.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2ebfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb2ec182a30 0x7fb2ec0eeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:60108/0 (socket says 172.21.15.90:60108) 2022-07-05T11:46:37.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2ebfff700 1 -- 172.21.15.90:0/1914514025 learned_addr learned my addr 172.21.15.90:0/1914514025 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:37.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2f0c83700 1 --2- 172.21.15.90:0/1914514025 >> v2:172.21.15.149:3300/0 conn(0x7fb2ec17bda0 0x7fb2ec0ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2eb7fe700 1 -- 172.21.15.90:0/1914514025 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832796371 0 0) 0x7fb2ec0ee170 con 0x7fb2ec182a30 2022-07-05T11:46:37.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2eb7fe700 1 -- 172.21.15.90:0/1914514025 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d80033f0 con 0x7fb2ec182a30 2022-07-05T11:46:37.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2f0c83700 1 -- 172.21.15.90:0/1914514025 >> v1:172.21.15.149:6789/0 conn(0x7fb2ec17e750 legacy=0x7fb2ec17ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2f0c83700 1 -- 172.21.15.90:0/1914514025 >> v1:172.21.15.110:6789/0 conn(0x7fb2ec182a30 legacy=0x7fb2ec0eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2f0c83700 1 -- 172.21.15.90:0/1914514025 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0ed560 con 0x7fb2ec17bda0 2022-07-05T11:46:37.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2f0c83700 1 --2- 172.21.15.90:0/1914514025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17bda0 0x7fb2ec0ee600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb2dc009e60 tx=0x7fb2dc009780).ready entity=mon.2 client_cookie=16f7b4a1e509760a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2eb7fe700 1 -- 172.21.15.90:0/1914514025 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00e070 con 0x7fb2ec17bda0 2022-07-05T11:46:37.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2eb7fe700 1 -- 172.21.15.90:0/1914514025 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00bb60 con 0x7fb2ec17bda0 2022-07-05T11:46:37.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.289+0000 7fb2eb7fe700 1 -- 172.21.15.90:0/1914514025 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc012410 con 0x7fb2ec17bda0 2022-07-05T11:46:37.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.290+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/1914514025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17bda0 msgr2=0x7fb2ec0ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.290+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/1914514025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17bda0 0x7fb2ec0ee600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb2dc009e60 tx=0x7fb2dc009780).stop 2022-07-05T11:46:37.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.290+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/1914514025 shutdown_connections 2022-07-05T11:46:37.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.290+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/1914514025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17bda0 0x7fb2ec0ee600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.290+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/1914514025 >> 172.21.15.90:0/1914514025 conn(0x7fb2ec0f21d0 msgr2=0x7fb2ec069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:37.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.290+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/1914514025 shutdown_connections 2022-07-05T11:46:37.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.290+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/1914514025 wait complete. 2022-07-05T11:46:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.291+0000 7fb2f2ee7700 1 Processor -- start 2022-07-05T11:46:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.291+0000 7fb2f2ee7700 1 -- start start 2022-07-05T11:46:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.292+0000 7fb2f2ee7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec17bda0 0x7fb2ec192920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.292+0000 7fb2f2ee7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17e750 0x7fb2ec1907f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.292+0000 7fb2f2ee7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2ec182a30 0x7fb2ec190ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.292+0000 7fb2f2ee7700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c8c60 con 0x7fb2ec182a30 2022-07-05T11:46:37.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.292+0000 7fb2f2ee7700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec190360 con 0x7fb2ec17bda0 2022-07-05T11:46:37.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.292+0000 7fb2f2ee7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c83c0 con 0x7fb2ec17e750 2022-07-05T11:46:37.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.292+0000 7fb2f1484700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2ec182a30 0x7fb2ec190ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2ec182a30 0x7fb2ec190ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57578/0 (socket says 172.21.15.90:57578) 2022-07-05T11:46:37.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 -- 172.21.15.90:0/964836194 learned_addr learned my addr 172.21.15.90:0/964836194 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f0c83700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec17bda0 0x7fb2ec192920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2ebfff700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17e750 0x7fb2ec1907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 -- 172.21.15.90:0/964836194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17e750 msgr2=0x7fb2ec1907f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17e750 0x7fb2ec1907f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 -- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec17bda0 msgr2=0x7fb2ec192920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec17bda0 0x7fb2ec192920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 -- 172.21.15.90:0/964836194 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc009a20 con 0x7fb2ec182a30 2022-07-05T11:46:37.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2ebfff700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17e750 0x7fb2ec1907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:37.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f1484700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2ec182a30 0x7fb2ec190ce0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fb2e400c440 tx=0x7fb2e4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2e8ff9700 1 -- 172.21.15.90:0/964836194 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400cea0 con 0x7fb2ec182a30 2022-07-05T11:46:37.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0c86a0 con 0x7fb2ec182a30 2022-07-05T11:46:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2e8ff9700 1 -- 172.21.15.90:0/964836194 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4001e90 con 0x7fb2ec182a30 2022-07-05T11:46:37.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2e8ff9700 1 -- 172.21.15.90:0/964836194 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400f680 con 0x7fb2ec182a30 2022-07-05T11:46:37.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.293+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec18fff0 con 0x7fb2ec182a30 2022-07-05T11:46:37.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.294+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec06b1e0 con 0x7fb2ec182a30 2022-07-05T11:46:37.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.295+0000 7fb2e8ff9700 1 -- 172.21.15.90:0/964836194 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb2e4010070 con 0x7fb2ec182a30 2022-07-05T11:46:37.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.295+0000 7fb2e8ff9700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb2cc08ba40 0x7fb2cc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.295+0000 7fb2e8ff9700 1 -- 172.21.15.90:0/964836194 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb2e40afb40 con 0x7fb2ec182a30 2022-07-05T11:46:37.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.295+0000 7fb2f0c83700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb2cc08ba40 0x7fb2cc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.296+0000 7fb2f0c83700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb2cc08ba40 0x7fb2cc08df00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb2dc0094d0 tx=0x7fb2dc009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.299+0000 7fb2e8ff9700 1 -- 172.21.15.90:0/964836194 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fb2e4080800 con 0x7fb2ec182a30 2022-07-05T11:46:37.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.462+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2ec06be40 con 0x7fb2ec182a30 2022-07-05T11:46:37.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.463+0000 7fb2e8ff9700 1 -- 172.21.15.90:0/964836194 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2e4083e20 con 0x7fb2ec182a30 2022-07-05T11:46:37.465 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:37.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb2cc08ba40 msgr2=0x7fb2cc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb2cc08ba40 0x7fb2cc08df00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb2dc0094d0 tx=0x7fb2dc009780).stop 2022-07-05T11:46:37.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2ec182a30 msgr2=0x7fb2ec190ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2ec182a30 0x7fb2ec190ce0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fb2e400c440 tx=0x7fb2e4007d70).stop 2022-07-05T11:46:37.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 shutdown_connections 2022-07-05T11:46:37.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb2cc08ba40 0x7fb2cc08df00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2ec182a30 0x7fb2ec190ce0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec17bda0 0x7fb2ec192920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 --2- 172.21.15.90:0/964836194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2ec17e750 0x7fb2ec1907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 >> 172.21.15.90:0/964836194 conn(0x7fb2ec0f21d0 msgr2=0x7fb2ec16c860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:37.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 shutdown_connections 2022-07-05T11:46:37.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.465+0000 7fb2f2ee7700 1 -- 172.21.15.90:0/964836194 wait complete. 2022-07-05T11:46:37.482 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-07-05T11:46:37.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.596+0000 7fabe91bb700 1 Processor -- start 2022-07-05T11:46:37.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.596+0000 7fabe91bb700 1 -- start start 2022-07-05T11:46:37.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.597+0000 7fabe91bb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fabe4182a30 0x7fabe40eed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.597+0000 7fabe91bb700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe40ee170 con 0x7fabe417bda0 2022-07-05T11:46:37.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.597+0000 7fabe91bb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe417c3f0 con 0x7fabe417e750 2022-07-05T11:46:37.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.597+0000 7fabe91bb700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe40ed280 con 0x7fabe4182a30 2022-07-05T11:46:37.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe259c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fabe4182a30 0x7fabe40eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe2d9d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fabe417bda0 0x7fabe40ee600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:60120/0 (socket says 172.21.15.90:60120) 2022-07-05T11:46:37.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe2d9d700 1 -- 172.21.15.90:0/1100803116 learned_addr learned my addr 172.21.15.90:0/1100803116 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:37.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe259c700 1 -- 172.21.15.90:0/1100803116 >> v1:172.21.15.149:6789/0 conn(0x7fabe417e750 legacy=0x7fabe417ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe259c700 1 -- 172.21.15.90:0/1100803116 >> v1:172.21.15.110:6789/0 conn(0x7fabe417bda0 legacy=0x7fabe40ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe1d9b700 1 -- 172.21.15.90:0/1100803116 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742334157 0 0) 0x7fabe417c3f0 con 0x7fabe417e750 2022-07-05T11:46:37.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe259c700 1 -- 172.21.15.90:0/1100803116 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40ed560 con 0x7fabe4182a30 2022-07-05T11:46:37.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.598+0000 7fabe259c700 1 --2- 172.21.15.90:0/1100803116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 0x7fabe40eed10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fabcc009760 tx=0x7fabcc009060).ready entity=mon.1 client_cookie=b29997d8391e3e1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe1d9b700 1 -- 172.21.15.90:0/1100803116 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00f510 con 0x7fabe4182a30 2022-07-05T11:46:37.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe1d9b700 1 -- 172.21.15.90:0/1100803116 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00f670 con 0x7fabe4182a30 2022-07-05T11:46:37.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe1d9b700 1 -- 172.21.15.90:0/1100803116 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00f9f0 con 0x7fabe4182a30 2022-07-05T11:46:37.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe91bb700 1 -- 172.21.15.90:0/1100803116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 msgr2=0x7fabe40eed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe91bb700 1 --2- 172.21.15.90:0/1100803116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 0x7fabe40eed10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fabcc009760 tx=0x7fabcc009060).stop 2022-07-05T11:46:37.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe91bb700 1 -- 172.21.15.90:0/1100803116 shutdown_connections 2022-07-05T11:46:37.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe91bb700 1 --2- 172.21.15.90:0/1100803116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 0x7fabe40eed10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe91bb700 1 -- 172.21.15.90:0/1100803116 >> 172.21.15.90:0/1100803116 conn(0x7fabe40f21d0 msgr2=0x7fabe4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:37.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe91bb700 1 -- 172.21.15.90:0/1100803116 shutdown_connections 2022-07-05T11:46:37.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.599+0000 7fabe91bb700 1 -- 172.21.15.90:0/1100803116 wait complete. 2022-07-05T11:46:37.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.600+0000 7fabe91bb700 1 Processor -- start 2022-07-05T11:46:37.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.601+0000 7fabe91bb700 1 -- start start 2022-07-05T11:46:37.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.601+0000 7fabe91bb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabe417bda0 0x7fabe417f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.601+0000 7fabe91bb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabe417e750 0x7fabe41744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.601+0000 7fabe91bb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 0x7fabe41749e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.601+0000 7fabe91bb700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe4178c20 con 0x7fabe417bda0 2022-07-05T11:46:37.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.601+0000 7fabe91bb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe41790b0 con 0x7fabe4182a30 2022-07-05T11:46:37.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.601+0000 7fabe91bb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe4177d30 con 0x7fabe417e750 2022-07-05T11:46:37.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabe417bda0 0x7fabe417f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabe417bda0 0x7fabe417f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57592/0 (socket says 172.21.15.90:57592) 2022-07-05T11:46:37.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 -- 172.21.15.90:0/774060330 learned_addr learned my addr 172.21.15.90:0/774060330 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:37.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe259c700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabe417e750 0x7fabe41744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe359e700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 0x7fabe41749e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 -- 172.21.15.90:0/774060330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabe417e750 msgr2=0x7fabe41744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabe417e750 0x7fabe41744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 -- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 msgr2=0x7fabe41749e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 0x7fabe41749e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 -- 172.21.15.90:0/774060330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0092a0 con 0x7fabe417bda0 2022-07-05T11:46:37.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe2d9d700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabe417bda0 0x7fabe417f060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fabd400c960 tx=0x7fabd4001690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabdaffd700 1 -- 172.21.15.90:0/774060330 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4005d30 con 0x7fabe417bda0 2022-07-05T11:46:37.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabdaffd700 1 -- 172.21.15.90:0/774060330 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4007110 con 0x7fabe417bda0 2022-07-05T11:46:37.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe4178010 con 0x7fabe417bda0 2022-07-05T11:46:37.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabdaffd700 1 -- 172.21.15.90:0/774060330 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40074d0 con 0x7fabe417bda0 2022-07-05T11:46:37.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.602+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe41785d0 con 0x7fabe417bda0 2022-07-05T11:46:37.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.603+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe4178f00 con 0x7fabe417bda0 2022-07-05T11:46:37.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.604+0000 7fabdaffd700 1 -- 172.21.15.90:0/774060330 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fabd4010030 con 0x7fabe417bda0 2022-07-05T11:46:37.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.604+0000 7fabdaffd700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fabc808ba40 0x7fabc808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.604+0000 7fabdaffd700 1 -- 172.21.15.90:0/774060330 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fabd40b0870 con 0x7fabe417bda0 2022-07-05T11:46:37.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.605+0000 7fabe259c700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fabc808ba40 0x7fabc808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.605+0000 7fabe259c700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fabc808ba40 0x7fabc808df00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fabe40c5c60 tx=0x7fabcc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.608+0000 7fabdaffd700 1 -- 172.21.15.90:0/774060330 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fabd40814b0 con 0x7fabe417bda0 2022-07-05T11:46:37.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.770+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabe406b1e0 con 0x7fabe417bda0 2022-07-05T11:46:37.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.770+0000 7fabdaffd700 1 -- 172.21.15.90:0/774060330 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabd4084ad0 con 0x7fabe417bda0 2022-07-05T11:46:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:37.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fabc808ba40 msgr2=0x7fabc808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fabc808ba40 0x7fabc808df00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fabe40c5c60 tx=0x7fabcc017000).stop 2022-07-05T11:46:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabe417bda0 msgr2=0x7fabe417f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabe417bda0 0x7fabe417f060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fabd400c960 tx=0x7fabd4001690).stop 2022-07-05T11:46:37.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 shutdown_connections 2022-07-05T11:46:37.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fabc808ba40 0x7fabc808df00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabe4182a30 0x7fabe41749e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabe417bda0 0x7fabe417f060 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 --2- 172.21.15.90:0/774060330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabe417e750 0x7fabe41744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 >> 172.21.15.90:0/774060330 conn(0x7fabe40f21d0 msgr2=0x7fabe4175800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 shutdown_connections 2022-07-05T11:46:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.772+0000 7fabe91bb700 1 -- 172.21.15.90:0/774060330 wait complete. 2022-07-05T11:46:37.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-07-05T11:46:37.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.899+0000 7faa2f181700 1 Processor -- start 2022-07-05T11:46:37.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.899+0000 7faa2f181700 1 -- start start 2022-07-05T11:46:37.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.900+0000 7faa2f181700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa2817bda0 0x7faa280ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.900+0000 7faa2f181700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa280ee170 con 0x7faa2817e750 2022-07-05T11:46:37.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.900+0000 7faa2f181700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2817c3f0 con 0x7faa28182a30 2022-07-05T11:46:37.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.900+0000 7faa2f181700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280ed280 con 0x7faa2817bda0 2022-07-05T11:46:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa2cf1d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa2817bda0 0x7faa280ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa2d71e700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7faa2817e750 0x7faa2817ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50538/0 (socket says 172.21.15.90:50538) 2022-07-05T11:46:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa2d71e700 1 -- 172.21.15.90:0/1452297800 learned_addr learned my addr 172.21.15.90:0/1452297800 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:37.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa2cf1d700 1 -- 172.21.15.90:0/1452297800 >> v1:172.21.15.149:6789/0 conn(0x7faa28182a30 legacy=0x7faa280eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:37.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa2cf1d700 1 -- 172.21.15.90:0/1452297800 >> v1:172.21.15.90:6789/0 conn(0x7faa2817e750 legacy=0x7faa2817ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa2cf1d700 1 -- 172.21.15.90:0/1452297800 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa280ed560 con 0x7faa2817bda0 2022-07-05T11:46:37.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa277fe700 1 -- 172.21.15.90:0/1452297800 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038467688 0 0) 0x7faa280ee170 con 0x7faa2817e750 2022-07-05T11:46:37.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa2cf1d700 1 --2- 172.21.15.90:0/1452297800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa2817bda0 0x7faa280ee600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7faa18009760 tx=0x7faa18009060).ready entity=mon.0 client_cookie=58dcb8ea226ed509 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa277fe700 1 -- 172.21.15.90:0/1452297800 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800b520 con 0x7faa2817bda0 2022-07-05T11:46:37.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa277fe700 1 -- 172.21.15.90:0/1452297800 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1800b680 con 0x7faa2817bda0 2022-07-05T11:46:37.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.901+0000 7faa277fe700 1 -- 172.21.15.90:0/1452297800 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800ba00 con 0x7faa2817bda0 2022-07-05T11:46:37.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.902+0000 7faa2f181700 1 -- 172.21.15.90:0/1452297800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa2817bda0 msgr2=0x7faa280ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.902+0000 7faa2f181700 1 --2- 172.21.15.90:0/1452297800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa2817bda0 0x7faa280ee600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7faa18009760 tx=0x7faa18009060).stop 2022-07-05T11:46:37.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.902+0000 7faa2f181700 1 -- 172.21.15.90:0/1452297800 shutdown_connections 2022-07-05T11:46:37.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.902+0000 7faa2f181700 1 --2- 172.21.15.90:0/1452297800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa2817bda0 0x7faa280ee600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.902+0000 7faa2f181700 1 -- 172.21.15.90:0/1452297800 >> 172.21.15.90:0/1452297800 conn(0x7faa280f21d0 msgr2=0x7faa28069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:37.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.902+0000 7faa2f181700 1 -- 172.21.15.90:0/1452297800 shutdown_connections 2022-07-05T11:46:37.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.902+0000 7faa2f181700 1 -- 172.21.15.90:0/1452297800 wait complete. 2022-07-05T11:46:37.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.903+0000 7faa2f181700 1 Processor -- start 2022-07-05T11:46:37.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.903+0000 7faa2f181700 1 -- start start 2022-07-05T11:46:37.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2f181700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa2817bda0 0x7faa2815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2f181700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa2817e750 0x7faa280c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2f181700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa28182a30 0x7faa28179490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2f181700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa28178d80 con 0x7faa28182a30 2022-07-05T11:46:37.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2f181700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa28179000 con 0x7faa2817e750 2022-07-05T11:46:37.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2f181700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2815b3d0 con 0x7faa2817bda0 2022-07-05T11:46:37.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2d71e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa28182a30 0x7faa28179490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2d71e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa28182a30 0x7faa28179490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57606/0 (socket says 172.21.15.90:57606) 2022-07-05T11:46:37.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.904+0000 7faa2d71e700 1 -- 172.21.15.90:0/3919849067 learned_addr learned my addr 172.21.15.90:0/3919849067 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:37.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2d71e700 1 -- 172.21.15.90:0/3919849067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa2817bda0 msgr2=0x7faa2815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2d71e700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa2817bda0 0x7faa2815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:37.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa27fff700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa2817e750 0x7faa280c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2d71e700 1 -- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa2817e750 msgr2=0x7faa280c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:37.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2d71e700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa2817e750 0x7faa280c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:37.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2d71e700 1 -- 172.21.15.90:0/3919849067 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa180092a0 con 0x7faa28182a30 2022-07-05T11:46:37.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2d71e700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa28182a30 0x7faa28179490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7faa20001eb0 tx=0x7faa20007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa24ff9700 1 -- 172.21.15.90:0/3919849067 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200072e0 con 0x7faa28182a30 2022-07-05T11:46:37.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa24ff9700 1 -- 172.21.15.90:0/3919849067 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa20007440 con 0x7faa28182a30 2022-07-05T11:46:37.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa280c87b0 con 0x7faa28182a30 2022-07-05T11:46:37.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa24ff9700 1 -- 172.21.15.90:0/3919849067 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200057a0 con 0x7faa28182a30 2022-07-05T11:46:37.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.905+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa280c8d70 con 0x7faa28182a30 2022-07-05T11:46:37.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.906+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2806b1e0 con 0x7faa28182a30 2022-07-05T11:46:37.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.906+0000 7faa24ff9700 1 -- 172.21.15.90:0/3919849067 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7faa20010070 con 0x7faa28182a30 2022-07-05T11:46:37.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.907+0000 7faa24ff9700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa0c08ba40 0x7faa0c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:37.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.907+0000 7faa24ff9700 1 -- 172.21.15.90:0/3919849067 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7faa200afe80 con 0x7faa28182a30 2022-07-05T11:46:37.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.907+0000 7faa2cf1d700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa0c08ba40 0x7faa0c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:37.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.907+0000 7faa2cf1d700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa0c08ba40 0x7faa0c08df00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7faa1800b2e0 tx=0x7faa18017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:37.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:37.911+0000 7faa24ff9700 1 -- 172.21.15.90:0/3919849067 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7faa20080b40 con 0x7faa28182a30 2022-07-05T11:46:38.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.071+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa28179170 con 0x7faa28182a30 2022-07-05T11:46:38.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.072+0000 7faa24ff9700 1 -- 172.21.15.90:0/3919849067 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa20084160 con 0x7faa28182a30 2022-07-05T11:46:38.074 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2022-07-05T11:46:38.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa0c08ba40 msgr2=0x7faa0c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa0c08ba40 0x7faa0c08df00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7faa1800b2e0 tx=0x7faa18017000).stop 2022-07-05T11:46:38.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa28182a30 msgr2=0x7faa28179490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa28182a30 0x7faa28179490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7faa20001eb0 tx=0x7faa20007bb0).stop 2022-07-05T11:46:38.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 shutdown_connections 2022-07-05T11:46:38.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faa0c08ba40 0x7faa0c08df00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:38.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa28182a30 0x7faa28179490 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:38.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa2817bda0 0x7faa2815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:38.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 --2- 172.21.15.90:0/3919849067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa2817e750 0x7faa280c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:38.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 >> 172.21.15.90:0/3919849067 conn(0x7faa280f21d0 msgr2=0x7faa280c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:38.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 shutdown_connections 2022-07-05T11:46:38.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.073+0000 7faa2f181700 1 -- 172.21.15.90:0/3919849067 wait complete. 2022-07-05T11:46:38.086 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-07-05T11:46:38.087 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:38.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.199+0000 7fde22d75700 1 Processor -- start 2022-07-05T11:46:38.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.199+0000 7fde22d75700 1 -- start start 2022-07-05T11:46:38.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.200+0000 7fde22d75700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fde1c17da60 0x7fde1c17de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:38.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.200+0000 7fde22d75700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c0c9090 con 0x7fde1c0c9520 2022-07-05T11:46:38.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.200+0000 7fde22d75700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c0c81a0 con 0x7fde1c0c7d00 2022-07-05T11:46:38.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.200+0000 7fde22d75700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c0c8480 con 0x7fde1c17da60 2022-07-05T11:46:38.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde21312700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fde1c0c9520 0x7fde1c0c99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50552/0 (socket says 172.21.15.90:50552) 2022-07-05T11:46:38.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde21312700 1 -- 172.21.15.90:0/1065215578 learned_addr learned my addr 172.21.15.90:0/1065215578 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:38.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde20b11700 1 --2- 172.21.15.90:0/1065215578 >> v2:172.21.15.90:3300/0 conn(0x7fde1c17da60 0x7fde1c17de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:38.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde20b11700 1 -- 172.21.15.90:0/1065215578 >> v1:172.21.15.149:6789/0 conn(0x7fde1c0c7d00 legacy=0x7fde1c17eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:38.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde20b11700 1 -- 172.21.15.90:0/1065215578 >> v1:172.21.15.90:6789/0 conn(0x7fde1c0c9520 legacy=0x7fde1c0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde1b7fe700 1 -- 172.21.15.90:0/1065215578 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231826550 0 0) 0x7fde1c0c9090 con 0x7fde1c0c9520 2022-07-05T11:46:38.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde20b11700 1 -- 172.21.15.90:0/1065215578 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0c8760 con 0x7fde1c17da60 2022-07-05T11:46:38.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde20b11700 1 --2- 172.21.15.90:0/1065215578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c17da60 0x7fde1c17de40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fde0c009760 tx=0x7fde0c009060).ready entity=mon.0 client_cookie=2432104914ceb887 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:38.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde1b7fe700 1 -- 172.21.15.90:0/1065215578 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00b520 con 0x7fde1c17da60 2022-07-05T11:46:38.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde1b7fe700 1 -- 172.21.15.90:0/1065215578 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0c00b680 con 0x7fde1c17da60 2022-07-05T11:46:38.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.201+0000 7fde1b7fe700 1 -- 172.21.15.90:0/1065215578 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00ba00 con 0x7fde1c17da60 2022-07-05T11:46:38.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.202+0000 7fde22d75700 1 -- 172.21.15.90:0/1065215578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c17da60 msgr2=0x7fde1c17de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.202+0000 7fde22d75700 1 --2- 172.21.15.90:0/1065215578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c17da60 0x7fde1c17de40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fde0c009760 tx=0x7fde0c009060).stop 2022-07-05T11:46:38.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.202+0000 7fde22d75700 1 -- 172.21.15.90:0/1065215578 shutdown_connections 2022-07-05T11:46:38.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.202+0000 7fde22d75700 1 --2- 172.21.15.90:0/1065215578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c17da60 0x7fde1c17de40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:38.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.202+0000 7fde22d75700 1 -- 172.21.15.90:0/1065215578 >> 172.21.15.90:0/1065215578 conn(0x7fde1c0f4b70 msgr2=0x7fde1c0f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:38.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.202+0000 7fde22d75700 1 -- 172.21.15.90:0/1065215578 shutdown_connections 2022-07-05T11:46:38.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.202+0000 7fde22d75700 1 -- 172.21.15.90:0/1065215578 wait complete. 2022-07-05T11:46:38.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.203+0000 7fde22d75700 1 Processor -- start 2022-07-05T11:46:38.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.203+0000 7fde22d75700 1 -- start start 2022-07-05T11:46:38.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde22d75700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c0c7d00 0x7fde1c17b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:38.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde22d75700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1c0c9520 0x7fde1c15e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:38.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde22d75700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1c17da60 0x7fde1c15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:38.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde22d75700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c15f360 con 0x7fde1c0c7d00 2022-07-05T11:46:38.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde22d75700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c17d2c0 con 0x7fde1c0c9520 2022-07-05T11:46:38.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde22d75700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c17c3d0 con 0x7fde1c17da60 2022-07-05T11:46:38.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde20b11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c0c7d00 0x7fde1c17b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:38.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde20b11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c0c7d00 0x7fde1c17b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57616/0 (socket says 172.21.15.90:57616) 2022-07-05T11:46:38.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.204+0000 7fde20b11700 1 -- 172.21.15.90:0/3147792973 learned_addr learned my addr 172.21.15.90:0/3147792973 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:38.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde20b11700 1 -- 172.21.15.90:0/3147792973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1c17da60 msgr2=0x7fde1c15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde20b11700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1c17da60 0x7fde1c15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:38.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde20b11700 1 -- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1c0c9520 msgr2=0x7fde1c15e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde20b11700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1c0c9520 0x7fde1c15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:38.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde20b11700 1 -- 172.21.15.90:0/3147792973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0092a0 con 0x7fde1c0c7d00 2022-07-05T11:46:38.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde20b11700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c0c7d00 0x7fde1c17b990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fde0c009eb0 tx=0x7fde0c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:38.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde18ff9700 1 -- 172.21.15.90:0/3147792973 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00b7f0 con 0x7fde1c0c7d00 2022-07-05T11:46:38.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde18ff9700 1 -- 172.21.15.90:0/3147792973 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0c00b950 con 0x7fde1c0c7d00 2022-07-05T11:46:38.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde18ff9700 1 -- 172.21.15.90:0/3147792973 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c01c630 con 0x7fde1c0c7d00 2022-07-05T11:46:38.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c17c6b0 con 0x7fde1c0c7d00 2022-07-05T11:46:38.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.205+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c17cc70 con 0x7fde1c0c7d00 2022-07-05T11:46:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.206+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c06be40 con 0x7fde1c0c7d00 2022-07-05T11:46:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.207+0000 7fde18ff9700 1 -- 172.21.15.90:0/3147792973 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fde0c02c070 con 0x7fde1c0c7d00 2022-07-05T11:46:38.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.207+0000 7fde18ff9700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fde0008ba40 0x7fde0008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:38.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.207+0000 7fde18ff9700 1 -- 172.21.15.90:0/3147792973 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fde0c0b2720 con 0x7fde1c0c7d00 2022-07-05T11:46:38.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.207+0000 7fde1bfff700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fde0008ba40 0x7fde0008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:38.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.208+0000 7fde1bfff700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fde0008ba40 0x7fde0008df00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fde1c0f0c40 tx=0x7fde04006ae0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.211+0000 7fde18ff9700 1 -- 172.21.15.90:0/3147792973 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fde0c0833e0 con 0x7fde1c0c7d00 2022-07-05T11:46:38.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.411+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde1c0c4030 con 0x7fde1c0c7d00 2022-07-05T11:46:38.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.412+0000 7fde18ff9700 1 -- 172.21.15.90:0/3147792973 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+10607 (secure 0 0 0) 0x7fde0c02a090 con 0x7fde1c0c7d00 2022-07-05T11:46:38.414 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:38.415 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:22.354922+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4371,"mds_1":4362,"mds_2":4346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4340":{"gid":4340,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4341":{"gid":4341,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4344":{"gid":4344,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4346":{"gid":4346,"name":"l","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4362":{"gid":4362,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-07-05T11:46:38.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fde0008ba40 msgr2=0x7fde0008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fde0008ba40 0x7fde0008df00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fde1c0f0c40 tx=0x7fde04006ae0).stop 2022-07-05T11:46:38.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c0c7d00 msgr2=0x7fde1c17b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:38.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c0c7d00 0x7fde1c17b990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fde0c009eb0 tx=0x7fde0c017000).stop 2022-07-05T11:46:38.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 shutdown_connections 2022-07-05T11:46:38.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fde0008ba40 0x7fde0008df00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:38.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1c17da60 0x7fde1c15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:38.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde1c0c7d00 0x7fde1c17b990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:38.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 --2- 172.21.15.90:0/3147792973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1c0c9520 0x7fde1c15e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:38.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 >> 172.21.15.90:0/3147792973 conn(0x7fde1c0f4b70 msgr2=0x7fde1c0f2770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:38.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 shutdown_connections 2022-07-05T11:46:38.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:38.414+0000 7fde22d75700 1 -- 172.21.15.90:0/3147792973 wait complete. 2022-07-05T11:46:38.422 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2022-07-05T11:46:39.637 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 50, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2022-07-05T11:46:04.574721+0000', 'modified': '2022-07-05T11:46:22.354922+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4371, 'mds_1': 4362, 'mds_2': 4346}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4340': {'gid': 4340, 'name': 'i', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.149:6835/2788360445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 2788360445}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 2788360445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4341': {'gid': 4341, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.110:6836/701705434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 701705434}, {'type': 'v1', 'addr': '172.21.15.110:6836', 'nonce': 701705434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4344': {'gid': 4344, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.110:6837/3239498851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 3239498851}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 3239498851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4346': {'gid': 4346, 'name': 'l', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.149:6839/4158465025', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6838', 'nonce': 4158465025}, {'type': 'v1', 'addr': '172.21.15.149:6839', 'nonce': 4158465025}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4362': {'gid': 4362, 'name': 'c', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.149:6833/4013403095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6832', 'nonce': 4013403095}, {'type': 'v1', 'addr': '172.21.15.149:6833', 'nonce': 4013403095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4371': {'gid': 4371, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/3440068716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 3440068716}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3440068716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-07-05T11:46:39.637 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2022-07-05T11:46:39.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2022-07-05T11:46:39.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.764+0000 7f160f2bb700 1 Processor -- start 2022-07-05T11:46:39.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.764+0000 7f160f2bb700 1 -- start start 2022-07-05T11:46:39.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160f2bb700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f160817dd60 0x7f16080c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160f2bb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16080c4390 0x7f16080c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160f2bb700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16080c3a10 con 0x7f160817d980 2022-07-05T11:46:39.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160f2bb700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16080f0330 con 0x7f160817dd60 2022-07-05T11:46:39.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160f2bb700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160817f210 con 0x7f16080c4390 2022-07-05T11:46:39.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160dab8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f160817dd60 0x7f16080c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160dab8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f160817dd60 0x7f16080c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57628/0 (socket says 172.21.15.90:57628) 2022-07-05T11:46:39.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160dab8700 1 -- 172.21.15.90:0/4074035578 learned_addr learned my addr 172.21.15.90:0/4074035578 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:39.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160dab8700 1 -- 172.21.15.90:0/4074035578 >> v2:172.21.15.149:3300/0 conn(0x7f16080c4390 msgr2=0x7f16080c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160dab8700 1 --2- 172.21.15.90:0/4074035578 >> v2:172.21.15.149:3300/0 conn(0x7f16080c4390 0x7f16080c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:39.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160dab8700 1 -- 172.21.15.90:0/4074035578 >> v1:172.21.15.110:6789/0 conn(0x7f160817d980 legacy=0x7f160817eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.765+0000 7f160dab8700 1 -- 172.21.15.90:0/4074035578 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080ed380 con 0x7f160817dd60 2022-07-05T11:46:39.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160dab8700 1 --2- 172.21.15.90:0/4074035578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f16080c3ea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f16080eb9d0 tx=0x7f15fc0090f0).ready entity=mon.0 client_cookie=aa7b9cf3090e734e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:39.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160d2b7700 1 -- 172.21.15.90:0/4074035578 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00b5a0 con 0x7f160817dd60 2022-07-05T11:46:39.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160d2b7700 1 -- 172.21.15.90:0/4074035578 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc00b700 con 0x7f160817dd60 2022-07-05T11:46:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160d2b7700 1 -- 172.21.15.90:0/4074035578 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00baa0 con 0x7f160817dd60 2022-07-05T11:46:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 -- 172.21.15.90:0/4074035578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 msgr2=0x7f16080c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 --2- 172.21.15.90:0/4074035578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f16080c3ea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f16080eb9d0 tx=0x7f15fc0090f0).stop 2022-07-05T11:46:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 -- 172.21.15.90:0/4074035578 shutdown_connections 2022-07-05T11:46:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 --2- 172.21.15.90:0/4074035578 >> v2:172.21.15.149:3300/0 conn(0x7f16080c4390 0x7f16080c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:39.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 --2- 172.21.15.90:0/4074035578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f16080c3ea0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 -- 172.21.15.90:0/4074035578 >> 172.21.15.90:0/4074035578 conn(0x7f16080f1420 msgr2=0x7f16080f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 -- 172.21.15.90:0/4074035578 shutdown_connections 2022-07-05T11:46:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.766+0000 7f160f2bb700 1 -- 172.21.15.90:0/4074035578 wait complete. 2022-07-05T11:46:39.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.768+0000 7f160f2bb700 1 Processor -- start 2022-07-05T11:46:39.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.768+0000 7f160f2bb700 1 -- start start 2022-07-05T11:46:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16080c4390 0x7f160818f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160817d980 0x7f16080cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f160816d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080cbc10 con 0x7f160817dd60 2022-07-05T11:46:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080cad20 con 0x7f16080c4390 2022-07-05T11:46:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080cb000 con 0x7f160817d980 2022-07-05T11:46:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f160816d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f160816d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57634/0 (socket says 172.21.15.90:57634) 2022-07-05T11:46:39.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 -- 172.21.15.90:0/2704715221 learned_addr learned my addr 172.21.15.90:0/2704715221 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:39.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160e2b9700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16080c4390 0x7f160818f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160dab8700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160817d980 0x7f16080cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 -- 172.21.15.90:0/2704715221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160817d980 msgr2=0x7f16080cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160817d980 0x7f16080cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 -- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16080c4390 msgr2=0x7f160818f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16080c4390 0x7f160818f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 -- 172.21.15.90:0/2704715221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc009370 con 0x7f160817dd60 2022-07-05T11:46:39.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160eaba700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f160816d610 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f160000b410 tx=0x7f1600006f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f16067fc700 1 -- 172.21.15.90:0/2704715221 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600002320 con 0x7f160817dd60 2022-07-05T11:46:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f16067fc700 1 -- 172.21.15.90:0/2704715221 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16000024a0 con 0x7f160817dd60 2022-07-05T11:46:39.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f16067fc700 1 -- 172.21.15.90:0/2704715221 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600002860 con 0x7f160817dd60 2022-07-05T11:46:39.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16080cb2e0 con 0x7f160817dd60 2022-07-05T11:46:39.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.769+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16080cb8a0 con 0x7f160817dd60 2022-07-05T11:46:39.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.771+0000 7f16067fc700 1 -- 172.21.15.90:0/2704715221 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f160000f030 con 0x7f160817dd60 2022-07-05T11:46:39.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.772+0000 7f16067fc700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f15e808ba40 0x7f15e808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.772+0000 7f16067fc700 1 -- 172.21.15.90:0/2704715221 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f16000b0640 con 0x7f160817dd60 2022-07-05T11:46:39.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.772+0000 7f160e2b9700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f15e808ba40 0x7f15e808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.772+0000 7f160e2b9700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f15e808ba40 0x7f15e808df00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f15f8003e80 tx=0x7f15f8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:39.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.774+0000 7f1621ea9b80 1 Processor -- start 2022-07-05T11:46:39.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.774+0000 7f1621ea9b80 1 -- start start 2022-07-05T11:46:39.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a7025860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a7073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a6fef280 con 0x55d0a7069460 2022-07-05T11:46:39.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a6f66a50 con 0x55d0a7025d50 2022-07-05T11:46:39.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a6f7b900 con 0x55d0a7069840 2022-07-05T11:46:39.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a7025860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a7025860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57638/0 (socket says 172.21.15.90:57638) 2022-07-05T11:46:39.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 -- 172.21.15.90:0/3772690004 learned_addr learned my addr 172.21.15.90:0/3772690004 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:39.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160dab8700 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a7073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160eaba700 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 -- 172.21.15.90:0/3772690004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 msgr2=0x55d0a7069cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7069cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 -- 172.21.15.90:0/3772690004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 msgr2=0x55d0a7073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a7073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 -- 172.21.15.90:0/3772690004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a6dad990 con 0x55d0a7069460 2022-07-05T11:46:39.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160dab8700 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a7073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:39.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f160e2b9700 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a7025860 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f15f800ea70 tx=0x7f15f8013000).ready entity=mon.0 client_cookie=3bb936f10aab091 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:39.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f15e77fe700 1 -- 172.21.15.90:0/3772690004 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8013ac0 con 0x55d0a7069460 2022-07-05T11:46:39.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f15e77fe700 1 -- 172.21.15.90:0/3772690004 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8017070 con 0x55d0a7069460 2022-07-05T11:46:39.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.775+0000 7f15e77fe700 1 -- 172.21.15.90:0/3772690004 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8013c40 con 0x55d0a7069460 2022-07-05T11:46:39.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3772690004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 msgr2=0x55d0a7025860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a7025860 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f15f800ea70 tx=0x7f15f8013000).stop 2022-07-05T11:46:39.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3772690004 shutdown_connections 2022-07-05T11:46:39.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a7025860 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3772690004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a7073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3772690004 >> 172.21.15.90:0/3772690004 conn(0x55d0a6e94170 msgr2=0x55d0a7028b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:39.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3772690004 shutdown_connections 2022-07-05T11:46:39.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.776+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3772690004 wait complete. 2022-07-05T11:46:39.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.777+0000 7f1621ea9b80 1 -- start start 2022-07-05T11:46:39.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.777+0000 7f1621ea9b80 1 Processor -- start 2022-07-05T11:46:39.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a70ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a709ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7067e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a6f430d0 con 0x55d0a7069460 2022-07-05T11:46:39.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a709b620 con 0x55d0a7025d50 2022-07-05T11:46:39.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a7063610 con 0x55d0a7069840 2022-07-05T11:46:39.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f1621ea9b80 10 client.0 ll_register_callbacks cb 0x55d0a6fe9330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:39.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a709ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a709ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57646/0 (socket says 172.21.15.90:57646) 2022-07-05T11:46:39.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 -- 172.21.15.90:0/3103723625 learned_addr learned my addr 172.21.15.90:0/3103723625 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:39.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160e2b9700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a70ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160eaba700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7067e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 -- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 msgr2=0x55d0a7067e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7067e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 -- 172.21.15.90:0/3103723625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 msgr2=0x55d0a70ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a70ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.778+0000 7f160dab8700 1 -- 172.21.15.90:0/3103723625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f800f040 con 0x55d0a7069460 2022-07-05T11:46:39.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f160eaba700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7067e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:39.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f160dab8700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a709ac10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f15fc006fd0 tx=0x7f15fc015000).ready entity=mon.0 client_cookie=15d987fe2178a17c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:39.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f15e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:39.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f15e4ff9700 1 -- 172.21.15.90:0/3103723625 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc020070 con 0x55d0a7069460 2022-07-05T11:46:39.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f15e4ff9700 1 -- 172.21.15.90:0/3103723625 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f15fc01a610 con 0x55d0a7069460 2022-07-05T11:46:39.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0a7023640 con 0x55d0a7069460 2022-07-05T11:46:39.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f15e4ff9700 1 -- 172.21.15.90:0/3103723625 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15fc000d10 con 0x55d0a7069460 2022-07-05T11:46:39.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 10 client.4980 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:39.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55d0a6e1cc80 con 0x55d0a7069460 2022-07-05T11:46:39.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f15e4ff9700 1 -- 172.21.15.90:0/3103723625 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc02f020 con 0x55d0a7069460 2022-07-05T11:46:39.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f15e4ff9700 1 -- 172.21.15.90:0/3103723625 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f15fc0098e0 con 0x55d0a7069460 2022-07-05T11:46:39.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 10 client.4980 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:39.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 10 client.4980 resolve_mds: resolved name 'l' to daemon mds.l 2022-07-05T11:46:39.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 20 client.4980 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:39.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a705e120 0x55d0a70a8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 4 client.4980 mds_command: new command op to 4346 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:39.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.779+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 --> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0a6f717a0 con 0x55d0a705e120 2022-07-05T11:46:39.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.780+0000 7f160e2b9700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a705e120 0x55d0a70a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.780+0000 7f160e2b9700 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a705e120 0x55d0a70a8320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.2 client_cookie=e69169090ecbb63e server_cookie=a86cb2dfcef6cd0e in_seq=0 out_seq=0 2022-07-05T11:46:39.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.780+0000 7f15e4ff9700 10 client.4980 ms_handle_connect on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:39.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f15e4ff9700 1 -- 172.21.15.90:0/3103723625 <== mds.2 v2:172.21.15.149:6838/4158465025 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55d0a6f717a0 con 0x55d0a705e120 2022-07-05T11:46:39.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f15e4ff9700 10 client.4980 handle_command_reply: tid=0 2022-07-05T11:46:39.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 client.4980 shutdown 2022-07-05T11:46:39.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 msgr2=0x55d0a709ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a709ac10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f15fc006fd0 tx=0x7f15fc015000).stop 2022-07-05T11:46:39.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 shutdown_connections 2022-07-05T11:46:39.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a705e120 0x55d0a70a8320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069840 0x55d0a7067e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f15e4ff9700 0 client.4980 ms_handle_reset on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:39.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a70ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/3103723625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069460 0x55d0a709ac10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 >> 172.21.15.90:0/3103723625 conn(0x55d0a6e94170 msgr2=0x55d0a70267a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:39.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 shutdown_connections 2022-07-05T11:46:39.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 1 -- 172.21.15.90:0/3103723625 wait complete. 2022-07-05T11:46:39.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.781+0000 7f1621ea9b80 20 client.4980 trim_cache size 0 max 16384 2022-07-05T11:46:39.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.797+0000 7f1621ea9b80 1 Processor -- start 2022-07-05T11:46:39.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.797+0000 7f1621ea9b80 1 -- start start 2022-07-05T11:46:39.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a701fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 0x55d0a70a7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069840 0x55d0a7070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a709bb60 con 0x55d0a7069840 2022-07-05T11:46:39.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a7098ba0 con 0x55d0a7025d50 2022-07-05T11:46:39.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a7030960 con 0x55d0a7069460 2022-07-05T11:46:39.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069840 0x55d0a7070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069840 0x55d0a7070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57654/0 (socket says 172.21.15.90:57654) 2022-07-05T11:46:39.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 -- 172.21.15.90:0/774818429 learned_addr learned my addr 172.21.15.90:0/774818429 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:39.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160e2b9700 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a701fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 -- 172.21.15.90:0/774818429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 msgr2=0x55d0a70a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 0x55d0a70a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:39.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 -- 172.21.15.90:0/774818429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 msgr2=0x55d0a701fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a701fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.798+0000 7f160eaba700 1 -- 172.21.15.90:0/774818429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a6deaf80 con 0x55d0a7069840 2022-07-05T11:46:39.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f160eaba700 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069840 0x55d0a7070980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f1600084f50 tx=0x7f1600084e20).ready entity=mon.0 client_cookie=18b557e8f067ff59 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:39.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f15e7fff700 1 -- 172.21.15.90:0/774818429 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600057070 con 0x55d0a7069840 2022-07-05T11:46:39.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f15e7fff700 1 -- 172.21.15.90:0/774818429 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600083360 con 0x55d0a7069840 2022-07-05T11:46:39.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f15e7fff700 1 -- 172.21.15.90:0/774818429 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000addf0 con 0x55d0a7069840 2022-07-05T11:46:39.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 -- 172.21.15.90:0/774818429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069840 msgr2=0x55d0a7070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069840 0x55d0a7070980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f1600084f50 tx=0x7f1600084e20).stop 2022-07-05T11:46:39.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 -- 172.21.15.90:0/774818429 shutdown_connections 2022-07-05T11:46:39.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7069840 0x55d0a7070980 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7025d50 0x55d0a701fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/774818429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 0x55d0a70a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:39.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 -- 172.21.15.90:0/774818429 >> 172.21.15.90:0/774818429 conn(0x55d0a6e94170 msgr2=0x55d0a70961f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:39.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 -- 172.21.15.90:0/774818429 shutdown_connections 2022-07-05T11:46:39.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.799+0000 7f1621ea9b80 1 -- 172.21.15.90:0/774818429 wait complete. 2022-07-05T11:46:39.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.800+0000 7f1621ea9b80 1 -- start start 2022-07-05T11:46:39.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.800+0000 7f1621ea9b80 1 Processor -- start 2022-07-05T11:46:39.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7025d50 0x55d0a7023e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 0x55d0a7024330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f1621ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7069840 0x55d0a7024820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a7066df0 con 0x55d0a7025d50 2022-07-05T11:46:39.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a7095530 con 0x55d0a7069840 2022-07-05T11:46:39.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f1621ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a70a6df0 con 0x55d0a7069460 2022-07-05T11:46:39.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f1621ea9b80 10 client.0 ll_register_callbacks cb 0x55d0a6fe9330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:39.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f160e2b9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7025d50 0x55d0a7023e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f160e2b9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7025d50 0x55d0a7023e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57658/0 (socket says 172.21.15.90:57658) 2022-07-05T11:46:39.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f160e2b9700 1 -- 172.21.15.90:0/2380958006 learned_addr learned my addr 172.21.15.90:0/2380958006 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:39.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.801+0000 7f160dab8700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 0x55d0a7024330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160e2b9700 1 -- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 msgr2=0x55d0a7024330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160e2b9700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 0x55d0a7024330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160eaba700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7069840 0x55d0a7024820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160e2b9700 1 -- 172.21.15.90:0/2380958006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7069840 msgr2=0x55d0a7024820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:39.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160e2b9700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7069840 0x55d0a7024820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160e2b9700 1 -- 172.21.15.90:0/2380958006 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16080cb8a0 con 0x55d0a7025d50 2022-07-05T11:46:39.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160eaba700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7069840 0x55d0a7024820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:39.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f160e2b9700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7025d50 0x55d0a7023e40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f15f8013700 tx=0x7f15f8017000).ready entity=mon.0 client_cookie=9676839b239cc1af server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:39.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f15e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:39.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f15e4ff9700 1 -- 172.21.15.90:0/2380958006 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f802f030 con 0x55d0a7025d50 2022-07-05T11:46:39.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15f8017070 con 0x55d0a7025d50 2022-07-05T11:46:39.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f15e4ff9700 1 -- 172.21.15.90:0/2380958006 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f15f8030070 con 0x55d0a7025d50 2022-07-05T11:46:39.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f15e4ff9700 1 -- 172.21.15.90:0/2380958006 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f8024040 con 0x55d0a7025d50 2022-07-05T11:46:39.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 10 client.4986 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:39.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55d0a7070b40 con 0x55d0a7025d50 2022-07-05T11:46:39.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f15e4ff9700 1 -- 172.21.15.90:0/2380958006 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8017070 con 0x55d0a7025d50 2022-07-05T11:46:39.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f15e4ff9700 1 -- 172.21.15.90:0/2380958006 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f15f8013ac0 con 0x55d0a7025d50 2022-07-05T11:46:39.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 10 client.4986 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:39.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 10 client.4986 resolve_mds: resolved name 'l' to daemon mds.l 2022-07-05T11:46:39.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 20 client.4986 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:39.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a7069c20 0x55d0a7094f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:39.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 4 client.4986 mds_command: new command op to 4346 tid=0[{"prefix": "status"}] 2022-07-05T11:46:39.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.802+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 --> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d0a6f68640 con 0x55d0a7069c20 2022-07-05T11:46:39.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f160dab8700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a7069c20 0x55d0a7094f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:39.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f160dab8700 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a7069c20 0x55d0a7094f50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.2 client_cookie=860889911cdf4bf1 server_cookie=3c3831d8a9c134cc in_seq=0 out_seq=0 2022-07-05T11:46:39.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f15e4ff9700 10 client.4986 ms_handle_connect on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:39.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f15e4ff9700 1 -- 172.21.15.90:0/2380958006 <== mds.2 v2:172.21.15.149:6838/4158465025 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d0a6f68640 con 0x55d0a7069c20 2022-07-05T11:46:39.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f15e4ff9700 10 client.4986 handle_command_reply: tid=0 2022-07-05T11:46:39.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 client.4986 shutdown 2022-07-05T11:46:39.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7025d50 msgr2=0x55d0a7023e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7025d50 0x55d0a7023e40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f15f8013700 tx=0x7f15f8017000).stop 2022-07-05T11:46:39.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 shutdown_connections 2022-07-05T11:46:39.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0a7069840 0x55d0a7024820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d0a7025d50 0x55d0a7023e40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:6838/4158465025,v1:172.21.15.149:6839/4158465025] conn(0x55d0a7069c20 0x55d0a7094f50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 --2- 172.21.15.90:0/2380958006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d0a7069460 0x55d0a7024330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f15e4ff9700 0 client.4986 ms_handle_reset on v2:172.21.15.149:6838/4158465025 2022-07-05T11:46:39.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 >> 172.21.15.90:0/2380958006 conn(0x55d0a6e94170 msgr2=0x55d0a705d750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:39.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 shutdown_connections 2022-07-05T11:46:39.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.803+0000 7f1621ea9b80 1 -- 172.21.15.90:0/2380958006 wait complete. 2022-07-05T11:46:39.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f1621ea9b80 20 client.4986 trim_cache size 0 max 16384 2022-07-05T11:46:39.880 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:39.880 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:39.881 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 2, 2022-07-05T11:46:39.881 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4346, 2022-07-05T11:46:39.881 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:39.881 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:39.882 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:39.882 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 18.451934948000002, 2022-07-05T11:46:39.882 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2022-07-05T11:46:39.882 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:39.882 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 31, 2022-07-05T11:46:39.883 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 39.488399473000001 2022-07-05T11:46:39.883 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:39.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f15e808ba40 msgr2=0x7f15e808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f15e808ba40 0x7f15e808df00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f15f8003e80 tx=0x7f15f8009040).stop 2022-07-05T11:46:39.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 msgr2=0x7f160816d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:39.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f160816d610 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f160000b410 tx=0x7f1600006f50).stop 2022-07-05T11:46:39.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 shutdown_connections 2022-07-05T11:46:39.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f15e808ba40 0x7f15e808df00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f160817dd60 0x7f160816d610 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16080c4390 0x7f160818f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 --2- 172.21.15.90:0/2704715221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160817d980 0x7f16080cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:39.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 >> 172.21.15.90:0/2704715221 conn(0x7f16080f1420 msgr2=0x7f1608177bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:39.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 shutdown_connections 2022-07-05T11:46:39.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:39.804+0000 7f160f2bb700 1 -- 172.21.15.90:0/2704715221 wait complete. 2022-07-05T11:46:39.888 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-07-05T11:46:40.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.000+0000 7fae1095d700 1 Processor -- start 2022-07-05T11:46:40.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.000+0000 7fae1095d700 1 -- start start 2022-07-05T11:46:40.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae1095d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae0c17b750 0x7fae0c17bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae1095d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fae0c0edb60 0x7fae0c0edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae1095d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c083710 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae1095d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c0839f0 con 0x7fae0c0edb60 2022-07-05T11:46:40.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae1095d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c083cd0 con 0x7fae0c17b750 2022-07-05T11:46:40.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fae0c0edb60 0x7fae0c0edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fae0c0edb60 0x7fae0c0edfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57666/0 (socket says 172.21.15.90:57666) 2022-07-05T11:46:40.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 -- 172.21.15.90:0/1770571259 learned_addr learned my addr 172.21.15.90:0/1770571259 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/1770571259 >> v2:172.21.15.149:3300/0 conn(0x7fae0c17b750 0x7fae0c17bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 -- 172.21.15.90:0/1770571259 >> v2:172.21.15.149:3300/0 conn(0x7fae0c17b750 msgr2=0x7fae0c17bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 --2- 172.21.15.90:0/1770571259 >> v2:172.21.15.149:3300/0 conn(0x7fae0c17b750 0x7fae0c17bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 -- 172.21.15.90:0/1770571259 >> v1:172.21.15.110:6789/0 conn(0x7fae0c0ee4d0 legacy=0x7fae0c0847b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 -- 172.21.15.90:0/1770571259 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c083fb0 con 0x7fae0c0edb60 2022-07-05T11:46:40.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/1770571259 >> v2:172.21.15.149:3300/0 conn(0x7fae0c17b750 0x7fae0c17bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:40.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae0a59c700 1 --2- 172.21.15.90:0/1770571259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0edb60 0x7fae0c0edfe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fae0c0865c0 tx=0x7fae00009840).ready entity=mon.0 client_cookie=a3a9c9ef31730d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae09d9b700 1 -- 172.21.15.90:0/1770571259 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000e070 con 0x7fae0c0edb60 2022-07-05T11:46:40.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae09d9b700 1 -- 172.21.15.90:0/1770571259 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0000ba10 con 0x7fae0c0edb60 2022-07-05T11:46:40.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.001+0000 7fae09d9b700 1 -- 172.21.15.90:0/1770571259 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000bd90 con 0x7fae0c0edb60 2022-07-05T11:46:40.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 -- 172.21.15.90:0/1770571259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0edb60 msgr2=0x7fae0c0edfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 --2- 172.21.15.90:0/1770571259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0edb60 0x7fae0c0edfe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fae0c0865c0 tx=0x7fae00009840).stop 2022-07-05T11:46:40.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 -- 172.21.15.90:0/1770571259 shutdown_connections 2022-07-05T11:46:40.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 --2- 172.21.15.90:0/1770571259 >> v2:172.21.15.149:3300/0 conn(0x7fae0c17b750 0x7fae0c17bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 --2- 172.21.15.90:0/1770571259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0edb60 0x7fae0c0edfe0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 -- 172.21.15.90:0/1770571259 >> 172.21.15.90:0/1770571259 conn(0x7fae0c0f27c0 msgr2=0x7fae0c0f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 -- 172.21.15.90:0/1770571259 shutdown_connections 2022-07-05T11:46:40.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.002+0000 7fae1095d700 1 -- 172.21.15.90:0/1770571259 wait complete. 2022-07-05T11:46:40.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.003+0000 7fae1095d700 1 Processor -- start 2022-07-05T11:46:40.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.003+0000 7fae1095d700 1 -- start start 2022-07-05T11:46:40.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.004+0000 7fae1095d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae0c0edb60 0x7fae0c0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.004+0000 7fae1095d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0ee4d0 0x7fae0c16bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.004+0000 7fae1095d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0c17b750 0x7fae0c16c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.004+0000 7fae1095d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0ea210 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.004+0000 7fae1095d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0ea440 con 0x7fae0c17b750 2022-07-05T11:46:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.004+0000 7fae1095d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0ea720 con 0x7fae0c0edb60 2022-07-05T11:46:40.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0ee4d0 0x7fae0c16bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0ee4d0 0x7fae0c16bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57674/0 (socket says 172.21.15.90:57674) 2022-07-05T11:46:40.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 -- 172.21.15.90:0/771257291 learned_addr learned my addr 172.21.15.90:0/771257291 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae0c0edb60 0x7fae0c0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0b59e700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0c17b750 0x7fae0c16c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 -- 172.21.15.90:0/771257291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae0c0edb60 msgr2=0x7fae0c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae0c0edb60 0x7fae0c0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 -- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0c17b750 msgr2=0x7fae0c16c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0c17b750 0x7fae0c16c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 -- 172.21.15.90:0/771257291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009ae0 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0b59e700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0c17b750 0x7fae0c16c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae0a59c700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0ee4d0 0x7fae0c16bbe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fae00009540 tx=0x7fae00009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fadf2ffd700 1 -- 172.21.15.90:0/771257291 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00013ce0 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fadf2ffd700 1 -- 172.21.15.90:0/771257291 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00013e60 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c0eaa00 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fadf2ffd700 1 -- 172.21.15.90:0/771257291 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0001e6c0 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.005+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c0eafc0 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.008+0000 7fadf2ffd700 1 -- 172.21.15.90:0/771257291 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fae00025030 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.008+0000 7fadf2ffd700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fadec08ba40 0x7fadec08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.008+0000 7fadf2ffd700 1 -- 172.21.15.90:0/771257291 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fae000b1db0 con 0x7fae0c0ee4d0 2022-07-05T11:46:40.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.008+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fadec08ba40 0x7fadec08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.009+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fadec08ba40 0x7fadec08df00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fae0400abd0 tx=0x7fae04008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.009+0000 7fae22aeab80 1 Processor -- start 2022-07-05T11:46:40.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.009+0000 7fae22aeab80 1 -- start start 2022-07-05T11:46:40.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.010+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f62e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.010+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f67ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.010+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672840 0x557c3f672cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.010+0000 7fae22aeab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f5f8280 con 0x557c3f62ed50 2022-07-05T11:46:40.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.010+0000 7fae22aeab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f56fa50 con 0x557c3f672840 2022-07-05T11:46:40.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.010+0000 7fae22aeab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f584900 con 0x557c3f672460 2022-07-05T11:46:40.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f67ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f67ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57680/0 (socket says 172.21.15.90:57680) 2022-07-05T11:46:40.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 -- 172.21.15.90:0/828604554 learned_addr learned my addr 172.21.15.90:0/828604554 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f62e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0b59e700 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672840 0x557c3f672cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 -- 172.21.15.90:0/828604554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 msgr2=0x557c3f62e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f62e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 -- 172.21.15.90:0/828604554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672840 msgr2=0x557c3f672cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672840 0x557c3f672cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 -- 172.21.15.90:0/828604554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3f3b6990 con 0x557c3f62ed50 2022-07-05T11:46:40.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fae0a59c700 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f67ca30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fae00086610 tx=0x7fae00007190).ready entity=mon.0 client_cookie=cf9783cd0a4165af server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fade7fff700 1 -- 172.21.15.90:0/828604554 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0008c010 con 0x557c3f62ed50 2022-07-05T11:46:40.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fade7fff700 1 -- 172.21.15.90:0/828604554 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00084ad0 con 0x557c3f62ed50 2022-07-05T11:46:40.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.011+0000 7fade7fff700 1 -- 172.21.15.90:0/828604554 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00085c20 con 0x557c3f62ed50 2022-07-05T11:46:40.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 -- 172.21.15.90:0/828604554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 msgr2=0x557c3f67ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f67ca30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fae00086610 tx=0x7fae00007190).stop 2022-07-05T11:46:40.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 -- 172.21.15.90:0/828604554 shutdown_connections 2022-07-05T11:46:40.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672840 0x557c3f672cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f62e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 --2- 172.21.15.90:0/828604554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f67ca30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 -- 172.21.15.90:0/828604554 >> 172.21.15.90:0/828604554 conn(0x557c3f49d170 msgr2=0x557c3f631b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 -- 172.21.15.90:0/828604554 shutdown_connections 2022-07-05T11:46:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.012+0000 7fae22aeab80 1 -- 172.21.15.90:0/828604554 wait complete. 2022-07-05T11:46:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.013+0000 7fae22aeab80 1 -- start start 2022-07-05T11:46:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.013+0000 7fae22aeab80 1 Processor -- start 2022-07-05T11:46:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f6a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f6a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672840 0x557c3f62ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f54c0d0 con 0x557c3f62ed50 2022-07-05T11:46:40.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f6a2760 con 0x557c3f672460 2022-07-05T11:46:40.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f62d6c0 con 0x557c3f672840 2022-07-05T11:46:40.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 10 client.0 ll_register_callbacks cb 0x557c3f5f2330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:40.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f6a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f6a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57686/0 (socket says 172.21.15.90:57686) 2022-07-05T11:46:40.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 -- 172.21.15.90:0/996024132 learned_addr learned my addr 172.21.15.90:0/996024132 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0b59e700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672840 0x557c3f62ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0a59c700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f6a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 -- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672840 msgr2=0x557c3f62ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672840 0x557c3f62ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 -- 172.21.15.90:0/996024132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 msgr2=0x557c3f6a31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f6a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 -- 172.21.15.90:0/996024132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c0eafc0 con 0x557c3f62ed50 2022-07-05T11:46:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0b59e700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672840 0x557c3f62ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f6a4760 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fae040138a0 tx=0x7fae04015000).ready entity=mon.0 client_cookie=e4e7ca84c7a9289 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fade57fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fade57fa700 1 -- 172.21.15.90:0/996024132 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0401e620 con 0x557c3f62ed50 2022-07-05T11:46:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c3f62c640 con 0x557c3f62ed50 2022-07-05T11:46:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.014+0000 7fade57fa700 1 -- 172.21.15.90:0/996024132 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fae04018040 con 0x557c3f62ed50 2022-07-05T11:46:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fade57fa700 1 -- 172.21.15.90:0/996024132 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0401e990 con 0x557c3f62ed50 2022-07-05T11:46:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 10 client.4998 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x557c3f425c80 con 0x557c3f62ed50 2022-07-05T11:46:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fade57fa700 1 -- 172.21.15.90:0/996024132 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c3f62c640 con 0x557c3f62ed50 2022-07-05T11:46:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fade57fa700 1 -- 172.21.15.90:0/996024132 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fae0401eaf0 con 0x557c3f62ed50 2022-07-05T11:46:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 10 client.4998 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 10 client.4998 resolve_mds: resolved name 'c' to daemon mds.c 2022-07-05T11:46:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 20 client.4998 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6b0c70 0x557c3f6bd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 4 client.4998 mds_command: new command op to 4362 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 --> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c3f57a7a0 con 0x557c3f6b0c70 2022-07-05T11:46:40.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae0a59c700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6b0c70 0x557c3f6bd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fade57fa700 10 client.4998 ms_handle_connect on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:40.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.015+0000 7fae0a59c700 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6b0c70 0x557c3f6bd1d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.1 client_cookie=dbf95acbaf8e1519 server_cookie=b870797e5eb1a472 in_seq=0 out_seq=0 2022-07-05T11:46:40.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fade57fa700 1 -- 172.21.15.90:0/996024132 <== mds.1 v2:172.21.15.149:6832/4013403095 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x557c3f57a7a0 con 0x557c3f6b0c70 2022-07-05T11:46:40.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fade57fa700 10 client.4998 handle_command_reply: tid=0 2022-07-05T11:46:40.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 client.4998 shutdown 2022-07-05T11:46:40.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 msgr2=0x557c3f6a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f6a4760 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fae040138a0 tx=0x7fae04015000).stop 2022-07-05T11:46:40.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 shutdown_connections 2022-07-05T11:46:40.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672840 0x557c3f62ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f62ed50 0x557c3f6a4760 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6b0c70 0x557c3f6bd1d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 --2- 172.21.15.90:0/996024132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f6a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fade57fa700 0 client.4998 ms_handle_reset on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:40.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 >> 172.21.15.90:0/996024132 conn(0x557c3f49d170 msgr2=0x557c3f69f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 shutdown_connections 2022-07-05T11:46:40.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.016+0000 7fae22aeab80 1 -- 172.21.15.90:0/996024132 wait complete. 2022-07-05T11:46:40.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.017+0000 7fae22aeab80 20 client.4998 trim_cache size 0 max 16384 2022-07-05T11:46:40.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.033+0000 7fae22aeab80 1 Processor -- start 2022-07-05T11:46:40.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.033+0000 7fae22aeab80 1 -- start start 2022-07-05T11:46:40.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f62ed50 0x557c3f6a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f631ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae22aeab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f6a2620 con 0x557c3f672840 2022-07-05T11:46:40.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae22aeab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f69f9f0 con 0x557c3f62ed50 2022-07-05T11:46:40.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae22aeab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f632c50 con 0x557c3f672460 2022-07-05T11:46:40.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57698/0 (socket says 172.21.15.90:57698) 2022-07-05T11:46:40.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 -- 172.21.15.90:0/3474274399 learned_addr learned my addr 172.21.15.90:0/3474274399 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0a59c700 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f631ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f62ed50 0x557c3f6a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 -- 172.21.15.90:0/3474274399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 msgr2=0x557c3f631ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f631ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 -- 172.21.15.90:0/3474274399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f62ed50 msgr2=0x557c3f6a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f62ed50 0x557c3f6a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 -- 172.21.15.90:0/3474274399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3f3f3f80 con 0x557c3f672840 2022-07-05T11:46:40.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f62ed50 0x557c3f6a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:40.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fae0b59e700 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6c11f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fadfc0103d0 tx=0x7fadfc009040).ready entity=mon.0 client_cookie=b1ce6d4107969b5d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fadf0bd3700 1 -- 172.21.15.90:0/3474274399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc010de0 con 0x557c3f672840 2022-07-05T11:46:40.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fadf0bd3700 1 -- 172.21.15.90:0/3474274399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc00d070 con 0x557c3f672840 2022-07-05T11:46:40.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.034+0000 7fadf0bd3700 1 -- 172.21.15.90:0/3474274399 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc014650 con 0x557c3f672840 2022-07-05T11:46:40.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 -- 172.21.15.90:0/3474274399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 msgr2=0x557c3f6c11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6c11f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fadfc0103d0 tx=0x7fadfc009040).stop 2022-07-05T11:46:40.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 -- 172.21.15.90:0/3474274399 shutdown_connections 2022-07-05T11:46:40.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6c11f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f62ed50 0x557c3f6a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3474274399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f672460 0x557c3f631ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 -- 172.21.15.90:0/3474274399 >> 172.21.15.90:0/3474274399 conn(0x557c3f49d170 msgr2=0x557c3f6a5410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 -- 172.21.15.90:0/3474274399 shutdown_connections 2022-07-05T11:46:40.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 -- 172.21.15.90:0/3474274399 wait complete. 2022-07-05T11:46:40.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.035+0000 7fae22aeab80 1 -- start start 2022-07-05T11:46:40.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.036+0000 7fae22aeab80 1 Processor -- start 2022-07-05T11:46:40.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f62ed50 0x557c3f6640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f706ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f62d160 con 0x557c3f672840 2022-07-05T11:46:40.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f66ad00 con 0x557c3f672460 2022-07-05T11:46:40.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3f6a3cf0 con 0x557c3f62ed50 2022-07-05T11:46:40.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 10 client.0 ll_register_callbacks cb 0x557c3f5f2330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:40.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57704/0 (socket says 172.21.15.90:57704) 2022-07-05T11:46:40.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 -- 172.21.15.90:0/3383459223 learned_addr learned my addr 172.21.15.90:0/3383459223 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0a59c700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f706ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f62ed50 0x557c3f6640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 -- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f62ed50 msgr2=0x557c3f6640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f62ed50 0x557c3f6640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 -- 172.21.15.90:0/3383459223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 msgr2=0x557c3f706ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f706ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 -- 172.21.15.90:0/3383459223 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc00f040 con 0x557c3f672840 2022-07-05T11:46:40.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f62ed50 0x557c3f6640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:40.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae0b59e700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6afcb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fadfc007960 tx=0x7fadfc009040).ready entity=mon.0 client_cookie=5215b20f5464c1c7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fade57fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:40.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fade57fa700 1 -- 172.21.15.90:0/3383459223 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc014e60 con 0x557c3f672840 2022-07-05T11:46:40.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae00084ad0 con 0x557c3f672840 2022-07-05T11:46:40.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fade57fa700 1 -- 172.21.15.90:0/3383459223 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fadfc007030 con 0x557c3f672840 2022-07-05T11:46:40.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fade57fa700 1 -- 172.21.15.90:0/3383459223 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadfc007bf0 con 0x557c3f672840 2022-07-05T11:46:40.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 10 client.5004 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:40.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.037+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x557c3f6a4010 con 0x557c3f672840 2022-07-05T11:46:40.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fade57fa700 1 -- 172.21.15.90:0/3383459223 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00084ad0 con 0x557c3f672840 2022-07-05T11:46:40.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fade57fa700 1 -- 172.21.15.90:0/3383459223 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fadfc007400 con 0x557c3f672840 2022-07-05T11:46:40.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fae22aeab80 10 client.5004 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:40.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fae22aeab80 10 client.5004 resolve_mds: resolved name 'c' to daemon mds.c 2022-07-05T11:46:40.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fae22aeab80 20 client.5004 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:40.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6792e0 0x557c3f6796c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fae22aeab80 4 client.5004 mds_command: new command op to 4362 tid=0[{"prefix": "status"}] 2022-07-05T11:46:40.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 --> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557c3f571640 con 0x557c3f6792e0 2022-07-05T11:46:40.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.038+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6792e0 0x557c3f6796c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fade57fa700 10 client.5004 ms_handle_connect on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae0ad9d700 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6792e0 0x557c3f6796c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.1 client_cookie=23e79c46e5ebe801 server_cookie=c0a13298ab7fffa9 in_seq=0 out_seq=0 2022-07-05T11:46:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fade57fa700 1 -- 172.21.15.90:0/3383459223 <== mds.1 v2:172.21.15.149:6832/4013403095 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557c3f571640 con 0x557c3f6792e0 2022-07-05T11:46:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fade57fa700 10 client.5004 handle_command_reply: tid=0 2022-07-05T11:46:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 client.5004 shutdown 2022-07-05T11:46:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 msgr2=0x557c3f6afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6afcb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fadfc007960 tx=0x7fadfc009040).stop 2022-07-05T11:46:40.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 shutdown_connections 2022-07-05T11:46:40.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c3f672840 0x557c3f6afcb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557c3f62ed50 0x557c3f6640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.149:6832/4013403095,v1:172.21.15.149:6833/4013403095] conn(0x557c3f6792e0 0x557c3f6796c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 --2- 172.21.15.90:0/3383459223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c3f672460 0x557c3f706ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fade57fa700 0 client.5004 ms_handle_reset on v2:172.21.15.149:6832/4013403095 2022-07-05T11:46:40.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 >> 172.21.15.90:0/3383459223 conn(0x557c3f49d170 msgr2=0x557c3f67a020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 shutdown_connections 2022-07-05T11:46:40.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 1 -- 172.21.15.90:0/3383459223 wait complete. 2022-07-05T11:46:40.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.039+0000 7fae22aeab80 20 client.5004 trim_cache size 0 max 16384 2022-07-05T11:46:40.091 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:40.091 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:40.091 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 1, 2022-07-05T11:46:40.091 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4362, 2022-07-05T11:46:40.092 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:40.092 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:40.092 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:40.092 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 19.694851879000002, 2022-07-05T11:46:40.092 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2022-07-05T11:46:40.093 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:40.093 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 31, 2022-07-05T11:46:40.093 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 39.732557282000002 2022-07-05T11:46:40.094 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fadec08ba40 msgr2=0x7fadec08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fadec08ba40 0x7fadec08df00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fae0400abd0 tx=0x7fae04008040).stop 2022-07-05T11:46:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0ee4d0 msgr2=0x7fae0c16bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0ee4d0 0x7fae0c16bbe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fae00009540 tx=0x7fae00009840).stop 2022-07-05T11:46:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 shutdown_connections 2022-07-05T11:46:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fadec08ba40 0x7fadec08df00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0c17b750 0x7fae0c16c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae0c0edb60 0x7fae0c0caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 --2- 172.21.15.90:0/771257291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae0c0ee4d0 0x7fae0c16bbe0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 >> 172.21.15.90:0/771257291 conn(0x7fae0c0f27c0 msgr2=0x7fae0c175ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 shutdown_connections 2022-07-05T11:46:40.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.040+0000 7fae1095d700 1 -- 172.21.15.90:0/771257291 wait complete. 2022-07-05T11:46:40.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-07-05T11:46:40.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.211+0000 7f6cedbe1700 1 Processor -- start 2022-07-05T11:46:40.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.211+0000 7f6cedbe1700 1 -- start start 2022-07-05T11:46:40.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.212+0000 7f6cedbe1700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ce80cacd0 0x7f6ce8064b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.212+0000 7f6cedbe1700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80f0410 con 0x7f6ce817d860 2022-07-05T11:46:40.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.212+0000 7f6cedbe1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce8065020 con 0x7f6ce80cc670 2022-07-05T11:46:40.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.212+0000 7f6cedbe1700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80cb2f0 con 0x7f6ce80cacd0 2022-07-05T11:46:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.212+0000 7f6ce77fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6ce817d860 0x7f6ce817dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50648/0 (socket says 172.21.15.90:50648) 2022-07-05T11:46:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.212+0000 7f6ce77fe700 1 -- 172.21.15.90:0/1900280628 learned_addr learned my addr 172.21.15.90:0/1900280628 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/1900280628 >> v2:172.21.15.110:3300/0 conn(0x7f6ce80cacd0 0x7f6ce8064b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce67fc700 1 -- 172.21.15.90:0/1900280628 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562442571 0 0) 0x7f6ce80f0410 con 0x7f6ce817d860 2022-07-05T11:46:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce67fc700 1 -- 172.21.15.90:0/1900280628 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd40033f0 con 0x7f6ce817d860 2022-07-05T11:46:40.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/1900280628 >> v1:172.21.15.149:6789/0 conn(0x7f6ce80cc670 legacy=0x7f6ce80ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/1900280628 >> v1:172.21.15.90:6789/0 conn(0x7f6ce817d860 legacy=0x7f6ce817dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/1900280628 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80cb5d0 con 0x7f6ce80cacd0 2022-07-05T11:46:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/1900280628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 0x7f6ce8064b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6cdc009760 tx=0x7f6cdc009060).ready entity=mon.1 client_cookie=e4e5e7284fc2067d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce67fc700 1 -- 172.21.15.90:0/1900280628 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00f510 con 0x7f6ce80cacd0 2022-07-05T11:46:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce67fc700 1 -- 172.21.15.90:0/1900280628 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc00f670 con 0x7f6ce80cacd0 2022-07-05T11:46:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.213+0000 7f6ce67fc700 1 -- 172.21.15.90:0/1900280628 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00f9f0 con 0x7f6ce80cacd0 2022-07-05T11:46:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.214+0000 7f6cedbe1700 1 -- 172.21.15.90:0/1900280628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 msgr2=0x7f6ce8064b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.214+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/1900280628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 0x7f6ce8064b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6cdc009760 tx=0x7f6cdc009060).stop 2022-07-05T11:46:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.214+0000 7f6cedbe1700 1 -- 172.21.15.90:0/1900280628 shutdown_connections 2022-07-05T11:46:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.214+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/1900280628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 0x7f6ce8064b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.214+0000 7f6cedbe1700 1 -- 172.21.15.90:0/1900280628 >> 172.21.15.90:0/1900280628 conn(0x7f6ce80f4ab0 msgr2=0x7f6ce80f4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.214+0000 7f6cedbe1700 1 -- 172.21.15.90:0/1900280628 shutdown_connections 2022-07-05T11:46:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.214+0000 7f6cedbe1700 1 -- 172.21.15.90:0/1900280628 wait complete. 2022-07-05T11:46:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.215+0000 7f6cedbe1700 1 Processor -- start 2022-07-05T11:46:40.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.215+0000 7f6cedbe1700 1 -- start start 2022-07-05T11:46:40.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6cedbe1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 0x7f6ce816b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6cedbe1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce80cc670 0x7f6ce8170f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6cedbe1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce817d860 0x7f6ce81789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6cedbe1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce816b520 con 0x7f6ce817d860 2022-07-05T11:46:40.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6cedbe1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8178550 con 0x7f6ce80cacd0 2022-07-05T11:46:40.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6cedbe1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8177f70 con 0x7f6ce80cc670 2022-07-05T11:46:40.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6ce7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce817d860 0x7f6ce81789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6ce7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce817d860 0x7f6ce81789e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57718/0 (socket says 172.21.15.90:57718) 2022-07-05T11:46:40.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6ce7fff700 1 -- 172.21.15.90:0/3441225665 learned_addr learned my addr 172.21.15.90:0/3441225665 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.216+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 0x7f6ce816b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce80cc670 0x7f6ce8170f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce7fff700 1 -- 172.21.15.90:0/3441225665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce80cc670 msgr2=0x7f6ce8170f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce80cc670 0x7f6ce8170f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce7fff700 1 -- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 msgr2=0x7f6ce816b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 0x7f6ce816b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce7fff700 1 -- 172.21.15.90:0/3441225665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0092a0 con 0x7f6ce817d860 2022-07-05T11:46:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce80cc670 0x7f6ce8170f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce817d860 0x7f6ce81789e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f6ce000c470 tx=0x7f6ce0007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ccf7fe700 1 -- 172.21.15.90:0/3441225665 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000ce30 con 0x7f6ce817d860 2022-07-05T11:46:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ccf7fe700 1 -- 172.21.15.90:0/3441225665 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce000f470 con 0x7f6ce817d860 2022-07-05T11:46:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6ccf7fe700 1 -- 172.21.15.90:0/3441225665 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000f810 con 0x7f6ce817d860 2022-07-05T11:46:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce81713f0 con 0x7f6ce817d860 2022-07-05T11:46:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.217+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce817ccc0 con 0x7f6ce817d860 2022-07-05T11:46:40.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.219+0000 7f6ccf7fe700 1 -- 172.21.15.90:0/3441225665 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6ce0010070 con 0x7f6ce817d860 2022-07-05T11:46:40.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.219+0000 7f6ccf7fe700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cc808ba40 0x7f6cc808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.219+0000 7f6ccf7fe700 1 -- 172.21.15.90:0/3441225665 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6ce00afbd0 con 0x7f6ce817d860 2022-07-05T11:46:40.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.219+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cc808ba40 0x7f6cc808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.220+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cc808ba40 0x7f6cc808df00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6ce8064c00 tx=0x7f6cd8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.221+0000 7f6cff56db80 1 Processor -- start 2022-07-05T11:46:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.221+0000 7f6cff56db80 1 -- start start 2022-07-05T11:46:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe19770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe67940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe5dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6cff56db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fde3280 con 0x56427fe5d750 2022-07-05T11:46:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6cff56db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fd5aa50 con 0x56427fe19c60 2022-07-05T11:46:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6cff56db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fd6f900 con 0x56427fe5d370 2022-07-05T11:46:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe5dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe5dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57724/0 (socket says 172.21.15.90:57724) 2022-07-05T11:46:40.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 -- 172.21.15.90:0/1661302775 learned_addr learned my addr 172.21.15.90:0/1661302775 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe67940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe19770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 -- 172.21.15.90:0/1661302775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 msgr2=0x56427fe19770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe19770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 -- 172.21.15.90:0/1661302775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 msgr2=0x56427fe67940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe67940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 -- 172.21.15.90:0/1661302775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56427fba1990 con 0x56427fe5d750 2022-07-05T11:46:40.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe5dbd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6ce0084010 tx=0x7f6ce00809c0).ready entity=mon.0 client_cookie=995e31088853eed1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.222+0000 7f6cccff9700 1 -- 172.21.15.90:0/1661302775 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00845d0 con 0x56427fe5d750 2022-07-05T11:46:40.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cccff9700 1 -- 172.21.15.90:0/1661302775 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0084320 con 0x56427fe5d750 2022-07-05T11:46:40.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cccff9700 1 -- 172.21.15.90:0/1661302775 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0089e30 con 0x56427fe5d750 2022-07-05T11:46:40.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 -- 172.21.15.90:0/1661302775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 msgr2=0x56427fe5dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe5dbd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6ce0084010 tx=0x7f6ce00809c0).stop 2022-07-05T11:46:40.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 -- 172.21.15.90:0/1661302775 shutdown_connections 2022-07-05T11:46:40.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe5dbd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe19770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 --2- 172.21.15.90:0/1661302775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe67940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 -- 172.21.15.90:0/1661302775 >> 172.21.15.90:0/1661302775 conn(0x56427fc88170 msgr2=0x56427fe1ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 -- 172.21.15.90:0/1661302775 shutdown_connections 2022-07-05T11:46:40.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.223+0000 7f6cff56db80 1 -- 172.21.15.90:0/1661302775 wait complete. 2022-07-05T11:46:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.224+0000 7f6cff56db80 1 -- start start 2022-07-05T11:46:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.224+0000 7f6cff56db80 1 Processor -- start 2022-07-05T11:46:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe9c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe9e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe1d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6cff56db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fd370d0 con 0x56427fe5d750 2022-07-05T11:46:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6cff56db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fe9e810 con 0x56427fe19c60 2022-07-05T11:46:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6cff56db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fe576c0 con 0x56427fe5d370 2022-07-05T11:46:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6cff56db80 10 client.0 ll_register_callbacks cb 0x56427fddd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe1d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe1d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57728/0 (socket says 172.21.15.90:57728) 2022-07-05T11:46:40.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 -- 172.21.15.90:0/2642935437 learned_addr learned my addr 172.21.15.90:0/2642935437 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe9e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe9c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 -- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 msgr2=0x56427fe9e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe9e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 -- 172.21.15.90:0/2642935437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 msgr2=0x56427fe9c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe9c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.225+0000 7f6ce7fff700 1 -- 172.21.15.90:0/2642935437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce817ccc0 con 0x56427fe5d750 2022-07-05T11:46:40.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe1d7e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6ce00844e0 tx=0x7f6ce0014000).ready entity=mon.0 client_cookie=9f375aa45964cfe9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:40.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2642935437 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00829c0 con 0x56427fe5d750 2022-07-05T11:46:40.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2642935437 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6ce0083c50 con 0x56427fe5d750 2022-07-05T11:46:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56427fe173f0 con 0x56427fe5d750 2022-07-05T11:46:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2642935437 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ce0089bb0 con 0x56427fe5d750 2022-07-05T11:46:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 10 client.5016 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56427fc10c80 con 0x56427fe5d750 2022-07-05T11:46:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2642935437 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56427fe173f0 con 0x56427fe5d750 2022-07-05T11:46:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2642935437 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f6ce000fbc0 con 0x56427fe5d750 2022-07-05T11:46:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 10 client.5016 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 10 client.5016 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 20 client.5016 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:40.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe9bb50 0x56427fe671a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 4 client.5016 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:40.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56427fd657a0 con 0x56427fe9bb50 2022-07-05T11:46:40.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.226+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe9bb50 0x56427fe671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.227+0000 7f6cc1ffb700 10 client.5016 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.227+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe9bb50 0x56427fe671a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3bb6a975bb851ea9 server_cookie=ddd729683a65e5c0 in_seq=0 out_seq=0 2022-07-05T11:46:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.227+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2642935437 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x56427fd657a0 con 0x56427fe9bb50 2022-07-05T11:46:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.227+0000 7f6cc1ffb700 10 client.5016 handle_command_reply: tid=0 2022-07-05T11:46:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.227+0000 7f6cff56db80 1 client.5016 shutdown 2022-07-05T11:46:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.227+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 msgr2=0x56427fe1d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.227+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe1d7e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6ce00844e0 tx=0x7f6ce0014000).stop 2022-07-05T11:46:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 shutdown_connections 2022-07-05T11:46:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe9bb50 0x56427fe671a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d750 0x56427fe1d7e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe9c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cc1ffb700 0 client.5016 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2642935437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d370 0x56427fe9e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 >> 172.21.15.90:0/2642935437 conn(0x56427fc88170 msgr2=0x56427fe1c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 shutdown_connections 2022-07-05T11:46:40.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 1 -- 172.21.15.90:0/2642935437 wait complete. 2022-07-05T11:46:40.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.228+0000 7f6cff56db80 20 client.5016 trim_cache size 0 max 16384 2022-07-05T11:46:40.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.244+0000 7f6cff56db80 1 Processor -- start 2022-07-05T11:46:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.244+0000 7f6cff56db80 1 -- start start 2022-07-05T11:46:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe570e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe1a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 0x56427fe64290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6cff56db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fe518f0 con 0x56427fe5d370 2022-07-05T11:46:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6cff56db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fe5e530 con 0x56427fe19c60 2022-07-05T11:46:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6cff56db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fe9af60 con 0x56427fe5d750 2022-07-05T11:46:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe1a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe1a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57736/0 (socket says 172.21.15.90:57736) 2022-07-05T11:46:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2417677232 learned_addr learned my addr 172.21.15.90:0/2417677232 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2417677232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 msgr2=0x56427fe64290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 0x56427fe64290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2417677232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 msgr2=0x56427fe570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2417677232 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56427fbdef80 con 0x56427fe5d370 2022-07-05T11:46:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.245+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe1a040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f6cdc009e00 tx=0x7f6cdc017000).ready entity=mon.0 client_cookie=b24ab3afc38dc4f3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6ccd7fa700 1 -- 172.21.15.90:0/2417677232 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc021070 con 0x56427fe5d370 2022-07-05T11:46:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6ccd7fa700 1 -- 172.21.15.90:0/2417677232 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc000bc0 con 0x56427fe5d370 2022-07-05T11:46:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6ccd7fa700 1 -- 172.21.15.90:0/2417677232 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00f9f0 con 0x56427fe5d370 2022-07-05T11:46:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 -- 172.21.15.90:0/2417677232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 msgr2=0x56427fe1a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe1a040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f6cdc009e00 tx=0x7f6cdc017000).stop 2022-07-05T11:46:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 -- 172.21.15.90:0/2417677232 shutdown_connections 2022-07-05T11:46:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 0x56427fe64290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2417677232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe1a040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 -- 172.21.15.90:0/2417677232 >> 172.21.15.90:0/2417677232 conn(0x56427fc88170 msgr2=0x56427fe9bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 -- 172.21.15.90:0/2417677232 shutdown_connections 2022-07-05T11:46:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.246+0000 7f6cff56db80 1 -- 172.21.15.90:0/2417677232 wait complete. 2022-07-05T11:46:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.247+0000 7f6cff56db80 1 -- start start 2022-07-05T11:46:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.247+0000 7f6cff56db80 1 Processor -- start 2022-07-05T11:46:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe1abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe5b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 0x56427fef4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fe53bf0 con 0x56427fe5d370 2022-07-05T11:46:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fef54c0 con 0x56427fe19c60 2022-07-05T11:46:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56427fe5f320 con 0x56427fe5d750 2022-07-05T11:46:40.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 10 client.0 ll_register_callbacks cb 0x56427fddd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:40.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe5b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe5b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57740/0 (socket says 172.21.15.90:57740) 2022-07-05T11:46:40.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2728338433 learned_addr learned my addr 172.21.15.90:0/2728338433 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe1abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce7fff700 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 0x56427fef4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 msgr2=0x56427fef4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 0x56427fef4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2728338433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 msgr2=0x56427fe1abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe1abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 -- 172.21.15.90:0/2728338433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80cb5d0 con 0x56427fe5d370 2022-07-05T11:46:40.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6ce6ffd700 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe5b820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f6cdc01d000 tx=0x7f6cdc021000).ready entity=mon.0 client_cookie=34a5902c70a32baa server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2728338433 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc006cd0 con 0x56427fe5d370 2022-07-05T11:46:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2728338433 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6cdc01b620 con 0x56427fe5d370 2022-07-05T11:46:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.248+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56427fe9ee80 con 0x56427fe5d370 2022-07-05T11:46:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2728338433 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cdc01ba30 con 0x56427fe5d370 2022-07-05T11:46:40.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 10 client.5022 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:40.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56427fe1d790 con 0x56427fe5d370 2022-07-05T11:46:40.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2728338433 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56427fe9ee80 con 0x56427fe5d370 2022-07-05T11:46:40.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2728338433 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f6cdc009790 con 0x56427fe5d370 2022-07-05T11:46:40.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 10 client.5022 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:40.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 10 client.5022 resolve_mds: resolved name 'f' to daemon mds.f 2022-07-05T11:46:40.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 20 client.5022 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:40.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe67a20 0x56427fefb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 4 client.5022 mds_command: new command op to 4371 tid=0[{"prefix": "status"}] 2022-07-05T11:46:40.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f6ce0084320 con 0x56427fe67a20 2022-07-05T11:46:40.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe67a20 0x56427fefb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6cc1ffb700 10 client.5022 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:40.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.249+0000 7f6ce77fe700 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe67a20 0x56427fefb900 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a8705fce3184d583 server_cookie=f01de40c3459d7e7 in_seq=0 out_seq=0 2022-07-05T11:46:40.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cc1ffb700 1 -- 172.21.15.90:0/2728338433 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f6ce0084320 con 0x56427fe67a20 2022-07-05T11:46:40.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cc1ffb700 10 client.5022 handle_command_reply: tid=0 2022-07-05T11:46:40.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 client.5022 shutdown 2022-07-05T11:46:40.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 msgr2=0x56427fe5b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe5b820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f6cdc01d000 tx=0x7f6cdc021000).stop 2022-07-05T11:46:40.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 shutdown_connections 2022-07-05T11:46:40.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56427fe67a20 0x56427fefb900 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56427fe5d750 0x56427fef4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cc1ffb700 0 client.5022 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:40.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56427fe19c60 0x56427fe1abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 --2- 172.21.15.90:0/2728338433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56427fe5d370 0x56427fe5b820 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 >> 172.21.15.90:0/2728338433 conn(0x56427fc88170 msgr2=0x56427fe65ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 shutdown_connections 2022-07-05T11:46:40.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 1 -- 172.21.15.90:0/2728338433 wait complete. 2022-07-05T11:46:40.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cff56db80 20 client.5022 trim_cache size 0 max 16384 2022-07-05T11:46:40.292 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:40.293 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "fc926128-a7e6-49db-b76e-e89bbf4193cc", 2022-07-05T11:46:40.293 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2022-07-05T11:46:40.293 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4371, 2022-07-05T11:46:40.293 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2022-07-05T11:46:40.293 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2022-07-05T11:46:40.294 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2022-07-05T11:46:40.294 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 35.673831446000001, 2022-07-05T11:46:40.294 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2022-07-05T11:46:40.294 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2022-07-05T11:46:40.295 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 31, 2022-07-05T11:46:40.295 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 39.938568941 2022-07-05T11:46:40.295 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:40.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cc808ba40 msgr2=0x7f6cc808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cc808ba40 0x7f6cc808df00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6ce8064c00 tx=0x7f6cd8009040).stop 2022-07-05T11:46:40.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce817d860 msgr2=0x7f6ce81789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce817d860 0x7f6ce81789e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f6ce000c470 tx=0x7f6ce0007dd0).stop 2022-07-05T11:46:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 shutdown_connections 2022-07-05T11:46:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6cc808ba40 0x7f6cc808df00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce817d860 0x7f6ce81789e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce80cacd0 0x7f6ce816b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 --2- 172.21.15.90:0/3441225665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce80cc670 0x7f6ce8170f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 >> 172.21.15.90:0/3441225665 conn(0x7f6ce80f4ab0 msgr2=0x7f6ce80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.250+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 shutdown_connections 2022-07-05T11:46:40.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.251+0000 7f6cedbe1700 1 -- 172.21.15.90:0/3441225665 wait complete. 2022-07-05T11:46:40.300 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2022-07-05T11:46:40.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:40.301 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p /home/ubuntu/cephtest/mnt.0 2022-07-05T11:46:40.316 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-07-05T11:46:40.317 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes,nowsync 2022-07-05T11:46:40.394 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes,nowsync 2022-07-05T11:46:40.395 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes,nowsync" will pass to kernel. 2022-07-05T11:46:40.521 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes,nowsync 2022-07-05T11:46:40.522 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes,nowsync" will pass to kernel. 2022-07-05T11:46:40.525 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-07-05T11:46:40.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-07-05T11:46:40.526 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-07-05T11:46:40.590 INFO:teuthology.run_tasks:Running task fwd_scrub... 2022-07-05T11:46:40.603 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:40.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.741+0000 7fefea2c1700 1 Processor -- start 2022-07-05T11:46:40.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.741+0000 7fefea2c1700 1 -- start start 2022-07-05T11:46:40.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefea2c1700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fefe417da60 0x7fefe417de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefea2c1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fefe40c9520 0x7fefe40c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefea2c1700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40c9090 con 0x7fefe40c7d00 2022-07-05T11:46:40.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefea2c1700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40c81a0 con 0x7fefe417da60 2022-07-05T11:46:40.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefea2c1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40c8480 con 0x7fefe40c9520 2022-07-05T11:46:40.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe37fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fefe40c7d00 0x7fefe417eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50696/0 (socket says 172.21.15.90:50696) 2022-07-05T11:46:40.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe37fe700 1 -- 172.21.15.90:0/1409824380 learned_addr learned my addr 172.21.15.90:0/1409824380 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:40.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe3fff700 1 --2- 172.21.15.90:0/1409824380 >> v2:172.21.15.110:3300/0 conn(0x7fefe417da60 0x7fefe417de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750725283 0 0) 0x7fefe40c9090 con 0x7fefe40c7d00 2022-07-05T11:46:40.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe885e700 1 --2- 172.21.15.90:0/1409824380 >> v2:172.21.15.149:3300/0 conn(0x7fefe40c9520 0x7fefe40c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd00033f0 con 0x7fefe40c7d00 2022-07-05T11:46:40.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795978053 0 0) 0x7fefd00033f0 con 0x7fefe40c7d00 2022-07-05T11:46:40.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 >> v2:172.21.15.149:3300/0 conn(0x7fefe40c9520 msgr2=0x7fefe40c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 --2- 172.21.15.90:0/1409824380 >> v2:172.21.15.149:3300/0 conn(0x7fefe40c9520 0x7fefe40c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 >> v2:172.21.15.110:3300/0 conn(0x7fefe417da60 msgr2=0x7fefe417de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 --2- 172.21.15.90:0/1409824380 >> v2:172.21.15.110:3300/0 conn(0x7fefe417da60 0x7fefe417de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40c8760 con 0x7fefe40c7d00 2022-07-05T11:46:40.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fefd8001470 con 0x7fefe40c7d00 2022-07-05T11:46:40.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.742+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 >> v1:172.21.15.90:6789/0 conn(0x7fefe40c7d00 legacy=0x7fefe417eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd0003930 0x7fefd0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefd0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd0005000 0x7fefd000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c81a0 con 0x7fefd0004690 2022-07-05T11:46:40.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c8480 con 0x7fefd0005000 2022-07-05T11:46:40.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd000bdd0 con 0x7fefd0003930 2022-07-05T11:46:40.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe37fe700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefd0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe3fff700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd0003930 0x7fefd0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe885e700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd0005000 0x7fefd000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe37fe700 1 -- 172.21.15.90:0/1409824380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd0003930 msgr2=0x7fefd0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe37fe700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd0003930 0x7fefd0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe37fe700 1 -- 172.21.15.90:0/1409824380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd0005000 msgr2=0x7fefd000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:40.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe37fe700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefd0005000 0x7fefd000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe885e700 1 -- 172.21.15.90:0/1409824380 reap_dead start 2022-07-05T11:46:40.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe37fe700 1 -- 172.21.15.90:0/1409824380 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00033f0 con 0x7fefd0004690 2022-07-05T11:46:40.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe37fe700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefd0004b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fefd800c1e0 tx=0x7fefd8001e90).ready entity=mon.0 client_cookie=f391ebe213e6e30 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8007a60 con 0x7fefd0004690 2022-07-05T11:46:40.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800ca60 con 0x7fefd0004690 2022-07-05T11:46:40.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.743+0000 7fefe2ffd700 1 -- 172.21.15.90:0/1409824380 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800cde0 con 0x7fefd0004690 2022-07-05T11:46:40.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.744+0000 7fefea2c1700 1 -- 172.21.15.90:0/1409824380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 msgr2=0x7fefd0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.744+0000 7fefea2c1700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefd0004b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fefd800c1e0 tx=0x7fefd8001e90).stop 2022-07-05T11:46:40.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.744+0000 7fefea2c1700 1 -- 172.21.15.90:0/1409824380 shutdown_connections 2022-07-05T11:46:40.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.744+0000 7fefea2c1700 1 --2- 172.21.15.90:0/1409824380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefd0004b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.744+0000 7fefea2c1700 1 -- 172.21.15.90:0/1409824380 >> 172.21.15.90:0/1409824380 conn(0x7fefe40f4b70 msgr2=0x7fefe40f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.744+0000 7fefea2c1700 1 -- 172.21.15.90:0/1409824380 shutdown_connections 2022-07-05T11:46:40.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.744+0000 7fefea2c1700 1 -- 172.21.15.90:0/1409824380 wait complete. 2022-07-05T11:46:40.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.745+0000 7fefea2c1700 1 Processor -- start 2022-07-05T11:46:40.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.745+0000 7fefea2c1700 1 -- start start 2022-07-05T11:46:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefea2c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefe417c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefea2c1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefe417cac0 0x7fefe418e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefea2c1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe418eda0 0x7fefe416a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefea2c1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe417c140 con 0x7fefd0004690 2022-07-05T11:46:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefea2c1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe417af70 con 0x7fefe418eda0 2022-07-05T11:46:40.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefea2c1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe417b250 con 0x7fefe417cac0 2022-07-05T11:46:40.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefe3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefe417c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefe3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefe417c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57764/0 (socket says 172.21.15.90:57764) 2022-07-05T11:46:40.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefe3fff700 1 -- 172.21.15.90:0/3433988937 learned_addr learned my addr 172.21.15.90:0/3433988937 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:40.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefe37fe700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefe417cac0 0x7fefe418e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.746+0000 7fefe885e700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe418eda0 0x7fefe416a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefe3fff700 1 -- 172.21.15.90:0/3433988937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefe417cac0 msgr2=0x7fefe418e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefe3fff700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefe417cac0 0x7fefe418e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefe3fff700 1 -- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe418eda0 msgr2=0x7fefe416a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefe3fff700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe418eda0 0x7fefe416a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefe3fff700 1 -- 172.21.15.90:0/3433988937 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe417b530 con 0x7fefd0004690 2022-07-05T11:46:40.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefe885e700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe418eda0 0x7fefe416a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:40.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefe3fff700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefe417c5d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fefd40119f0 tx=0x7fefd4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefcbfff700 1 -- 172.21.15.90:0/3433988937 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4011ee0 con 0x7fefd0004690 2022-07-05T11:46:40.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefcbfff700 1 -- 172.21.15.90:0/3433988937 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd400f940 con 0x7fefd0004690 2022-07-05T11:46:40.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe417b810 con 0x7fefd0004690 2022-07-05T11:46:40.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefcbfff700 1 -- 172.21.15.90:0/3433988937 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd400fcc0 con 0x7fefd0004690 2022-07-05T11:46:40.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.747+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe417bdd0 con 0x7fefd0004690 2022-07-05T11:46:40.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.748+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe417c420 con 0x7fefd0004690 2022-07-05T11:46:40.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.749+0000 7fefcbfff700 1 -- 172.21.15.90:0/3433988937 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fefd4024070 con 0x7fefd0004690 2022-07-05T11:46:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.750+0000 7fefcbfff700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fefc408ba40 0x7fefc408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.750+0000 7fefcbfff700 1 -- 172.21.15.90:0/3433988937 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fefd40b19d0 con 0x7fefd0004690 2022-07-05T11:46:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.750+0000 7fefe37fe700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fefc408ba40 0x7fefc408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.750+0000 7fefe37fe700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fefc408ba40 0x7fefc408df00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fefd8000c00 tx=0x7fefd8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.753+0000 7fefcbfff700 1 -- 172.21.15.90:0/3433988937 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fefd4082610 con 0x7fefd0004690 2022-07-05T11:46:40.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.913+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefe406be40 con 0x7fefd0004690 2022-07-05T11:46:40.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.914+0000 7fefcbfff700 1 -- 172.21.15.90:0/3433988937 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7fefd4085c30 con 0x7fefd0004690 2022-07-05T11:46:40.915 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:40.916 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fefc408ba40 msgr2=0x7fefc408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fefc408ba40 0x7fefc408df00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fefd8000c00 tx=0x7fefd8015000).stop 2022-07-05T11:46:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 msgr2=0x7fefe417c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefe417c5d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fefd40119f0 tx=0x7fefd4009060).stop 2022-07-05T11:46:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 shutdown_connections 2022-07-05T11:46:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fefc408ba40 0x7fefc408df00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefe418eda0 0x7fefe416a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefd0004690 0x7fefe417c5d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 --2- 172.21.15.90:0/3433988937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefe417cac0 0x7fefe418e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 >> 172.21.15.90:0/3433988937 conn(0x7fefe40f4b70 msgr2=0x7fefe40ef400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 shutdown_connections 2022-07-05T11:46:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:40.916+0000 7fefea2c1700 1 -- 172.21.15.90:0/3433988937 wait complete. 2022-07-05T11:46:40.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-07-05T11:46:03.055092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-07-05T11:46:03.515295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-07-05T11:46:06.613134+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-07-05T11:46:40.929 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:41.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.043+0000 7ff3db19d700 1 Processor -- start 2022-07-05T11:46:41.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.043+0000 7ff3db19d700 1 -- start start 2022-07-05T11:46:41.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.044+0000 7ff3db19d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3d417dc70 0x7ff3d417e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3db19d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff3d41815f0 0x7ff3d417f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3db19d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d417fdf0 con 0x7ff3d4181170 2022-07-05T11:46:41.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3db19d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d41800d0 con 0x7ff3d417dc70 2022-07-05T11:46:41.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3db19d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d41803b0 con 0x7ff3d41815f0 2022-07-05T11:46:41.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d3fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff3d4181170 0x7ff3d417e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50714/0 (socket says 172.21.15.90:50714) 2022-07-05T11:46:41.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d3fff700 1 -- 172.21.15.90:0/2187812416 learned_addr learned my addr 172.21.15.90:0/2187812416 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:41.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d8f39700 1 --2- 172.21.15.90:0/2187812416 >> v2:172.21.15.110:3300/0 conn(0x7ff3d417dc70 0x7ff3d417e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d973a700 1 --2- 172.21.15.90:0/2187812416 >> v2:172.21.15.149:3300/0 conn(0x7ff3d41815f0 0x7ff3d417f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d37fe700 1 -- 172.21.15.90:0/2187812416 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942199449 0 0) 0x7ff3d417fdf0 con 0x7ff3d4181170 2022-07-05T11:46:41.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d37fe700 1 -- 172.21.15.90:0/2187812416 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c00033f0 con 0x7ff3d4181170 2022-07-05T11:46:41.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d8f39700 1 -- 172.21.15.90:0/2187812416 >> v2:172.21.15.149:3300/0 conn(0x7ff3d41815f0 msgr2=0x7ff3d417f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:41.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d8f39700 1 --2- 172.21.15.90:0/2187812416 >> v2:172.21.15.149:3300/0 conn(0x7ff3d41815f0 0x7ff3d417f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d8f39700 1 -- 172.21.15.90:0/2187812416 >> v1:172.21.15.90:6789/0 conn(0x7ff3d4181170 legacy=0x7ff3d417e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d8f39700 1 -- 172.21.15.90:0/2187812416 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4180690 con 0x7ff3d417dc70 2022-07-05T11:46:41.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d973a700 1 --2- 172.21.15.90:0/2187812416 >> v2:172.21.15.149:3300/0 conn(0x7ff3d41815f0 0x7ff3d417f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:41.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d8f39700 1 --2- 172.21.15.90:0/2187812416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d417e050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff3d40ee3c0 tx=0x7ff3c4009060).ready entity=mon.1 client_cookie=e4f060c72f058b7e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d37fe700 1 -- 172.21.15.90:0/2187812416 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400d4a0 con 0x7ff3d417dc70 2022-07-05T11:46:41.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d37fe700 1 -- 172.21.15.90:0/2187812416 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c400d600 con 0x7ff3d417dc70 2022-07-05T11:46:41.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.045+0000 7ff3d37fe700 1 -- 172.21.15.90:0/2187812416 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400d980 con 0x7ff3d417dc70 2022-07-05T11:46:41.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 -- 172.21.15.90:0/2187812416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 msgr2=0x7ff3d417e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2187812416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d417e050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff3d40ee3c0 tx=0x7ff3c4009060).stop 2022-07-05T11:46:41.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 -- 172.21.15.90:0/2187812416 shutdown_connections 2022-07-05T11:46:41.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2187812416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d417e050 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2187812416 >> v2:172.21.15.149:3300/0 conn(0x7ff3d41815f0 0x7ff3d417f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 -- 172.21.15.90:0/2187812416 >> 172.21.15.90:0/2187812416 conn(0x7ff3d405d9a0 msgr2=0x7ff3d405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:41.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 -- 172.21.15.90:0/2187812416 shutdown_connections 2022-07-05T11:46:41.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.046+0000 7ff3db19d700 1 -- 172.21.15.90:0/2187812416 wait complete. 2022-07-05T11:46:41.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.047+0000 7ff3db19d700 1 Processor -- start 2022-07-05T11:46:41.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.048+0000 7ff3db19d700 1 -- start start 2022-07-05T11:46:41.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d4066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3d4181170 0x7ff3d41918e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3d41815f0 0x7ff3d418fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4191450 con 0x7ff3d41815f0 2022-07-05T11:46:41.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4190310 con 0x7ff3d417dc70 2022-07-05T11:46:41.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4190560 con 0x7ff3d4181170 2022-07-05T11:46:41.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3d41815f0 0x7ff3d418fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3d41815f0 0x7ff3d418fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57782/0 (socket says 172.21.15.90:57782) 2022-07-05T11:46:41.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 -- 172.21.15.90:0/2062319037 learned_addr learned my addr 172.21.15.90:0/2062319037 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:41.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d3fff700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3d4181170 0x7ff3d41918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d8f39700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d4066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 -- 172.21.15.90:0/2062319037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3d4181170 msgr2=0x7ff3d41918e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3d4181170 0x7ff3d41918e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 -- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 msgr2=0x7ff3d4066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d4066820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 -- 172.21.15.90:0/2062319037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc009a20 con 0x7ff3d41815f0 2022-07-05T11:46:41.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d8f39700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d4066820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:41.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d973a700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3d41815f0 0x7ff3d418fe20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ff3cc00c0f0 tx=0x7ff3cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d0ff9700 1 -- 172.21.15.90:0/2062319037 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc009d20 con 0x7ff3d41815f0 2022-07-05T11:46:41.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d0ff9700 1 -- 172.21.15.90:0/2062319037 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc00f040 con 0x7ff3d41815f0 2022-07-05T11:46:41.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c40092a0 con 0x7ff3d41815f0 2022-07-05T11:46:41.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3d0ff9700 1 -- 172.21.15.90:0/2062319037 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc00ce90 con 0x7ff3d41815f0 2022-07-05T11:46:41.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.049+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d4190b20 con 0x7ff3d41815f0 2022-07-05T11:46:41.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.050+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d4191600 con 0x7ff3d41815f0 2022-07-05T11:46:41.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.051+0000 7ff3d0ff9700 1 -- 172.21.15.90:0/2062319037 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff3cc013610 con 0x7ff3d41815f0 2022-07-05T11:46:41.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.051+0000 7ff3d0ff9700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff3b408ba40 0x7ff3b408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.052+0000 7ff3d0ff9700 1 -- 172.21.15.90:0/2062319037 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff3cc0b13c0 con 0x7ff3d41815f0 2022-07-05T11:46:41.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.052+0000 7ff3d8f39700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff3b408ba40 0x7ff3b408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.052+0000 7ff3d8f39700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff3b408ba40 0x7ff3b408df00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7ff3c4009fd0 tx=0x7ff3c4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.055+0000 7ff3d0ff9700 1 -- 172.21.15.90:0/2062319037 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7ff3d4191600 con 0x7ff3d41815f0 2022-07-05T11:46:41.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.216+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3d4191600 con 0x7ff3d41815f0 2022-07-05T11:46:41.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.216+0000 7ff3d0ff9700 1 -- 172.21.15.90:0/2062319037 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff3d4191600 con 0x7ff3d41815f0 2022-07-05T11:46:41.218 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:41.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff3b408ba40 msgr2=0x7ff3b408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff3b408ba40 0x7ff3b408df00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7ff3c4009fd0 tx=0x7ff3c4016000).stop 2022-07-05T11:46:41.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3d41815f0 msgr2=0x7ff3d418fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3d41815f0 0x7ff3d418fe20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ff3cc00c0f0 tx=0x7ff3cc00b040).stop 2022-07-05T11:46:41.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 shutdown_connections 2022-07-05T11:46:41.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff3b408ba40 0x7ff3b408df00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3d41815f0 0x7ff3d418fe20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d417dc70 0x7ff3d4066820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 --2- 172.21.15.90:0/2062319037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3d4181170 0x7ff3d41918e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 >> 172.21.15.90:0/2062319037 conn(0x7ff3d405d9a0 msgr2=0x7ff3d40e7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:41.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 shutdown_connections 2022-07-05T11:46:41.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.218+0000 7ff3db19d700 1 -- 172.21.15.90:0/2062319037 wait complete. 2022-07-05T11:46:41.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.346+0000 7fd5d75c1700 1 Processor -- start 2022-07-05T11:46:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.346+0000 7fd5d75c1700 1 -- start start 2022-07-05T11:46:41.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d75c1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd5d017bda0 0x7fd5d00ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d75c1700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5d0182a30 0x7fd5d00eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d75c1700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00ee170 con 0x7fd5d0061f10 2022-07-05T11:46:41.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d75c1700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d017f760 con 0x7fd5d0182a30 2022-07-05T11:46:41.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d75c1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d017c3f0 con 0x7fd5d017bda0 2022-07-05T11:46:41.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d4b5c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5d0182a30 0x7fd5d00eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d4b5c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5d0182a30 0x7fd5d00eeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57790/0 (socket says 172.21.15.90:57790) 2022-07-05T11:46:41.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.347+0000 7fd5d4b5c700 1 -- 172.21.15.90:0/525677663 learned_addr learned my addr 172.21.15.90:0/525677663 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:41.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d535d700 1 --2- 172.21.15.90:0/525677663 >> v2:172.21.15.149:3300/0 conn(0x7fd5d017bda0 0x7fd5d00ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d4b5c700 1 -- 172.21.15.90:0/525677663 >> v2:172.21.15.149:3300/0 conn(0x7fd5d017bda0 msgr2=0x7fd5d00ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d4b5c700 1 --2- 172.21.15.90:0/525677663 >> v2:172.21.15.149:3300/0 conn(0x7fd5d017bda0 0x7fd5d00ee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d4b5c700 1 -- 172.21.15.90:0/525677663 >> v1:172.21.15.110:6789/0 conn(0x7fd5d0061f10 legacy=0x7fd5d00623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d4b5c700 1 -- 172.21.15.90:0/525677663 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d00ed280 con 0x7fd5d0182a30 2022-07-05T11:46:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d4b5c700 1 --2- 172.21.15.90:0/525677663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d00eeaf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fd5d006b170 tx=0x7fd5c40090f0).ready entity=mon.0 client_cookie=2943ec19af76cbb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5cffff700 1 -- 172.21.15.90:0/525677663 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400b600 con 0x7fd5d0182a30 2022-07-05T11:46:41.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5cffff700 1 -- 172.21.15.90:0/525677663 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c400b760 con 0x7fd5d0182a30 2022-07-05T11:46:41.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5cffff700 1 -- 172.21.15.90:0/525677663 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400bae0 con 0x7fd5d0182a30 2022-07-05T11:46:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d75c1700 1 -- 172.21.15.90:0/525677663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 msgr2=0x7fd5d00eeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/525677663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d00eeaf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fd5d006b170 tx=0x7fd5c40090f0).stop 2022-07-05T11:46:41.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d75c1700 1 -- 172.21.15.90:0/525677663 shutdown_connections 2022-07-05T11:46:41.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/525677663 >> v2:172.21.15.149:3300/0 conn(0x7fd5d017bda0 0x7fd5d00ee600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/525677663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d00eeaf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.348+0000 7fd5d75c1700 1 -- 172.21.15.90:0/525677663 >> 172.21.15.90:0/525677663 conn(0x7fd5d00f21d0 msgr2=0x7fd5d0069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:41.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.349+0000 7fd5d75c1700 1 -- 172.21.15.90:0/525677663 shutdown_connections 2022-07-05T11:46:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.349+0000 7fd5d75c1700 1 -- 172.21.15.90:0/525677663 wait complete. 2022-07-05T11:46:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.350+0000 7fd5d75c1700 1 Processor -- start 2022-07-05T11:46:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.350+0000 7fd5d75c1700 1 -- start start 2022-07-05T11:46:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d75c1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5d0061f10 0x7fd5d0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d75c1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5d017bda0 0x7fd5d0178620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d75c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d0178b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d75c1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d017ea20 con 0x7fd5d0182a30 2022-07-05T11:46:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d75c1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0178190 con 0x7fd5d0061f10 2022-07-05T11:46:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d75c1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d017e460 con 0x7fd5d017bda0 2022-07-05T11:46:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d0178b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d0178b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57794/0 (socket says 172.21.15.90:57794) 2022-07-05T11:46:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 -- 172.21.15.90:0/357001494 learned_addr learned my addr 172.21.15.90:0/357001494 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d535d700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5d0061f10 0x7fd5d0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d4b5c700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5d017bda0 0x7fd5d0178620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 -- 172.21.15.90:0/357001494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5d017bda0 msgr2=0x7fd5d0178620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5d017bda0 0x7fd5d0178620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 -- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5d0061f10 msgr2=0x7fd5d0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5d0061f10 0x7fd5d0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d5b5e700 1 -- 172.21.15.90:0/357001494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009370 con 0x7fd5d0182a30 2022-07-05T11:46:41.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d535d700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5d0061f10 0x7fd5d0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:41.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.351+0000 7fd5d4b5c700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5d017bda0 0x7fd5d0178620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:41.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.352+0000 7fd5d5b5e700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d0178b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd5c800c440 tx=0x7fd5c8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.352+0000 7fd5cd7fa700 1 -- 172.21.15.90:0/357001494 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800f470 con 0x7fd5d0182a30 2022-07-05T11:46:41.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.352+0000 7fd5cd7fa700 1 -- 172.21.15.90:0/357001494 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8001e90 con 0x7fd5d0182a30 2022-07-05T11:46:41.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.352+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d017e740 con 0x7fd5d0182a30 2022-07-05T11:46:41.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.352+0000 7fd5cd7fa700 1 -- 172.21.15.90:0/357001494 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800f7e0 con 0x7fd5d0182a30 2022-07-05T11:46:41.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.352+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d0177e20 con 0x7fd5d0182a30 2022-07-05T11:46:41.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.353+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d01779a0 con 0x7fd5d0182a30 2022-07-05T11:46:41.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.354+0000 7fd5cd7fa700 1 -- 172.21.15.90:0/357001494 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd5c8010070 con 0x7fd5d0182a30 2022-07-05T11:46:41.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.354+0000 7fd5cd7fa700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd5b008ba40 0x7fd5b008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.354+0000 7fd5cd7fa700 1 -- 172.21.15.90:0/357001494 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd5c80afbc0 con 0x7fd5d0182a30 2022-07-05T11:46:41.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.354+0000 7fd5d535d700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd5b008ba40 0x7fd5b008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.355+0000 7fd5d535d700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd5b008ba40 0x7fd5b008df00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd5c000e5a0 tx=0x7fd5c00076f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.358+0000 7fd5cd7fa700 1 -- 172.21.15.90:0/357001494 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fd5c8056e60 con 0x7fd5d0182a30 2022-07-05T11:46:41.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.519+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5d006b1e0 con 0x7fd5d0182a30 2022-07-05T11:46:41.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.519+0000 7fd5cd7fa700 1 -- 172.21.15.90:0/357001494 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5d01779a0 con 0x7fd5d0182a30 2022-07-05T11:46:41.520 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:41.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd5b008ba40 msgr2=0x7fd5b008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd5b008ba40 0x7fd5b008df00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd5c000e5a0 tx=0x7fd5c00076f0).stop 2022-07-05T11:46:41.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 msgr2=0x7fd5d0178b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d0178b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd5c800c440 tx=0x7fd5c8007d70).stop 2022-07-05T11:46:41.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 shutdown_connections 2022-07-05T11:46:41.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd5b008ba40 0x7fd5b008df00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5d0182a30 0x7fd5d0178b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5d0061f10 0x7fd5d0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 --2- 172.21.15.90:0/357001494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5d017bda0 0x7fd5d0178620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 >> 172.21.15.90:0/357001494 conn(0x7fd5d00f21d0 msgr2=0x7fd5d00f43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:41.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 shutdown_connections 2022-07-05T11:46:41.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.521+0000 7fd5d75c1700 1 -- 172.21.15.90:0/357001494 wait complete. 2022-07-05T11:46:41.534 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-07-05T11:46:41.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.647+0000 7f117b50d700 1 Processor -- start 2022-07-05T11:46:41.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.647+0000 7f117b50d700 1 -- start start 2022-07-05T11:46:41.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f117b50d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f117417bda0 0x7f11740ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f117b50d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f117417e750 0x7f117417ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f117b50d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740ee170 con 0x7f1174182a30 2022-07-05T11:46:41.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f117b50d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117417c3f0 con 0x7f117417bda0 2022-07-05T11:46:41.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f117b50d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11740ed280 con 0x7f117417e750 2022-07-05T11:46:41.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f11792a9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f117417bda0 0x7f11740ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f11792a9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f117417bda0 0x7f11740ee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57800/0 (socket says 172.21.15.90:57800) 2022-07-05T11:46:41.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f1178aa8700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1174182a30 0x7f11740eeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50742/0 (socket says 172.21.15.90:50742) 2022-07-05T11:46:41.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.648+0000 7f11792a9700 1 -- 172.21.15.90:0/1745499931 learned_addr learned my addr 172.21.15.90:0/1745499931 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:41.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f1179aaa700 1 --2- 172.21.15.90:0/1745499931 >> v2:172.21.15.149:3300/0 conn(0x7f117417e750 0x7f117417ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f11792a9700 1 -- 172.21.15.90:0/1745499931 >> v2:172.21.15.149:3300/0 conn(0x7f117417e750 msgr2=0x7f117417ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:41.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f11792a9700 1 --2- 172.21.15.90:0/1745499931 >> v2:172.21.15.149:3300/0 conn(0x7f117417e750 0x7f117417ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f11792a9700 1 -- 172.21.15.90:0/1745499931 >> v1:172.21.15.90:6789/0 conn(0x7f1174182a30 legacy=0x7f11740eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f11792a9700 1 -- 172.21.15.90:0/1745499931 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740ed560 con 0x7f117417bda0 2022-07-05T11:46:41.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f1163fff700 1 -- 172.21.15.90:0/1745499931 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503561962 0 0) 0x7f11740ee170 con 0x7f1174182a30 2022-07-05T11:46:41.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f11792a9700 1 --2- 172.21.15.90:0/1745499931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f11740ee600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f11740ef4d0 tx=0x7f11700090f0).ready entity=mon.0 client_cookie=218fc9d847da8629 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f1163fff700 1 -- 172.21.15.90:0/1745499931 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000b520 con 0x7f117417bda0 2022-07-05T11:46:41.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f1163fff700 1 -- 172.21.15.90:0/1745499931 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000b680 con 0x7f117417bda0 2022-07-05T11:46:41.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f1163fff700 1 -- 172.21.15.90:0/1745499931 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000ba00 con 0x7f117417bda0 2022-07-05T11:46:41.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f117b50d700 1 -- 172.21.15.90:0/1745499931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 msgr2=0x7f11740ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f117b50d700 1 --2- 172.21.15.90:0/1745499931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f11740ee600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f11740ef4d0 tx=0x7f11700090f0).stop 2022-07-05T11:46:41.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f117b50d700 1 -- 172.21.15.90:0/1745499931 shutdown_connections 2022-07-05T11:46:41.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f117b50d700 1 --2- 172.21.15.90:0/1745499931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f11740ee600 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f117b50d700 1 --2- 172.21.15.90:0/1745499931 >> v2:172.21.15.149:3300/0 conn(0x7f117417e750 0x7f117417ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.649+0000 7f117b50d700 1 -- 172.21.15.90:0/1745499931 >> 172.21.15.90:0/1745499931 conn(0x7f11740f21d0 msgr2=0x7f1174069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:41.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.650+0000 7f117b50d700 1 -- 172.21.15.90:0/1745499931 shutdown_connections 2022-07-05T11:46:41.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.650+0000 7f117b50d700 1 -- 172.21.15.90:0/1745499931 wait complete. 2022-07-05T11:46:41.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.651+0000 7f117b50d700 1 Processor -- start 2022-07-05T11:46:41.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.651+0000 7f117b50d700 1 -- start start 2022-07-05T11:46:41.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f117b50d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f1174174d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f117b50d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f117417e750 0x7f1174170760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f117b50d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174182a30 0x7f11741904f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f117b50d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117417d9b0 con 0x7f117417bda0 2022-07-05T11:46:41.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f117b50d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741748b0 con 0x7f1174182a30 2022-07-05T11:46:41.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f117b50d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174173ca0 con 0x7f117417e750 2022-07-05T11:46:41.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f1174174d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f1174174d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57806/0 (socket says 172.21.15.90:57806) 2022-07-05T11:46:41.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 -- 172.21.15.90:0/2311696406 learned_addr learned my addr 172.21.15.90:0/2311696406 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:41.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f1178aa8700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f117417e750 0x7f1174170760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f1179aaa700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174182a30 0x7f11741904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 -- 172.21.15.90:0/2311696406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f117417e750 msgr2=0x7f1174170760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f117417e750 0x7f1174170760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 -- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174182a30 msgr2=0x7f11741904f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174182a30 0x7f11741904f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f11792a9700 1 -- 172.21.15.90:0/2311696406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170009370 con 0x7f117417bda0 2022-07-05T11:46:41.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.652+0000 7f1179aaa700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174182a30 0x7f11741904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:41.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.653+0000 7f11792a9700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f1174174d40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f1174088960 tx=0x7f1170017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.653+0000 7f11617fa700 1 -- 172.21.15.90:0/2311696406 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000be90 con 0x7f117417bda0 2022-07-05T11:46:41.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.653+0000 7f11617fa700 1 -- 172.21.15.90:0/2311696406 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000b7f0 con 0x7f117417bda0 2022-07-05T11:46:41.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.653+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1174173f80 con 0x7f117417bda0 2022-07-05T11:46:41.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.653+0000 7f11617fa700 1 -- 172.21.15.90:0/2311696406 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117001b660 con 0x7f117417bda0 2022-07-05T11:46:41.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.653+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174174540 con 0x7f117417bda0 2022-07-05T11:46:41.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.654+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174174b90 con 0x7f117417bda0 2022-07-05T11:46:41.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.654+0000 7f11617fa700 1 -- 172.21.15.90:0/2311696406 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f117002b070 con 0x7f117417bda0 2022-07-05T11:46:41.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.655+0000 7f11617fa700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.655+0000 7f11617fa700 1 -- 172.21.15.90:0/2311696406 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f11700b2180 con 0x7f117417bda0 2022-07-05T11:46:41.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.655+0000 7f1178aa8700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.655+0000 7f1178aa8700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1174064560 tx=0x7f1164007180).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.659+0000 7f11617fa700 1 -- 172.21.15.90:0/2311696406 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f1170082dc0 con 0x7f117417bda0 2022-07-05T11:46:41.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.816+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f117406b1e0 con 0x7f117417bda0 2022-07-05T11:46:41.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.817+0000 7f11617fa700 1 -- 172.21.15.90:0/2311696406 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f117001f020 con 0x7f117417bda0 2022-07-05T11:46:41.818 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:41.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 msgr2=0x7f115408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1174064560 tx=0x7f1164007180).stop 2022-07-05T11:46:41.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 msgr2=0x7f1174174d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f1174174d40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f1174088960 tx=0x7f1170017000).stop 2022-07-05T11:46:41.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 shutdown_connections 2022-07-05T11:46:41.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f115408ba40 0x7f115408df00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1174182a30 0x7f11741904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117417bda0 0x7f1174174d40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 --2- 172.21.15.90:0/2311696406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f117417e750 0x7f1174170760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 >> 172.21.15.90:0/2311696406 conn(0x7f11740f21d0 msgr2=0x7f11740c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:41.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 shutdown_connections 2022-07-05T11:46:41.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.818+0000 7f117b50d700 1 -- 172.21.15.90:0/2311696406 wait complete. 2022-07-05T11:46:41.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-07-05T11:46:41.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.944+0000 7fc3344fd700 1 Processor -- start 2022-07-05T11:46:41.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.944+0000 7fc3344fd700 1 -- start start 2022-07-05T11:46:41.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc3344fd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc32c17bda0 0x7fc32c0ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc3344fd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc32c17e750 0x7fc32c17ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc3344fd700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c0ee170 con 0x7fc32c182a30 2022-07-05T11:46:41.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc3344fd700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32c17c3f0 con 0x7fc32c17bda0 2022-07-05T11:46:41.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc3344fd700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32c0ed280 con 0x7fc32c17e750 2022-07-05T11:46:41.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc332299700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc32c17bda0 0x7fc32c0ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc332299700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc32c17bda0 0x7fc32c0ee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57814/0 (socket says 172.21.15.90:57814) 2022-07-05T11:46:41.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.945+0000 7fc332299700 1 -- 172.21.15.90:0/2174989708 learned_addr learned my addr 172.21.15.90:0/2174989708 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:41.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc332a9a700 1 --2- 172.21.15.90:0/2174989708 >> v2:172.21.15.110:3300/0 conn(0x7fc32c17e750 0x7fc32c17ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc332299700 1 -- 172.21.15.90:0/2174989708 >> v2:172.21.15.110:3300/0 conn(0x7fc32c17e750 msgr2=0x7fc32c17ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:41.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc332299700 1 --2- 172.21.15.90:0/2174989708 >> v2:172.21.15.110:3300/0 conn(0x7fc32c17e750 0x7fc32c17ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc332299700 1 -- 172.21.15.90:0/2174989708 >> v1:172.21.15.149:6789/0 conn(0x7fc32c182a30 legacy=0x7fc32c0eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc332299700 1 -- 172.21.15.90:0/2174989708 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0ed560 con 0x7fc32c17bda0 2022-07-05T11:46:41.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc332299700 1 --2- 172.21.15.90:0/2174989708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c17bda0 0x7fc32c0ee600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fc32c0ef4d0 tx=0x7fc31c009840).ready entity=mon.0 client_cookie=dd40a2cc8801280d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc331297700 1 -- 172.21.15.90:0/2174989708 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00e070 con 0x7fc32c17bda0 2022-07-05T11:46:41.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc331297700 1 -- 172.21.15.90:0/2174989708 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c00ba50 con 0x7fc32c17bda0 2022-07-05T11:46:41.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc331297700 1 -- 172.21.15.90:0/2174989708 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00bdd0 con 0x7fc32c17bda0 2022-07-05T11:46:41.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc3344fd700 1 -- 172.21.15.90:0/2174989708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c17bda0 msgr2=0x7fc32c0ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.946+0000 7fc3344fd700 1 --2- 172.21.15.90:0/2174989708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c17bda0 0x7fc32c0ee600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fc32c0ef4d0 tx=0x7fc31c009840).stop 2022-07-05T11:46:41.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.947+0000 7fc3344fd700 1 -- 172.21.15.90:0/2174989708 shutdown_connections 2022-07-05T11:46:41.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.947+0000 7fc3344fd700 1 --2- 172.21.15.90:0/2174989708 >> v2:172.21.15.110:3300/0 conn(0x7fc32c17e750 0x7fc32c17ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.947+0000 7fc3344fd700 1 --2- 172.21.15.90:0/2174989708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c17bda0 0x7fc32c0ee600 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.947+0000 7fc3344fd700 1 -- 172.21.15.90:0/2174989708 >> 172.21.15.90:0/2174989708 conn(0x7fc32c0f21d0 msgr2=0x7fc32c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:41.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.947+0000 7fc3344fd700 1 -- 172.21.15.90:0/2174989708 shutdown_connections 2022-07-05T11:46:41.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.947+0000 7fc3344fd700 1 -- 172.21.15.90:0/2174989708 wait complete. 2022-07-05T11:46:41.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.948+0000 7fc3344fd700 1 Processor -- start 2022-07-05T11:46:41.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.948+0000 7fc3344fd700 1 -- start start 2022-07-05T11:46:41.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc3344fd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc32c17bda0 0x7fc32c18ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc3344fd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc32c17e750 0x7fc32c17b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc3344fd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c182a30 0x7fc32c179220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc3344fd700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c178d90 con 0x7fc32c182a30 2022-07-05T11:46:41.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc3344fd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c177ea0 con 0x7fc32c17bda0 2022-07-05T11:46:41.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc3344fd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c178180 con 0x7fc32c17e750 2022-07-05T11:46:41.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c182a30 0x7fc32c179220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c182a30 0x7fc32c179220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57822/0 (socket says 172.21.15.90:57822) 2022-07-05T11:46:41.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 -- 172.21.15.90:0/3281715839 learned_addr learned my addr 172.21.15.90:0/3281715839 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:41.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332299700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc32c17bda0 0x7fc32c18ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc331a98700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc32c17e750 0x7fc32c17b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 -- 172.21.15.90:0/3281715839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc32c17e750 msgr2=0x7fc32c17b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc32c17e750 0x7fc32c17b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 -- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc32c17bda0 msgr2=0x7fc32c18ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:41.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc32c17bda0 0x7fc32c18ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:41.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 -- 172.21.15.90:0/3281715839 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009ae0 con 0x7fc32c182a30 2022-07-05T11:46:41.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc331a98700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc32c17e750 0x7fc32c17b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:41.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc332a9a700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c182a30 0x7fc32c179220 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fc32400d890 tx=0x7fc324008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.949+0000 7fc32a7fc700 1 -- 172.21.15.90:0/3281715839 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324011590 con 0x7fc32c182a30 2022-07-05T11:46:41.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.950+0000 7fc32a7fc700 1 -- 172.21.15.90:0/3281715839 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3240116f0 con 0x7fc32c182a30 2022-07-05T11:46:41.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.950+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c178460 con 0x7fc32c182a30 2022-07-05T11:46:41.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.950+0000 7fc32a7fc700 1 -- 172.21.15.90:0/3281715839 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324011a70 con 0x7fc32c182a30 2022-07-05T11:46:41.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.950+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c178a20 con 0x7fc32c182a30 2022-07-05T11:46:41.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.950+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32c06b1e0 con 0x7fc32c182a30 2022-07-05T11:46:41.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.952+0000 7fc32a7fc700 1 -- 172.21.15.90:0/3281715839 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc32401c460 con 0x7fc32c182a30 2022-07-05T11:46:41.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.952+0000 7fc32a7fc700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc30c08ba40 0x7fc30c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:41.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.953+0000 7fc32a7fc700 1 -- 172.21.15.90:0/3281715839 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc3240b11d0 con 0x7fc32c182a30 2022-07-05T11:46:41.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.953+0000 7fc332299700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc30c08ba40 0x7fc30c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:41.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.953+0000 7fc332299700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc30c08ba40 0x7fc30c08df00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fc31c00ba20 tx=0x7fc31c009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:41.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:41.956+0000 7fc32a7fc700 1 -- 172.21.15.90:0/3281715839 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fc324081e90 con 0x7fc32c182a30 2022-07-05T11:46:42.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.113+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc32c06be40 con 0x7fc32c182a30 2022-07-05T11:46:42.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.114+0000 7fc32a7fc700 1 -- 172.21.15.90:0/3281715839 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3240854b0 con 0x7fc32c182a30 2022-07-05T11:46:42.115 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:42.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.115+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc30c08ba40 msgr2=0x7fc30c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.115+0000 7fc3344fd700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc30c08ba40 0x7fc30c08df00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fc31c00ba20 tx=0x7fc31c009840).stop 2022-07-05T11:46:42.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.115+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c182a30 msgr2=0x7fc32c179220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.115+0000 7fc3344fd700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c182a30 0x7fc32c179220 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fc32400d890 tx=0x7fc324008040).stop 2022-07-05T11:46:42.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 shutdown_connections 2022-07-05T11:46:42.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc30c08ba40 0x7fc30c08df00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc32c182a30 0x7fc32c179220 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc32c17bda0 0x7fc32c18ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 --2- 172.21.15.90:0/3281715839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc32c17e750 0x7fc32c17b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 >> 172.21.15.90:0/3281715839 conn(0x7fc32c0f21d0 msgr2=0x7fc32c0ee500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 shutdown_connections 2022-07-05T11:46:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.116+0000 7fc3344fd700 1 -- 172.21.15.90:0/3281715839 wait complete. 2022-07-05T11:46:42.129 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-07-05T11:46:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.244+0000 7f0383778700 1 Processor -- start 2022-07-05T11:46:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.244+0000 7f0383778700 1 -- start start 2022-07-05T11:46:42.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.245+0000 7f0383778700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f037c182a30 0x7f037c0eed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.245+0000 7f0383778700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0ee170 con 0x7f037c17bda0 2022-07-05T11:46:42.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.245+0000 7f0383778700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c17c3f0 con 0x7f037c17e750 2022-07-05T11:46:42.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.245+0000 7f0383778700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0ed280 con 0x7f037c182a30 2022-07-05T11:46:42.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.245+0000 7f0381514700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f037c17bda0 0x7f037c0ee600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50766/0 (socket says 172.21.15.90:50766) 2022-07-05T11:46:42.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.245+0000 7f0381514700 1 -- 172.21.15.90:0/3050998908 learned_addr learned my addr 172.21.15.90:0/3050998908 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:42.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0380d13700 1 --2- 172.21.15.90:0/3050998908 >> v2:172.21.15.149:3300/0 conn(0x7f037c182a30 0x7f037c0eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4887261 0 0) 0x7f037c0ee170 con 0x7f037c17bda0 2022-07-05T11:46:42.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03680033f0 con 0x7f037c17bda0 2022-07-05T11:46:42.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239043182 0 0) 0x7f037c17c3f0 con 0x7f037c17e750 2022-07-05T11:46:42.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f037c0ee170 con 0x7f037c17e750 2022-07-05T11:46:42.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1079766897 0 0) 0x7f03680033f0 con 0x7f037c17bda0 2022-07-05T11:46:42.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 >> v2:172.21.15.149:3300/0 conn(0x7f037c182a30 msgr2=0x7f037c0eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 --2- 172.21.15.90:0/3050998908 >> v2:172.21.15.149:3300/0 conn(0x7f037c182a30 0x7f037c0eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 >> v1:172.21.15.110:6789/0 conn(0x7f037c17e750 legacy=0x7f037c17ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0ed560 con 0x7f037c17bda0 2022-07-05T11:46:42.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f036c0017f0 con 0x7f037c17bda0 2022-07-05T11:46:42.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 >> v1:172.21.15.90:6789/0 conn(0x7f037c17bda0 legacy=0x7f037c0ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0368003ac0 0x7f0368003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0368004690 0x7f0368004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368005000 0x7f036800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0ed280 con 0x7f0368004690 2022-07-05T11:46:42.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036800beb0 con 0x7f0368005000 2022-07-05T11:46:42.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036800c070 con 0x7f0368003ac0 2022-07-05T11:46:42.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0380d13700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0368004690 0x7f0368004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0381d15700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368005000 0x7f036800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0381514700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0368003ac0 0x7f0368003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0380d13700 1 -- 172.21.15.90:0/3050998908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0368003ac0 msgr2=0x7f0368003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0380d13700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0368003ac0 0x7f0368003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0380d13700 1 -- 172.21.15.90:0/3050998908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368005000 msgr2=0x7f036800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0380d13700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368005000 0x7f036800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0380d13700 1 -- 172.21.15.90:0/3050998908 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03680033f0 con 0x7f0368004690 2022-07-05T11:46:42.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.246+0000 7f0381d15700 1 -- 172.21.15.90:0/3050998908 reap_dead start 2022-07-05T11:46:42.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0380d13700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0368004690 0x7f0368004b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f0370009a60 tx=0x7f0370009060).ready entity=mon.0 client_cookie=28a08136e0852bdf server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370009ea0 con 0x7f0368004690 2022-07-05T11:46:42.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370009430 con 0x7f0368004690 2022-07-05T11:46:42.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f037bfff700 1 -- 172.21.15.90:0/3050998908 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000e870 con 0x7f0368004690 2022-07-05T11:46:42.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0383778700 1 -- 172.21.15.90:0/3050998908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0368004690 msgr2=0x7f0368004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0383778700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0368004690 0x7f0368004b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f0370009a60 tx=0x7f0370009060).stop 2022-07-05T11:46:42.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0383778700 1 -- 172.21.15.90:0/3050998908 shutdown_connections 2022-07-05T11:46:42.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0383778700 1 --2- 172.21.15.90:0/3050998908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0368004690 0x7f0368004b10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0383778700 1 -- 172.21.15.90:0/3050998908 >> 172.21.15.90:0/3050998908 conn(0x7f037c0f21d0 msgr2=0x7f037c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:42.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0383778700 1 -- 172.21.15.90:0/3050998908 shutdown_connections 2022-07-05T11:46:42.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.247+0000 7f0383778700 1 -- 172.21.15.90:0/3050998908 wait complete. 2022-07-05T11:46:42.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.249+0000 7f0383778700 1 Processor -- start 2022-07-05T11:46:42.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.249+0000 7f0383778700 1 -- start start 2022-07-05T11:46:42.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368004690 0x7f037c17fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037c1737c0 0x7f037c173c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f037c18e7b0 0x7f037c18ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0f3bf0 con 0x7f037c18e7b0 2022-07-05T11:46:42.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0f4080 con 0x7f0368004690 2022-07-05T11:46:42.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c180150 con 0x7f037c1737c0 2022-07-05T11:46:42.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f037c18e7b0 0x7f037c18ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f037c18e7b0 0x7f037c18ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57842/0 (socket says 172.21.15.90:57842) 2022-07-05T11:46:42.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 -- 172.21.15.90:0/3879105771 learned_addr learned my addr 172.21.15.90:0/3879105771 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:42.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381514700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368004690 0x7f037c17fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0380d13700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037c1737c0 0x7f037c173c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 -- 172.21.15.90:0/3879105771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037c1737c0 msgr2=0x7f037c173c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037c1737c0 0x7f037c173c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 -- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368004690 msgr2=0x7f037c17fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368004690 0x7f037c17fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 -- 172.21.15.90:0/3879105771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0f2d00 con 0x7f037c18e7b0 2022-07-05T11:46:42.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0380d13700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037c1737c0 0x7f037c173c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:42.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0381d15700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f037c18e7b0 0x7f037c18ec30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f037c0ebcb0 tx=0x7f0374007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f03797fa700 1 -- 172.21.15.90:0/3879105771 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374007240 con 0x7f037c18e7b0 2022-07-05T11:46:42.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f03797fa700 1 -- 172.21.15.90:0/3879105771 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03740073a0 con 0x7f037c18e7b0 2022-07-05T11:46:42.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c0f2fe0 con 0x7f037c18e7b0 2022-07-05T11:46:42.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f03797fa700 1 -- 172.21.15.90:0/3879105771 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740066a0 con 0x7f037c18e7b0 2022-07-05T11:46:42.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.250+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c0f35a0 con 0x7f037c18e7b0 2022-07-05T11:46:42.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.251+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c06b1e0 con 0x7f037c18e7b0 2022-07-05T11:46:42.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.252+0000 7f03797fa700 1 -- 172.21.15.90:0/3879105771 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f037401e030 con 0x7f037c18e7b0 2022-07-05T11:46:42.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.252+0000 7f03797fa700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f035c08ba40 0x7f035c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.253+0000 7f03797fa700 1 -- 172.21.15.90:0/3879105771 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f03740b07c0 con 0x7f037c18e7b0 2022-07-05T11:46:42.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.253+0000 7f0381514700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f035c08ba40 0x7f035c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.253+0000 7f0381514700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f035c08ba40 0x7f035c08df00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f036c002250 tx=0x7f036c007f20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.256+0000 7f03797fa700 1 -- 172.21.15.90:0/3879105771 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f0374081400 con 0x7f037c18e7b0 2022-07-05T11:46:42.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.416+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f037c06be40 con 0x7f037c18e7b0 2022-07-05T11:46:42.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.416+0000 7f03797fa700 1 -- 172.21.15.90:0/3879105771 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0374084a20 con 0x7f037c18e7b0 2022-07-05T11:46:42.418 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2022-07-05T11:46:42.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f035c08ba40 msgr2=0x7f035c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f035c08ba40 0x7f035c08df00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f036c002250 tx=0x7f036c007f20).stop 2022-07-05T11:46:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f037c18e7b0 msgr2=0x7f037c18ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f037c18e7b0 0x7f037c18ec30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f037c0ebcb0 tx=0x7f0374007bb0).stop 2022-07-05T11:46:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 shutdown_connections 2022-07-05T11:46:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f035c08ba40 0x7f035c08df00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f037c18e7b0 0x7f037c18ec30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0368004690 0x7f037c17fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 --2- 172.21.15.90:0/3879105771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037c1737c0 0x7f037c173c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 >> 172.21.15.90:0/3879105771 conn(0x7f037c0f21d0 msgr2=0x7f037c172ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:42.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 shutdown_connections 2022-07-05T11:46:42.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.418+0000 7f0383778700 1 -- 172.21.15.90:0/3879105771 wait complete. 2022-07-05T11:46:42.431 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:42.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.542+0000 7fa0c8969700 1 Processor -- start 2022-07-05T11:46:42.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.542+0000 7fa0c8969700 1 -- start start 2022-07-05T11:46:42.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.543+0000 7fa0c8969700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa0c417e890 0x7fa0c4061f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.543+0000 7fa0c8969700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c4063e10 con 0x7fa0c4174930 2022-07-05T11:46:42.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.543+0000 7fa0c8969700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40c0d40 con 0x7fa0c4174550 2022-07-05T11:46:42.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.543+0000 7fa0c8969700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c4063850 con 0x7fa0c417e890 2022-07-05T11:46:42.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.543+0000 7fa0c359e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa0c417e890 0x7fa0c4061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.543+0000 7fa0c359e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa0c417e890 0x7fa0c4061f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57850/0 (socket says 172.21.15.90:57850) 2022-07-05T11:46:42.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.543+0000 7fa0c359e700 1 -- 172.21.15.90:0/3356870983 learned_addr learned my addr 172.21.15.90:0/3356870983 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:42.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c359e700 1 -- 172.21.15.90:0/3356870983 >> v1:172.21.15.149:6789/0 conn(0x7fa0c4174550 legacy=0x7fa0c40c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c359e700 1 -- 172.21.15.90:0/3356870983 >> v1:172.21.15.110:6789/0 conn(0x7fa0c4174930 legacy=0x7fa0c40c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c359e700 1 -- 172.21.15.90:0/3356870983 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4063b30 con 0x7fa0c417e890 2022-07-05T11:46:42.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c359e700 1 --2- 172.21.15.90:0/3356870983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c417e890 0x7fa0c4061f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fa0bc009f20 tx=0x7fa0bc009840).ready entity=mon.0 client_cookie=276d5968da5cfd72 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c259c700 1 -- 172.21.15.90:0/3356870983 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00e070 con 0x7fa0c417e890 2022-07-05T11:46:42.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c259c700 1 -- 172.21.15.90:0/3356870983 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc00ba00 con 0x7fa0c417e890 2022-07-05T11:46:42.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c259c700 1 -- 172.21.15.90:0/3356870983 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00bd80 con 0x7fa0c417e890 2022-07-05T11:46:42.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c8969700 1 -- 172.21.15.90:0/3356870983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c417e890 msgr2=0x7fa0c4061f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c8969700 1 --2- 172.21.15.90:0/3356870983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c417e890 0x7fa0c4061f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fa0bc009f20 tx=0x7fa0bc009840).stop 2022-07-05T11:46:42.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c8969700 1 -- 172.21.15.90:0/3356870983 shutdown_connections 2022-07-05T11:46:42.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c8969700 1 --2- 172.21.15.90:0/3356870983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c417e890 0x7fa0c4061f10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c8969700 1 -- 172.21.15.90:0/3356870983 >> 172.21.15.90:0/3356870983 conn(0x7fa0c405e470 msgr2=0x7fa0c40f05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:42.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c8969700 1 -- 172.21.15.90:0/3356870983 shutdown_connections 2022-07-05T11:46:42.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.544+0000 7fa0c8969700 1 -- 172.21.15.90:0/3356870983 wait complete. 2022-07-05T11:46:42.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.546+0000 7fa0c8969700 1 Processor -- start 2022-07-05T11:46:42.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.546+0000 7fa0c8969700 1 -- start start 2022-07-05T11:46:42.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c4174550 0x7fa0c40ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0c4174930 0x7fa0c4156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c417e890 0x7fa0c41569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4173c50 con 0x7fa0c4174550 2022-07-05T11:46:42.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40ed7f0 con 0x7fa0c417e890 2022-07-05T11:46:42.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c415dc70 con 0x7fa0c4174930 2022-07-05T11:46:42.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c4174550 0x7fa0c40ec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c4174550 0x7fa0c40ec2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57852/0 (socket says 172.21.15.90:57852) 2022-07-05T11:46:42.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 -- 172.21.15.90:0/2883626170 learned_addr learned my addr 172.21.15.90:0/2883626170 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:42.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0bbfff700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0c4174930 0x7fa0c4156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c359e700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c417e890 0x7fa0c41569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 -- 172.21.15.90:0/2883626170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0c4174930 msgr2=0x7fa0c4156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0c4174930 0x7fa0c4156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 -- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c417e890 msgr2=0x7fa0c41569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c417e890 0x7fa0c41569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 -- 172.21.15.90:0/2883626170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc009ae0 con 0x7fa0c4174550 2022-07-05T11:46:42.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c2d9d700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c4174550 0x7fa0c40ec2a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fa0b400c440 tx=0x7fa0b4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0baffd700 1 -- 172.21.15.90:0/2883626170 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400cea0 con 0x7fa0c4174550 2022-07-05T11:46:42.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0baffd700 1 -- 172.21.15.90:0/2883626170 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b400f470 con 0x7fa0c4174550 2022-07-05T11:46:42.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c40ecc70 con 0x7fa0c4174550 2022-07-05T11:46:42.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0baffd700 1 -- 172.21.15.90:0/2883626170 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400f830 con 0x7fa0c4174550 2022-07-05T11:46:42.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.547+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40ed230 con 0x7fa0c4174550 2022-07-05T11:46:42.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.548+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c415da40 con 0x7fa0c4174550 2022-07-05T11:46:42.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.549+0000 7fa0baffd700 1 -- 172.21.15.90:0/2883626170 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fa0b4019030 con 0x7fa0c4174550 2022-07-05T11:46:42.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.549+0000 7fa0baffd700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa0a808ba40 0x7fa0a808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.550+0000 7fa0baffd700 1 -- 172.21.15.90:0/2883626170 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa0b40afb40 con 0x7fa0c4174550 2022-07-05T11:46:42.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.550+0000 7fa0bbfff700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa0a808ba40 0x7fa0a808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.550+0000 7fa0bbfff700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa0a808ba40 0x7fa0a808df00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa0c40c91f0 tx=0x7fa0ac007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.553+0000 7fa0baffd700 1 -- 172.21.15.90:0/2883626170 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fa0c415da40 con 0x7fa0c4174550 2022-07-05T11:46:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.716+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0c415da40 con 0x7fa0c4174550 2022-07-05T11:46:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.717+0000 7fa0baffd700 1 -- 172.21.15.90:0/2883626170 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7fa0c415da40 con 0x7fa0c4174550 2022-07-05T11:46:42.718 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:42.719 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:42.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa0a808ba40 msgr2=0x7fa0a808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa0a808ba40 0x7fa0a808df00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa0c40c91f0 tx=0x7fa0ac007d20).stop 2022-07-05T11:46:42.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c4174550 msgr2=0x7fa0c40ec2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c4174550 0x7fa0c40ec2a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fa0b400c440 tx=0x7fa0b4007de0).stop 2022-07-05T11:46:42.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 shutdown_connections 2022-07-05T11:46:42.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa0a808ba40 0x7fa0a808df00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0c417e890 0x7fa0c41569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c4174550 0x7fa0c40ec2a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 --2- 172.21.15.90:0/2883626170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0c4174930 0x7fa0c4156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 >> 172.21.15.90:0/2883626170 conn(0x7fa0c405e470 msgr2=0x7fa0c40c40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 shutdown_connections 2022-07-05T11:46:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.719+0000 7fa0c8969700 1 -- 172.21.15.90:0/2883626170 wait complete. 2022-07-05T11:46:42.733 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-07-05T11:46:03.055092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-07-05T11:46:03.515295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-07-05T11:46:06.613134+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-07-05T11:46:42.735 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:42.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.849+0000 7f551a61f700 1 Processor -- start 2022-07-05T11:46:42.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.849+0000 7f551a61f700 1 -- start start 2022-07-05T11:46:42.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f551a61f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55140ec750 0x7f551417cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f551a61f700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551417cb20 con 0x7f551417d4a0 2022-07-05T11:46:42.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f551a61f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5514172360 con 0x7f5514171f80 2022-07-05T11:46:42.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f551a61f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55140c7b40 con 0x7f55140ec750 2022-07-05T11:46:42.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5518bbc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f551417d4a0 0x7f551417ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50802/0 (socket says 172.21.15.90:50802) 2022-07-05T11:46:42.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5518bbc700 1 -- 172.21.15.90:0/3111223293 learned_addr learned my addr 172.21.15.90:0/3111223293 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:42.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f55137fe700 1 --2- 172.21.15.90:0/3111223293 >> v2:172.21.15.110:3300/0 conn(0x7f55140ec750 0x7f551417cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251357760 0 0) 0x7f551417cb20 con 0x7f551417d4a0 2022-07-05T11:46:42.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55000033f0 con 0x7f551417d4a0 2022-07-05T11:46:42.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703735073 0 0) 0x7f55000033f0 con 0x7f551417d4a0 2022-07-05T11:46:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 >> v2:172.21.15.110:3300/0 conn(0x7f55140ec750 msgr2=0x7f551417cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5512ffd700 1 --2- 172.21.15.90:0/3111223293 >> v2:172.21.15.110:3300/0 conn(0x7f55140ec750 0x7f551417cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 >> v1:172.21.15.149:6789/0 conn(0x7f5514171f80 legacy=0x7f55140c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.850+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140c7e20 con 0x7f551417d4a0 2022-07-05T11:46:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f550c0017f0 con 0x7f551417d4a0 2022-07-05T11:46:42.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 >> v1:172.21.15.90:6789/0 conn(0x7f551417d4a0 legacy=0x7f551417ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500003930 0x7f5500003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5500004690 0x7f5500004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5500005120 0x7f550000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140c7b40 con 0x7f5500005120 2022-07-05T11:46:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550000c030 con 0x7f5500003930 2022-07-05T11:46:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550000c1f0 con 0x7f5500004690 2022-07-05T11:46:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5500005120 0x7f550000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f55137fe700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5500004690 0x7f5500004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5513fff700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500003930 0x7f5500003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 -- 172.21.15.90:0/3111223293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5500004690 msgr2=0x7f5500004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5500004690 0x7f5500004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 -- 172.21.15.90:0/3111223293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500003930 msgr2=0x7f5500003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500003930 0x7f5500003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 -- 172.21.15.90:0/3111223293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000033f0 con 0x7f5500005120 2022-07-05T11:46:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5513fff700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500003930 0x7f5500003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 -- 172.21.15.90:0/3111223293 reap_dead start 2022-07-05T11:46:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5518bbc700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5500005120 0x7f550000b8e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f550c00c640 tx=0x7f55140c9c60).ready entity=mon.0 client_cookie=259833164023b038 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c00ce00 con 0x7f5500005120 2022-07-05T11:46:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c005b20 con 0x7f5500005120 2022-07-05T11:46:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.851+0000 7f5512ffd700 1 -- 172.21.15.90:0/3111223293 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0070d0 con 0x7f5500005120 2022-07-05T11:46:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.852+0000 7f551a61f700 1 -- 172.21.15.90:0/3111223293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5500005120 msgr2=0x7f550000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.852+0000 7f551a61f700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5500005120 0x7f550000b8e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f550c00c640 tx=0x7f55140c9c60).stop 2022-07-05T11:46:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.852+0000 7f551a61f700 1 -- 172.21.15.90:0/3111223293 shutdown_connections 2022-07-05T11:46:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.852+0000 7f551a61f700 1 --2- 172.21.15.90:0/3111223293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5500005120 0x7f550000b8e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.852+0000 7f551a61f700 1 -- 172.21.15.90:0/3111223293 >> 172.21.15.90:0/3111223293 conn(0x7f551405d9a0 msgr2=0x7f551405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.852+0000 7f551a61f700 1 -- 172.21.15.90:0/3111223293 shutdown_connections 2022-07-05T11:46:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.852+0000 7f551a61f700 1 -- 172.21.15.90:0/3111223293 wait complete. 2022-07-05T11:46:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.853+0000 7f551a61f700 1 Processor -- start 2022-07-05T11:46:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.853+0000 7f551a61f700 1 -- start start 2022-07-05T11:46:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.854+0000 7f551a61f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500005120 0x7f551418b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.854+0000 7f551a61f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55140c30b0 0x7f551416e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.854+0000 7f551a61f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f551416ea10 0x7f551416ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.854+0000 7f551a61f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551418cb50 con 0x7f551416ea10 2022-07-05T11:46:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.854+0000 7f551a61f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551418ce30 con 0x7f5500005120 2022-07-05T11:46:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.854+0000 7f551a61f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551418d110 con 0x7f55140c30b0 2022-07-05T11:46:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f551416ea10 0x7f551416ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f551416ea10 0x7f551416ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57874/0 (socket says 172.21.15.90:57874) 2022-07-05T11:46:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 -- 172.21.15.90:0/369161131 learned_addr learned my addr 172.21.15.90:0/369161131 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f55137fe700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55140c30b0 0x7f551416e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5513fff700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500005120 0x7f551418b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 -- 172.21.15.90:0/369161131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55140c30b0 msgr2=0x7f551416e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55140c30b0 0x7f551416e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 -- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500005120 msgr2=0x7f551418b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500005120 0x7f551418b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 -- 172.21.15.90:0/369161131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551418d3f0 con 0x7f551416ea10 2022-07-05T11:46:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f55137fe700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55140c30b0 0x7f551416e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f5518bbc700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f551416ea10 0x7f551416ee90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f550c007fd0 tx=0x7f550c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f54fbfff700 1 -- 172.21.15.90:0/369161131 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0070d0 con 0x7f551416ea10 2022-07-05T11:46:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f54fbfff700 1 -- 172.21.15.90:0/369161131 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c0017f0 con 0x7f551416ea10 2022-07-05T11:46:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551418d6d0 con 0x7f551416ea10 2022-07-05T11:46:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f54fbfff700 1 -- 172.21.15.90:0/369161131 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c013450 con 0x7f551416ea10 2022-07-05T11:46:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.855+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551416e000 con 0x7f551416ea10 2022-07-05T11:46:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.856+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551406be40 con 0x7f551416ea10 2022-07-05T11:46:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.857+0000 7f54fbfff700 1 -- 172.21.15.90:0/369161131 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f550c01d070 con 0x7f551416ea10 2022-07-05T11:46:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.857+0000 7f54fbfff700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f54f408ba40 0x7f54f408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.857+0000 7f54fbfff700 1 -- 172.21.15.90:0/369161131 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f550c0b23a0 con 0x7f551416ea10 2022-07-05T11:46:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.858+0000 7f5513fff700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f54f408ba40 0x7f54f408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.858+0000 7f5513fff700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f54f408ba40 0x7f54f408df00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5504007900 tx=0x7f550400c040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:42.860+0000 7f54fbfff700 1 -- 172.21.15.90:0/369161131 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f550c082fe0 con 0x7f551416ea10 2022-07-05T11:46:43.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.018+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f55140c8100 con 0x7f551416ea10 2022-07-05T11:46:43.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.019+0000 7f54fbfff700 1 -- 172.21.15.90:0/369161131 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f550c02d070 con 0x7f551416ea10 2022-07-05T11:46:43.021 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f54f408ba40 msgr2=0x7f54f408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f54f408ba40 0x7f54f408df00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5504007900 tx=0x7f550400c040).stop 2022-07-05T11:46:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f551416ea10 msgr2=0x7f551416ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f551416ea10 0x7f551416ee90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f550c007fd0 tx=0x7f550c015000).stop 2022-07-05T11:46:43.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 shutdown_connections 2022-07-05T11:46:43.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f54f408ba40 0x7f54f408df00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f551416ea10 0x7f551416ee90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5500005120 0x7f551418b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 --2- 172.21.15.90:0/369161131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55140c30b0 0x7f551416e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.020+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 >> 172.21.15.90:0/369161131 conn(0x7f551405d9a0 msgr2=0x7f55140c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:43.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.021+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 shutdown_connections 2022-07-05T11:46:43.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.021+0000 7f551a61f700 1 -- 172.21.15.90:0/369161131 wait complete. 2022-07-05T11:46:43.033 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:43.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.147+0000 7f5735f71700 1 Processor -- start 2022-07-05T11:46:43.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.147+0000 7f5735f71700 1 -- start start 2022-07-05T11:46:43.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.148+0000 7f5735f71700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57300eed10 0x7f5730064620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.148+0000 7f5735f71700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57300ee170 con 0x7f5730182a30 2022-07-05T11:46:43.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.148+0000 7f5735f71700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573017c3f0 con 0x7f573017bda0 2022-07-05T11:46:43.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.148+0000 7f5735f71700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5730064b10 con 0x7f57300eed10 2022-07-05T11:46:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572effd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5730182a30 0x7f573017e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50822/0 (socket says 172.21.15.90:50822) 2022-07-05T11:46:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572effd700 1 -- 172.21.15.90:0/3960187331 learned_addr learned my addr 172.21.15.90:0/3960187331 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572ffff700 1 --2- 172.21.15.90:0/3960187331 >> v2:172.21.15.110:3300/0 conn(0x7f57300eed10 0x7f5730064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993615496 0 0) 0x7f57300ee170 con 0x7f5730182a30 2022-07-05T11:46:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f571c0033f0 con 0x7f5730182a30 2022-07-05T11:46:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1848355364 0 0) 0x7f571c0033f0 con 0x7f5730182a30 2022-07-05T11:46:43.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 >> v2:172.21.15.110:3300/0 conn(0x7f57300eed10 msgr2=0x7f5730064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 --2- 172.21.15.90:0/3960187331 >> v2:172.21.15.110:3300/0 conn(0x7f57300eed10 0x7f5730064620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 >> v1:172.21.15.110:6789/0 conn(0x7f573017bda0 legacy=0x7f57300ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57300ed280 con 0x7f5730182a30 2022-07-05T11:46:43.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f5724001470 con 0x7f5730182a30 2022-07-05T11:46:43.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 >> v1:172.21.15.90:6789/0 conn(0x7f5730182a30 legacy=0x7f573017e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f571c003930 0x7f571c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c004690 0x7f571c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f571c005000 0x7f571c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730064b10 con 0x7f571c005000 2022-07-05T11:46:43.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c00bf30 con 0x7f571c003930 2022-07-05T11:46:43.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c00c0f0 con 0x7f571c004690 2022-07-05T11:46:43.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572ffff700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f571c005000 0x7f571c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572f7fe700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f571c003930 0x7f571c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572effd700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c004690 0x7f571c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572ffff700 1 -- 172.21.15.90:0/3960187331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c004690 msgr2=0x7f571c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572ffff700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c004690 0x7f571c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572ffff700 1 -- 172.21.15.90:0/3960187331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f571c003930 msgr2=0x7f571c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572ffff700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f571c003930 0x7f571c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572ffff700 1 -- 172.21.15.90:0/3960187331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0033f0 con 0x7f571c005000 2022-07-05T11:46:43.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.149+0000 7f572effd700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c004690 0x7f571c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:43.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f572ffff700 1 -- 172.21.15.90:0/3960187331 reap_dead start 2022-07-05T11:46:43.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f572ffff700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f571c005000 0x7f571c00b8e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f572800e210 tx=0x7f572800b040).ready entity=mon.0 client_cookie=70de8cbc825ae002 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728009ac0 con 0x7f571c005000 2022-07-05T11:46:43.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800f040 con 0x7f571c005000 2022-07-05T11:46:43.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f572e7fc700 1 -- 172.21.15.90:0/3960187331 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800ed10 con 0x7f571c005000 2022-07-05T11:46:43.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f5735f71700 1 -- 172.21.15.90:0/3960187331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f571c005000 msgr2=0x7f571c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f5735f71700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f571c005000 0x7f571c00b8e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f572800e210 tx=0x7f572800b040).stop 2022-07-05T11:46:43.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f5735f71700 1 -- 172.21.15.90:0/3960187331 shutdown_connections 2022-07-05T11:46:43.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f5735f71700 1 --2- 172.21.15.90:0/3960187331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f571c005000 0x7f571c00b8e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f5735f71700 1 -- 172.21.15.90:0/3960187331 >> 172.21.15.90:0/3960187331 conn(0x7f57300f21d0 msgr2=0x7f5730069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:43.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f5735f71700 1 -- 172.21.15.90:0/3960187331 shutdown_connections 2022-07-05T11:46:43.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.150+0000 7f5735f71700 1 -- 172.21.15.90:0/3960187331 wait complete. 2022-07-05T11:46:43.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.152+0000 7f5735f71700 1 Processor -- start 2022-07-05T11:46:43.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.152+0000 7f5735f71700 1 -- start start 2022-07-05T11:46:43.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f5735f71700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c005000 0x7f57300f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f5735f71700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5730163130 0x7f5730175350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f5735f71700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57300f4450 0x7f5730196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f5735f71700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573017cba0 con 0x7f57300f4450 2022-07-05T11:46:43.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f5735f71700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57301635b0 con 0x7f5730163130 2022-07-05T11:46:43.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f5735f71700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573017d400 con 0x7f571c005000 2022-07-05T11:46:43.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57300f4450 0x7f5730196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57300f4450 0x7f5730196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57896/0 (socket says 172.21.15.90:57896) 2022-07-05T11:46:43.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 -- 172.21.15.90:0/2667542158 learned_addr learned my addr 172.21.15.90:0/2667542158 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:43.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572effd700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5730163130 0x7f5730175350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572f7fe700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c005000 0x7f57300f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 -- 172.21.15.90:0/2667542158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c005000 msgr2=0x7f57300f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c005000 0x7f57300f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 -- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5730163130 msgr2=0x7f5730175350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5730163130 0x7f5730175350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 -- 172.21.15.90:0/2667542158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730196ce0 con 0x7f57300f4450 2022-07-05T11:46:43.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572effd700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5730163130 0x7f5730175350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:43.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f572ffff700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57300f4450 0x7f5730196310 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f5728008000 tx=0x7f5728018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f57177fe700 1 -- 172.21.15.90:0/2667542158 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572801d460 con 0x7f57300f4450 2022-07-05T11:46:43.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f57177fe700 1 -- 172.21.15.90:0/2667542158 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572801d5e0 con 0x7f57300f4450 2022-07-05T11:46:43.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5730196fc0 con 0x7f57300f4450 2022-07-05T11:46:43.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.153+0000 7f57177fe700 1 -- 172.21.15.90:0/2667542158 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572801d9a0 con 0x7f57300f4450 2022-07-05T11:46:43.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.154+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573017d090 con 0x7f57300f4450 2022-07-05T11:46:43.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.154+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573017d250 con 0x7f57300f4450 2022-07-05T11:46:43.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.155+0000 7f57177fe700 1 -- 172.21.15.90:0/2667542158 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f572802c070 con 0x7f57300f4450 2022-07-05T11:46:43.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.156+0000 7f57177fe700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571008ba40 0x7f571008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.156+0000 7f57177fe700 1 -- 172.21.15.90:0/2667542158 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f57280b2850 con 0x7f57300f4450 2022-07-05T11:46:43.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.156+0000 7f572f7fe700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571008ba40 0x7f571008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.156+0000 7f572f7fe700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571008ba40 0x7f571008df00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f5720000f60 tx=0x7f5720009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.160+0000 7f57177fe700 1 -- 172.21.15.90:0/2667542158 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f5728083510 con 0x7f57300f4450 2022-07-05T11:46:43.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.322+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f573006b1e0 con 0x7f57300f4450 2022-07-05T11:46:43.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.322+0000 7f57177fe700 1 -- 172.21.15.90:0/2667542158 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f572802a020 con 0x7f57300f4450 2022-07-05T11:46:43.327 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571008ba40 msgr2=0x7f571008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571008ba40 0x7f571008df00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f5720000f60 tx=0x7f5720009040).stop 2022-07-05T11:46:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57300f4450 msgr2=0x7f5730196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57300f4450 0x7f5730196310 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f5728008000 tx=0x7f5728018000).stop 2022-07-05T11:46:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 shutdown_connections 2022-07-05T11:46:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571008ba40 0x7f571008df00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57300f4450 0x7f5730196310 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f571c005000 0x7f57300f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 --2- 172.21.15.90:0/2667542158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5730163130 0x7f5730175350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 >> 172.21.15.90:0/2667542158 conn(0x7f57300f21d0 msgr2=0x7f57300c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 shutdown_connections 2022-07-05T11:46:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.324+0000 7f5735f71700 1 -- 172.21.15.90:0/2667542158 wait complete. 2022-07-05T11:46:43.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-07-05T11:46:43.466 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.454+0000 7fd504022700 1 Processor -- start 2022-07-05T11:46:43.467 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.454+0000 7fd504022700 1 -- start start 2022-07-05T11:46:43.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd504022700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4fc17dc70 0x7fd4fc17e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd504022700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd4fc181170 0x7fd4fc1815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd504022700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc181ae0 con 0x7fd4fc17e9d0 2022-07-05T11:46:43.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd504022700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc17fdf0 con 0x7fd4fc181170 2022-07-05T11:46:43.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd504022700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc1800d0 con 0x7fd4fc17dc70 2022-07-05T11:46:43.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd4fc181170 0x7fd4fc1815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd4fc181170 0x7fd4fc1815f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57900/0 (socket says 172.21.15.90:57900) 2022-07-05T11:46:43.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 -- 172.21.15.90:0/3438206964 learned_addr learned my addr 172.21.15.90:0/3438206964 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:43.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd501dbe700 1 --2- 172.21.15.90:0/3438206964 >> v2:172.21.15.149:3300/0 conn(0x7fd4fc17dc70 0x7fd4fc17e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 -- 172.21.15.90:0/3438206964 >> v2:172.21.15.149:3300/0 conn(0x7fd4fc17dc70 msgr2=0x7fd4fc17e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 --2- 172.21.15.90:0/3438206964 >> v2:172.21.15.149:3300/0 conn(0x7fd4fc17dc70 0x7fd4fc17e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 -- 172.21.15.90:0/3438206964 >> v1:172.21.15.110:6789/0 conn(0x7fd4fc17e9d0 legacy=0x7fd4fc17ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 -- 172.21.15.90:0/3438206964 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc1803b0 con 0x7fd4fc181170 2022-07-05T11:46:43.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd501dbe700 1 --2- 172.21.15.90:0/3438206964 >> v2:172.21.15.149:3300/0 conn(0x7fd4fc17dc70 0x7fd4fc17e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:43.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd5015bd700 1 --2- 172.21.15.90:0/3438206964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc1815f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fd4fc0601d0 tx=0x7fd4f00090f0).ready entity=mon.0 client_cookie=e5e11e99a5bf22ce server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.455+0000 7fd500dbc700 1 -- 172.21.15.90:0/3438206964 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000b5a0 con 0x7fd4fc181170 2022-07-05T11:46:43.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd500dbc700 1 -- 172.21.15.90:0/3438206964 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f000b700 con 0x7fd4fc181170 2022-07-05T11:46:43.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd500dbc700 1 -- 172.21.15.90:0/3438206964 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000ba80 con 0x7fd4fc181170 2022-07-05T11:46:43.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 -- 172.21.15.90:0/3438206964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 msgr2=0x7fd4fc1815f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 --2- 172.21.15.90:0/3438206964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc1815f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fd4fc0601d0 tx=0x7fd4f00090f0).stop 2022-07-05T11:46:43.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 -- 172.21.15.90:0/3438206964 shutdown_connections 2022-07-05T11:46:43.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 --2- 172.21.15.90:0/3438206964 >> v2:172.21.15.149:3300/0 conn(0x7fd4fc17dc70 0x7fd4fc17e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 --2- 172.21.15.90:0/3438206964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc1815f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 -- 172.21.15.90:0/3438206964 >> 172.21.15.90:0/3438206964 conn(0x7fd4fc05d9a0 msgr2=0x7fd4fc05ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:43.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 -- 172.21.15.90:0/3438206964 shutdown_connections 2022-07-05T11:46:43.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.456+0000 7fd504022700 1 -- 172.21.15.90:0/3438206964 wait complete. 2022-07-05T11:46:43.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.457+0000 7fd504022700 1 Processor -- start 2022-07-05T11:46:43.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.457+0000 7fd504022700 1 -- start start 2022-07-05T11:46:43.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.458+0000 7fd504022700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc17dc70 0x7fd4fc192c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.458+0000 7fd504022700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc17e9d0 0x7fd4fc0639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.458+0000 7fd504022700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc167c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.458+0000 7fd504022700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc063ee0 con 0x7fd4fc181170 2022-07-05T11:46:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.458+0000 7fd504022700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0640e0 con 0x7fd4fc17e9d0 2022-07-05T11:46:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.458+0000 7fd504022700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0643c0 con 0x7fd4fc17dc70 2022-07-05T11:46:43.478 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.478 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc167c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57904/0 (socket says 172.21.15.90:57904) 2022-07-05T11:46:43.478 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 -- 172.21.15.90:0/3306289536 learned_addr learned my addr 172.21.15.90:0/3306289536 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:43.478 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 -- 172.21.15.90:0/3306289536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc17dc70 msgr2=0x7fd4fc192c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd501dbe700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc17dc70 0x7fd4fc192c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5015bd700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc17e9d0 0x7fd4fc0639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc17dc70 0x7fd4fc192c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 -- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc17e9d0 msgr2=0x7fd4fc0639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc17e9d0 0x7fd4fc0639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 -- 172.21.15.90:0/3306289536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f0009370 con 0x7fd4fc181170 2022-07-05T11:46:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd5025bf700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc167c00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fd4f400c490 tx=0x7fd4f4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd4f9ffb700 1 -- 172.21.15.90:0/3306289536 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4002ea0 con 0x7fd4fc181170 2022-07-05T11:46:43.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd4f9ffb700 1 -- 172.21.15.90:0/3306289536 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400f470 con 0x7fd4fc181170 2022-07-05T11:46:43.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0646a0 con 0x7fd4fc181170 2022-07-05T11:46:43.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd4f9ffb700 1 -- 172.21.15.90:0/3306289536 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400f810 con 0x7fd4fc181170 2022-07-05T11:46:43.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.459+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc064c60 con 0x7fd4fc181170 2022-07-05T11:46:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.460+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc06be40 con 0x7fd4fc181170 2022-07-05T11:46:43.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.461+0000 7fd4f9ffb700 1 -- 172.21.15.90:0/3306289536 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd4f4010070 con 0x7fd4fc181170 2022-07-05T11:46:43.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.461+0000 7fd4f9ffb700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd4dc08ba40 0x7fd4dc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.461+0000 7fd4f9ffb700 1 -- 172.21.15.90:0/3306289536 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd4f40afc30 con 0x7fd4fc181170 2022-07-05T11:46:43.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.462+0000 7fd501dbe700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd4dc08ba40 0x7fd4dc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.462+0000 7fd501dbe700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd4dc08ba40 0x7fd4dc08df00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fd4ec0094d0 tx=0x7fd4ec00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.465+0000 7fd4f9ffb700 1 -- 172.21.15.90:0/3306289536 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fd4f40808f0 con 0x7fd4fc181170 2022-07-05T11:46:43.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.625+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4fc084bd0 con 0x7fd4fc181170 2022-07-05T11:46:43.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.625+0000 7fd4f9ffb700 1 -- 172.21.15.90:0/3306289536 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4f4083f10 con 0x7fd4fc181170 2022-07-05T11:46:43.627 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:43.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd4dc08ba40 msgr2=0x7fd4dc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd4dc08ba40 0x7fd4dc08df00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fd4ec0094d0 tx=0x7fd4ec00b040).stop 2022-07-05T11:46:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 msgr2=0x7fd4fc167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc167c00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fd4f400c490 tx=0x7fd4f4007de0).stop 2022-07-05T11:46:43.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 shutdown_connections 2022-07-05T11:46:43.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd4dc08ba40 0x7fd4dc08df00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc181170 0x7fd4fc167c00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc17dc70 0x7fd4fc192c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 --2- 172.21.15.90:0/3306289536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc17e9d0 0x7fd4fc0639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 >> 172.21.15.90:0/3306289536 conn(0x7fd4fc05d9a0 msgr2=0x7fd4fc0ef910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:43.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 shutdown_connections 2022-07-05T11:46:43.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.627+0000 7fd504022700 1 -- 172.21.15.90:0/3306289536 wait complete. 2022-07-05T11:46:43.639 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-07-05T11:46:43.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.754+0000 7ffb0359e700 1 Processor -- start 2022-07-05T11:46:43.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.754+0000 7ffb0359e700 1 -- start start 2022-07-05T11:46:43.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.755+0000 7ffb0359e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffafc178420 0x7ffafc17f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.755+0000 7ffb0359e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffafc17fce0 0x7ffafc181cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0359e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffafc178800 con 0x7ffafc1821e0 2022-07-05T11:46:43.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0359e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffafc0ebaf0 con 0x7ffafc178420 2022-07-05T11:46:43.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0359e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffafc0ec9f0 con 0x7ffafc17fce0 2022-07-05T11:46:43.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb02d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ffafc1821e0 0x7ffafc061f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50852/0 (socket says 172.21.15.90:50852) 2022-07-05T11:46:43.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb02d9d700 1 -- 172.21.15.90:0/830431695 learned_addr learned my addr 172.21.15.90:0/830431695 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:43.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb01d9b700 1 --2- 172.21.15.90:0/830431695 >> v2:172.21.15.149:3300/0 conn(0x7ffafc17fce0 0x7ffafc181cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0259c700 1 --2- 172.21.15.90:0/830431695 >> v2:172.21.15.110:3300/0 conn(0x7ffafc178420 0x7ffafc17f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345985747 0 0) 0x7ffafc178800 con 0x7ffafc1821e0 2022-07-05T11:46:43.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae40033f0 con 0x7ffafc1821e0 2022-07-05T11:46:43.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3371741294 0 0) 0x7ffae40033f0 con 0x7ffafc1821e0 2022-07-05T11:46:43.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 >> v2:172.21.15.149:3300/0 conn(0x7ffafc17fce0 msgr2=0x7ffafc181cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 --2- 172.21.15.90:0/830431695 >> v2:172.21.15.149:3300/0 conn(0x7ffafc17fce0 0x7ffafc181cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 >> v2:172.21.15.110:3300/0 conn(0x7ffafc178420 msgr2=0x7ffafc17f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 --2- 172.21.15.90:0/830431695 >> v2:172.21.15.110:3300/0 conn(0x7ffafc178420 0x7ffafc17f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc0eccd0 con 0x7ffafc1821e0 2022-07-05T11:46:43.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7ffaf80017f0 con 0x7ffafc1821e0 2022-07-05T11:46:43.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb01d9b700 1 --2- 172.21.15.90:0/830431695 >> v2:172.21.15.149:3300/0 conn(0x7ffafc17fce0 0x7ffafc181cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:46:43.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 >> v1:172.21.15.90:6789/0 conn(0x7ffafc1821e0 legacy=0x7ffafc061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffae40038e0 0x7ffae4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae4004690 0x7ffae4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffae4005000 0x7ffae400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0ebaf0 con 0x7ffae40038e0 2022-07-05T11:46:43.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0ec9f0 con 0x7ffae4005000 2022-07-05T11:46:43.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae400bdd0 con 0x7ffae4004690 2022-07-05T11:46:43.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.756+0000 7ffb0259c700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffae40038e0 0x7ffae4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb01d9b700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae4004690 0x7ffae4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb02d9d700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffae4005000 0x7ffae400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0259c700 1 -- 172.21.15.90:0/830431695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae4004690 msgr2=0x7ffae4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0259c700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae4004690 0x7ffae4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0259c700 1 -- 172.21.15.90:0/830431695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffae4005000 msgr2=0x7ffae400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:43.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0259c700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffae4005000 0x7ffae400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0259c700 1 -- 172.21.15.90:0/830431695 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae40033f0 con 0x7ffae40038e0 2022-07-05T11:46:43.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb02d9d700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffae4005000 0x7ffae400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:43.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb02d9d700 1 -- 172.21.15.90:0/830431695 reap_dead start 2022-07-05T11:46:43.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0259c700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffae40038e0 0x7ffae4003cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ffaf4009a80 tx=0x7ffaf4009060).ready entity=mon.0 client_cookie=de4fb3610bd83336 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4009430 con 0x7ffae40038e0 2022-07-05T11:46:43.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf400e640 con 0x7ffae40038e0 2022-07-05T11:46:43.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0159a700 1 -- 172.21.15.90:0/830431695 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400e9c0 con 0x7ffae40038e0 2022-07-05T11:46:43.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0359e700 1 -- 172.21.15.90:0/830431695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffae40038e0 msgr2=0x7ffae4003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0359e700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffae40038e0 0x7ffae4003cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ffaf4009a80 tx=0x7ffaf4009060).stop 2022-07-05T11:46:43.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0359e700 1 -- 172.21.15.90:0/830431695 shutdown_connections 2022-07-05T11:46:43.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0359e700 1 --2- 172.21.15.90:0/830431695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffae40038e0 0x7ffae4003cc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0359e700 1 -- 172.21.15.90:0/830431695 >> 172.21.15.90:0/830431695 conn(0x7ffafc0eebf0 msgr2=0x7ffafc05d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:43.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0359e700 1 -- 172.21.15.90:0/830431695 shutdown_connections 2022-07-05T11:46:43.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.757+0000 7ffb0359e700 1 -- 172.21.15.90:0/830431695 wait complete. 2022-07-05T11:46:43.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.759+0000 7ffb0359e700 1 Processor -- start 2022-07-05T11:46:43.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.759+0000 7ffb0359e700 1 -- start start 2022-07-05T11:46:43.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae40038e0 0x7ffafc16a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc0c8290 0x7ffafc0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffafc0c8c00 0x7ffafc191d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0c55e0 con 0x7ffafc0c8290 2022-07-05T11:46:43.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0c7e00 con 0x7ffafc0c8c00 2022-07-05T11:46:43.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc16a8a0 con 0x7ffae40038e0 2022-07-05T11:46:43.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc0c8290 0x7ffafc0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc0c8290 0x7ffafc0c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57924/0 (socket says 172.21.15.90:57924) 2022-07-05T11:46:43.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 -- 172.21.15.90:0/1896159457 learned_addr learned my addr 172.21.15.90:0/1896159457 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:43.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0259c700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae40038e0 0x7ffafc16a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb02d9d700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffafc0c8c00 0x7ffafc191d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 -- 172.21.15.90:0/1896159457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae40038e0 msgr2=0x7ffafc16a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae40038e0 0x7ffafc16a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 -- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffafc0c8c00 msgr2=0x7ffafc191d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffafc0c8c00 0x7ffafc191d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 -- 172.21.15.90:0/1896159457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc0c71f0 con 0x7ffafc0c8290 2022-07-05T11:46:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb01d9b700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc0c8290 0x7ffafc0c8710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ffaec011d40 tx=0x7ffaec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffaea7fc700 1 -- 172.21.15.90:0/1896159457 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec009730 con 0x7ffafc0c8290 2022-07-05T11:46:43.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffaea7fc700 1 -- 172.21.15.90:0/1896159457 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec00fa60 con 0x7ffafc0c8290 2022-07-05T11:46:43.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffafc0c74d0 con 0x7ffafc0c8290 2022-07-05T11:46:43.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffaea7fc700 1 -- 172.21.15.90:0/1896159457 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00fde0 con 0x7ffafc0c8290 2022-07-05T11:46:43.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.760+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc0c7a90 con 0x7ffafc0c8290 2022-07-05T11:46:43.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.761+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc0c80e0 con 0x7ffafc0c8290 2022-07-05T11:46:43.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.762+0000 7ffaea7fc700 1 -- 172.21.15.90:0/1896159457 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ffaec024070 con 0x7ffafc0c8290 2022-07-05T11:46:43.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.763+0000 7ffaea7fc700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ffadc08ba40 0x7ffadc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:43.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.763+0000 7ffaea7fc700 1 -- 172.21.15.90:0/1896159457 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ffaec0b1aa0 con 0x7ffafc0c8290 2022-07-05T11:46:43.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.763+0000 7ffb0259c700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ffadc08ba40 0x7ffadc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:43.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.763+0000 7ffb0259c700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ffadc08ba40 0x7ffadc08df00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ffaf4006d50 tx=0x7ffaf401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:43.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.766+0000 7ffaea7fc700 1 -- 172.21.15.90:0/1896159457 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7ffaec082760 con 0x7ffafc0c8290 2022-07-05T11:46:43.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.928+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffafc0657a0 con 0x7ffafc0c8290 2022-07-05T11:46:43.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.928+0000 7ffaea7fc700 1 -- 172.21.15.90:0/1896159457 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffaec018070 con 0x7ffafc0c8290 2022-07-05T11:46:43.930 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:43.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ffadc08ba40 msgr2=0x7ffadc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ffadc08ba40 0x7ffadc08df00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ffaf4006d50 tx=0x7ffaf401a000).stop 2022-07-05T11:46:43.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc0c8290 msgr2=0x7ffafc0c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:43.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc0c8290 0x7ffafc0c8710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ffaec011d40 tx=0x7ffaec009060).stop 2022-07-05T11:46:43.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 shutdown_connections 2022-07-05T11:46:43.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ffadc08ba40 0x7ffadc08df00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffafc0c8c00 0x7ffafc191d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae40038e0 0x7ffafc16a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 --2- 172.21.15.90:0/1896159457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffafc0c8290 0x7ffafc0c8710 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 >> 172.21.15.90:0/1896159457 conn(0x7ffafc0eebf0 msgr2=0x7ffafc180ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 shutdown_connections 2022-07-05T11:46:43.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:43.930+0000 7ffb0359e700 1 -- 172.21.15.90:0/1896159457 wait complete. 2022-07-05T11:46:43.943 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-07-05T11:46:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.056+0000 7f6de2da9700 1 Processor -- start 2022-07-05T11:46:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.056+0000 7f6de2da9700 1 -- start start 2022-07-05T11:46:44.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de2da9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ddc17bda0 0x7f6ddc0ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de2da9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ddc17e750 0x7f6ddc17ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de2da9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0ee170 con 0x7f6ddc182a30 2022-07-05T11:46:44.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de2da9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc17c3f0 con 0x7f6ddc17e750 2022-07-05T11:46:44.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de2da9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0ed280 con 0x7f6ddc17bda0 2022-07-05T11:46:44.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de1346700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ddc17e750 0x7f6ddc17ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de1346700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ddc17e750 0x7f6ddc17ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57934/0 (socket says 172.21.15.90:57934) 2022-07-05T11:46:44.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.057+0000 7f6de1346700 1 -- 172.21.15.90:0/875135929 learned_addr learned my addr 172.21.15.90:0/875135929 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:44.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6de0b45700 1 --2- 172.21.15.90:0/875135929 >> v2:172.21.15.149:3300/0 conn(0x7f6ddc17bda0 0x7f6ddc0ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6de1346700 1 -- 172.21.15.90:0/875135929 >> v2:172.21.15.149:3300/0 conn(0x7f6ddc17bda0 msgr2=0x7f6ddc0ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:44.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6de1346700 1 --2- 172.21.15.90:0/875135929 >> v2:172.21.15.149:3300/0 conn(0x7f6ddc17bda0 0x7f6ddc0ee600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6de1346700 1 -- 172.21.15.90:0/875135929 >> v1:172.21.15.149:6789/0 conn(0x7f6ddc182a30 legacy=0x7f6ddc0eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6de1346700 1 -- 172.21.15.90:0/875135929 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0ed560 con 0x7f6ddc17e750 2022-07-05T11:46:44.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6de1346700 1 --2- 172.21.15.90:0/875135929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc17ebb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6ddc06b170 tx=0x7f6dd4009840).ready entity=mon.0 client_cookie=9c93817cbde88fb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6ddb7fe700 1 -- 172.21.15.90:0/875135929 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400e070 con 0x7f6ddc17e750 2022-07-05T11:46:44.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6ddb7fe700 1 -- 172.21.15.90:0/875135929 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd400ba20 con 0x7f6ddc17e750 2022-07-05T11:46:44.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.058+0000 7f6ddb7fe700 1 -- 172.21.15.90:0/875135929 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400bda0 con 0x7f6ddc17e750 2022-07-05T11:46:44.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 -- 172.21.15.90:0/875135929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 msgr2=0x7f6ddc17ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 --2- 172.21.15.90:0/875135929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc17ebb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6ddc06b170 tx=0x7f6dd4009840).stop 2022-07-05T11:46:44.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 -- 172.21.15.90:0/875135929 shutdown_connections 2022-07-05T11:46:44.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 --2- 172.21.15.90:0/875135929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc17ebb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 --2- 172.21.15.90:0/875135929 >> v2:172.21.15.149:3300/0 conn(0x7f6ddc17bda0 0x7f6ddc0ee600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 -- 172.21.15.90:0/875135929 >> 172.21.15.90:0/875135929 conn(0x7f6ddc0f21d0 msgr2=0x7f6ddc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:44.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 -- 172.21.15.90:0/875135929 shutdown_connections 2022-07-05T11:46:44.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.059+0000 7f6de2da9700 1 -- 172.21.15.90:0/875135929 wait complete. 2022-07-05T11:46:44.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.060+0000 7f6de2da9700 1 Processor -- start 2022-07-05T11:46:44.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.060+0000 7f6de2da9700 1 -- start start 2022-07-05T11:46:44.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de2da9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc17bda0 0x7f6ddc18f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de2da9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc191e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de2da9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ddc182a30 0x7f6ddc172ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de2da9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc192350 con 0x7f6ddc17e750 2022-07-05T11:46:44.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de2da9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc1925c0 con 0x7f6ddc17bda0 2022-07-05T11:46:44.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de2da9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc1928a0 con 0x7f6ddc182a30 2022-07-05T11:46:44.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6ddbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc191e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6ddbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc191e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57938/0 (socket says 172.21.15.90:57938) 2022-07-05T11:46:44.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6ddbfff700 1 -- 172.21.15.90:0/38698120 learned_addr learned my addr 172.21.15.90:0/38698120 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:44.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de1346700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ddc182a30 0x7f6ddc172ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.061+0000 7f6de0b45700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc17bda0 0x7f6ddc18f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6ddbfff700 1 -- 172.21.15.90:0/38698120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ddc182a30 msgr2=0x7f6ddc172ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6ddbfff700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ddc182a30 0x7f6ddc172ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6ddbfff700 1 -- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc17bda0 msgr2=0x7f6ddc18f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6ddbfff700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc17bda0 0x7f6ddc18f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6ddbfff700 1 -- 172.21.15.90:0/38698120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4009ae0 con 0x7f6ddc17e750 2022-07-05T11:46:44.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6de0b45700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc17bda0 0x7f6ddc18f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:44.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6ddbfff700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc191e60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f6dc400c440 tx=0x7f6dc4007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6dd8ff9700 1 -- 172.21.15.90:0/38698120 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400cea0 con 0x7f6ddc17e750 2022-07-05T11:46:44.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6dd8ff9700 1 -- 172.21.15.90:0/38698120 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc400f470 con 0x7f6ddc17e750 2022-07-05T11:46:44.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc192b80 con 0x7f6ddc17e750 2022-07-05T11:46:44.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6dd8ff9700 1 -- 172.21.15.90:0/38698120 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400f810 con 0x7f6ddc17e750 2022-07-05T11:46:44.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.062+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc18eeb0 con 0x7f6ddc17e750 2022-07-05T11:46:44.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.063+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc06b1e0 con 0x7f6ddc17e750 2022-07-05T11:46:44.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.064+0000 7f6dd8ff9700 1 -- 172.21.15.90:0/38698120 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6dc4019030 con 0x7f6ddc17e750 2022-07-05T11:46:44.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.064+0000 7f6dd8ff9700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc008ba10 0x7f6dc008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.064+0000 7f6dd8ff9700 1 -- 172.21.15.90:0/38698120 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6dc40b0010 con 0x7f6ddc17e750 2022-07-05T11:46:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.064+0000 7f6de0b45700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc008ba10 0x7f6dc008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.065+0000 7f6de0b45700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc008ba10 0x7f6dc008ded0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f6dcc009b60 tx=0x7f6dcc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.067+0000 7f6dd8ff9700 1 -- 172.21.15.90:0/38698120 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f6dc4080cd0 con 0x7f6ddc17e750 2022-07-05T11:46:44.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.228+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ddc192d10 con 0x7f6ddc17e750 2022-07-05T11:46:44.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.229+0000 7f6dd8ff9700 1 -- 172.21.15.90:0/38698120 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6dc4017030 con 0x7f6ddc17e750 2022-07-05T11:46:44.231 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2022-07-05T11:46:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc008ba10 msgr2=0x7f6dc008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc008ba10 0x7f6dc008ded0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f6dcc009b60 tx=0x7f6dcc008040).stop 2022-07-05T11:46:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 msgr2=0x7f6ddc191e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc191e60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f6dc400c440 tx=0x7f6dc4007dc0).stop 2022-07-05T11:46:44.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 shutdown_connections 2022-07-05T11:46:44.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6dc008ba10 0x7f6dc008ded0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ddc182a30 0x7f6ddc172ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ddc17bda0 0x7f6ddc18f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 --2- 172.21.15.90:0/38698120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ddc17e750 0x7f6ddc191e60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 >> 172.21.15.90:0/38698120 conn(0x7f6ddc0f21d0 msgr2=0x7f6ddc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:44.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 shutdown_connections 2022-07-05T11:46:44.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.231+0000 7f6de2da9700 1 -- 172.21.15.90:0/38698120 wait complete. 2022-07-05T11:46:44.244 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2022-07-05T11:46:44.245 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:44.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.358+0000 7f35ce41b700 1 Processor -- start 2022-07-05T11:46:44.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.358+0000 7f35ce41b700 1 -- start start 2022-07-05T11:46:44.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35ce41b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f35c81782d0 0x7f35c817fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35ce41b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c80854c0 con 0x7f35c81786b0 2022-07-05T11:46:44.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35ce41b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c8086060 con 0x7f35c817f0e0 2022-07-05T11:46:44.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35ce41b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c8178b40 con 0x7f35c81782d0 2022-07-05T11:46:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35cc9b8700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f35c81786b0 0x7f35c80ed300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50888/0 (socket says 172.21.15.90:50888) 2022-07-05T11:46:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35cc9b8700 1 -- 172.21.15.90:0/1638216943 learned_addr learned my addr 172.21.15.90:0/1638216943 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237357193 0 0) 0x7f35c80854c0 con 0x7f35c81786b0 2022-07-05T11:46:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b40033f0 con 0x7f35c81786b0 2022-07-05T11:46:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c7fff700 1 --2- 172.21.15.90:0/1638216943 >> v2:172.21.15.110:3300/0 conn(0x7f35c81782d0 0x7f35c817fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914345036 0 0) 0x7f35b40033f0 con 0x7f35c81786b0 2022-07-05T11:46:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 >> v2:172.21.15.110:3300/0 conn(0x7f35c81782d0 msgr2=0x7f35c817fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 --2- 172.21.15.90:0/1638216943 >> v2:172.21.15.110:3300/0 conn(0x7f35c81782d0 0x7f35c817fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 >> v1:172.21.15.110:6789/0 conn(0x7f35c817f0e0 legacy=0x7f35c8085950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c80845d0 con 0x7f35c81786b0 2022-07-05T11:46:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f35c00017f0 con 0x7f35c81786b0 2022-07-05T11:46:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 >> v1:172.21.15.90:6789/0 conn(0x7f35c81786b0 legacy=0x7f35c80ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4003930 0x7f35b4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b4004690 0x7f35b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b4005000 0x7f35b400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8178b40 con 0x7f35b4005000 2022-07-05T11:46:44.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b400bf30 con 0x7f35b4003930 2022-07-05T11:46:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.359+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b400c0f0 con 0x7f35b4004690 2022-07-05T11:46:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b4005000 0x7f35b400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35c7fff700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4003930 0x7f35b4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 -- 172.21.15.90:0/1638216943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b4004690 msgr2=0x7f35b4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b4004690 0x7f35b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 -- 172.21.15.90:0/1638216943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4003930 msgr2=0x7f35b4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4003930 0x7f35b4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 -- 172.21.15.90:0/1638216943 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40033f0 con 0x7f35b4005000 2022-07-05T11:46:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 -- 172.21.15.90:0/1638216943 reap_dead start 2022-07-05T11:46:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35cc9b8700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b4005000 0x7f35b400b8e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f35c000c480 tx=0x7f35c000c790).ready entity=mon.0 client_cookie=704b4868fbd264c8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0002030 con 0x7f35b4005000 2022-07-05T11:46:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c000ce20 con 0x7f35b4005000 2022-07-05T11:46:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35c6ffd700 1 -- 172.21.15.90:0/1638216943 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0005d30 con 0x7f35b4005000 2022-07-05T11:46:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35ce41b700 1 -- 172.21.15.90:0/1638216943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b4005000 msgr2=0x7f35b400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b4005000 0x7f35b400b8e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f35c000c480 tx=0x7f35c000c790).stop 2022-07-05T11:46:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35ce41b700 1 -- 172.21.15.90:0/1638216943 shutdown_connections 2022-07-05T11:46:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1638216943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b4005000 0x7f35b400b8e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.360+0000 7f35ce41b700 1 -- 172.21.15.90:0/1638216943 >> 172.21.15.90:0/1638216943 conn(0x7f35c80f2960 msgr2=0x7f35c80f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.361+0000 7f35ce41b700 1 -- 172.21.15.90:0/1638216943 shutdown_connections 2022-07-05T11:46:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.361+0000 7f35ce41b700 1 -- 172.21.15.90:0/1638216943 wait complete. 2022-07-05T11:46:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.362+0000 7f35ce41b700 1 Processor -- start 2022-07-05T11:46:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.362+0000 7f35ce41b700 1 -- start start 2022-07-05T11:46:44.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35ce41b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4005000 0x7f35c8180140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35ce41b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c818fee0 0x7f35c81719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35ce41b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35c80f1fe0 0x7f35c8069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35ce41b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8180630 con 0x7f35c818fee0 2022-07-05T11:46:44.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35ce41b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8182d90 con 0x7f35b4005000 2022-07-05T11:46:44.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35ce41b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80693f0 con 0x7f35c80f1fe0 2022-07-05T11:46:44.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c818fee0 0x7f35c81719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c818fee0 0x7f35c81719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57958/0 (socket says 172.21.15.90:57958) 2022-07-05T11:46:44.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 -- 172.21.15.90:0/1137450666 learned_addr learned my addr 172.21.15.90:0/1137450666 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:44.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c7fff700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4005000 0x7f35c8180140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 -- 172.21.15.90:0/1137450666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35c80f1fe0 msgr2=0x7f35c8069880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35cc9b8700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35c80f1fe0 0x7f35c8069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35c80f1fe0 0x7f35c8069880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 -- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4005000 msgr2=0x7f35c8180140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4005000 0x7f35c8180140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.363+0000 7f35c77fe700 1 -- 172.21.15.90:0/1137450666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8171e90 con 0x7f35c818fee0 2022-07-05T11:46:44.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.364+0000 7f35c77fe700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c818fee0 0x7f35c81719a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f35b800c4f0 tx=0x7f35b8007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.364+0000 7f35affff700 1 -- 172.21.15.90:0/1137450666 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800f470 con 0x7f35c818fee0 2022-07-05T11:46:44.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.364+0000 7f35affff700 1 -- 172.21.15.90:0/1137450666 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800f5f0 con 0x7f35c818fee0 2022-07-05T11:46:44.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.364+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c8190360 con 0x7f35c818fee0 2022-07-05T11:46:44.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.364+0000 7f35affff700 1 -- 172.21.15.90:0/1137450666 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800f9b0 con 0x7f35c818fee0 2022-07-05T11:46:44.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.364+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c8068ac0 con 0x7f35c818fee0 2022-07-05T11:46:44.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.365+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c806be40 con 0x7f35c818fee0 2022-07-05T11:46:44.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.366+0000 7f35affff700 1 -- 172.21.15.90:0/1137450666 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f35b8019030 con 0x7f35c818fee0 2022-07-05T11:46:44.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.366+0000 7f35affff700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f35a808ba10 0x7f35a808ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.366+0000 7f35affff700 1 -- 172.21.15.90:0/1137450666 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f35b80afbd0 con 0x7f35c818fee0 2022-07-05T11:46:44.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.366+0000 7f35c7fff700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f35a808ba10 0x7f35a808ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.367+0000 7f35c7fff700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f35a808ba10 0x7f35a808ded0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f35bc006d50 tx=0x7f35bc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.370+0000 7f35affff700 1 -- 172.21.15.90:0/1137450666 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f35b8080890 con 0x7f35c818fee0 2022-07-05T11:46:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.571+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35c80848b0 con 0x7f35c818fee0 2022-07-05T11:46:44.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.571+0000 7f35affff700 1 -- 172.21.15.90:0/1137450666 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+10607 (secure 0 0 0) 0x7f35b8017020 con 0x7f35c818fee0 2022-07-05T11:46:44.573 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:44.573 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:22.354922+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4371,"mds_1":4362,"mds_2":4346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4340":{"gid":4340,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4341":{"gid":4341,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4344":{"gid":4344,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4346":{"gid":4346,"name":"l","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4362":{"gid":4362,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-07-05T11:46:44.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f35a808ba10 msgr2=0x7f35a808ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f35a808ba10 0x7f35a808ded0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f35bc006d50 tx=0x7f35bc008040).stop 2022-07-05T11:46:44.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c818fee0 msgr2=0x7f35c81719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c818fee0 0x7f35c81719a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f35b800c4f0 tx=0x7f35b8007db0).stop 2022-07-05T11:46:44.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 shutdown_connections 2022-07-05T11:46:44.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f35a808ba10 0x7f35a808ded0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35c80f1fe0 0x7f35c8069880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4005000 0x7f35c8180140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 --2- 172.21.15.90:0/1137450666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c818fee0 0x7f35c81719a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 >> 172.21.15.90:0/1137450666 conn(0x7f35c80f2960 msgr2=0x7f35c8172660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:44.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 shutdown_connections 2022-07-05T11:46:44.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.573+0000 7f35ce41b700 1 -- 172.21.15.90:0/1137450666 wait complete. 2022-07-05T11:46:44.577 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2022-07-05T11:46:44.586 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2022-07-05T11:46:44.586 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2022-07-05T11:46:44.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-07-05T11:46:44.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.697+0000 7f3b48722700 1 Processor -- start 2022-07-05T11:46:44.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.697+0000 7f3b48722700 1 -- start start 2022-07-05T11:46:44.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.698+0000 7f3b48722700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b4017da60 0x7f3b4017de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.698+0000 7f3b48722700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3b400c7d00 0x7f3b4017eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.698+0000 7f3b48722700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400c9090 con 0x7f3b4017f070 2022-07-05T11:46:44.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.698+0000 7f3b48722700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b400c81a0 con 0x7f3b400c7d00 2022-07-05T11:46:44.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.698+0000 7f3b48722700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b400c8480 con 0x7f3b4017da60 2022-07-05T11:46:44.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.698+0000 7f3b45cbd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3b400c7d00 0x7f3b4017eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b45cbd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3b400c7d00 0x7f3b4017eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57968/0 (socket says 172.21.15.90:57968) 2022-07-05T11:46:44.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b45cbd700 1 -- 172.21.15.90:0/628518291 learned_addr learned my addr 172.21.15.90:0/628518291 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:44.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b464be700 1 --2- 172.21.15.90:0/628518291 >> v2:172.21.15.149:3300/0 conn(0x7f3b4017da60 0x7f3b4017de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b45cbd700 1 -- 172.21.15.90:0/628518291 >> v2:172.21.15.149:3300/0 conn(0x7f3b4017da60 msgr2=0x7f3b4017de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:44.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b45cbd700 1 --2- 172.21.15.90:0/628518291 >> v2:172.21.15.149:3300/0 conn(0x7f3b4017da60 0x7f3b4017de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b45cbd700 1 -- 172.21.15.90:0/628518291 >> v1:172.21.15.110:6789/0 conn(0x7f3b4017f070 legacy=0x7f3b400c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b45cbd700 1 -- 172.21.15.90:0/628518291 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400c8760 con 0x7f3b400c7d00 2022-07-05T11:46:44.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b464be700 1 --2- 172.21.15.90:0/628518291 >> v2:172.21.15.149:3300/0 conn(0x7f3b4017da60 0x7f3b4017de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:44.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b45cbd700 1 --2- 172.21.15.90:0/628518291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b400c7d00 0x7f3b4017eb80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f3b34006fd0 tx=0x7f3b340090f0).ready entity=mon.0 client_cookie=309f1f87fb226a7c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b454bc700 1 -- 172.21.15.90:0/628518291 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400b600 con 0x7f3b400c7d00 2022-07-05T11:46:44.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b454bc700 1 -- 172.21.15.90:0/628518291 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3400b760 con 0x7f3b400c7d00 2022-07-05T11:46:44.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b454bc700 1 -- 172.21.15.90:0/628518291 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400bae0 con 0x7f3b400c7d00 2022-07-05T11:46:44.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b48722700 1 -- 172.21.15.90:0/628518291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b400c7d00 msgr2=0x7f3b4017eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.699+0000 7f3b48722700 1 --2- 172.21.15.90:0/628518291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b400c7d00 0x7f3b4017eb80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f3b34006fd0 tx=0x7f3b340090f0).stop 2022-07-05T11:46:44.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.700+0000 7f3b48722700 1 -- 172.21.15.90:0/628518291 shutdown_connections 2022-07-05T11:46:44.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.700+0000 7f3b48722700 1 --2- 172.21.15.90:0/628518291 >> v2:172.21.15.149:3300/0 conn(0x7f3b4017da60 0x7f3b4017de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.700+0000 7f3b48722700 1 --2- 172.21.15.90:0/628518291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b400c7d00 0x7f3b4017eb80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.700+0000 7f3b48722700 1 -- 172.21.15.90:0/628518291 >> 172.21.15.90:0/628518291 conn(0x7f3b400f4b70 msgr2=0x7f3b400f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:44.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.700+0000 7f3b48722700 1 -- 172.21.15.90:0/628518291 shutdown_connections 2022-07-05T11:46:44.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.700+0000 7f3b48722700 1 -- 172.21.15.90:0/628518291 wait complete. 2022-07-05T11:46:44.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.701+0000 7f3b48722700 1 Processor -- start 2022-07-05T11:46:44.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.701+0000 7f3b48722700 1 -- start start 2022-07-05T11:46:44.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b48722700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b400c7d00 0x7f3b40196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b48722700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b4017da60 0x7f3b40162b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b48722700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4017f070 0x7f3b40163030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b48722700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40164440 con 0x7f3b4017f070 2022-07-05T11:46:44.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b48722700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40176ec0 con 0x7f3b4017da60 2022-07-05T11:46:44.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b48722700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40163830 con 0x7f3b400c7d00 2022-07-05T11:46:44.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4017f070 0x7f3b40163030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4017f070 0x7f3b40163030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57974/0 (socket says 172.21.15.90:57974) 2022-07-05T11:46:44.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 -- 172.21.15.90:0/3193929666 learned_addr learned my addr 172.21.15.90:0/3193929666 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:44.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b45cbd700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b4017da60 0x7f3b40162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 -- 172.21.15.90:0/3193929666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b400c7d00 msgr2=0x7f3b40196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b464be700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b400c7d00 0x7f3b40196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b400c7d00 0x7f3b40196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 -- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b4017da60 msgr2=0x7f3b40162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b4017da60 0x7f3b40162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 -- 172.21.15.90:0/3193929666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34009370 con 0x7f3b4017f070 2022-07-05T11:46:44.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.702+0000 7f3b46cbf700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4017f070 0x7f3b40163030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f3b3800c440 tx=0x7f3b38007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.703+0000 7f3b3e7fc700 1 -- 172.21.15.90:0/3193929666 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38012400 con 0x7f3b4017f070 2022-07-05T11:46:44.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.703+0000 7f3b3e7fc700 1 -- 172.21.15.90:0/3193929666 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b38012560 con 0x7f3b4017f070 2022-07-05T11:46:44.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.703+0000 7f3b3e7fc700 1 -- 172.21.15.90:0/3193929666 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38012900 con 0x7f3b4017f070 2022-07-05T11:46:44.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.703+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b40163b10 con 0x7f3b4017f070 2022-07-05T11:46:44.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.703+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b401640d0 con 0x7f3b4017f070 2022-07-05T11:46:44.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.703+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4006be40 con 0x7f3b4017f070 2022-07-05T11:46:44.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.704+0000 7f3b3e7fc700 1 -- 172.21.15.90:0/3193929666 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3b38019030 con 0x7f3b4017f070 2022-07-05T11:46:44.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.705+0000 7f3b3e7fc700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b2008ba40 0x7f3b2008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:44.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.705+0000 7f3b3e7fc700 1 -- 172.21.15.90:0/3193929666 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3b380afa00 con 0x7f3b4017f070 2022-07-05T11:46:44.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.705+0000 7f3b464be700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b2008ba40 0x7f3b2008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:44.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.706+0000 7f3b464be700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b2008ba40 0x7f3b2008df00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3b3000d380 tx=0x7f3b30007500).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:44.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.709+0000 7f3b3e7fc700 1 -- 172.21.15.90:0/3193929666 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3b380806c0 con 0x7f3b4017f070 2022-07-05T11:46:44.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.868+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 --> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b400c4030 con 0x7f3b2008ba40 2022-07-05T11:46:44.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.881+0000 7f3b3e7fc700 1 -- 172.21.15.90:0/3193929666 <== mgr.4105 v2:172.21.15.110:6800/36906 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434329 (secure 0 0 0) 0x7f3b400c4030 con 0x7f3b2008ba40 2022-07-05T11:46:44.889 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:44.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b2008ba40 msgr2=0x7f3b2008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b2008ba40 0x7f3b2008df00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3b3000d380 tx=0x7f3b30007500).stop 2022-07-05T11:46:44.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4017f070 msgr2=0x7f3b40163030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:44.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4017f070 0x7f3b40163030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f3b3800c440 tx=0x7f3b38007da0).stop 2022-07-05T11:46:44.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 shutdown_connections 2022-07-05T11:46:44.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3b2008ba40 0x7f3b2008df00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4017f070 0x7f3b40163030 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b400c7d00 0x7f3b40196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 --2- 172.21.15.90:0/3193929666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b4017da60 0x7f3b40162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:44.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.884+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 >> 172.21.15.90:0/3193929666 conn(0x7f3b400f4b70 msgr2=0x7f3b400c4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:44.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.885+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 shutdown_connections 2022-07-05T11:46:44.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:44.885+0000 7f3b48722700 1 -- 172.21.15.90:0/3193929666 wait complete. 2022-07-05T11:46:44.897 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2022-07-05T11:46:44.898 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2022-07-05T11:46:43.125940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7400,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":141,"num_read_kb":83,"num_write":130,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":64192,"kb_used_data":4000,"kb_used_omap":0,"kb_used_meta":60096,"kb_avail":1132397888,"statfs":{"total":1159641169920,"available":1159575437312,"internally_reserved":0,"allocated":4096000,"data_stored":1977484,"data_compressed":167460,"data_compressed_allocated":245760,"data_compressed_original":491520,"omap_allocated":0,"internal_metadata":61538304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":46,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004062"},"pg_stats":[{"pgid":"3.3f","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360284+0000","last_change":"2022-07-05T11:46:04.211228+0000","last_active":"2022-07-05T11:46:21.360284+0000","last_peered":"2022-07-05T11:46:21.360284+0000","last_clean":"2022-07-05T11:46:21.360284+0000","last_became_active":"2022-07-05T11:46:04.210963+0000","last_became_peered":"2022-07-05T11:46:04.210963+0000","last_unstale":"2022-07-05T11:46:21.360284+0000","last_undegraded":"2022-07-05T11:46:21.360284+0000","last_fullsized":"2022-07-05T11:46:21.360284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029059+0000","last_change":"2022-07-05T11:46:04.590106+0000","last_active":"2022-07-05T11:46:09.029059+0000","last_peered":"2022-07-05T11:46:09.029059+0000","last_clean":"2022-07-05T11:46:09.029059+0000","last_became_active":"2022-07-05T11:46:04.589807+0000","last_became_peered":"2022-07-05T11:46:04.589807+0000","last_unstale":"2022-07-05T11:46:09.029059+0000","last_undegraded":"2022-07-05T11:46:09.029059+0000","last_fullsized":"2022-07-05T11:46:09.029059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.408147+0000","last_change":"2022-07-05T11:46:04.202921+0000","last_active":"2022-07-05T11:46:10.408147+0000","last_peered":"2022-07-05T11:46:10.408147+0000","last_clean":"2022-07-05T11:46:10.408147+0000","last_became_active":"2022-07-05T11:46:04.202631+0000","last_became_peered":"2022-07-05T11:46:04.202631+0000","last_unstale":"2022-07-05T11:46:10.408147+0000","last_undegraded":"2022-07-05T11:46:10.408147+0000","last_fullsized":"2022-07-05T11:46:10.408147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028341+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.028341+0000","last_peered":"2022-07-05T11:46:09.028341+0000","last_clean":"2022-07-05T11:46:09.028341+0000","last_became_active":"2022-07-05T11:46:04.595253+0000","last_became_peered":"2022-07-05T11:46:04.595253+0000","last_unstale":"2022-07-05T11:46:09.028341+0000","last_undegraded":"2022-07-05T11:46:09.028341+0000","last_fullsized":"2022-07-05T11:46:09.028341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360892+0000","last_change":"2022-07-05T11:46:04.211131+0000","last_active":"2022-07-05T11:46:21.360892+0000","last_peered":"2022-07-05T11:46:21.360892+0000","last_clean":"2022-07-05T11:46:21.360892+0000","last_became_active":"2022-07-05T11:46:04.210828+0000","last_became_peered":"2022-07-05T11:46:04.210828+0000","last_unstale":"2022-07-05T11:46:21.360892+0000","last_undegraded":"2022-07-05T11:46:21.360892+0000","last_fullsized":"2022-07-05T11:46:21.360892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012401+0000","last_change":"2022-07-05T11:46:04.592905+0000","last_active":"2022-07-05T11:46:09.012401+0000","last_peered":"2022-07-05T11:46:09.012401+0000","last_clean":"2022-07-05T11:46:09.012401+0000","last_became_active":"2022-07-05T11:46:04.592593+0000","last_became_peered":"2022-07-05T11:46:04.592593+0000","last_unstale":"2022-07-05T11:46:09.012401+0000","last_undegraded":"2022-07-05T11:46:09.012401+0000","last_fullsized":"2022-07-05T11:46:09.012401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012779+0000","last_change":"2022-07-05T11:46:04.209903+0000","last_active":"2022-07-05T11:46:09.012779+0000","last_peered":"2022-07-05T11:46:09.012779+0000","last_clean":"2022-07-05T11:46:09.012779+0000","last_became_active":"2022-07-05T11:46:04.204575+0000","last_became_peered":"2022-07-05T11:46:04.204575+0000","last_unstale":"2022-07-05T11:46:09.012779+0000","last_undegraded":"2022-07-05T11:46:09.012779+0000","last_fullsized":"2022-07-05T11:46:09.012779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974869+0000","last_change":"2022-07-05T11:46:04.595822+0000","last_active":"2022-07-05T11:46:08.974869+0000","last_peered":"2022-07-05T11:46:08.974869+0000","last_clean":"2022-07-05T11:46:08.974869+0000","last_became_active":"2022-07-05T11:46:04.595306+0000","last_became_peered":"2022-07-05T11:46:04.595306+0000","last_unstale":"2022-07-05T11:46:08.974869+0000","last_undegraded":"2022-07-05T11:46:08.974869+0000","last_fullsized":"2022-07-05T11:46:08.974869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"25'1","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029038+0000","last_change":"2022-07-05T11:46:04.202298+0000","last_active":"2022-07-05T11:46:09.029038+0000","last_peered":"2022-07-05T11:46:09.029038+0000","last_clean":"2022-07-05T11:46:09.029038+0000","last_became_active":"2022-07-05T11:46:04.202010+0000","last_became_peered":"2022-07-05T11:46:04.202010+0000","last_unstale":"2022-07-05T11:46:09.029038+0000","last_undegraded":"2022-07-05T11:46:09.029038+0000","last_fullsized":"2022-07-05T11:46:09.029038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029758+0000","last_change":"2022-07-05T11:46:04.590970+0000","last_active":"2022-07-05T11:46:09.029758+0000","last_peered":"2022-07-05T11:46:09.029758+0000","last_clean":"2022-07-05T11:46:09.029758+0000","last_became_active":"2022-07-05T11:46:04.590714+0000","last_became_peered":"2022-07-05T11:46:04.590714+0000","last_unstale":"2022-07-05T11:46:09.029758+0000","last_undegraded":"2022-07-05T11:46:09.029758+0000","last_fullsized":"2022-07-05T11:46:09.029758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358625+0000","last_change":"2022-07-05T11:46:04.204607+0000","last_active":"2022-07-05T11:46:21.358625+0000","last_peered":"2022-07-05T11:46:21.358625+0000","last_clean":"2022-07-05T11:46:21.358625+0000","last_became_active":"2022-07-05T11:46:04.204287+0000","last_became_peered":"2022-07-05T11:46:04.204287+0000","last_unstale":"2022-07-05T11:46:21.358625+0000","last_undegraded":"2022-07-05T11:46:21.358625+0000","last_fullsized":"2022-07-05T11:46:21.358625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012802+0000","last_change":"2022-07-05T11:46:04.606655+0000","last_active":"2022-07-05T11:46:09.012802+0000","last_peered":"2022-07-05T11:46:09.012802+0000","last_clean":"2022-07-05T11:46:09.012802+0000","last_became_active":"2022-07-05T11:46:04.606370+0000","last_became_peered":"2022-07-05T11:46:04.606370+0000","last_unstale":"2022-07-05T11:46:09.012802+0000","last_undegraded":"2022-07-05T11:46:09.012802+0000","last_fullsized":"2022-07-05T11:46:09.012802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360703+0000","last_change":"2022-07-05T11:46:04.206427+0000","last_active":"2022-07-05T11:46:21.360703+0000","last_peered":"2022-07-05T11:46:21.360703+0000","last_clean":"2022-07-05T11:46:21.360703+0000","last_became_active":"2022-07-05T11:46:04.206192+0000","last_became_peered":"2022-07-05T11:46:04.206192+0000","last_unstale":"2022-07-05T11:46:21.360703+0000","last_undegraded":"2022-07-05T11:46:21.360703+0000","last_fullsized":"2022-07-05T11:46:21.360703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028587+0000","last_change":"2022-07-05T11:46:04.599321+0000","last_active":"2022-07-05T11:46:09.028587+0000","last_peered":"2022-07-05T11:46:09.028587+0000","last_clean":"2022-07-05T11:46:09.028587+0000","last_became_active":"2022-07-05T11:46:04.597626+0000","last_became_peered":"2022-07-05T11:46:04.597626+0000","last_unstale":"2022-07-05T11:46:09.028587+0000","last_undegraded":"2022-07-05T11:46:09.028587+0000","last_fullsized":"2022-07-05T11:46:09.028587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407177+0000","last_change":"2022-07-05T11:46:04.204458+0000","last_active":"2022-07-05T11:46:10.407177+0000","last_peered":"2022-07-05T11:46:10.407177+0000","last_clean":"2022-07-05T11:46:10.407177+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:10.407177+0000","last_undegraded":"2022-07-05T11:46:10.407177+0000","last_fullsized":"2022-07-05T11:46:10.407177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028708+0000","last_change":"2022-07-05T11:46:04.598830+0000","last_active":"2022-07-05T11:46:09.028708+0000","last_peered":"2022-07-05T11:46:09.028708+0000","last_clean":"2022-07-05T11:46:09.028708+0000","last_became_active":"2022-07-05T11:46:04.597158+0000","last_became_peered":"2022-07-05T11:46:04.597158+0000","last_unstale":"2022-07-05T11:46:09.028708+0000","last_undegraded":"2022-07-05T11:46:09.028708+0000","last_fullsized":"2022-07-05T11:46:09.028708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029721+0000","last_change":"2022-07-05T11:46:04.207355+0000","last_active":"2022-07-05T11:46:09.029721+0000","last_peered":"2022-07-05T11:46:09.029721+0000","last_clean":"2022-07-05T11:46:09.029721+0000","last_became_active":"2022-07-05T11:46:04.207059+0000","last_became_peered":"2022-07-05T11:46:04.207059+0000","last_unstale":"2022-07-05T11:46:09.029721+0000","last_undegraded":"2022-07-05T11:46:09.029721+0000","last_fullsized":"2022-07-05T11:46:09.029721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012425+0000","last_change":"2022-07-05T11:46:04.595782+0000","last_active":"2022-07-05T11:46:09.012425+0000","last_peered":"2022-07-05T11:46:09.012425+0000","last_clean":"2022-07-05T11:46:09.012425+0000","last_became_active":"2022-07-05T11:46:04.595530+0000","last_became_peered":"2022-07-05T11:46:04.595530+0000","last_unstale":"2022-07-05T11:46:09.012425+0000","last_undegraded":"2022-07-05T11:46:09.012425+0000","last_fullsized":"2022-07-05T11:46:09.012425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.351876+0000","last_change":"2022-07-05T11:46:04.210209+0000","last_active":"2022-07-05T11:46:20.351876+0000","last_peered":"2022-07-05T11:46:20.351876+0000","last_clean":"2022-07-05T11:46:20.351876+0000","last_became_active":"2022-07-05T11:46:04.209883+0000","last_became_peered":"2022-07-05T11:46:04.209883+0000","last_unstale":"2022-07-05T11:46:20.351876+0000","last_undegraded":"2022-07-05T11:46:20.351876+0000","last_fullsized":"2022-07-05T11:46:20.351876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028150+0000","last_change":"2022-07-05T11:46:04.600375+0000","last_active":"2022-07-05T11:46:09.028150+0000","last_peered":"2022-07-05T11:46:09.028150+0000","last_clean":"2022-07-05T11:46:09.028150+0000","last_became_active":"2022-07-05T11:46:04.600101+0000","last_became_peered":"2022-07-05T11:46:04.600101+0000","last_unstale":"2022-07-05T11:46:09.028150+0000","last_undegraded":"2022-07-05T11:46:09.028150+0000","last_fullsized":"2022-07-05T11:46:09.028150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030246+0000","last_change":"2022-07-05T11:46:04.204891+0000","last_active":"2022-07-05T11:46:09.030246+0000","last_peered":"2022-07-05T11:46:09.030246+0000","last_clean":"2022-07-05T11:46:09.030246+0000","last_became_active":"2022-07-05T11:46:04.204619+0000","last_became_peered":"2022-07-05T11:46:04.204619+0000","last_unstale":"2022-07-05T11:46:09.030246+0000","last_undegraded":"2022-07-05T11:46:09.030246+0000","last_fullsized":"2022-07-05T11:46:09.030246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028234+0000","last_change":"2022-07-05T11:46:04.600335+0000","last_active":"2022-07-05T11:46:09.028234+0000","last_peered":"2022-07-05T11:46:09.028234+0000","last_clean":"2022-07-05T11:46:09.028234+0000","last_became_active":"2022-07-05T11:46:04.600026+0000","last_became_peered":"2022-07-05T11:46:04.600026+0000","last_unstale":"2022-07-05T11:46:09.028234+0000","last_undegraded":"2022-07-05T11:46:09.028234+0000","last_fullsized":"2022-07-05T11:46:09.028234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'9","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.387268+0000","last_change":"2022-07-05T11:46:04.210563+0000","last_active":"2022-07-05T11:46:40.387268+0000","last_peered":"2022-07-05T11:46:40.387268+0000","last_clean":"2022-07-05T11:46:40.387268+0000","last_became_active":"2022-07-05T11:46:04.210264+0000","last_became_peered":"2022-07-05T11:46:04.210264+0000","last_unstale":"2022-07-05T11:46:40.387268+0000","last_undegraded":"2022-07-05T11:46:40.387268+0000","last_fullsized":"2022-07-05T11:46:40.387268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3070,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975654+0000","last_change":"2022-07-05T11:46:04.596566+0000","last_active":"2022-07-05T11:46:08.975654+0000","last_peered":"2022-07-05T11:46:08.975654+0000","last_clean":"2022-07-05T11:46:08.975654+0000","last_became_active":"2022-07-05T11:46:04.596385+0000","last_became_peered":"2022-07-05T11:46:04.596385+0000","last_unstale":"2022-07-05T11:46:08.975654+0000","last_undegraded":"2022-07-05T11:46:08.975654+0000","last_fullsized":"2022-07-05T11:46:08.975654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359717+0000","last_change":"2022-07-05T11:46:04.205836+0000","last_active":"2022-07-05T11:46:21.359717+0000","last_peered":"2022-07-05T11:46:21.359717+0000","last_clean":"2022-07-05T11:46:21.359717+0000","last_became_active":"2022-07-05T11:46:04.205522+0000","last_became_peered":"2022-07-05T11:46:04.205522+0000","last_unstale":"2022-07-05T11:46:21.359717+0000","last_undegraded":"2022-07-05T11:46:21.359717+0000","last_fullsized":"2022-07-05T11:46:21.359717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027942+0000","last_change":"2022-07-05T11:46:04.600047+0000","last_active":"2022-07-05T11:46:09.027942+0000","last_peered":"2022-07-05T11:46:09.027942+0000","last_clean":"2022-07-05T11:46:09.027942+0000","last_became_active":"2022-07-05T11:46:04.599735+0000","last_became_peered":"2022-07-05T11:46:04.599735+0000","last_unstale":"2022-07-05T11:46:09.027942+0000","last_undegraded":"2022-07-05T11:46:09.027942+0000","last_fullsized":"2022-07-05T11:46:09.027942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027527+0000","last_change":"2022-07-05T11:46:04.204754+0000","last_active":"2022-07-05T11:46:09.027527+0000","last_peered":"2022-07-05T11:46:09.027527+0000","last_clean":"2022-07-05T11:46:09.027527+0000","last_became_active":"2022-07-05T11:46:04.204466+0000","last_became_peered":"2022-07-05T11:46:04.204466+0000","last_unstale":"2022-07-05T11:46:09.027527+0000","last_undegraded":"2022-07-05T11:46:09.027527+0000","last_fullsized":"2022-07-05T11:46:09.027527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012900+0000","last_change":"2022-07-05T11:46:04.594552+0000","last_active":"2022-07-05T11:46:09.012900+0000","last_peered":"2022-07-05T11:46:09.012900+0000","last_clean":"2022-07-05T11:46:09.012900+0000","last_became_active":"2022-07-05T11:46:04.594285+0000","last_became_peered":"2022-07-05T11:46:04.594285+0000","last_unstale":"2022-07-05T11:46:09.012900+0000","last_undegraded":"2022-07-05T11:46:09.012900+0000","last_fullsized":"2022-07-05T11:46:09.012900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027421+0000","last_change":"2022-07-05T11:46:04.206416+0000","last_active":"2022-07-05T11:46:09.027421+0000","last_peered":"2022-07-05T11:46:09.027421+0000","last_clean":"2022-07-05T11:46:09.027421+0000","last_became_active":"2022-07-05T11:46:04.206118+0000","last_became_peered":"2022-07-05T11:46:04.206118+0000","last_unstale":"2022-07-05T11:46:09.027421+0000","last_undegraded":"2022-07-05T11:46:09.027421+0000","last_fullsized":"2022-07-05T11:46:09.027421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975854+0000","last_change":"2022-07-05T11:46:04.596814+0000","last_active":"2022-07-05T11:46:08.975854+0000","last_peered":"2022-07-05T11:46:08.975854+0000","last_clean":"2022-07-05T11:46:08.975854+0000","last_became_active":"2022-07-05T11:46:04.596492+0000","last_became_peered":"2022-07-05T11:46:04.596492+0000","last_unstale":"2022-07-05T11:46:08.975854+0000","last_undegraded":"2022-07-05T11:46:08.975854+0000","last_fullsized":"2022-07-05T11:46:08.975854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'10","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359758+0000","last_change":"2022-07-05T11:46:04.208748+0000","last_active":"2022-07-05T11:46:21.359758+0000","last_peered":"2022-07-05T11:46:21.359758+0000","last_clean":"2022-07-05T11:46:21.359758+0000","last_became_active":"2022-07-05T11:46:04.208440+0000","last_became_peered":"2022-07-05T11:46:04.208440+0000","last_unstale":"2022-07-05T11:46:21.359758+0000","last_undegraded":"2022-07-05T11:46:21.359758+0000","last_fullsized":"2022-07-05T11:46:21.359758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974079+0000","last_change":"2022-07-05T11:46:04.592371+0000","last_active":"2022-07-05T11:46:08.974079+0000","last_peered":"2022-07-05T11:46:08.974079+0000","last_clean":"2022-07-05T11:46:08.974079+0000","last_became_active":"2022-07-05T11:46:04.592201+0000","last_became_peered":"2022-07-05T11:46:04.592201+0000","last_unstale":"2022-07-05T11:46:08.974079+0000","last_undegraded":"2022-07-05T11:46:08.974079+0000","last_fullsized":"2022-07-05T11:46:08.974079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.982904+0000","last_change":"2022-07-05T11:46:04.211261+0000","last_active":"2022-07-05T11:46:09.982904+0000","last_peered":"2022-07-05T11:46:09.982904+0000","last_clean":"2022-07-05T11:46:09.982904+0000","last_became_active":"2022-07-05T11:46:04.211004+0000","last_became_peered":"2022-07-05T11:46:04.211004+0000","last_unstale":"2022-07-05T11:46:09.982904+0000","last_undegraded":"2022-07-05T11:46:09.982904+0000","last_fullsized":"2022-07-05T11:46:09.982904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974789+0000","last_change":"2022-07-05T11:46:04.597787+0000","last_active":"2022-07-05T11:46:08.974789+0000","last_peered":"2022-07-05T11:46:08.974789+0000","last_clean":"2022-07-05T11:46:08.974789+0000","last_became_active":"2022-07-05T11:46:04.597433+0000","last_became_peered":"2022-07-05T11:46:04.597433+0000","last_unstale":"2022-07-05T11:46:08.974789+0000","last_undegraded":"2022-07-05T11:46:08.974789+0000","last_fullsized":"2022-07-05T11:46:08.974789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974038+0000","last_change":"2022-07-05T11:46:04.211347+0000","last_active":"2022-07-05T11:46:08.974038+0000","last_peered":"2022-07-05T11:46:08.974038+0000","last_clean":"2022-07-05T11:46:08.974038+0000","last_became_active":"2022-07-05T11:46:04.211045+0000","last_became_peered":"2022-07-05T11:46:04.211045+0000","last_unstale":"2022-07-05T11:46:08.974038+0000","last_undegraded":"2022-07-05T11:46:08.974038+0000","last_fullsized":"2022-07-05T11:46:08.974038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973840+0000","last_change":"2022-07-05T11:46:04.587177+0000","last_active":"2022-07-05T11:46:08.973840+0000","last_peered":"2022-07-05T11:46:08.973840+0000","last_clean":"2022-07-05T11:46:08.973840+0000","last_became_active":"2022-07-05T11:46:04.586915+0000","last_became_peered":"2022-07-05T11:46:04.586915+0000","last_unstale":"2022-07-05T11:46:08.973840+0000","last_undegraded":"2022-07-05T11:46:08.973840+0000","last_fullsized":"2022-07-05T11:46:08.973840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317123+0000","last_change":"2022-07-05T11:46:04.213135+0000","last_active":"2022-07-05T11:46:10.317123+0000","last_peered":"2022-07-05T11:46:10.317123+0000","last_clean":"2022-07-05T11:46:10.317123+0000","last_became_active":"2022-07-05T11:46:04.212877+0000","last_became_peered":"2022-07-05T11:46:04.212877+0000","last_unstale":"2022-07-05T11:46:10.317123+0000","last_undegraded":"2022-07-05T11:46:10.317123+0000","last_fullsized":"2022-07-05T11:46:10.317123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975178+0000","last_change":"2022-07-05T11:46:04.598414+0000","last_active":"2022-07-05T11:46:08.975178+0000","last_peered":"2022-07-05T11:46:08.975178+0000","last_clean":"2022-07-05T11:46:08.975178+0000","last_became_active":"2022-07-05T11:46:04.595082+0000","last_became_peered":"2022-07-05T11:46:04.595082+0000","last_unstale":"2022-07-05T11:46:08.975178+0000","last_undegraded":"2022-07-05T11:46:08.975178+0000","last_fullsized":"2022-07-05T11:46:08.975178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360365+0000","last_change":"2022-07-05T11:46:04.208533+0000","last_active":"2022-07-05T11:46:21.360365+0000","last_peered":"2022-07-05T11:46:21.360365+0000","last_clean":"2022-07-05T11:46:21.360365+0000","last_became_active":"2022-07-05T11:46:04.208198+0000","last_became_peered":"2022-07-05T11:46:04.208198+0000","last_unstale":"2022-07-05T11:46:21.360365+0000","last_undegraded":"2022-07-05T11:46:21.360365+0000","last_fullsized":"2022-07-05T11:46:21.360365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029685+0000","last_change":"2022-07-05T11:46:04.590329+0000","last_active":"2022-07-05T11:46:09.029685+0000","last_peered":"2022-07-05T11:46:09.029685+0000","last_clean":"2022-07-05T11:46:09.029685+0000","last_became_active":"2022-07-05T11:46:04.590046+0000","last_became_peered":"2022-07-05T11:46:04.590046+0000","last_unstale":"2022-07-05T11:46:09.029685+0000","last_undegraded":"2022-07-05T11:46:09.029685+0000","last_fullsized":"2022-07-05T11:46:09.029685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352181+0000","last_change":"2022-07-05T11:46:04.207526+0000","last_active":"2022-07-05T11:46:20.352181+0000","last_peered":"2022-07-05T11:46:20.352181+0000","last_clean":"2022-07-05T11:46:20.352181+0000","last_became_active":"2022-07-05T11:46:04.207209+0000","last_became_peered":"2022-07-05T11:46:04.207209+0000","last_unstale":"2022-07-05T11:46:20.352181+0000","last_undegraded":"2022-07-05T11:46:20.352181+0000","last_fullsized":"2022-07-05T11:46:20.352181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029663+0000","last_change":"2022-07-05T11:46:04.590203+0000","last_active":"2022-07-05T11:46:09.029663+0000","last_peered":"2022-07-05T11:46:09.029663+0000","last_clean":"2022-07-05T11:46:09.029663+0000","last_became_active":"2022-07-05T11:46:04.589893+0000","last_became_peered":"2022-07-05T11:46:04.589893+0000","last_unstale":"2022-07-05T11:46:09.029663+0000","last_undegraded":"2022-07-05T11:46:09.029663+0000","last_fullsized":"2022-07-05T11:46:09.029663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407980+0000","last_change":"2022-07-05T11:46:04.207726+0000","last_active":"2022-07-05T11:46:10.407980+0000","last_peered":"2022-07-05T11:46:10.407980+0000","last_clean":"2022-07-05T11:46:10.407980+0000","last_became_active":"2022-07-05T11:46:04.207398+0000","last_became_peered":"2022-07-05T11:46:04.207398+0000","last_unstale":"2022-07-05T11:46:10.407980+0000","last_undegraded":"2022-07-05T11:46:10.407980+0000","last_fullsized":"2022-07-05T11:46:10.407980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028460+0000","last_change":"2022-07-05T11:46:04.598660+0000","last_active":"2022-07-05T11:46:09.028460+0000","last_peered":"2022-07-05T11:46:09.028460+0000","last_clean":"2022-07-05T11:46:09.028460+0000","last_became_active":"2022-07-05T11:46:04.598419+0000","last_became_peered":"2022-07-05T11:46:04.598419+0000","last_unstale":"2022-07-05T11:46:09.028460+0000","last_undegraded":"2022-07-05T11:46:09.028460+0000","last_fullsized":"2022-07-05T11:46:09.028460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028769+0000","last_change":"2022-07-05T11:46:04.214164+0000","last_active":"2022-07-05T11:46:09.028769+0000","last_peered":"2022-07-05T11:46:09.028769+0000","last_clean":"2022-07-05T11:46:09.028769+0000","last_became_active":"2022-07-05T11:46:04.213794+0000","last_became_peered":"2022-07-05T11:46:04.213794+0000","last_unstale":"2022-07-05T11:46:09.028769+0000","last_undegraded":"2022-07-05T11:46:09.028769+0000","last_fullsized":"2022-07-05T11:46:09.028769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.599315+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.599091+0000","last_became_peered":"2022-07-05T11:46:04.599091+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353175+0000","last_change":"2022-07-05T11:46:04.208200+0000","last_active":"2022-07-05T11:46:20.353175+0000","last_peered":"2022-07-05T11:46:20.353175+0000","last_clean":"2022-07-05T11:46:20.353175+0000","last_became_active":"2022-07-05T11:46:04.207891+0000","last_became_peered":"2022-07-05T11:46:04.207891+0000","last_unstale":"2022-07-05T11:46:20.353175+0000","last_undegraded":"2022-07-05T11:46:20.353175+0000","last_fullsized":"2022-07-05T11:46:20.353175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028740+0000","last_change":"2022-07-05T11:46:04.594011+0000","last_active":"2022-07-05T11:46:09.028740+0000","last_peered":"2022-07-05T11:46:09.028740+0000","last_clean":"2022-07-05T11:46:09.028740+0000","last_became_active":"2022-07-05T11:46:04.593800+0000","last_became_peered":"2022-07-05T11:46:04.593800+0000","last_unstale":"2022-07-05T11:46:09.028740+0000","last_undegraded":"2022-07-05T11:46:09.028740+0000","last_fullsized":"2022-07-05T11:46:09.028740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353238+0000","last_change":"2022-07-05T11:46:04.206715+0000","last_active":"2022-07-05T11:46:20.353238+0000","last_peered":"2022-07-05T11:46:20.353238+0000","last_clean":"2022-07-05T11:46:20.353238+0000","last_became_active":"2022-07-05T11:46:04.206230+0000","last_became_peered":"2022-07-05T11:46:04.206230+0000","last_unstale":"2022-07-05T11:46:20.353238+0000","last_undegraded":"2022-07-05T11:46:20.353238+0000","last_fullsized":"2022-07-05T11:46:20.353238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029238+0000","last_change":"2022-07-05T11:46:04.590527+0000","last_active":"2022-07-05T11:46:09.029238+0000","last_peered":"2022-07-05T11:46:09.029238+0000","last_clean":"2022-07-05T11:46:09.029238+0000","last_became_active":"2022-07-05T11:46:04.589992+0000","last_became_peered":"2022-07-05T11:46:04.589992+0000","last_unstale":"2022-07-05T11:46:09.029238+0000","last_undegraded":"2022-07-05T11:46:09.029238+0000","last_fullsized":"2022-07-05T11:46:09.029238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317357+0000","last_change":"2022-07-05T11:46:04.209943+0000","last_active":"2022-07-05T11:46:10.317357+0000","last_peered":"2022-07-05T11:46:10.317357+0000","last_clean":"2022-07-05T11:46:10.317357+0000","last_became_active":"2022-07-05T11:46:04.209640+0000","last_became_peered":"2022-07-05T11:46:04.209640+0000","last_unstale":"2022-07-05T11:46:10.317357+0000","last_undegraded":"2022-07-05T11:46:10.317357+0000","last_fullsized":"2022-07-05T11:46:10.317357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028615+0000","last_change":"2022-07-05T11:46:04.593997+0000","last_active":"2022-07-05T11:46:09.028615+0000","last_peered":"2022-07-05T11:46:09.028615+0000","last_clean":"2022-07-05T11:46:09.028615+0000","last_became_active":"2022-07-05T11:46:04.593708+0000","last_became_peered":"2022-07-05T11:46:04.593708+0000","last_unstale":"2022-07-05T11:46:09.028615+0000","last_undegraded":"2022-07-05T11:46:09.028615+0000","last_fullsized":"2022-07-05T11:46:09.028615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352932+0000","last_change":"2022-07-05T11:46:04.203818+0000","last_active":"2022-07-05T11:46:20.352932+0000","last_peered":"2022-07-05T11:46:20.352932+0000","last_clean":"2022-07-05T11:46:20.352932+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:20.352932+0000","last_undegraded":"2022-07-05T11:46:20.352932+0000","last_fullsized":"2022-07-05T11:46:20.352932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975098+0000","last_change":"2022-07-05T11:46:04.598669+0000","last_active":"2022-07-05T11:46:08.975098+0000","last_peered":"2022-07-05T11:46:08.975098+0000","last_clean":"2022-07-05T11:46:08.975098+0000","last_became_active":"2022-07-05T11:46:04.598400+0000","last_became_peered":"2022-07-05T11:46:04.598400+0000","last_unstale":"2022-07-05T11:46:08.975098+0000","last_undegraded":"2022-07-05T11:46:08.975098+0000","last_fullsized":"2022-07-05T11:46:08.975098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028775+0000","last_change":"2022-07-05T11:46:04.212247+0000","last_active":"2022-07-05T11:46:09.028775+0000","last_peered":"2022-07-05T11:46:09.028775+0000","last_clean":"2022-07-05T11:46:09.028775+0000","last_became_active":"2022-07-05T11:46:04.211958+0000","last_became_peered":"2022-07-05T11:46:04.211958+0000","last_unstale":"2022-07-05T11:46:09.028775+0000","last_undegraded":"2022-07-05T11:46:09.028775+0000","last_fullsized":"2022-07-05T11:46:09.028775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029158+0000","last_change":"2022-07-05T11:46:04.599477+0000","last_active":"2022-07-05T11:46:09.029158+0000","last_peered":"2022-07-05T11:46:09.029158+0000","last_clean":"2022-07-05T11:46:09.029158+0000","last_became_active":"2022-07-05T11:46:04.599214+0000","last_became_peered":"2022-07-05T11:46:04.599214+0000","last_unstale":"2022-07-05T11:46:09.029158+0000","last_undegraded":"2022-07-05T11:46:09.029158+0000","last_fullsized":"2022-07-05T11:46:09.029158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027608+0000","last_change":"2022-07-05T11:46:04.209196+0000","last_active":"2022-07-05T11:46:09.027608+0000","last_peered":"2022-07-05T11:46:09.027608+0000","last_clean":"2022-07-05T11:46:09.027608+0000","last_became_active":"2022-07-05T11:46:04.208918+0000","last_became_peered":"2022-07-05T11:46:04.208918+0000","last_unstale":"2022-07-05T11:46:09.027608+0000","last_undegraded":"2022-07-05T11:46:09.027608+0000","last_fullsized":"2022-07-05T11:46:09.027608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975167+0000","last_change":"2022-07-05T11:46:04.594414+0000","last_active":"2022-07-05T11:46:08.975167+0000","last_peered":"2022-07-05T11:46:08.975167+0000","last_clean":"2022-07-05T11:46:08.975167+0000","last_became_active":"2022-07-05T11:46:04.594114+0000","last_became_peered":"2022-07-05T11:46:04.594114+0000","last_unstale":"2022-07-05T11:46:08.975167+0000","last_undegraded":"2022-07-05T11:46:08.975167+0000","last_fullsized":"2022-07-05T11:46:08.975167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027763+0000","last_change":"2022-07-05T11:46:04.215006+0000","last_active":"2022-07-05T11:46:09.027763+0000","last_peered":"2022-07-05T11:46:09.027763+0000","last_clean":"2022-07-05T11:46:09.027763+0000","last_became_active":"2022-07-05T11:46:04.214585+0000","last_became_peered":"2022-07-05T11:46:04.214585+0000","last_unstale":"2022-07-05T11:46:09.027763+0000","last_undegraded":"2022-07-05T11:46:09.027763+0000","last_fullsized":"2022-07-05T11:46:09.027763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030101+0000","last_change":"2022-07-05T11:46:04.601912+0000","last_active":"2022-07-05T11:46:09.030101+0000","last_peered":"2022-07-05T11:46:09.030101+0000","last_clean":"2022-07-05T11:46:09.030101+0000","last_became_active":"2022-07-05T11:46:04.601605+0000","last_became_peered":"2022-07-05T11:46:04.601605+0000","last_unstale":"2022-07-05T11:46:09.030101+0000","last_undegraded":"2022-07-05T11:46:09.030101+0000","last_fullsized":"2022-07-05T11:46:09.030101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.387919+0000","last_change":"2022-07-05T11:46:04.208064+0000","last_active":"2022-07-05T11:46:40.387919+0000","last_peered":"2022-07-05T11:46:40.387919+0000","last_clean":"2022-07-05T11:46:40.387919+0000","last_became_active":"2022-07-05T11:46:04.207845+0000","last_became_peered":"2022-07-05T11:46:04.207845+0000","last_unstale":"2022-07-05T11:46:40.387919+0000","last_undegraded":"2022-07-05T11:46:40.387919+0000","last_fullsized":"2022-07-05T11:46:40.387919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030056+0000","last_change":"2022-07-05T11:46:04.589990+0000","last_active":"2022-07-05T11:46:09.030056+0000","last_peered":"2022-07-05T11:46:09.030056+0000","last_clean":"2022-07-05T11:46:09.030056+0000","last_became_active":"2022-07-05T11:46:04.589734+0000","last_became_peered":"2022-07-05T11:46:04.589734+0000","last_unstale":"2022-07-05T11:46:09.030056+0000","last_undegraded":"2022-07-05T11:46:09.030056+0000","last_fullsized":"2022-07-05T11:46:09.030056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974955+0000","last_change":"2022-07-05T11:46:04.208275+0000","last_active":"2022-07-05T11:46:08.974955+0000","last_peered":"2022-07-05T11:46:08.974955+0000","last_clean":"2022-07-05T11:46:08.974955+0000","last_became_active":"2022-07-05T11:46:04.208001+0000","last_became_peered":"2022-07-05T11:46:04.208001+0000","last_unstale":"2022-07-05T11:46:08.974955+0000","last_undegraded":"2022-07-05T11:46:08.974955+0000","last_fullsized":"2022-07-05T11:46:08.974955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028628+0000","last_change":"2022-07-05T11:46:04.597446+0000","last_active":"2022-07-05T11:46:09.028628+0000","last_peered":"2022-07-05T11:46:09.028628+0000","last_clean":"2022-07-05T11:46:09.028628+0000","last_became_active":"2022-07-05T11:46:04.596828+0000","last_became_peered":"2022-07-05T11:46:04.596828+0000","last_unstale":"2022-07-05T11:46:09.028628+0000","last_undegraded":"2022-07-05T11:46:09.028628+0000","last_fullsized":"2022-07-05T11:46:09.028628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360630+0000","last_change":"2022-07-05T11:46:04.211080+0000","last_active":"2022-07-05T11:46:21.360630+0000","last_peered":"2022-07-05T11:46:21.360630+0000","last_clean":"2022-07-05T11:46:21.360630+0000","last_became_active":"2022-07-05T11:46:04.210805+0000","last_became_peered":"2022-07-05T11:46:04.210805+0000","last_unstale":"2022-07-05T11:46:21.360630+0000","last_undegraded":"2022-07-05T11:46:21.360630+0000","last_fullsized":"2022-07-05T11:46:21.360630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012330+0000","last_change":"2022-07-05T11:46:04.594116+0000","last_active":"2022-07-05T11:46:09.012330+0000","last_peered":"2022-07-05T11:46:09.012330+0000","last_clean":"2022-07-05T11:46:09.012330+0000","last_became_active":"2022-07-05T11:46:04.593716+0000","last_became_peered":"2022-07-05T11:46:04.593716+0000","last_unstale":"2022-07-05T11:46:09.012330+0000","last_undegraded":"2022-07-05T11:46:09.012330+0000","last_fullsized":"2022-07-05T11:46:09.012330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017611+0000","last_change":"2022-07-05T11:46:09.014114+0000","last_active":"2022-07-05T11:46:09.017611+0000","last_peered":"2022-07-05T11:46:09.017611+0000","last_clean":"2022-07-05T11:46:09.017611+0000","last_became_active":"2022-07-05T11:46:09.013707+0000","last_became_peered":"2022-07-05T11:46:09.013707+0000","last_unstale":"2022-07-05T11:46:09.017611+0000","last_undegraded":"2022-07-05T11:46:09.017611+0000","last_fullsized":"2022-07-05T11:46:09.017611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029324+0000","last_change":"2022-07-05T11:46:04.213375+0000","last_active":"2022-07-05T11:46:09.029324+0000","last_peered":"2022-07-05T11:46:09.029324+0000","last_clean":"2022-07-05T11:46:09.029324+0000","last_became_active":"2022-07-05T11:46:04.213094+0000","last_became_peered":"2022-07-05T11:46:04.213094+0000","last_unstale":"2022-07-05T11:46:09.029324+0000","last_undegraded":"2022-07-05T11:46:09.029324+0000","last_fullsized":"2022-07-05T11:46:09.029324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027648+0000","last_change":"2022-07-05T11:46:04.599779+0000","last_active":"2022-07-05T11:46:09.027648+0000","last_peered":"2022-07-05T11:46:09.027648+0000","last_clean":"2022-07-05T11:46:09.027648+0000","last_became_active":"2022-07-05T11:46:04.597330+0000","last_became_peered":"2022-07-05T11:46:04.597330+0000","last_unstale":"2022-07-05T11:46:09.027648+0000","last_undegraded":"2022-07-05T11:46:09.027648+0000","last_fullsized":"2022-07-05T11:46:09.027648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012222+0000","last_change":"2022-07-05T11:46:08.615050+0000","last_active":"2022-07-05T11:46:09.012222+0000","last_peered":"2022-07-05T11:46:09.012222+0000","last_clean":"2022-07-05T11:46:09.012222+0000","last_became_active":"2022-07-05T11:46:08.614715+0000","last_became_peered":"2022-07-05T11:46:08.614715+0000","last_unstale":"2022-07-05T11:46:09.012222+0000","last_undegraded":"2022-07-05T11:46:09.012222+0000","last_fullsized":"2022-07-05T11:46:09.012222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975318+0000","last_change":"2022-07-05T11:46:04.206835+0000","last_active":"2022-07-05T11:46:08.975318+0000","last_peered":"2022-07-05T11:46:08.975318+0000","last_clean":"2022-07-05T11:46:08.975318+0000","last_became_active":"2022-07-05T11:46:04.206389+0000","last_became_peered":"2022-07-05T11:46:04.206389+0000","last_unstale":"2022-07-05T11:46:08.975318+0000","last_undegraded":"2022-07-05T11:46:08.975318+0000","last_fullsized":"2022-07-05T11:46:08.975318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012352+0000","last_change":"2022-07-05T11:46:04.595704+0000","last_active":"2022-07-05T11:46:09.012352+0000","last_peered":"2022-07-05T11:46:09.012352+0000","last_clean":"2022-07-05T11:46:09.012352+0000","last_became_active":"2022-07-05T11:46:04.594581+0000","last_became_peered":"2022-07-05T11:46:04.594581+0000","last_unstale":"2022-07-05T11:46:09.012352+0000","last_undegraded":"2022-07-05T11:46:09.012352+0000","last_fullsized":"2022-07-05T11:46:09.012352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028313+0000","last_change":"2022-07-05T11:46:08.618434+0000","last_active":"2022-07-05T11:46:09.028313+0000","last_peered":"2022-07-05T11:46:09.028313+0000","last_clean":"2022-07-05T11:46:09.028313+0000","last_became_active":"2022-07-05T11:46:08.618022+0000","last_became_peered":"2022-07-05T11:46:08.618022+0000","last_unstale":"2022-07-05T11:46:09.028313+0000","last_undegraded":"2022-07-05T11:46:09.028313+0000","last_fullsized":"2022-07-05T11:46:09.028313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029453+0000","last_change":"2022-07-05T11:46:04.213103+0000","last_active":"2022-07-05T11:46:09.029453+0000","last_peered":"2022-07-05T11:46:09.029453+0000","last_clean":"2022-07-05T11:46:09.029453+0000","last_became_active":"2022-07-05T11:46:04.211627+0000","last_became_peered":"2022-07-05T11:46:04.211627+0000","last_unstale":"2022-07-05T11:46:09.029453+0000","last_undegraded":"2022-07-05T11:46:09.029453+0000","last_fullsized":"2022-07-05T11:46:09.029453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012463+0000","last_change":"2022-07-05T11:46:04.593912+0000","last_active":"2022-07-05T11:46:09.012463+0000","last_peered":"2022-07-05T11:46:09.012463+0000","last_clean":"2022-07-05T11:46:09.012463+0000","last_became_active":"2022-07-05T11:46:04.593631+0000","last_became_peered":"2022-07-05T11:46:04.593631+0000","last_unstale":"2022-07-05T11:46:09.012463+0000","last_undegraded":"2022-07-05T11:46:09.012463+0000","last_fullsized":"2022-07-05T11:46:09.012463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028223+0000","last_change":"2022-07-05T11:46:09.013932+0000","last_active":"2022-07-05T11:46:09.028223+0000","last_peered":"2022-07-05T11:46:09.028223+0000","last_clean":"2022-07-05T11:46:09.028223+0000","last_became_active":"2022-07-05T11:46:09.013609+0000","last_became_peered":"2022-07-05T11:46:09.013609+0000","last_unstale":"2022-07-05T11:46:09.028223+0000","last_undegraded":"2022-07-05T11:46:09.028223+0000","last_fullsized":"2022-07-05T11:46:09.028223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028226+0000","last_change":"2022-07-05T11:46:09.016568+0000","last_active":"2022-07-05T11:46:09.028226+0000","last_peered":"2022-07-05T11:46:09.028226+0000","last_clean":"2022-07-05T11:46:09.028226+0000","last_became_active":"2022-07-05T11:46:09.016162+0000","last_became_peered":"2022-07-05T11:46:09.016162+0000","last_unstale":"2022-07-05T11:46:09.028226+0000","last_undegraded":"2022-07-05T11:46:09.028226+0000","last_fullsized":"2022-07-05T11:46:09.028226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:41.395640+0000","last_change":"2022-07-05T11:46:04.208656+0000","last_active":"2022-07-05T11:46:41.395640+0000","last_peered":"2022-07-05T11:46:41.395640+0000","last_clean":"2022-07-05T11:46:41.395640+0000","last_became_active":"2022-07-05T11:46:04.208394+0000","last_became_peered":"2022-07-05T11:46:04.208394+0000","last_unstale":"2022-07-05T11:46:41.395640+0000","last_undegraded":"2022-07-05T11:46:41.395640+0000","last_fullsized":"2022-07-05T11:46:41.395640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":830,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027906+0000","last_change":"2022-07-05T11:46:04.600156+0000","last_active":"2022-07-05T11:46:09.027906+0000","last_peered":"2022-07-05T11:46:09.027906+0000","last_clean":"2022-07-05T11:46:09.027906+0000","last_became_active":"2022-07-05T11:46:04.599836+0000","last_became_peered":"2022-07-05T11:46:04.599836+0000","last_unstale":"2022-07-05T11:46:09.027906+0000","last_undegraded":"2022-07-05T11:46:09.027906+0000","last_fullsized":"2022-07-05T11:46:09.027906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027863+0000","last_change":"2022-07-05T11:46:04.599555+0000","last_active":"2022-07-05T11:46:09.027863+0000","last_peered":"2022-07-05T11:46:09.027863+0000","last_clean":"2022-07-05T11:46:09.027863+0000","last_became_active":"2022-07-05T11:46:04.597036+0000","last_became_peered":"2022-07-05T11:46:04.597036+0000","last_unstale":"2022-07-05T11:46:09.027863+0000","last_undegraded":"2022-07-05T11:46:09.027863+0000","last_fullsized":"2022-07-05T11:46:09.027863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.357392+0000","last_change":"2022-07-05T11:46:04.215037+0000","last_active":"2022-07-05T11:46:21.357392+0000","last_peered":"2022-07-05T11:46:21.357392+0000","last_clean":"2022-07-05T11:46:21.357392+0000","last_became_active":"2022-07-05T11:46:04.214699+0000","last_became_peered":"2022-07-05T11:46:04.214699+0000","last_unstale":"2022-07-05T11:46:21.357392+0000","last_undegraded":"2022-07-05T11:46:21.357392+0000","last_fullsized":"2022-07-05T11:46:21.357392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012966+0000","last_change":"2022-07-05T11:46:00.405416+0000","last_active":"2022-07-05T11:46:09.012966+0000","last_peered":"2022-07-05T11:46:09.012966+0000","last_clean":"2022-07-05T11:46:09.012966+0000","last_became_active":"2022-07-05T11:46:00.405179+0000","last_became_peered":"2022-07-05T11:46:00.405179+0000","last_unstale":"2022-07-05T11:46:09.012966+0000","last_undegraded":"2022-07-05T11:46:09.012966+0000","last_fullsized":"2022-07-05T11:46:09.012966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027570+0000","last_change":"2022-07-05T11:46:08.616541+0000","last_active":"2022-07-05T11:46:09.027570+0000","last_peered":"2022-07-05T11:46:09.027570+0000","last_clean":"2022-07-05T11:46:09.027570+0000","last_became_active":"2022-07-05T11:46:08.616124+0000","last_became_peered":"2022-07-05T11:46:08.616124+0000","last_unstale":"2022-07-05T11:46:09.027570+0000","last_undegraded":"2022-07-05T11:46:09.027570+0000","last_fullsized":"2022-07-05T11:46:09.027570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028425+0000","last_change":"2022-07-05T11:46:04.584095+0000","last_active":"2022-07-05T11:46:09.028425+0000","last_peered":"2022-07-05T11:46:09.028425+0000","last_clean":"2022-07-05T11:46:09.028425+0000","last_became_active":"2022-07-05T11:46:04.583806+0000","last_became_peered":"2022-07-05T11:46:04.583806+0000","last_unstale":"2022-07-05T11:46:09.028425+0000","last_undegraded":"2022-07-05T11:46:09.028425+0000","last_fullsized":"2022-07-05T11:46:09.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974096+0000","last_change":"2022-07-05T11:46:00.174377+0000","last_active":"2022-07-05T11:46:08.974096+0000","last_peered":"2022-07-05T11:46:08.974096+0000","last_clean":"2022-07-05T11:46:08.974096+0000","last_became_active":"2022-07-05T11:46:00.174041+0000","last_became_peered":"2022-07-05T11:46:00.174041+0000","last_unstale":"2022-07-05T11:46:08.974096+0000","last_undegraded":"2022-07-05T11:46:08.974096+0000","last_fullsized":"2022-07-05T11:46:08.974096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029651+0000","last_change":"2022-07-05T11:46:04.201186+0000","last_active":"2022-07-05T11:46:09.029651+0000","last_peered":"2022-07-05T11:46:09.029651+0000","last_clean":"2022-07-05T11:46:09.029651+0000","last_became_active":"2022-07-05T11:46:04.200331+0000","last_became_peered":"2022-07-05T11:46:04.200331+0000","last_unstale":"2022-07-05T11:46:09.029651+0000","last_undegraded":"2022-07-05T11:46:09.029651+0000","last_fullsized":"2022-07-05T11:46:09.029651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012267+0000","last_change":"2022-07-05T11:46:08.617187+0000","last_active":"2022-07-05T11:46:09.012267+0000","last_peered":"2022-07-05T11:46:09.012267+0000","last_clean":"2022-07-05T11:46:09.012267+0000","last_became_active":"2022-07-05T11:46:08.616787+0000","last_became_peered":"2022-07-05T11:46:08.616787+0000","last_unstale":"2022-07-05T11:46:09.012267+0000","last_undegraded":"2022-07-05T11:46:09.012267+0000","last_fullsized":"2022-07-05T11:46:09.012267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974758+0000","last_change":"2022-07-05T11:46:04.595606+0000","last_active":"2022-07-05T11:46:08.974758+0000","last_peered":"2022-07-05T11:46:08.974758+0000","last_clean":"2022-07-05T11:46:08.974758+0000","last_became_active":"2022-07-05T11:46:04.594962+0000","last_became_peered":"2022-07-05T11:46:04.594962+0000","last_unstale":"2022-07-05T11:46:08.974758+0000","last_undegraded":"2022-07-05T11:46:08.974758+0000","last_fullsized":"2022-07-05T11:46:08.974758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028691+0000","last_change":"2022-07-05T11:46:04.208492+0000","last_active":"2022-07-05T11:46:09.028691+0000","last_peered":"2022-07-05T11:46:09.028691+0000","last_clean":"2022-07-05T11:46:09.028691+0000","last_became_active":"2022-07-05T11:46:04.208135+0000","last_became_peered":"2022-07-05T11:46:04.208135+0000","last_unstale":"2022-07-05T11:46:09.028691+0000","last_undegraded":"2022-07-05T11:46:09.028691+0000","last_fullsized":"2022-07-05T11:46:09.028691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028400+0000","last_change":"2022-07-05T11:46:01.122048+0000","last_active":"2022-07-05T11:46:09.028400+0000","last_peered":"2022-07-05T11:46:09.028400+0000","last_clean":"2022-07-05T11:46:09.028400+0000","last_became_active":"2022-07-05T11:46:01.121724+0000","last_became_peered":"2022-07-05T11:46:01.121724+0000","last_unstale":"2022-07-05T11:46:09.028400+0000","last_undegraded":"2022-07-05T11:46:09.028400+0000","last_fullsized":"2022-07-05T11:46:09.028400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029610+0000","last_change":"2022-07-05T11:46:08.614936+0000","last_active":"2022-07-05T11:46:09.029610+0000","last_peered":"2022-07-05T11:46:09.029610+0000","last_clean":"2022-07-05T11:46:09.029610+0000","last_became_active":"2022-07-05T11:46:08.613212+0000","last_became_peered":"2022-07-05T11:46:08.613212+0000","last_unstale":"2022-07-05T11:46:09.029610+0000","last_undegraded":"2022-07-05T11:46:09.029610+0000","last_fullsized":"2022-07-05T11:46:09.029610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358743+0000","last_change":"2022-07-05T11:46:04.207235+0000","last_active":"2022-07-05T11:46:21.358743+0000","last_peered":"2022-07-05T11:46:21.358743+0000","last_clean":"2022-07-05T11:46:21.358743+0000","last_became_active":"2022-07-05T11:46:04.206912+0000","last_became_peered":"2022-07-05T11:46:04.206912+0000","last_unstale":"2022-07-05T11:46:21.358743+0000","last_undegraded":"2022-07-05T11:46:21.358743+0000","last_fullsized":"2022-07-05T11:46:21.358743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027868+0000","last_change":"2022-07-05T11:46:00.387606+0000","last_active":"2022-07-05T11:46:09.027868+0000","last_peered":"2022-07-05T11:46:09.027868+0000","last_clean":"2022-07-05T11:46:09.027868+0000","last_became_active":"2022-07-05T11:46:00.387285+0000","last_became_peered":"2022-07-05T11:46:00.387285+0000","last_unstale":"2022-07-05T11:46:09.027868+0000","last_undegraded":"2022-07-05T11:46:09.027868+0000","last_fullsized":"2022-07-05T11:46:09.027868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975087+0000","last_change":"2022-07-05T11:46:04.597434+0000","last_active":"2022-07-05T11:46:08.975087+0000","last_peered":"2022-07-05T11:46:08.975087+0000","last_clean":"2022-07-05T11:46:08.975087+0000","last_became_active":"2022-07-05T11:46:04.596283+0000","last_became_peered":"2022-07-05T11:46:04.596283+0000","last_unstale":"2022-07-05T11:46:08.975087+0000","last_undegraded":"2022-07-05T11:46:08.975087+0000","last_fullsized":"2022-07-05T11:46:08.975087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030525+0000","last_change":"2022-07-05T11:46:08.618008+0000","last_active":"2022-07-05T11:46:09.030525+0000","last_peered":"2022-07-05T11:46:09.030525+0000","last_clean":"2022-07-05T11:46:09.030525+0000","last_became_active":"2022-07-05T11:46:08.617640+0000","last_became_peered":"2022-07-05T11:46:08.617640+0000","last_unstale":"2022-07-05T11:46:09.030525+0000","last_undegraded":"2022-07-05T11:46:09.030525+0000","last_fullsized":"2022-07-05T11:46:09.030525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407205+0000","last_change":"2022-07-05T11:46:04.205557+0000","last_active":"2022-07-05T11:46:10.407205+0000","last_peered":"2022-07-05T11:46:10.407205+0000","last_clean":"2022-07-05T11:46:10.407205+0000","last_became_active":"2022-07-05T11:46:04.203760+0000","last_became_peered":"2022-07-05T11:46:04.203760+0000","last_unstale":"2022-07-05T11:46:10.407205+0000","last_undegraded":"2022-07-05T11:46:10.407205+0000","last_fullsized":"2022-07-05T11:46:10.407205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027789+0000","last_change":"2022-07-05T11:45:58.489958+0000","last_active":"2022-07-05T11:46:09.027789+0000","last_peered":"2022-07-05T11:46:09.027789+0000","last_clean":"2022-07-05T11:46:09.027789+0000","last_became_active":"2022-07-05T11:45:58.489710+0000","last_became_peered":"2022-07-05T11:45:58.489710+0000","last_unstale":"2022-07-05T11:46:09.027789+0000","last_undegraded":"2022-07-05T11:46:09.027789+0000","last_fullsized":"2022-07-05T11:46:09.027789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_clean_scrub_stamp":"2022-07-05T11:45:57.143009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012518+0000","last_change":"2022-07-05T11:46:01.154008+0000","last_active":"2022-07-05T11:46:09.012518+0000","last_peered":"2022-07-05T11:46:09.012518+0000","last_clean":"2022-07-05T11:46:09.012518+0000","last_became_active":"2022-07-05T11:46:01.153653+0000","last_became_peered":"2022-07-05T11:46:01.153653+0000","last_unstale":"2022-07-05T11:46:09.012518+0000","last_undegraded":"2022-07-05T11:46:09.012518+0000","last_fullsized":"2022-07-05T11:46:09.012518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029959+0000","last_change":"2022-07-05T11:46:04.597444+0000","last_active":"2022-07-05T11:46:09.029959+0000","last_peered":"2022-07-05T11:46:09.029959+0000","last_clean":"2022-07-05T11:46:09.029959+0000","last_became_active":"2022-07-05T11:46:04.597199+0000","last_became_peered":"2022-07-05T11:46:04.597199+0000","last_unstale":"2022-07-05T11:46:09.029959+0000","last_undegraded":"2022-07-05T11:46:09.029959+0000","last_fullsized":"2022-07-05T11:46:09.029959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028215+0000","last_change":"2022-07-05T11:46:09.017084+0000","last_active":"2022-07-05T11:46:09.028215+0000","last_peered":"2022-07-05T11:46:09.028215+0000","last_clean":"2022-07-05T11:46:09.028215+0000","last_became_active":"2022-07-05T11:46:09.016658+0000","last_became_peered":"2022-07-05T11:46:09.016658+0000","last_unstale":"2022-07-05T11:46:09.028215+0000","last_undegraded":"2022-07-05T11:46:09.028215+0000","last_fullsized":"2022-07-05T11:46:09.028215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358568+0000","last_change":"2022-07-05T11:46:04.209767+0000","last_active":"2022-07-05T11:46:21.358568+0000","last_peered":"2022-07-05T11:46:21.358568+0000","last_clean":"2022-07-05T11:46:21.358568+0000","last_became_active":"2022-07-05T11:46:04.209524+0000","last_became_peered":"2022-07-05T11:46:04.209524+0000","last_unstale":"2022-07-05T11:46:21.358568+0000","last_undegraded":"2022-07-05T11:46:21.358568+0000","last_fullsized":"2022-07-05T11:46:21.358568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028541+0000","last_change":"2022-07-05T11:46:01.118061+0000","last_active":"2022-07-05T11:46:09.028541+0000","last_peered":"2022-07-05T11:46:09.028541+0000","last_clean":"2022-07-05T11:46:09.028541+0000","last_became_active":"2022-07-05T11:46:01.117762+0000","last_became_peered":"2022-07-05T11:46:01.117762+0000","last_unstale":"2022-07-05T11:46:09.028541+0000","last_undegraded":"2022-07-05T11:46:09.028541+0000","last_fullsized":"2022-07-05T11:46:09.028541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028916+0000","last_change":"2022-07-05T11:46:04.594377+0000","last_active":"2022-07-05T11:46:09.028916+0000","last_peered":"2022-07-05T11:46:09.028916+0000","last_clean":"2022-07-05T11:46:09.028916+0000","last_became_active":"2022-07-05T11:46:04.594103+0000","last_became_peered":"2022-07-05T11:46:04.594103+0000","last_unstale":"2022-07-05T11:46:09.028916+0000","last_undegraded":"2022-07-05T11:46:09.028916+0000","last_fullsized":"2022-07-05T11:46:09.028916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017137+0000","last_change":"2022-07-05T11:46:09.014687+0000","last_active":"2022-07-05T11:46:09.017137+0000","last_peered":"2022-07-05T11:46:09.017137+0000","last_clean":"2022-07-05T11:46:09.017137+0000","last_became_active":"2022-07-05T11:46:09.014298+0000","last_became_peered":"2022-07-05T11:46:09.014298+0000","last_unstale":"2022-07-05T11:46:09.017137+0000","last_undegraded":"2022-07-05T11:46:09.017137+0000","last_fullsized":"2022-07-05T11:46:09.017137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028627+0000","last_change":"2022-07-05T11:46:04.593068+0000","last_active":"2022-07-05T11:46:09.028627+0000","last_peered":"2022-07-05T11:46:09.028627+0000","last_clean":"2022-07-05T11:46:09.028627+0000","last_became_active":"2022-07-05T11:46:04.592770+0000","last_became_peered":"2022-07-05T11:46:04.592770+0000","last_unstale":"2022-07-05T11:46:09.028627+0000","last_undegraded":"2022-07-05T11:46:09.028627+0000","last_fullsized":"2022-07-05T11:46:09.028627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:22.362211+0000","last_change":"2022-07-05T11:46:04.205846+0000","last_active":"2022-07-05T11:46:22.362211+0000","last_peered":"2022-07-05T11:46:22.362211+0000","last_clean":"2022-07-05T11:46:22.362211+0000","last_became_active":"2022-07-05T11:46:04.205358+0000","last_became_peered":"2022-07-05T11:46:04.205358+0000","last_unstale":"2022-07-05T11:46:22.362211+0000","last_undegraded":"2022-07-05T11:46:22.362211+0000","last_fullsized":"2022-07-05T11:46:22.362211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028856+0000","last_change":"2022-07-05T11:46:00.171709+0000","last_active":"2022-07-05T11:46:09.028856+0000","last_peered":"2022-07-05T11:46:09.028856+0000","last_clean":"2022-07-05T11:46:09.028856+0000","last_became_active":"2022-07-05T11:46:00.171328+0000","last_became_peered":"2022-07-05T11:46:00.171328+0000","last_unstale":"2022-07-05T11:46:09.028856+0000","last_undegraded":"2022-07-05T11:46:09.028856+0000","last_fullsized":"2022-07-05T11:46:09.028856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017640+0000","last_change":"2022-07-05T11:46:09.015332+0000","last_active":"2022-07-05T11:46:09.017640+0000","last_peered":"2022-07-05T11:46:09.017640+0000","last_clean":"2022-07-05T11:46:09.017640+0000","last_became_active":"2022-07-05T11:46:09.013688+0000","last_became_peered":"2022-07-05T11:46:09.013688+0000","last_unstale":"2022-07-05T11:46:09.017640+0000","last_undegraded":"2022-07-05T11:46:09.017640+0000","last_fullsized":"2022-07-05T11:46:09.017640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028419+0000","last_change":"2022-07-05T11:46:04.600986+0000","last_active":"2022-07-05T11:46:09.028419+0000","last_peered":"2022-07-05T11:46:09.028419+0000","last_clean":"2022-07-05T11:46:09.028419+0000","last_became_active":"2022-07-05T11:46:04.600619+0000","last_became_peered":"2022-07-05T11:46:04.600619+0000","last_unstale":"2022-07-05T11:46:09.028419+0000","last_undegraded":"2022-07-05T11:46:09.028419+0000","last_fullsized":"2022-07-05T11:46:09.028419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030201+0000","last_change":"2022-07-05T11:46:04.201044+0000","last_active":"2022-07-05T11:46:09.030201+0000","last_peered":"2022-07-05T11:46:09.030201+0000","last_clean":"2022-07-05T11:46:09.030201+0000","last_became_active":"2022-07-05T11:46:04.200743+0000","last_became_peered":"2022-07-05T11:46:04.200743+0000","last_unstale":"2022-07-05T11:46:09.030201+0000","last_undegraded":"2022-07-05T11:46:09.030201+0000","last_fullsized":"2022-07-05T11:46:09.030201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974024+0000","last_change":"2022-07-05T11:46:00.406891+0000","last_active":"2022-07-05T11:46:08.974024+0000","last_peered":"2022-07-05T11:46:08.974024+0000","last_clean":"2022-07-05T11:46:08.974024+0000","last_became_active":"2022-07-05T11:46:00.406555+0000","last_became_peered":"2022-07-05T11:46:00.406555+0000","last_unstale":"2022-07-05T11:46:08.974024+0000","last_undegraded":"2022-07-05T11:46:08.974024+0000","last_fullsized":"2022-07-05T11:46:08.974024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027228+0000","last_change":"2022-07-05T11:46:09.014076+0000","last_active":"2022-07-05T11:46:09.027228+0000","last_peered":"2022-07-05T11:46:09.027228+0000","last_clean":"2022-07-05T11:46:09.027228+0000","last_became_active":"2022-07-05T11:46:09.013674+0000","last_became_peered":"2022-07-05T11:46:09.013674+0000","last_unstale":"2022-07-05T11:46:09.027228+0000","last_undegraded":"2022-07-05T11:46:09.027228+0000","last_fullsized":"2022-07-05T11:46:09.027228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974896+0000","last_change":"2022-07-05T11:46:04.204890+0000","last_active":"2022-07-05T11:46:08.974896+0000","last_peered":"2022-07-05T11:46:08.974896+0000","last_clean":"2022-07-05T11:46:08.974896+0000","last_became_active":"2022-07-05T11:46:04.204615+0000","last_became_peered":"2022-07-05T11:46:04.204615+0000","last_unstale":"2022-07-05T11:46:08.974896+0000","last_undegraded":"2022-07-05T11:46:08.974896+0000","last_fullsized":"2022-07-05T11:46:08.974896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974109+0000","last_change":"2022-07-05T11:46:04.592359+0000","last_active":"2022-07-05T11:46:08.974109+0000","last_peered":"2022-07-05T11:46:08.974109+0000","last_clean":"2022-07-05T11:46:08.974109+0000","last_became_active":"2022-07-05T11:46:04.592112+0000","last_became_peered":"2022-07-05T11:46:04.592112+0000","last_unstale":"2022-07-05T11:46:08.974109+0000","last_undegraded":"2022-07-05T11:46:08.974109+0000","last_fullsized":"2022-07-05T11:46:08.974109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027403+0000","last_change":"2022-07-05T11:46:09.016814+0000","last_active":"2022-07-05T11:46:09.027403+0000","last_peered":"2022-07-05T11:46:09.027403+0000","last_clean":"2022-07-05T11:46:09.027403+0000","last_became_active":"2022-07-05T11:46:09.016282+0000","last_became_peered":"2022-07-05T11:46:09.016282+0000","last_unstale":"2022-07-05T11:46:09.027403+0000","last_undegraded":"2022-07-05T11:46:09.027403+0000","last_fullsized":"2022-07-05T11:46:09.027403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353211+0000","last_change":"2022-07-05T11:46:04.199484+0000","last_active":"2022-07-05T11:46:20.353211+0000","last_peered":"2022-07-05T11:46:20.353211+0000","last_clean":"2022-07-05T11:46:20.353211+0000","last_became_active":"2022-07-05T11:46:04.199190+0000","last_became_peered":"2022-07-05T11:46:04.199190+0000","last_unstale":"2022-07-05T11:46:20.353211+0000","last_undegraded":"2022-07-05T11:46:20.353211+0000","last_fullsized":"2022-07-05T11:46:20.353211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012845+0000","last_change":"2022-07-05T11:46:04.594175+0000","last_active":"2022-07-05T11:46:09.012845+0000","last_peered":"2022-07-05T11:46:09.012845+0000","last_clean":"2022-07-05T11:46:09.012845+0000","last_became_active":"2022-07-05T11:46:04.593700+0000","last_became_peered":"2022-07-05T11:46:04.593700+0000","last_unstale":"2022-07-05T11:46:09.012845+0000","last_undegraded":"2022-07-05T11:46:09.012845+0000","last_fullsized":"2022-07-05T11:46:09.012845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013139+0000","last_change":"2022-07-05T11:46:08.614509+0000","last_active":"2022-07-05T11:46:09.013139+0000","last_peered":"2022-07-05T11:46:09.013139+0000","last_clean":"2022-07-05T11:46:09.013139+0000","last_became_active":"2022-07-05T11:46:08.613935+0000","last_became_peered":"2022-07-05T11:46:08.613935+0000","last_unstale":"2022-07-05T11:46:09.013139+0000","last_undegraded":"2022-07-05T11:46:09.013139+0000","last_fullsized":"2022-07-05T11:46:09.013139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028943+0000","last_change":"2022-07-05T11:46:04.210344+0000","last_active":"2022-07-05T11:46:09.028943+0000","last_peered":"2022-07-05T11:46:09.028943+0000","last_clean":"2022-07-05T11:46:09.028943+0000","last_became_active":"2022-07-05T11:46:04.210054+0000","last_became_peered":"2022-07-05T11:46:04.210054+0000","last_unstale":"2022-07-05T11:46:09.028943+0000","last_undegraded":"2022-07-05T11:46:09.028943+0000","last_fullsized":"2022-07-05T11:46:09.028943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013018+0000","last_change":"2022-07-05T11:46:04.601851+0000","last_active":"2022-07-05T11:46:09.013018+0000","last_peered":"2022-07-05T11:46:09.013018+0000","last_clean":"2022-07-05T11:46:09.013018+0000","last_became_active":"2022-07-05T11:46:04.601528+0000","last_became_peered":"2022-07-05T11:46:04.601528+0000","last_unstale":"2022-07-05T11:46:09.013018+0000","last_undegraded":"2022-07-05T11:46:09.013018+0000","last_fullsized":"2022-07-05T11:46:09.013018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029283+0000","last_change":"2022-07-05T11:46:08.613389+0000","last_active":"2022-07-05T11:46:09.029283+0000","last_peered":"2022-07-05T11:46:09.029283+0000","last_clean":"2022-07-05T11:46:09.029283+0000","last_became_active":"2022-07-05T11:46:08.612988+0000","last_became_peered":"2022-07-05T11:46:08.612988+0000","last_unstale":"2022-07-05T11:46:09.029283+0000","last_undegraded":"2022-07-05T11:46:09.029283+0000","last_fullsized":"2022-07-05T11:46:09.029283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407358+0000","last_change":"2022-07-05T11:46:04.203173+0000","last_active":"2022-07-05T11:46:10.407358+0000","last_peered":"2022-07-05T11:46:10.407358+0000","last_clean":"2022-07-05T11:46:10.407358+0000","last_became_active":"2022-07-05T11:46:04.202879+0000","last_became_peered":"2022-07-05T11:46:04.202879+0000","last_unstale":"2022-07-05T11:46:10.407358+0000","last_undegraded":"2022-07-05T11:46:10.407358+0000","last_fullsized":"2022-07-05T11:46:10.407358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013005+0000","last_change":"2022-07-05T11:46:04.593203+0000","last_active":"2022-07-05T11:46:09.013005+0000","last_peered":"2022-07-05T11:46:09.013005+0000","last_clean":"2022-07-05T11:46:09.013005+0000","last_became_active":"2022-07-05T11:46:04.592953+0000","last_became_peered":"2022-07-05T11:46:04.592953+0000","last_unstale":"2022-07-05T11:46:09.013005+0000","last_undegraded":"2022-07-05T11:46:09.013005+0000","last_fullsized":"2022-07-05T11:46:09.013005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975419+0000","last_change":"2022-07-05T11:46:08.617348+0000","last_active":"2022-07-05T11:46:08.975419+0000","last_peered":"2022-07-05T11:46:08.975419+0000","last_clean":"2022-07-05T11:46:08.975419+0000","last_became_active":"2022-07-05T11:46:08.616964+0000","last_became_peered":"2022-07-05T11:46:08.616964+0000","last_unstale":"2022-07-05T11:46:08.975419+0000","last_undegraded":"2022-07-05T11:46:08.975419+0000","last_fullsized":"2022-07-05T11:46:08.975419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.213520+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.213132+0000","last_became_peered":"2022-07-05T11:46:04.213132+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027579+0000","last_change":"2022-07-05T11:46:04.589449+0000","last_active":"2022-07-05T11:46:09.027579+0000","last_peered":"2022-07-05T11:46:09.027579+0000","last_clean":"2022-07-05T11:46:09.027579+0000","last_became_active":"2022-07-05T11:46:04.589174+0000","last_became_peered":"2022-07-05T11:46:04.589174+0000","last_unstale":"2022-07-05T11:46:09.027579+0000","last_undegraded":"2022-07-05T11:46:09.027579+0000","last_fullsized":"2022-07-05T11:46:09.027579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027455+0000","last_change":"2022-07-05T11:46:08.617763+0000","last_active":"2022-07-05T11:46:09.027455+0000","last_peered":"2022-07-05T11:46:09.027455+0000","last_clean":"2022-07-05T11:46:09.027455+0000","last_became_active":"2022-07-05T11:46:08.617423+0000","last_became_peered":"2022-07-05T11:46:08.617423+0000","last_unstale":"2022-07-05T11:46:09.027455+0000","last_undegraded":"2022-07-05T11:46:09.027455+0000","last_fullsized":"2022-07-05T11:46:09.027455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030147+0000","last_change":"2022-07-05T11:46:04.211055+0000","last_active":"2022-07-05T11:46:09.030147+0000","last_peered":"2022-07-05T11:46:09.030147+0000","last_clean":"2022-07-05T11:46:09.030147+0000","last_became_active":"2022-07-05T11:46:04.210609+0000","last_became_peered":"2022-07-05T11:46:04.210609+0000","last_unstale":"2022-07-05T11:46:09.030147+0000","last_undegraded":"2022-07-05T11:46:09.030147+0000","last_fullsized":"2022-07-05T11:46:09.030147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028195+0000","last_change":"2022-07-05T11:46:04.583067+0000","last_active":"2022-07-05T11:46:09.028195+0000","last_peered":"2022-07-05T11:46:09.028195+0000","last_clean":"2022-07-05T11:46:09.028195+0000","last_became_active":"2022-07-05T11:46:04.582776+0000","last_became_peered":"2022-07-05T11:46:04.582776+0000","last_unstale":"2022-07-05T11:46:09.028195+0000","last_undegraded":"2022-07-05T11:46:09.028195+0000","last_fullsized":"2022-07-05T11:46:09.028195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975477+0000","last_change":"2022-07-05T11:46:08.619668+0000","last_active":"2022-07-05T11:46:08.975477+0000","last_peered":"2022-07-05T11:46:08.975477+0000","last_clean":"2022-07-05T11:46:08.975477+0000","last_became_active":"2022-07-05T11:46:08.619010+0000","last_became_peered":"2022-07-05T11:46:08.619010+0000","last_unstale":"2022-07-05T11:46:08.975477+0000","last_undegraded":"2022-07-05T11:46:08.975477+0000","last_fullsized":"2022-07-05T11:46:08.975477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975957+0000","last_change":"2022-07-05T11:46:04.202962+0000","last_active":"2022-07-05T11:46:08.975957+0000","last_peered":"2022-07-05T11:46:08.975957+0000","last_clean":"2022-07-05T11:46:08.975957+0000","last_became_active":"2022-07-05T11:46:04.202639+0000","last_became_peered":"2022-07-05T11:46:04.202639+0000","last_unstale":"2022-07-05T11:46:08.975957+0000","last_undegraded":"2022-07-05T11:46:08.975957+0000","last_fullsized":"2022-07-05T11:46:08.975957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975054+0000","last_change":"2022-07-05T11:46:04.595796+0000","last_active":"2022-07-05T11:46:08.975054+0000","last_peered":"2022-07-05T11:46:08.975054+0000","last_clean":"2022-07-05T11:46:08.975054+0000","last_became_active":"2022-07-05T11:46:04.595457+0000","last_became_peered":"2022-07-05T11:46:04.595457+0000","last_unstale":"2022-07-05T11:46:08.975054+0000","last_undegraded":"2022-07-05T11:46:08.975054+0000","last_fullsized":"2022-07-05T11:46:08.975054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027470+0000","last_change":"2022-07-05T11:46:08.617306+0000","last_active":"2022-07-05T11:46:09.027470+0000","last_peered":"2022-07-05T11:46:09.027470+0000","last_clean":"2022-07-05T11:46:09.027470+0000","last_became_active":"2022-07-05T11:46:08.616927+0000","last_became_peered":"2022-07-05T11:46:08.616927+0000","last_unstale":"2022-07-05T11:46:09.027470+0000","last_undegraded":"2022-07-05T11:46:09.027470+0000","last_fullsized":"2022-07-05T11:46:09.027470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.171485+0000","last_change":"2022-07-05T11:46:04.205780+0000","last_active":"2022-07-05T11:46:10.171485+0000","last_peered":"2022-07-05T11:46:10.171485+0000","last_clean":"2022-07-05T11:46:10.171485+0000","last_became_active":"2022-07-05T11:46:04.205486+0000","last_became_peered":"2022-07-05T11:46:04.205486+0000","last_unstale":"2022-07-05T11:46:10.171485+0000","last_undegraded":"2022-07-05T11:46:10.171485+0000","last_fullsized":"2022-07-05T11:46:10.171485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974611+0000","last_change":"2022-07-05T11:46:04.606819+0000","last_active":"2022-07-05T11:46:08.974611+0000","last_peered":"2022-07-05T11:46:08.974611+0000","last_clean":"2022-07-05T11:46:08.974611+0000","last_became_active":"2022-07-05T11:46:04.606484+0000","last_became_peered":"2022-07-05T11:46:04.606484+0000","last_unstale":"2022-07-05T11:46:08.974611+0000","last_undegraded":"2022-07-05T11:46:08.974611+0000","last_fullsized":"2022-07-05T11:46:08.974611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028555+0000","last_change":"2022-07-05T11:46:08.617224+0000","last_active":"2022-07-05T11:46:09.028555+0000","last_peered":"2022-07-05T11:46:09.028555+0000","last_clean":"2022-07-05T11:46:09.028555+0000","last_became_active":"2022-07-05T11:46:08.616821+0000","last_became_peered":"2022-07-05T11:46:08.616821+0000","last_unstale":"2022-07-05T11:46:09.028555+0000","last_undegraded":"2022-07-05T11:46:09.028555+0000","last_fullsized":"2022-07-05T11:46:09.028555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.170891+0000","last_change":"2022-07-05T11:46:04.204034+0000","last_active":"2022-07-05T11:46:10.170891+0000","last_peered":"2022-07-05T11:46:10.170891+0000","last_clean":"2022-07-05T11:46:10.170891+0000","last_became_active":"2022-07-05T11:46:04.203694+0000","last_became_peered":"2022-07-05T11:46:04.203694+0000","last_unstale":"2022-07-05T11:46:10.170891+0000","last_undegraded":"2022-07-05T11:46:10.170891+0000","last_fullsized":"2022-07-05T11:46:10.170891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974125+0000","last_change":"2022-07-05T11:46:04.593441+0000","last_active":"2022-07-05T11:46:08.974125+0000","last_peered":"2022-07-05T11:46:08.974125+0000","last_clean":"2022-07-05T11:46:08.974125+0000","last_became_active":"2022-07-05T11:46:04.593175+0000","last_became_peered":"2022-07-05T11:46:04.593175+0000","last_unstale":"2022-07-05T11:46:08.974125+0000","last_undegraded":"2022-07-05T11:46:08.974125+0000","last_fullsized":"2022-07-05T11:46:08.974125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028366+0000","last_change":"2022-07-05T11:46:09.016544+0000","last_active":"2022-07-05T11:46:09.028366+0000","last_peered":"2022-07-05T11:46:09.028366+0000","last_clean":"2022-07-05T11:46:09.028366+0000","last_became_active":"2022-07-05T11:46:09.016045+0000","last_became_peered":"2022-07-05T11:46:09.016045+0000","last_unstale":"2022-07-05T11:46:09.028366+0000","last_undegraded":"2022-07-05T11:46:09.028366+0000","last_fullsized":"2022-07-05T11:46:09.028366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'3","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.388311+0000","last_change":"2022-07-05T11:46:04.207209+0000","last_active":"2022-07-05T11:46:40.388311+0000","last_peered":"2022-07-05T11:46:40.388311+0000","last_clean":"2022-07-05T11:46:40.388311+0000","last_became_active":"2022-07-05T11:46:04.206333+0000","last_became_peered":"2022-07-05T11:46:04.206333+0000","last_unstale":"2022-07-05T11:46:40.388311+0000","last_undegraded":"2022-07-05T11:46:40.388311+0000","last_fullsized":"2022-07-05T11:46:40.388311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029985+0000","last_change":"2022-07-05T11:46:04.591635+0000","last_active":"2022-07-05T11:46:09.029985+0000","last_peered":"2022-07-05T11:46:09.029985+0000","last_clean":"2022-07-05T11:46:09.029985+0000","last_became_active":"2022-07-05T11:46:04.591370+0000","last_became_peered":"2022-07-05T11:46:04.591370+0000","last_unstale":"2022-07-05T11:46:09.029985+0000","last_undegraded":"2022-07-05T11:46:09.029985+0000","last_fullsized":"2022-07-05T11:46:09.029985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029798+0000","last_change":"2022-07-05T11:46:08.617287+0000","last_active":"2022-07-05T11:46:09.029798+0000","last_peered":"2022-07-05T11:46:09.029798+0000","last_clean":"2022-07-05T11:46:09.029798+0000","last_became_active":"2022-07-05T11:46:08.616929+0000","last_became_peered":"2022-07-05T11:46:08.616929+0000","last_unstale":"2022-07-05T11:46:09.029798+0000","last_undegraded":"2022-07-05T11:46:09.029798+0000","last_fullsized":"2022-07-05T11:46:09.029798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352160+0000","last_change":"2022-07-05T11:46:04.207520+0000","last_active":"2022-07-05T11:46:20.352160+0000","last_peered":"2022-07-05T11:46:20.352160+0000","last_clean":"2022-07-05T11:46:20.352160+0000","last_became_active":"2022-07-05T11:46:04.207167+0000","last_became_peered":"2022-07-05T11:46:04.207167+0000","last_unstale":"2022-07-05T11:46:20.352160+0000","last_undegraded":"2022-07-05T11:46:20.352160+0000","last_fullsized":"2022-07-05T11:46:20.352160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975400+0000","last_change":"2022-07-05T11:46:04.606473+0000","last_active":"2022-07-05T11:46:08.975400+0000","last_peered":"2022-07-05T11:46:08.975400+0000","last_clean":"2022-07-05T11:46:08.975400+0000","last_became_active":"2022-07-05T11:46:04.606183+0000","last_became_peered":"2022-07-05T11:46:04.606183+0000","last_unstale":"2022-07-05T11:46:08.975400+0000","last_undegraded":"2022-07-05T11:46:08.975400+0000","last_fullsized":"2022-07-05T11:46:08.975400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029169+0000","last_change":"2022-07-05T11:46:08.615322+0000","last_active":"2022-07-05T11:46:09.029169+0000","last_peered":"2022-07-05T11:46:09.029169+0000","last_clean":"2022-07-05T11:46:09.029169+0000","last_became_active":"2022-07-05T11:46:08.614916+0000","last_became_peered":"2022-07-05T11:46:08.614916+0000","last_unstale":"2022-07-05T11:46:09.029169+0000","last_undegraded":"2022-07-05T11:46:09.029169+0000","last_fullsized":"2022-07-05T11:46:09.029169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352984+0000","last_change":"2022-07-05T11:46:04.207417+0000","last_active":"2022-07-05T11:46:20.352984+0000","last_peered":"2022-07-05T11:46:20.352984+0000","last_clean":"2022-07-05T11:46:20.352984+0000","last_became_active":"2022-07-05T11:46:04.207078+0000","last_became_peered":"2022-07-05T11:46:04.207078+0000","last_unstale":"2022-07-05T11:46:20.352984+0000","last_undegraded":"2022-07-05T11:46:20.352984+0000","last_fullsized":"2022-07-05T11:46:20.352984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976049+0000","last_change":"2022-07-05T11:46:04.597152+0000","last_active":"2022-07-05T11:46:08.976049+0000","last_peered":"2022-07-05T11:46:08.976049+0000","last_clean":"2022-07-05T11:46:08.976049+0000","last_became_active":"2022-07-05T11:46:04.596847+0000","last_became_peered":"2022-07-05T11:46:04.596847+0000","last_unstale":"2022-07-05T11:46:08.976049+0000","last_undegraded":"2022-07-05T11:46:08.976049+0000","last_fullsized":"2022-07-05T11:46:08.976049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029455+0000","last_change":"2022-07-05T11:46:08.615281+0000","last_active":"2022-07-05T11:46:09.029455+0000","last_peered":"2022-07-05T11:46:09.029455+0000","last_clean":"2022-07-05T11:46:09.029455+0000","last_became_active":"2022-07-05T11:46:08.614859+0000","last_became_peered":"2022-07-05T11:46:08.614859+0000","last_unstale":"2022-07-05T11:46:09.029455+0000","last_undegraded":"2022-07-05T11:46:09.029455+0000","last_fullsized":"2022-07-05T11:46:09.029455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'2","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.386826+0000","last_change":"2022-07-05T11:46:04.209548+0000","last_active":"2022-07-05T11:46:40.386826+0000","last_peered":"2022-07-05T11:46:40.386826+0000","last_clean":"2022-07-05T11:46:40.386826+0000","last_became_active":"2022-07-05T11:46:04.209278+0000","last_became_peered":"2022-07-05T11:46:04.209278+0000","last_unstale":"2022-07-05T11:46:40.386826+0000","last_undegraded":"2022-07-05T11:46:40.386826+0000","last_fullsized":"2022-07-05T11:46:40.386826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012545+0000","last_change":"2022-07-05T11:46:04.601803+0000","last_active":"2022-07-05T11:46:09.012545+0000","last_peered":"2022-07-05T11:46:09.012545+0000","last_clean":"2022-07-05T11:46:09.012545+0000","last_became_active":"2022-07-05T11:46:04.601475+0000","last_became_peered":"2022-07-05T11:46:04.601475+0000","last_unstale":"2022-07-05T11:46:09.012545+0000","last_undegraded":"2022-07-05T11:46:09.012545+0000","last_fullsized":"2022-07-05T11:46:09.012545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028752+0000","last_change":"2022-07-05T11:46:08.617939+0000","last_active":"2022-07-05T11:46:09.028752+0000","last_peered":"2022-07-05T11:46:09.028752+0000","last_clean":"2022-07-05T11:46:09.028752+0000","last_became_active":"2022-07-05T11:46:08.617538+0000","last_became_peered":"2022-07-05T11:46:08.617538+0000","last_unstale":"2022-07-05T11:46:09.028752+0000","last_undegraded":"2022-07-05T11:46:09.028752+0000","last_fullsized":"2022-07-05T11:46:09.028752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352085+0000","last_change":"2022-07-05T11:46:04.199561+0000","last_active":"2022-07-05T11:46:20.352085+0000","last_peered":"2022-07-05T11:46:20.352085+0000","last_clean":"2022-07-05T11:46:20.352085+0000","last_became_active":"2022-07-05T11:46:04.199232+0000","last_became_peered":"2022-07-05T11:46:04.199232+0000","last_unstale":"2022-07-05T11:46:20.352085+0000","last_undegraded":"2022-07-05T11:46:20.352085+0000","last_fullsized":"2022-07-05T11:46:20.352085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973881+0000","last_change":"2022-07-05T11:46:04.601813+0000","last_active":"2022-07-05T11:46:08.973881+0000","last_peered":"2022-07-05T11:46:08.973881+0000","last_clean":"2022-07-05T11:46:08.973881+0000","last_became_active":"2022-07-05T11:46:04.601595+0000","last_became_peered":"2022-07-05T11:46:04.601595+0000","last_unstale":"2022-07-05T11:46:08.973881+0000","last_undegraded":"2022-07-05T11:46:08.973881+0000","last_fullsized":"2022-07-05T11:46:08.973881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975282+0000","last_change":"2022-07-05T11:46:08.621246+0000","last_active":"2022-07-05T11:46:08.975282+0000","last_peered":"2022-07-05T11:46:08.975282+0000","last_clean":"2022-07-05T11:46:08.975282+0000","last_became_active":"2022-07-05T11:46:08.620839+0000","last_became_peered":"2022-07-05T11:46:08.620839+0000","last_unstale":"2022-07-05T11:46:08.975282+0000","last_undegraded":"2022-07-05T11:46:08.975282+0000","last_fullsized":"2022-07-05T11:46:08.975282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029752+0000","last_change":"2022-07-05T11:46:04.204062+0000","last_active":"2022-07-05T11:46:09.029752+0000","last_peered":"2022-07-05T11:46:09.029752+0000","last_clean":"2022-07-05T11:46:09.029752+0000","last_became_active":"2022-07-05T11:46:04.203763+0000","last_became_peered":"2022-07-05T11:46:04.203763+0000","last_unstale":"2022-07-05T11:46:09.029752+0000","last_undegraded":"2022-07-05T11:46:09.029752+0000","last_fullsized":"2022-07-05T11:46:09.029752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029094+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.029094+0000","last_peered":"2022-07-05T11:46:09.029094+0000","last_clean":"2022-07-05T11:46:09.029094+0000","last_became_active":"2022-07-05T11:46:04.595288+0000","last_became_peered":"2022-07-05T11:46:04.595288+0000","last_unstale":"2022-07-05T11:46:09.029094+0000","last_undegraded":"2022-07-05T11:46:09.029094+0000","last_fullsized":"2022-07-05T11:46:09.029094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027709+0000","last_change":"2022-07-05T11:46:08.617183+0000","last_active":"2022-07-05T11:46:09.027709+0000","last_peered":"2022-07-05T11:46:09.027709+0000","last_clean":"2022-07-05T11:46:09.027709+0000","last_became_active":"2022-07-05T11:46:08.616762+0000","last_became_peered":"2022-07-05T11:46:08.616762+0000","last_unstale":"2022-07-05T11:46:09.027709+0000","last_undegraded":"2022-07-05T11:46:09.027709+0000","last_fullsized":"2022-07-05T11:46:09.027709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.526543+0000","last_change":"2022-07-05T11:46:04.206938+0000","last_active":"2022-07-05T11:46:40.526543+0000","last_peered":"2022-07-05T11:46:40.526543+0000","last_clean":"2022-07-05T11:46:40.526543+0000","last_became_active":"2022-07-05T11:46:04.206676+0000","last_became_peered":"2022-07-05T11:46:04.206676+0000","last_unstale":"2022-07-05T11:46:40.526543+0000","last_undegraded":"2022-07-05T11:46:40.526543+0000","last_fullsized":"2022-07-05T11:46:40.526543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973848+0000","last_change":"2022-07-05T11:46:04.589404+0000","last_active":"2022-07-05T11:46:08.973848+0000","last_peered":"2022-07-05T11:46:08.973848+0000","last_clean":"2022-07-05T11:46:08.973848+0000","last_became_active":"2022-07-05T11:46:04.589158+0000","last_became_peered":"2022-07-05T11:46:04.589158+0000","last_unstale":"2022-07-05T11:46:08.973848+0000","last_undegraded":"2022-07-05T11:46:08.973848+0000","last_fullsized":"2022-07-05T11:46:08.973848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028490+0000","last_change":"2022-07-05T11:46:08.619220+0000","last_active":"2022-07-05T11:46:09.028490+0000","last_peered":"2022-07-05T11:46:09.028490+0000","last_clean":"2022-07-05T11:46:09.028490+0000","last_became_active":"2022-07-05T11:46:08.618815+0000","last_became_peered":"2022-07-05T11:46:08.618815+0000","last_unstale":"2022-07-05T11:46:09.028490+0000","last_undegraded":"2022-07-05T11:46:09.028490+0000","last_fullsized":"2022-07-05T11:46:09.028490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974161+0000","last_change":"2022-07-05T11:46:08.617688+0000","last_active":"2022-07-05T11:46:08.974161+0000","last_peered":"2022-07-05T11:46:08.974161+0000","last_clean":"2022-07-05T11:46:08.974161+0000","last_became_active":"2022-07-05T11:46:08.617331+0000","last_became_peered":"2022-07-05T11:46:08.617331+0000","last_unstale":"2022-07-05T11:46:08.974161+0000","last_undegraded":"2022-07-05T11:46:08.974161+0000","last_fullsized":"2022-07-05T11:46:08.974161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029067+0000","last_change":"2022-07-05T11:46:04.199672+0000","last_active":"2022-07-05T11:46:09.029067+0000","last_peered":"2022-07-05T11:46:09.029067+0000","last_clean":"2022-07-05T11:46:09.029067+0000","last_became_active":"2022-07-05T11:46:04.199366+0000","last_became_peered":"2022-07-05T11:46:04.199366+0000","last_unstale":"2022-07-05T11:46:09.029067+0000","last_undegraded":"2022-07-05T11:46:09.029067+0000","last_fullsized":"2022-07-05T11:46:09.029067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976202+0000","last_change":"2022-07-05T11:46:04.598274+0000","last_active":"2022-07-05T11:46:08.976202+0000","last_peered":"2022-07-05T11:46:08.976202+0000","last_clean":"2022-07-05T11:46:08.976202+0000","last_became_active":"2022-07-05T11:46:04.597995+0000","last_became_peered":"2022-07-05T11:46:04.597995+0000","last_unstale":"2022-07-05T11:46:08.976202+0000","last_undegraded":"2022-07-05T11:46:08.976202+0000","last_fullsized":"2022-07-05T11:46:08.976202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030310+0000","last_change":"2022-07-05T11:46:08.612501+0000","last_active":"2022-07-05T11:46:09.030310+0000","last_peered":"2022-07-05T11:46:09.030310+0000","last_clean":"2022-07-05T11:46:09.030310+0000","last_became_active":"2022-07-05T11:46:08.611956+0000","last_became_peered":"2022-07-05T11:46:08.611956+0000","last_unstale":"2022-07-05T11:46:09.030310+0000","last_undegraded":"2022-07-05T11:46:09.030310+0000","last_fullsized":"2022-07-05T11:46:09.030310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973916+0000","last_change":"2022-07-05T11:46:04.212557+0000","last_active":"2022-07-05T11:46:08.973916+0000","last_peered":"2022-07-05T11:46:08.973916+0000","last_clean":"2022-07-05T11:46:08.973916+0000","last_became_active":"2022-07-05T11:46:04.212259+0000","last_became_peered":"2022-07-05T11:46:04.212259+0000","last_unstale":"2022-07-05T11:46:08.973916+0000","last_undegraded":"2022-07-05T11:46:08.973916+0000","last_fullsized":"2022-07-05T11:46:08.973916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028001+0000","last_change":"2022-07-05T11:46:04.593690+0000","last_active":"2022-07-05T11:46:09.028001+0000","last_peered":"2022-07-05T11:46:09.028001+0000","last_clean":"2022-07-05T11:46:09.028001+0000","last_became_active":"2022-07-05T11:46:04.593427+0000","last_became_peered":"2022-07-05T11:46:04.593427+0000","last_unstale":"2022-07-05T11:46:09.028001+0000","last_undegraded":"2022-07-05T11:46:09.028001+0000","last_fullsized":"2022-07-05T11:46:09.028001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028319+0000","last_change":"2022-07-05T11:46:04.204419+0000","last_active":"2022-07-05T11:46:09.028319+0000","last_peered":"2022-07-05T11:46:09.028319+0000","last_clean":"2022-07-05T11:46:09.028319+0000","last_became_active":"2022-07-05T11:46:04.204078+0000","last_became_peered":"2022-07-05T11:46:04.204078+0000","last_unstale":"2022-07-05T11:46:09.028319+0000","last_undegraded":"2022-07-05T11:46:09.028319+0000","last_fullsized":"2022-07-05T11:46:09.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028300+0000","last_change":"2022-07-05T11:46:04.600858+0000","last_active":"2022-07-05T11:46:09.028300+0000","last_peered":"2022-07-05T11:46:09.028300+0000","last_clean":"2022-07-05T11:46:09.028300+0000","last_became_active":"2022-07-05T11:46:04.600564+0000","last_became_peered":"2022-07-05T11:46:04.600564+0000","last_unstale":"2022-07-05T11:46:09.028300+0000","last_undegraded":"2022-07-05T11:46:09.028300+0000","last_fullsized":"2022-07-05T11:46:09.028300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017952+0000","last_change":"2022-07-05T11:46:09.017127+0000","last_active":"2022-07-05T11:46:09.017952+0000","last_peered":"2022-07-05T11:46:09.017952+0000","last_clean":"2022-07-05T11:46:09.017952+0000","last_became_active":"2022-07-05T11:46:09.016451+0000","last_became_peered":"2022-07-05T11:46:09.016451+0000","last_unstale":"2022-07-05T11:46:09.017952+0000","last_undegraded":"2022-07-05T11:46:09.017952+0000","last_fullsized":"2022-07-05T11:46:09.017952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7400,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":141,"num_read_kb":83,"num_write":130,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5348,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366492,"statfs":{"total":96636764160,"available":96631287808,"internally_reserved":0,"allocated":356352,"data_stored":165443,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":166661,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":9,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":8,"up_from":17,"seq":73014444044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164957,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":163725,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":17,"seq":73014444044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":1,"up_from":17,"seq":73014444043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":164777,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":0,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163647,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163717,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444043,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":168709,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5404,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366436,"statfs":{"total":96636764160,"available":96631230464,"internally_reserved":0,"allocated":348160,"data_stored":165107,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-07-05T11:46:44.908 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-07-05T11:46:45.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.049+0000 7f3fec9b0700 1 Processor -- start 2022-07-05T11:46:45.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.049+0000 7f3fec9b0700 1 -- start start 2022-07-05T11:46:45.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fec9b0700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80c3a10 con 0x7f3fe80c45b0 2022-07-05T11:46:45.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fec9b0700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80f0330 con 0x7f3fe817dd60 2022-07-05T11:46:45.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fec9b0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe817f210 con 0x7f3fe817d980 2022-07-05T11:46:45.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe759e700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3fe80c45b0 0x7f3fe80ec0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50920/0 (socket says 172.21.15.90:50920) 2022-07-05T11:46:45.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe759e700 1 -- 172.21.15.90:0/4235830674 learned_addr learned my addr 172.21.15.90:0/4235830674 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:45.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917146822 0 0) 0x7f3fe80c3a10 con 0x7f3fe80c45b0 2022-07-05T11:46:45.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd40033f0 con 0x7f3fe80c45b0 2022-07-05T11:46:45.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664067317 0 0) 0x7f3fe817f210 con 0x7f3fe817d980 2022-07-05T11:46:45.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe80c3a10 con 0x7f3fe817d980 2022-07-05T11:46:45.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 632271999 0 0) 0x7f3fd40033f0 con 0x7f3fe80c45b0 2022-07-05T11:46:45.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 >> v1:172.21.15.149:6789/0 conn(0x7f3fe817d980 legacy=0x7f3fe817eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.050+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 >> v1:172.21.15.110:6789/0 conn(0x7f3fe817dd60 legacy=0x7f3fe80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80ed380 con 0x7f3fe80c45b0 2022-07-05T11:46:45.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f3fe00017f0 con 0x7f3fe80c45b0 2022-07-05T11:46:45.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 >> v1:172.21.15.90:6789/0 conn(0x7f3fe80c45b0 legacy=0x7f3fe80ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4003aa0 0x7f3fd4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fd4004690 0x7f3fd4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fd4005200 0x7f3fd400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd400c120 con 0x7f3fd4004690 2022-07-05T11:46:45.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd400c290 con 0x7f3fd4003aa0 2022-07-05T11:46:45.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd400c450 con 0x7f3fd4005200 2022-07-05T11:46:45.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe659c700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fd4004690 0x7f3fd4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe6d9d700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4003aa0 0x7f3fd4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe759e700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fd4005200 0x7f3fd400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe659c700 1 -- 172.21.15.90:0/4235830674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fd4005200 msgr2=0x7f3fd400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:45.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe659c700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fd4005200 0x7f3fd400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe659c700 1 -- 172.21.15.90:0/4235830674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4003aa0 msgr2=0x7f3fd4003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:45.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe659c700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4003aa0 0x7f3fd4003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe659c700 1 -- 172.21.15.90:0/4235830674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40033f0 con 0x7f3fd4004690 2022-07-05T11:46:45.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe759e700 1 -- 172.21.15.90:0/4235830674 reap_dead start 2022-07-05T11:46:45.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe659c700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fd4004690 0x7f3fd4004b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f3fdc0017e0 tx=0x7f3fdc007b90).ready entity=mon.0 client_cookie=b7e6aa3b31cc7187 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc007ea0 con 0x7f3fd4004690 2022-07-05T11:46:45.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc012400 con 0x7f3fd4004690 2022-07-05T11:46:45.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.051+0000 7f3fe5d9b700 1 -- 172.21.15.90:0/4235830674 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0127a0 con 0x7f3fd4004690 2022-07-05T11:46:45.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.052+0000 7f3fec9b0700 1 -- 172.21.15.90:0/4235830674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fd4004690 msgr2=0x7f3fd4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.052+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fd4004690 0x7f3fd4004b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f3fdc0017e0 tx=0x7f3fdc007b90).stop 2022-07-05T11:46:45.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.052+0000 7f3fec9b0700 1 -- 172.21.15.90:0/4235830674 shutdown_connections 2022-07-05T11:46:45.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.052+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/4235830674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fd4004690 0x7f3fd4004b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.052+0000 7f3fec9b0700 1 -- 172.21.15.90:0/4235830674 >> 172.21.15.90:0/4235830674 conn(0x7f3fe80f1420 msgr2=0x7f3fe80f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:45.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.052+0000 7f3fec9b0700 1 -- 172.21.15.90:0/4235830674 shutdown_connections 2022-07-05T11:46:45.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.052+0000 7f3fec9b0700 1 -- 172.21.15.90:0/4235830674 wait complete. 2022-07-05T11:46:45.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.053+0000 7f3fec9b0700 1 Processor -- start 2022-07-05T11:46:45.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.053+0000 7f3fec9b0700 1 -- start start 2022-07-05T11:46:45.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fec9b0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4004690 0x7f3fe80ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fec9b0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe8174dc0 0x7f3fe8175240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fec9b0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fe816d760 0x7f3fe816dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fec9b0700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80ef790 con 0x7f3fe816d760 2022-07-05T11:46:45.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fec9b0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80ee630 con 0x7f3fd4004690 2022-07-05T11:46:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fec9b0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80efc20 con 0x7f3fe8174dc0 2022-07-05T11:46:45.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fe759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fe816d760 0x7f3fe816dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fe759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fe816d760 0x7f3fe816dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57992/0 (socket says 172.21.15.90:57992) 2022-07-05T11:46:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.054+0000 7f3fe759e700 1 -- 172.21.15.90:0/1937325528 learned_addr learned my addr 172.21.15.90:0/1937325528 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe6d9d700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4004690 0x7f3fe80ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe659c700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe8174dc0 0x7f3fe8175240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe759e700 1 -- 172.21.15.90:0/1937325528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe8174dc0 msgr2=0x7f3fe8175240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe759e700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe8174dc0 0x7f3fe8175240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe759e700 1 -- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4004690 msgr2=0x7f3fe80ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe759e700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4004690 0x7f3fe80ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe759e700 1 -- 172.21.15.90:0/1937325528 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80ee8a0 con 0x7f3fe816d760 2022-07-05T11:46:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fe759e700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fe816d760 0x7f3fe816dbe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f3fe80f07f0 tx=0x7f3fe0007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fceffd700 1 -- 172.21.15.90:0/1937325528 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000f8a0 con 0x7f3fe816d760 2022-07-05T11:46:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fceffd700 1 -- 172.21.15.90:0/1937325528 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe000fa00 con 0x7f3fe816d760 2022-07-05T11:46:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe80eeb80 con 0x7f3fe816d760 2022-07-05T11:46:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fceffd700 1 -- 172.21.15.90:0/1937325528 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000fda0 con 0x7f3fe816d760 2022-07-05T11:46:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.055+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe80ef140 con 0x7f3fe816d760 2022-07-05T11:46:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.056+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe80ef940 con 0x7f3fe816d760 2022-07-05T11:46:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.057+0000 7f3fceffd700 1 -- 172.21.15.90:0/1937325528 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3fe001b030 con 0x7f3fe816d760 2022-07-05T11:46:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.057+0000 7f3fceffd700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3fc808ba40 0x7f3fc808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.057+0000 7f3fceffd700 1 -- 172.21.15.90:0/1937325528 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3fe00b03c0 con 0x7f3fe816d760 2022-07-05T11:46:45.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.057+0000 7f3fe6d9d700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3fc808ba40 0x7f3fc808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.058+0000 7f3fe6d9d700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3fc808ba40 0x7f3fc808df00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3fd8000c00 tx=0x7f3fd8007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.061+0000 7f3fceffd700 1 -- 172.21.15.90:0/1937325528 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f3fe80ef940 con 0x7f3fe816d760 2022-07-05T11:46:45.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.219+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 --> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fe80ed660 con 0x7f3fc808ba40 2022-07-05T11:46:45.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.232+0000 7f3fceffd700 1 -- 172.21.15.90:0/1937325528 <== mgr.4105 v2:172.21.15.110:6800/36906 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434329 (secure 0 0 0) 0x7f3fe80ed660 con 0x7f3fc808ba40 2022-07-05T11:46:45.240 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:45.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3fc808ba40 msgr2=0x7f3fc808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3fc808ba40 0x7f3fc808df00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3fd8000c00 tx=0x7f3fd8007b90).stop 2022-07-05T11:46:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fe816d760 msgr2=0x7f3fe816dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fe816d760 0x7f3fe816dbe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f3fe80f07f0 tx=0x7f3fe0007f20).stop 2022-07-05T11:46:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 shutdown_connections 2022-07-05T11:46:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3fc808ba40 0x7f3fc808df00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fe816d760 0x7f3fe816dbe0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd4004690 0x7f3fe80ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 --2- 172.21.15.90:0/1937325528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe8174dc0 0x7f3fe8175240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.235+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 >> 172.21.15.90:0/1937325528 conn(0x7f3fe80f1420 msgr2=0x7f3fe8170f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.236+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 shutdown_connections 2022-07-05T11:46:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.236+0000 7f3fec9b0700 1 -- 172.21.15.90:0/1937325528 wait complete. 2022-07-05T11:46:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2022-07-05T11:46:45.249 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2022-07-05T11:46:45.126796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7400,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":141,"num_read_kb":83,"num_write":130,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":64192,"kb_used_data":4000,"kb_used_omap":0,"kb_used_meta":60096,"kb_avail":1132397888,"statfs":{"total":1159641169920,"available":1159575437312,"internally_reserved":0,"allocated":4096000,"data_stored":1977484,"data_compressed":167460,"data_compressed_allocated":245760,"data_compressed_original":491520,"omap_allocated":0,"internal_metadata":61538304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004277"},"pg_stats":[{"pgid":"3.3f","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360284+0000","last_change":"2022-07-05T11:46:04.211228+0000","last_active":"2022-07-05T11:46:21.360284+0000","last_peered":"2022-07-05T11:46:21.360284+0000","last_clean":"2022-07-05T11:46:21.360284+0000","last_became_active":"2022-07-05T11:46:04.210963+0000","last_became_peered":"2022-07-05T11:46:04.210963+0000","last_unstale":"2022-07-05T11:46:21.360284+0000","last_undegraded":"2022-07-05T11:46:21.360284+0000","last_fullsized":"2022-07-05T11:46:21.360284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029059+0000","last_change":"2022-07-05T11:46:04.590106+0000","last_active":"2022-07-05T11:46:09.029059+0000","last_peered":"2022-07-05T11:46:09.029059+0000","last_clean":"2022-07-05T11:46:09.029059+0000","last_became_active":"2022-07-05T11:46:04.589807+0000","last_became_peered":"2022-07-05T11:46:04.589807+0000","last_unstale":"2022-07-05T11:46:09.029059+0000","last_undegraded":"2022-07-05T11:46:09.029059+0000","last_fullsized":"2022-07-05T11:46:09.029059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.408147+0000","last_change":"2022-07-05T11:46:04.202921+0000","last_active":"2022-07-05T11:46:10.408147+0000","last_peered":"2022-07-05T11:46:10.408147+0000","last_clean":"2022-07-05T11:46:10.408147+0000","last_became_active":"2022-07-05T11:46:04.202631+0000","last_became_peered":"2022-07-05T11:46:04.202631+0000","last_unstale":"2022-07-05T11:46:10.408147+0000","last_undegraded":"2022-07-05T11:46:10.408147+0000","last_fullsized":"2022-07-05T11:46:10.408147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028341+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.028341+0000","last_peered":"2022-07-05T11:46:09.028341+0000","last_clean":"2022-07-05T11:46:09.028341+0000","last_became_active":"2022-07-05T11:46:04.595253+0000","last_became_peered":"2022-07-05T11:46:04.595253+0000","last_unstale":"2022-07-05T11:46:09.028341+0000","last_undegraded":"2022-07-05T11:46:09.028341+0000","last_fullsized":"2022-07-05T11:46:09.028341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360892+0000","last_change":"2022-07-05T11:46:04.211131+0000","last_active":"2022-07-05T11:46:21.360892+0000","last_peered":"2022-07-05T11:46:21.360892+0000","last_clean":"2022-07-05T11:46:21.360892+0000","last_became_active":"2022-07-05T11:46:04.210828+0000","last_became_peered":"2022-07-05T11:46:04.210828+0000","last_unstale":"2022-07-05T11:46:21.360892+0000","last_undegraded":"2022-07-05T11:46:21.360892+0000","last_fullsized":"2022-07-05T11:46:21.360892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012401+0000","last_change":"2022-07-05T11:46:04.592905+0000","last_active":"2022-07-05T11:46:09.012401+0000","last_peered":"2022-07-05T11:46:09.012401+0000","last_clean":"2022-07-05T11:46:09.012401+0000","last_became_active":"2022-07-05T11:46:04.592593+0000","last_became_peered":"2022-07-05T11:46:04.592593+0000","last_unstale":"2022-07-05T11:46:09.012401+0000","last_undegraded":"2022-07-05T11:46:09.012401+0000","last_fullsized":"2022-07-05T11:46:09.012401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012779+0000","last_change":"2022-07-05T11:46:04.209903+0000","last_active":"2022-07-05T11:46:09.012779+0000","last_peered":"2022-07-05T11:46:09.012779+0000","last_clean":"2022-07-05T11:46:09.012779+0000","last_became_active":"2022-07-05T11:46:04.204575+0000","last_became_peered":"2022-07-05T11:46:04.204575+0000","last_unstale":"2022-07-05T11:46:09.012779+0000","last_undegraded":"2022-07-05T11:46:09.012779+0000","last_fullsized":"2022-07-05T11:46:09.012779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974869+0000","last_change":"2022-07-05T11:46:04.595822+0000","last_active":"2022-07-05T11:46:08.974869+0000","last_peered":"2022-07-05T11:46:08.974869+0000","last_clean":"2022-07-05T11:46:08.974869+0000","last_became_active":"2022-07-05T11:46:04.595306+0000","last_became_peered":"2022-07-05T11:46:04.595306+0000","last_unstale":"2022-07-05T11:46:08.974869+0000","last_undegraded":"2022-07-05T11:46:08.974869+0000","last_fullsized":"2022-07-05T11:46:08.974869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"25'1","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029038+0000","last_change":"2022-07-05T11:46:04.202298+0000","last_active":"2022-07-05T11:46:09.029038+0000","last_peered":"2022-07-05T11:46:09.029038+0000","last_clean":"2022-07-05T11:46:09.029038+0000","last_became_active":"2022-07-05T11:46:04.202010+0000","last_became_peered":"2022-07-05T11:46:04.202010+0000","last_unstale":"2022-07-05T11:46:09.029038+0000","last_undegraded":"2022-07-05T11:46:09.029038+0000","last_fullsized":"2022-07-05T11:46:09.029038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029758+0000","last_change":"2022-07-05T11:46:04.590970+0000","last_active":"2022-07-05T11:46:09.029758+0000","last_peered":"2022-07-05T11:46:09.029758+0000","last_clean":"2022-07-05T11:46:09.029758+0000","last_became_active":"2022-07-05T11:46:04.590714+0000","last_became_peered":"2022-07-05T11:46:04.590714+0000","last_unstale":"2022-07-05T11:46:09.029758+0000","last_undegraded":"2022-07-05T11:46:09.029758+0000","last_fullsized":"2022-07-05T11:46:09.029758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358625+0000","last_change":"2022-07-05T11:46:04.204607+0000","last_active":"2022-07-05T11:46:21.358625+0000","last_peered":"2022-07-05T11:46:21.358625+0000","last_clean":"2022-07-05T11:46:21.358625+0000","last_became_active":"2022-07-05T11:46:04.204287+0000","last_became_peered":"2022-07-05T11:46:04.204287+0000","last_unstale":"2022-07-05T11:46:21.358625+0000","last_undegraded":"2022-07-05T11:46:21.358625+0000","last_fullsized":"2022-07-05T11:46:21.358625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012802+0000","last_change":"2022-07-05T11:46:04.606655+0000","last_active":"2022-07-05T11:46:09.012802+0000","last_peered":"2022-07-05T11:46:09.012802+0000","last_clean":"2022-07-05T11:46:09.012802+0000","last_became_active":"2022-07-05T11:46:04.606370+0000","last_became_peered":"2022-07-05T11:46:04.606370+0000","last_unstale":"2022-07-05T11:46:09.012802+0000","last_undegraded":"2022-07-05T11:46:09.012802+0000","last_fullsized":"2022-07-05T11:46:09.012802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360703+0000","last_change":"2022-07-05T11:46:04.206427+0000","last_active":"2022-07-05T11:46:21.360703+0000","last_peered":"2022-07-05T11:46:21.360703+0000","last_clean":"2022-07-05T11:46:21.360703+0000","last_became_active":"2022-07-05T11:46:04.206192+0000","last_became_peered":"2022-07-05T11:46:04.206192+0000","last_unstale":"2022-07-05T11:46:21.360703+0000","last_undegraded":"2022-07-05T11:46:21.360703+0000","last_fullsized":"2022-07-05T11:46:21.360703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028587+0000","last_change":"2022-07-05T11:46:04.599321+0000","last_active":"2022-07-05T11:46:09.028587+0000","last_peered":"2022-07-05T11:46:09.028587+0000","last_clean":"2022-07-05T11:46:09.028587+0000","last_became_active":"2022-07-05T11:46:04.597626+0000","last_became_peered":"2022-07-05T11:46:04.597626+0000","last_unstale":"2022-07-05T11:46:09.028587+0000","last_undegraded":"2022-07-05T11:46:09.028587+0000","last_fullsized":"2022-07-05T11:46:09.028587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407177+0000","last_change":"2022-07-05T11:46:04.204458+0000","last_active":"2022-07-05T11:46:10.407177+0000","last_peered":"2022-07-05T11:46:10.407177+0000","last_clean":"2022-07-05T11:46:10.407177+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:10.407177+0000","last_undegraded":"2022-07-05T11:46:10.407177+0000","last_fullsized":"2022-07-05T11:46:10.407177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028708+0000","last_change":"2022-07-05T11:46:04.598830+0000","last_active":"2022-07-05T11:46:09.028708+0000","last_peered":"2022-07-05T11:46:09.028708+0000","last_clean":"2022-07-05T11:46:09.028708+0000","last_became_active":"2022-07-05T11:46:04.597158+0000","last_became_peered":"2022-07-05T11:46:04.597158+0000","last_unstale":"2022-07-05T11:46:09.028708+0000","last_undegraded":"2022-07-05T11:46:09.028708+0000","last_fullsized":"2022-07-05T11:46:09.028708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029721+0000","last_change":"2022-07-05T11:46:04.207355+0000","last_active":"2022-07-05T11:46:09.029721+0000","last_peered":"2022-07-05T11:46:09.029721+0000","last_clean":"2022-07-05T11:46:09.029721+0000","last_became_active":"2022-07-05T11:46:04.207059+0000","last_became_peered":"2022-07-05T11:46:04.207059+0000","last_unstale":"2022-07-05T11:46:09.029721+0000","last_undegraded":"2022-07-05T11:46:09.029721+0000","last_fullsized":"2022-07-05T11:46:09.029721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012425+0000","last_change":"2022-07-05T11:46:04.595782+0000","last_active":"2022-07-05T11:46:09.012425+0000","last_peered":"2022-07-05T11:46:09.012425+0000","last_clean":"2022-07-05T11:46:09.012425+0000","last_became_active":"2022-07-05T11:46:04.595530+0000","last_became_peered":"2022-07-05T11:46:04.595530+0000","last_unstale":"2022-07-05T11:46:09.012425+0000","last_undegraded":"2022-07-05T11:46:09.012425+0000","last_fullsized":"2022-07-05T11:46:09.012425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.351876+0000","last_change":"2022-07-05T11:46:04.210209+0000","last_active":"2022-07-05T11:46:20.351876+0000","last_peered":"2022-07-05T11:46:20.351876+0000","last_clean":"2022-07-05T11:46:20.351876+0000","last_became_active":"2022-07-05T11:46:04.209883+0000","last_became_peered":"2022-07-05T11:46:04.209883+0000","last_unstale":"2022-07-05T11:46:20.351876+0000","last_undegraded":"2022-07-05T11:46:20.351876+0000","last_fullsized":"2022-07-05T11:46:20.351876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028150+0000","last_change":"2022-07-05T11:46:04.600375+0000","last_active":"2022-07-05T11:46:09.028150+0000","last_peered":"2022-07-05T11:46:09.028150+0000","last_clean":"2022-07-05T11:46:09.028150+0000","last_became_active":"2022-07-05T11:46:04.600101+0000","last_became_peered":"2022-07-05T11:46:04.600101+0000","last_unstale":"2022-07-05T11:46:09.028150+0000","last_undegraded":"2022-07-05T11:46:09.028150+0000","last_fullsized":"2022-07-05T11:46:09.028150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030246+0000","last_change":"2022-07-05T11:46:04.204891+0000","last_active":"2022-07-05T11:46:09.030246+0000","last_peered":"2022-07-05T11:46:09.030246+0000","last_clean":"2022-07-05T11:46:09.030246+0000","last_became_active":"2022-07-05T11:46:04.204619+0000","last_became_peered":"2022-07-05T11:46:04.204619+0000","last_unstale":"2022-07-05T11:46:09.030246+0000","last_undegraded":"2022-07-05T11:46:09.030246+0000","last_fullsized":"2022-07-05T11:46:09.030246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028234+0000","last_change":"2022-07-05T11:46:04.600335+0000","last_active":"2022-07-05T11:46:09.028234+0000","last_peered":"2022-07-05T11:46:09.028234+0000","last_clean":"2022-07-05T11:46:09.028234+0000","last_became_active":"2022-07-05T11:46:04.600026+0000","last_became_peered":"2022-07-05T11:46:04.600026+0000","last_unstale":"2022-07-05T11:46:09.028234+0000","last_undegraded":"2022-07-05T11:46:09.028234+0000","last_fullsized":"2022-07-05T11:46:09.028234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'9","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.387268+0000","last_change":"2022-07-05T11:46:04.210563+0000","last_active":"2022-07-05T11:46:40.387268+0000","last_peered":"2022-07-05T11:46:40.387268+0000","last_clean":"2022-07-05T11:46:40.387268+0000","last_became_active":"2022-07-05T11:46:04.210264+0000","last_became_peered":"2022-07-05T11:46:04.210264+0000","last_unstale":"2022-07-05T11:46:40.387268+0000","last_undegraded":"2022-07-05T11:46:40.387268+0000","last_fullsized":"2022-07-05T11:46:40.387268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3070,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975654+0000","last_change":"2022-07-05T11:46:04.596566+0000","last_active":"2022-07-05T11:46:08.975654+0000","last_peered":"2022-07-05T11:46:08.975654+0000","last_clean":"2022-07-05T11:46:08.975654+0000","last_became_active":"2022-07-05T11:46:04.596385+0000","last_became_peered":"2022-07-05T11:46:04.596385+0000","last_unstale":"2022-07-05T11:46:08.975654+0000","last_undegraded":"2022-07-05T11:46:08.975654+0000","last_fullsized":"2022-07-05T11:46:08.975654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359717+0000","last_change":"2022-07-05T11:46:04.205836+0000","last_active":"2022-07-05T11:46:21.359717+0000","last_peered":"2022-07-05T11:46:21.359717+0000","last_clean":"2022-07-05T11:46:21.359717+0000","last_became_active":"2022-07-05T11:46:04.205522+0000","last_became_peered":"2022-07-05T11:46:04.205522+0000","last_unstale":"2022-07-05T11:46:21.359717+0000","last_undegraded":"2022-07-05T11:46:21.359717+0000","last_fullsized":"2022-07-05T11:46:21.359717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027942+0000","last_change":"2022-07-05T11:46:04.600047+0000","last_active":"2022-07-05T11:46:09.027942+0000","last_peered":"2022-07-05T11:46:09.027942+0000","last_clean":"2022-07-05T11:46:09.027942+0000","last_became_active":"2022-07-05T11:46:04.599735+0000","last_became_peered":"2022-07-05T11:46:04.599735+0000","last_unstale":"2022-07-05T11:46:09.027942+0000","last_undegraded":"2022-07-05T11:46:09.027942+0000","last_fullsized":"2022-07-05T11:46:09.027942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027527+0000","last_change":"2022-07-05T11:46:04.204754+0000","last_active":"2022-07-05T11:46:09.027527+0000","last_peered":"2022-07-05T11:46:09.027527+0000","last_clean":"2022-07-05T11:46:09.027527+0000","last_became_active":"2022-07-05T11:46:04.204466+0000","last_became_peered":"2022-07-05T11:46:04.204466+0000","last_unstale":"2022-07-05T11:46:09.027527+0000","last_undegraded":"2022-07-05T11:46:09.027527+0000","last_fullsized":"2022-07-05T11:46:09.027527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012900+0000","last_change":"2022-07-05T11:46:04.594552+0000","last_active":"2022-07-05T11:46:09.012900+0000","last_peered":"2022-07-05T11:46:09.012900+0000","last_clean":"2022-07-05T11:46:09.012900+0000","last_became_active":"2022-07-05T11:46:04.594285+0000","last_became_peered":"2022-07-05T11:46:04.594285+0000","last_unstale":"2022-07-05T11:46:09.012900+0000","last_undegraded":"2022-07-05T11:46:09.012900+0000","last_fullsized":"2022-07-05T11:46:09.012900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027421+0000","last_change":"2022-07-05T11:46:04.206416+0000","last_active":"2022-07-05T11:46:09.027421+0000","last_peered":"2022-07-05T11:46:09.027421+0000","last_clean":"2022-07-05T11:46:09.027421+0000","last_became_active":"2022-07-05T11:46:04.206118+0000","last_became_peered":"2022-07-05T11:46:04.206118+0000","last_unstale":"2022-07-05T11:46:09.027421+0000","last_undegraded":"2022-07-05T11:46:09.027421+0000","last_fullsized":"2022-07-05T11:46:09.027421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975854+0000","last_change":"2022-07-05T11:46:04.596814+0000","last_active":"2022-07-05T11:46:08.975854+0000","last_peered":"2022-07-05T11:46:08.975854+0000","last_clean":"2022-07-05T11:46:08.975854+0000","last_became_active":"2022-07-05T11:46:04.596492+0000","last_became_peered":"2022-07-05T11:46:04.596492+0000","last_unstale":"2022-07-05T11:46:08.975854+0000","last_undegraded":"2022-07-05T11:46:08.975854+0000","last_fullsized":"2022-07-05T11:46:08.975854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'10","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359758+0000","last_change":"2022-07-05T11:46:04.208748+0000","last_active":"2022-07-05T11:46:21.359758+0000","last_peered":"2022-07-05T11:46:21.359758+0000","last_clean":"2022-07-05T11:46:21.359758+0000","last_became_active":"2022-07-05T11:46:04.208440+0000","last_became_peered":"2022-07-05T11:46:04.208440+0000","last_unstale":"2022-07-05T11:46:21.359758+0000","last_undegraded":"2022-07-05T11:46:21.359758+0000","last_fullsized":"2022-07-05T11:46:21.359758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974079+0000","last_change":"2022-07-05T11:46:04.592371+0000","last_active":"2022-07-05T11:46:08.974079+0000","last_peered":"2022-07-05T11:46:08.974079+0000","last_clean":"2022-07-05T11:46:08.974079+0000","last_became_active":"2022-07-05T11:46:04.592201+0000","last_became_peered":"2022-07-05T11:46:04.592201+0000","last_unstale":"2022-07-05T11:46:08.974079+0000","last_undegraded":"2022-07-05T11:46:08.974079+0000","last_fullsized":"2022-07-05T11:46:08.974079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.982904+0000","last_change":"2022-07-05T11:46:04.211261+0000","last_active":"2022-07-05T11:46:09.982904+0000","last_peered":"2022-07-05T11:46:09.982904+0000","last_clean":"2022-07-05T11:46:09.982904+0000","last_became_active":"2022-07-05T11:46:04.211004+0000","last_became_peered":"2022-07-05T11:46:04.211004+0000","last_unstale":"2022-07-05T11:46:09.982904+0000","last_undegraded":"2022-07-05T11:46:09.982904+0000","last_fullsized":"2022-07-05T11:46:09.982904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974789+0000","last_change":"2022-07-05T11:46:04.597787+0000","last_active":"2022-07-05T11:46:08.974789+0000","last_peered":"2022-07-05T11:46:08.974789+0000","last_clean":"2022-07-05T11:46:08.974789+0000","last_became_active":"2022-07-05T11:46:04.597433+0000","last_became_peered":"2022-07-05T11:46:04.597433+0000","last_unstale":"2022-07-05T11:46:08.974789+0000","last_undegraded":"2022-07-05T11:46:08.974789+0000","last_fullsized":"2022-07-05T11:46:08.974789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974038+0000","last_change":"2022-07-05T11:46:04.211347+0000","last_active":"2022-07-05T11:46:08.974038+0000","last_peered":"2022-07-05T11:46:08.974038+0000","last_clean":"2022-07-05T11:46:08.974038+0000","last_became_active":"2022-07-05T11:46:04.211045+0000","last_became_peered":"2022-07-05T11:46:04.211045+0000","last_unstale":"2022-07-05T11:46:08.974038+0000","last_undegraded":"2022-07-05T11:46:08.974038+0000","last_fullsized":"2022-07-05T11:46:08.974038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973840+0000","last_change":"2022-07-05T11:46:04.587177+0000","last_active":"2022-07-05T11:46:08.973840+0000","last_peered":"2022-07-05T11:46:08.973840+0000","last_clean":"2022-07-05T11:46:08.973840+0000","last_became_active":"2022-07-05T11:46:04.586915+0000","last_became_peered":"2022-07-05T11:46:04.586915+0000","last_unstale":"2022-07-05T11:46:08.973840+0000","last_undegraded":"2022-07-05T11:46:08.973840+0000","last_fullsized":"2022-07-05T11:46:08.973840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317123+0000","last_change":"2022-07-05T11:46:04.213135+0000","last_active":"2022-07-05T11:46:10.317123+0000","last_peered":"2022-07-05T11:46:10.317123+0000","last_clean":"2022-07-05T11:46:10.317123+0000","last_became_active":"2022-07-05T11:46:04.212877+0000","last_became_peered":"2022-07-05T11:46:04.212877+0000","last_unstale":"2022-07-05T11:46:10.317123+0000","last_undegraded":"2022-07-05T11:46:10.317123+0000","last_fullsized":"2022-07-05T11:46:10.317123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975178+0000","last_change":"2022-07-05T11:46:04.598414+0000","last_active":"2022-07-05T11:46:08.975178+0000","last_peered":"2022-07-05T11:46:08.975178+0000","last_clean":"2022-07-05T11:46:08.975178+0000","last_became_active":"2022-07-05T11:46:04.595082+0000","last_became_peered":"2022-07-05T11:46:04.595082+0000","last_unstale":"2022-07-05T11:46:08.975178+0000","last_undegraded":"2022-07-05T11:46:08.975178+0000","last_fullsized":"2022-07-05T11:46:08.975178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360365+0000","last_change":"2022-07-05T11:46:04.208533+0000","last_active":"2022-07-05T11:46:21.360365+0000","last_peered":"2022-07-05T11:46:21.360365+0000","last_clean":"2022-07-05T11:46:21.360365+0000","last_became_active":"2022-07-05T11:46:04.208198+0000","last_became_peered":"2022-07-05T11:46:04.208198+0000","last_unstale":"2022-07-05T11:46:21.360365+0000","last_undegraded":"2022-07-05T11:46:21.360365+0000","last_fullsized":"2022-07-05T11:46:21.360365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029685+0000","last_change":"2022-07-05T11:46:04.590329+0000","last_active":"2022-07-05T11:46:09.029685+0000","last_peered":"2022-07-05T11:46:09.029685+0000","last_clean":"2022-07-05T11:46:09.029685+0000","last_became_active":"2022-07-05T11:46:04.590046+0000","last_became_peered":"2022-07-05T11:46:04.590046+0000","last_unstale":"2022-07-05T11:46:09.029685+0000","last_undegraded":"2022-07-05T11:46:09.029685+0000","last_fullsized":"2022-07-05T11:46:09.029685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352181+0000","last_change":"2022-07-05T11:46:04.207526+0000","last_active":"2022-07-05T11:46:20.352181+0000","last_peered":"2022-07-05T11:46:20.352181+0000","last_clean":"2022-07-05T11:46:20.352181+0000","last_became_active":"2022-07-05T11:46:04.207209+0000","last_became_peered":"2022-07-05T11:46:04.207209+0000","last_unstale":"2022-07-05T11:46:20.352181+0000","last_undegraded":"2022-07-05T11:46:20.352181+0000","last_fullsized":"2022-07-05T11:46:20.352181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029663+0000","last_change":"2022-07-05T11:46:04.590203+0000","last_active":"2022-07-05T11:46:09.029663+0000","last_peered":"2022-07-05T11:46:09.029663+0000","last_clean":"2022-07-05T11:46:09.029663+0000","last_became_active":"2022-07-05T11:46:04.589893+0000","last_became_peered":"2022-07-05T11:46:04.589893+0000","last_unstale":"2022-07-05T11:46:09.029663+0000","last_undegraded":"2022-07-05T11:46:09.029663+0000","last_fullsized":"2022-07-05T11:46:09.029663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407980+0000","last_change":"2022-07-05T11:46:04.207726+0000","last_active":"2022-07-05T11:46:10.407980+0000","last_peered":"2022-07-05T11:46:10.407980+0000","last_clean":"2022-07-05T11:46:10.407980+0000","last_became_active":"2022-07-05T11:46:04.207398+0000","last_became_peered":"2022-07-05T11:46:04.207398+0000","last_unstale":"2022-07-05T11:46:10.407980+0000","last_undegraded":"2022-07-05T11:46:10.407980+0000","last_fullsized":"2022-07-05T11:46:10.407980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028460+0000","last_change":"2022-07-05T11:46:04.598660+0000","last_active":"2022-07-05T11:46:09.028460+0000","last_peered":"2022-07-05T11:46:09.028460+0000","last_clean":"2022-07-05T11:46:09.028460+0000","last_became_active":"2022-07-05T11:46:04.598419+0000","last_became_peered":"2022-07-05T11:46:04.598419+0000","last_unstale":"2022-07-05T11:46:09.028460+0000","last_undegraded":"2022-07-05T11:46:09.028460+0000","last_fullsized":"2022-07-05T11:46:09.028460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028769+0000","last_change":"2022-07-05T11:46:04.214164+0000","last_active":"2022-07-05T11:46:09.028769+0000","last_peered":"2022-07-05T11:46:09.028769+0000","last_clean":"2022-07-05T11:46:09.028769+0000","last_became_active":"2022-07-05T11:46:04.213794+0000","last_became_peered":"2022-07-05T11:46:04.213794+0000","last_unstale":"2022-07-05T11:46:09.028769+0000","last_undegraded":"2022-07-05T11:46:09.028769+0000","last_fullsized":"2022-07-05T11:46:09.028769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.599315+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.599091+0000","last_became_peered":"2022-07-05T11:46:04.599091+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353175+0000","last_change":"2022-07-05T11:46:04.208200+0000","last_active":"2022-07-05T11:46:20.353175+0000","last_peered":"2022-07-05T11:46:20.353175+0000","last_clean":"2022-07-05T11:46:20.353175+0000","last_became_active":"2022-07-05T11:46:04.207891+0000","last_became_peered":"2022-07-05T11:46:04.207891+0000","last_unstale":"2022-07-05T11:46:20.353175+0000","last_undegraded":"2022-07-05T11:46:20.353175+0000","last_fullsized":"2022-07-05T11:46:20.353175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028740+0000","last_change":"2022-07-05T11:46:04.594011+0000","last_active":"2022-07-05T11:46:09.028740+0000","last_peered":"2022-07-05T11:46:09.028740+0000","last_clean":"2022-07-05T11:46:09.028740+0000","last_became_active":"2022-07-05T11:46:04.593800+0000","last_became_peered":"2022-07-05T11:46:04.593800+0000","last_unstale":"2022-07-05T11:46:09.028740+0000","last_undegraded":"2022-07-05T11:46:09.028740+0000","last_fullsized":"2022-07-05T11:46:09.028740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353238+0000","last_change":"2022-07-05T11:46:04.206715+0000","last_active":"2022-07-05T11:46:20.353238+0000","last_peered":"2022-07-05T11:46:20.353238+0000","last_clean":"2022-07-05T11:46:20.353238+0000","last_became_active":"2022-07-05T11:46:04.206230+0000","last_became_peered":"2022-07-05T11:46:04.206230+0000","last_unstale":"2022-07-05T11:46:20.353238+0000","last_undegraded":"2022-07-05T11:46:20.353238+0000","last_fullsized":"2022-07-05T11:46:20.353238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029238+0000","last_change":"2022-07-05T11:46:04.590527+0000","last_active":"2022-07-05T11:46:09.029238+0000","last_peered":"2022-07-05T11:46:09.029238+0000","last_clean":"2022-07-05T11:46:09.029238+0000","last_became_active":"2022-07-05T11:46:04.589992+0000","last_became_peered":"2022-07-05T11:46:04.589992+0000","last_unstale":"2022-07-05T11:46:09.029238+0000","last_undegraded":"2022-07-05T11:46:09.029238+0000","last_fullsized":"2022-07-05T11:46:09.029238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317357+0000","last_change":"2022-07-05T11:46:04.209943+0000","last_active":"2022-07-05T11:46:10.317357+0000","last_peered":"2022-07-05T11:46:10.317357+0000","last_clean":"2022-07-05T11:46:10.317357+0000","last_became_active":"2022-07-05T11:46:04.209640+0000","last_became_peered":"2022-07-05T11:46:04.209640+0000","last_unstale":"2022-07-05T11:46:10.317357+0000","last_undegraded":"2022-07-05T11:46:10.317357+0000","last_fullsized":"2022-07-05T11:46:10.317357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028615+0000","last_change":"2022-07-05T11:46:04.593997+0000","last_active":"2022-07-05T11:46:09.028615+0000","last_peered":"2022-07-05T11:46:09.028615+0000","last_clean":"2022-07-05T11:46:09.028615+0000","last_became_active":"2022-07-05T11:46:04.593708+0000","last_became_peered":"2022-07-05T11:46:04.593708+0000","last_unstale":"2022-07-05T11:46:09.028615+0000","last_undegraded":"2022-07-05T11:46:09.028615+0000","last_fullsized":"2022-07-05T11:46:09.028615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352932+0000","last_change":"2022-07-05T11:46:04.203818+0000","last_active":"2022-07-05T11:46:20.352932+0000","last_peered":"2022-07-05T11:46:20.352932+0000","last_clean":"2022-07-05T11:46:20.352932+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:20.352932+0000","last_undegraded":"2022-07-05T11:46:20.352932+0000","last_fullsized":"2022-07-05T11:46:20.352932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975098+0000","last_change":"2022-07-05T11:46:04.598669+0000","last_active":"2022-07-05T11:46:08.975098+0000","last_peered":"2022-07-05T11:46:08.975098+0000","last_clean":"2022-07-05T11:46:08.975098+0000","last_became_active":"2022-07-05T11:46:04.598400+0000","last_became_peered":"2022-07-05T11:46:04.598400+0000","last_unstale":"2022-07-05T11:46:08.975098+0000","last_undegraded":"2022-07-05T11:46:08.975098+0000","last_fullsized":"2022-07-05T11:46:08.975098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028775+0000","last_change":"2022-07-05T11:46:04.212247+0000","last_active":"2022-07-05T11:46:09.028775+0000","last_peered":"2022-07-05T11:46:09.028775+0000","last_clean":"2022-07-05T11:46:09.028775+0000","last_became_active":"2022-07-05T11:46:04.211958+0000","last_became_peered":"2022-07-05T11:46:04.211958+0000","last_unstale":"2022-07-05T11:46:09.028775+0000","last_undegraded":"2022-07-05T11:46:09.028775+0000","last_fullsized":"2022-07-05T11:46:09.028775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029158+0000","last_change":"2022-07-05T11:46:04.599477+0000","last_active":"2022-07-05T11:46:09.029158+0000","last_peered":"2022-07-05T11:46:09.029158+0000","last_clean":"2022-07-05T11:46:09.029158+0000","last_became_active":"2022-07-05T11:46:04.599214+0000","last_became_peered":"2022-07-05T11:46:04.599214+0000","last_unstale":"2022-07-05T11:46:09.029158+0000","last_undegraded":"2022-07-05T11:46:09.029158+0000","last_fullsized":"2022-07-05T11:46:09.029158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027608+0000","last_change":"2022-07-05T11:46:04.209196+0000","last_active":"2022-07-05T11:46:09.027608+0000","last_peered":"2022-07-05T11:46:09.027608+0000","last_clean":"2022-07-05T11:46:09.027608+0000","last_became_active":"2022-07-05T11:46:04.208918+0000","last_became_peered":"2022-07-05T11:46:04.208918+0000","last_unstale":"2022-07-05T11:46:09.027608+0000","last_undegraded":"2022-07-05T11:46:09.027608+0000","last_fullsized":"2022-07-05T11:46:09.027608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975167+0000","last_change":"2022-07-05T11:46:04.594414+0000","last_active":"2022-07-05T11:46:08.975167+0000","last_peered":"2022-07-05T11:46:08.975167+0000","last_clean":"2022-07-05T11:46:08.975167+0000","last_became_active":"2022-07-05T11:46:04.594114+0000","last_became_peered":"2022-07-05T11:46:04.594114+0000","last_unstale":"2022-07-05T11:46:08.975167+0000","last_undegraded":"2022-07-05T11:46:08.975167+0000","last_fullsized":"2022-07-05T11:46:08.975167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027763+0000","last_change":"2022-07-05T11:46:04.215006+0000","last_active":"2022-07-05T11:46:09.027763+0000","last_peered":"2022-07-05T11:46:09.027763+0000","last_clean":"2022-07-05T11:46:09.027763+0000","last_became_active":"2022-07-05T11:46:04.214585+0000","last_became_peered":"2022-07-05T11:46:04.214585+0000","last_unstale":"2022-07-05T11:46:09.027763+0000","last_undegraded":"2022-07-05T11:46:09.027763+0000","last_fullsized":"2022-07-05T11:46:09.027763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030101+0000","last_change":"2022-07-05T11:46:04.601912+0000","last_active":"2022-07-05T11:46:09.030101+0000","last_peered":"2022-07-05T11:46:09.030101+0000","last_clean":"2022-07-05T11:46:09.030101+0000","last_became_active":"2022-07-05T11:46:04.601605+0000","last_became_peered":"2022-07-05T11:46:04.601605+0000","last_unstale":"2022-07-05T11:46:09.030101+0000","last_undegraded":"2022-07-05T11:46:09.030101+0000","last_fullsized":"2022-07-05T11:46:09.030101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.387919+0000","last_change":"2022-07-05T11:46:04.208064+0000","last_active":"2022-07-05T11:46:40.387919+0000","last_peered":"2022-07-05T11:46:40.387919+0000","last_clean":"2022-07-05T11:46:40.387919+0000","last_became_active":"2022-07-05T11:46:04.207845+0000","last_became_peered":"2022-07-05T11:46:04.207845+0000","last_unstale":"2022-07-05T11:46:40.387919+0000","last_undegraded":"2022-07-05T11:46:40.387919+0000","last_fullsized":"2022-07-05T11:46:40.387919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030056+0000","last_change":"2022-07-05T11:46:04.589990+0000","last_active":"2022-07-05T11:46:09.030056+0000","last_peered":"2022-07-05T11:46:09.030056+0000","last_clean":"2022-07-05T11:46:09.030056+0000","last_became_active":"2022-07-05T11:46:04.589734+0000","last_became_peered":"2022-07-05T11:46:04.589734+0000","last_unstale":"2022-07-05T11:46:09.030056+0000","last_undegraded":"2022-07-05T11:46:09.030056+0000","last_fullsized":"2022-07-05T11:46:09.030056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974955+0000","last_change":"2022-07-05T11:46:04.208275+0000","last_active":"2022-07-05T11:46:08.974955+0000","last_peered":"2022-07-05T11:46:08.974955+0000","last_clean":"2022-07-05T11:46:08.974955+0000","last_became_active":"2022-07-05T11:46:04.208001+0000","last_became_peered":"2022-07-05T11:46:04.208001+0000","last_unstale":"2022-07-05T11:46:08.974955+0000","last_undegraded":"2022-07-05T11:46:08.974955+0000","last_fullsized":"2022-07-05T11:46:08.974955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028628+0000","last_change":"2022-07-05T11:46:04.597446+0000","last_active":"2022-07-05T11:46:09.028628+0000","last_peered":"2022-07-05T11:46:09.028628+0000","last_clean":"2022-07-05T11:46:09.028628+0000","last_became_active":"2022-07-05T11:46:04.596828+0000","last_became_peered":"2022-07-05T11:46:04.596828+0000","last_unstale":"2022-07-05T11:46:09.028628+0000","last_undegraded":"2022-07-05T11:46:09.028628+0000","last_fullsized":"2022-07-05T11:46:09.028628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360630+0000","last_change":"2022-07-05T11:46:04.211080+0000","last_active":"2022-07-05T11:46:21.360630+0000","last_peered":"2022-07-05T11:46:21.360630+0000","last_clean":"2022-07-05T11:46:21.360630+0000","last_became_active":"2022-07-05T11:46:04.210805+0000","last_became_peered":"2022-07-05T11:46:04.210805+0000","last_unstale":"2022-07-05T11:46:21.360630+0000","last_undegraded":"2022-07-05T11:46:21.360630+0000","last_fullsized":"2022-07-05T11:46:21.360630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012330+0000","last_change":"2022-07-05T11:46:04.594116+0000","last_active":"2022-07-05T11:46:09.012330+0000","last_peered":"2022-07-05T11:46:09.012330+0000","last_clean":"2022-07-05T11:46:09.012330+0000","last_became_active":"2022-07-05T11:46:04.593716+0000","last_became_peered":"2022-07-05T11:46:04.593716+0000","last_unstale":"2022-07-05T11:46:09.012330+0000","last_undegraded":"2022-07-05T11:46:09.012330+0000","last_fullsized":"2022-07-05T11:46:09.012330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017611+0000","last_change":"2022-07-05T11:46:09.014114+0000","last_active":"2022-07-05T11:46:09.017611+0000","last_peered":"2022-07-05T11:46:09.017611+0000","last_clean":"2022-07-05T11:46:09.017611+0000","last_became_active":"2022-07-05T11:46:09.013707+0000","last_became_peered":"2022-07-05T11:46:09.013707+0000","last_unstale":"2022-07-05T11:46:09.017611+0000","last_undegraded":"2022-07-05T11:46:09.017611+0000","last_fullsized":"2022-07-05T11:46:09.017611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029324+0000","last_change":"2022-07-05T11:46:04.213375+0000","last_active":"2022-07-05T11:46:09.029324+0000","last_peered":"2022-07-05T11:46:09.029324+0000","last_clean":"2022-07-05T11:46:09.029324+0000","last_became_active":"2022-07-05T11:46:04.213094+0000","last_became_peered":"2022-07-05T11:46:04.213094+0000","last_unstale":"2022-07-05T11:46:09.029324+0000","last_undegraded":"2022-07-05T11:46:09.029324+0000","last_fullsized":"2022-07-05T11:46:09.029324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027648+0000","last_change":"2022-07-05T11:46:04.599779+0000","last_active":"2022-07-05T11:46:09.027648+0000","last_peered":"2022-07-05T11:46:09.027648+0000","last_clean":"2022-07-05T11:46:09.027648+0000","last_became_active":"2022-07-05T11:46:04.597330+0000","last_became_peered":"2022-07-05T11:46:04.597330+0000","last_unstale":"2022-07-05T11:46:09.027648+0000","last_undegraded":"2022-07-05T11:46:09.027648+0000","last_fullsized":"2022-07-05T11:46:09.027648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012222+0000","last_change":"2022-07-05T11:46:08.615050+0000","last_active":"2022-07-05T11:46:09.012222+0000","last_peered":"2022-07-05T11:46:09.012222+0000","last_clean":"2022-07-05T11:46:09.012222+0000","last_became_active":"2022-07-05T11:46:08.614715+0000","last_became_peered":"2022-07-05T11:46:08.614715+0000","last_unstale":"2022-07-05T11:46:09.012222+0000","last_undegraded":"2022-07-05T11:46:09.012222+0000","last_fullsized":"2022-07-05T11:46:09.012222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975318+0000","last_change":"2022-07-05T11:46:04.206835+0000","last_active":"2022-07-05T11:46:08.975318+0000","last_peered":"2022-07-05T11:46:08.975318+0000","last_clean":"2022-07-05T11:46:08.975318+0000","last_became_active":"2022-07-05T11:46:04.206389+0000","last_became_peered":"2022-07-05T11:46:04.206389+0000","last_unstale":"2022-07-05T11:46:08.975318+0000","last_undegraded":"2022-07-05T11:46:08.975318+0000","last_fullsized":"2022-07-05T11:46:08.975318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012352+0000","last_change":"2022-07-05T11:46:04.595704+0000","last_active":"2022-07-05T11:46:09.012352+0000","last_peered":"2022-07-05T11:46:09.012352+0000","last_clean":"2022-07-05T11:46:09.012352+0000","last_became_active":"2022-07-05T11:46:04.594581+0000","last_became_peered":"2022-07-05T11:46:04.594581+0000","last_unstale":"2022-07-05T11:46:09.012352+0000","last_undegraded":"2022-07-05T11:46:09.012352+0000","last_fullsized":"2022-07-05T11:46:09.012352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028313+0000","last_change":"2022-07-05T11:46:08.618434+0000","last_active":"2022-07-05T11:46:09.028313+0000","last_peered":"2022-07-05T11:46:09.028313+0000","last_clean":"2022-07-05T11:46:09.028313+0000","last_became_active":"2022-07-05T11:46:08.618022+0000","last_became_peered":"2022-07-05T11:46:08.618022+0000","last_unstale":"2022-07-05T11:46:09.028313+0000","last_undegraded":"2022-07-05T11:46:09.028313+0000","last_fullsized":"2022-07-05T11:46:09.028313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029453+0000","last_change":"2022-07-05T11:46:04.213103+0000","last_active":"2022-07-05T11:46:09.029453+0000","last_peered":"2022-07-05T11:46:09.029453+0000","last_clean":"2022-07-05T11:46:09.029453+0000","last_became_active":"2022-07-05T11:46:04.211627+0000","last_became_peered":"2022-07-05T11:46:04.211627+0000","last_unstale":"2022-07-05T11:46:09.029453+0000","last_undegraded":"2022-07-05T11:46:09.029453+0000","last_fullsized":"2022-07-05T11:46:09.029453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012463+0000","last_change":"2022-07-05T11:46:04.593912+0000","last_active":"2022-07-05T11:46:09.012463+0000","last_peered":"2022-07-05T11:46:09.012463+0000","last_clean":"2022-07-05T11:46:09.012463+0000","last_became_active":"2022-07-05T11:46:04.593631+0000","last_became_peered":"2022-07-05T11:46:04.593631+0000","last_unstale":"2022-07-05T11:46:09.012463+0000","last_undegraded":"2022-07-05T11:46:09.012463+0000","last_fullsized":"2022-07-05T11:46:09.012463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028223+0000","last_change":"2022-07-05T11:46:09.013932+0000","last_active":"2022-07-05T11:46:09.028223+0000","last_peered":"2022-07-05T11:46:09.028223+0000","last_clean":"2022-07-05T11:46:09.028223+0000","last_became_active":"2022-07-05T11:46:09.013609+0000","last_became_peered":"2022-07-05T11:46:09.013609+0000","last_unstale":"2022-07-05T11:46:09.028223+0000","last_undegraded":"2022-07-05T11:46:09.028223+0000","last_fullsized":"2022-07-05T11:46:09.028223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028226+0000","last_change":"2022-07-05T11:46:09.016568+0000","last_active":"2022-07-05T11:46:09.028226+0000","last_peered":"2022-07-05T11:46:09.028226+0000","last_clean":"2022-07-05T11:46:09.028226+0000","last_became_active":"2022-07-05T11:46:09.016162+0000","last_became_peered":"2022-07-05T11:46:09.016162+0000","last_unstale":"2022-07-05T11:46:09.028226+0000","last_undegraded":"2022-07-05T11:46:09.028226+0000","last_fullsized":"2022-07-05T11:46:09.028226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:41.395640+0000","last_change":"2022-07-05T11:46:04.208656+0000","last_active":"2022-07-05T11:46:41.395640+0000","last_peered":"2022-07-05T11:46:41.395640+0000","last_clean":"2022-07-05T11:46:41.395640+0000","last_became_active":"2022-07-05T11:46:04.208394+0000","last_became_peered":"2022-07-05T11:46:04.208394+0000","last_unstale":"2022-07-05T11:46:41.395640+0000","last_undegraded":"2022-07-05T11:46:41.395640+0000","last_fullsized":"2022-07-05T11:46:41.395640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":830,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027906+0000","last_change":"2022-07-05T11:46:04.600156+0000","last_active":"2022-07-05T11:46:09.027906+0000","last_peered":"2022-07-05T11:46:09.027906+0000","last_clean":"2022-07-05T11:46:09.027906+0000","last_became_active":"2022-07-05T11:46:04.599836+0000","last_became_peered":"2022-07-05T11:46:04.599836+0000","last_unstale":"2022-07-05T11:46:09.027906+0000","last_undegraded":"2022-07-05T11:46:09.027906+0000","last_fullsized":"2022-07-05T11:46:09.027906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027863+0000","last_change":"2022-07-05T11:46:04.599555+0000","last_active":"2022-07-05T11:46:09.027863+0000","last_peered":"2022-07-05T11:46:09.027863+0000","last_clean":"2022-07-05T11:46:09.027863+0000","last_became_active":"2022-07-05T11:46:04.597036+0000","last_became_peered":"2022-07-05T11:46:04.597036+0000","last_unstale":"2022-07-05T11:46:09.027863+0000","last_undegraded":"2022-07-05T11:46:09.027863+0000","last_fullsized":"2022-07-05T11:46:09.027863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.357392+0000","last_change":"2022-07-05T11:46:04.215037+0000","last_active":"2022-07-05T11:46:21.357392+0000","last_peered":"2022-07-05T11:46:21.357392+0000","last_clean":"2022-07-05T11:46:21.357392+0000","last_became_active":"2022-07-05T11:46:04.214699+0000","last_became_peered":"2022-07-05T11:46:04.214699+0000","last_unstale":"2022-07-05T11:46:21.357392+0000","last_undegraded":"2022-07-05T11:46:21.357392+0000","last_fullsized":"2022-07-05T11:46:21.357392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012966+0000","last_change":"2022-07-05T11:46:00.405416+0000","last_active":"2022-07-05T11:46:09.012966+0000","last_peered":"2022-07-05T11:46:09.012966+0000","last_clean":"2022-07-05T11:46:09.012966+0000","last_became_active":"2022-07-05T11:46:00.405179+0000","last_became_peered":"2022-07-05T11:46:00.405179+0000","last_unstale":"2022-07-05T11:46:09.012966+0000","last_undegraded":"2022-07-05T11:46:09.012966+0000","last_fullsized":"2022-07-05T11:46:09.012966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027570+0000","last_change":"2022-07-05T11:46:08.616541+0000","last_active":"2022-07-05T11:46:09.027570+0000","last_peered":"2022-07-05T11:46:09.027570+0000","last_clean":"2022-07-05T11:46:09.027570+0000","last_became_active":"2022-07-05T11:46:08.616124+0000","last_became_peered":"2022-07-05T11:46:08.616124+0000","last_unstale":"2022-07-05T11:46:09.027570+0000","last_undegraded":"2022-07-05T11:46:09.027570+0000","last_fullsized":"2022-07-05T11:46:09.027570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028425+0000","last_change":"2022-07-05T11:46:04.584095+0000","last_active":"2022-07-05T11:46:09.028425+0000","last_peered":"2022-07-05T11:46:09.028425+0000","last_clean":"2022-07-05T11:46:09.028425+0000","last_became_active":"2022-07-05T11:46:04.583806+0000","last_became_peered":"2022-07-05T11:46:04.583806+0000","last_unstale":"2022-07-05T11:46:09.028425+0000","last_undegraded":"2022-07-05T11:46:09.028425+0000","last_fullsized":"2022-07-05T11:46:09.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974096+0000","last_change":"2022-07-05T11:46:00.174377+0000","last_active":"2022-07-05T11:46:08.974096+0000","last_peered":"2022-07-05T11:46:08.974096+0000","last_clean":"2022-07-05T11:46:08.974096+0000","last_became_active":"2022-07-05T11:46:00.174041+0000","last_became_peered":"2022-07-05T11:46:00.174041+0000","last_unstale":"2022-07-05T11:46:08.974096+0000","last_undegraded":"2022-07-05T11:46:08.974096+0000","last_fullsized":"2022-07-05T11:46:08.974096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029651+0000","last_change":"2022-07-05T11:46:04.201186+0000","last_active":"2022-07-05T11:46:09.029651+0000","last_peered":"2022-07-05T11:46:09.029651+0000","last_clean":"2022-07-05T11:46:09.029651+0000","last_became_active":"2022-07-05T11:46:04.200331+0000","last_became_peered":"2022-07-05T11:46:04.200331+0000","last_unstale":"2022-07-05T11:46:09.029651+0000","last_undegraded":"2022-07-05T11:46:09.029651+0000","last_fullsized":"2022-07-05T11:46:09.029651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012267+0000","last_change":"2022-07-05T11:46:08.617187+0000","last_active":"2022-07-05T11:46:09.012267+0000","last_peered":"2022-07-05T11:46:09.012267+0000","last_clean":"2022-07-05T11:46:09.012267+0000","last_became_active":"2022-07-05T11:46:08.616787+0000","last_became_peered":"2022-07-05T11:46:08.616787+0000","last_unstale":"2022-07-05T11:46:09.012267+0000","last_undegraded":"2022-07-05T11:46:09.012267+0000","last_fullsized":"2022-07-05T11:46:09.012267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974758+0000","last_change":"2022-07-05T11:46:04.595606+0000","last_active":"2022-07-05T11:46:08.974758+0000","last_peered":"2022-07-05T11:46:08.974758+0000","last_clean":"2022-07-05T11:46:08.974758+0000","last_became_active":"2022-07-05T11:46:04.594962+0000","last_became_peered":"2022-07-05T11:46:04.594962+0000","last_unstale":"2022-07-05T11:46:08.974758+0000","last_undegraded":"2022-07-05T11:46:08.974758+0000","last_fullsized":"2022-07-05T11:46:08.974758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028691+0000","last_change":"2022-07-05T11:46:04.208492+0000","last_active":"2022-07-05T11:46:09.028691+0000","last_peered":"2022-07-05T11:46:09.028691+0000","last_clean":"2022-07-05T11:46:09.028691+0000","last_became_active":"2022-07-05T11:46:04.208135+0000","last_became_peered":"2022-07-05T11:46:04.208135+0000","last_unstale":"2022-07-05T11:46:09.028691+0000","last_undegraded":"2022-07-05T11:46:09.028691+0000","last_fullsized":"2022-07-05T11:46:09.028691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028400+0000","last_change":"2022-07-05T11:46:01.122048+0000","last_active":"2022-07-05T11:46:09.028400+0000","last_peered":"2022-07-05T11:46:09.028400+0000","last_clean":"2022-07-05T11:46:09.028400+0000","last_became_active":"2022-07-05T11:46:01.121724+0000","last_became_peered":"2022-07-05T11:46:01.121724+0000","last_unstale":"2022-07-05T11:46:09.028400+0000","last_undegraded":"2022-07-05T11:46:09.028400+0000","last_fullsized":"2022-07-05T11:46:09.028400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029610+0000","last_change":"2022-07-05T11:46:08.614936+0000","last_active":"2022-07-05T11:46:09.029610+0000","last_peered":"2022-07-05T11:46:09.029610+0000","last_clean":"2022-07-05T11:46:09.029610+0000","last_became_active":"2022-07-05T11:46:08.613212+0000","last_became_peered":"2022-07-05T11:46:08.613212+0000","last_unstale":"2022-07-05T11:46:09.029610+0000","last_undegraded":"2022-07-05T11:46:09.029610+0000","last_fullsized":"2022-07-05T11:46:09.029610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358743+0000","last_change":"2022-07-05T11:46:04.207235+0000","last_active":"2022-07-05T11:46:21.358743+0000","last_peered":"2022-07-05T11:46:21.358743+0000","last_clean":"2022-07-05T11:46:21.358743+0000","last_became_active":"2022-07-05T11:46:04.206912+0000","last_became_peered":"2022-07-05T11:46:04.206912+0000","last_unstale":"2022-07-05T11:46:21.358743+0000","last_undegraded":"2022-07-05T11:46:21.358743+0000","last_fullsized":"2022-07-05T11:46:21.358743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027868+0000","last_change":"2022-07-05T11:46:00.387606+0000","last_active":"2022-07-05T11:46:09.027868+0000","last_peered":"2022-07-05T11:46:09.027868+0000","last_clean":"2022-07-05T11:46:09.027868+0000","last_became_active":"2022-07-05T11:46:00.387285+0000","last_became_peered":"2022-07-05T11:46:00.387285+0000","last_unstale":"2022-07-05T11:46:09.027868+0000","last_undegraded":"2022-07-05T11:46:09.027868+0000","last_fullsized":"2022-07-05T11:46:09.027868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975087+0000","last_change":"2022-07-05T11:46:04.597434+0000","last_active":"2022-07-05T11:46:08.975087+0000","last_peered":"2022-07-05T11:46:08.975087+0000","last_clean":"2022-07-05T11:46:08.975087+0000","last_became_active":"2022-07-05T11:46:04.596283+0000","last_became_peered":"2022-07-05T11:46:04.596283+0000","last_unstale":"2022-07-05T11:46:08.975087+0000","last_undegraded":"2022-07-05T11:46:08.975087+0000","last_fullsized":"2022-07-05T11:46:08.975087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030525+0000","last_change":"2022-07-05T11:46:08.618008+0000","last_active":"2022-07-05T11:46:09.030525+0000","last_peered":"2022-07-05T11:46:09.030525+0000","last_clean":"2022-07-05T11:46:09.030525+0000","last_became_active":"2022-07-05T11:46:08.617640+0000","last_became_peered":"2022-07-05T11:46:08.617640+0000","last_unstale":"2022-07-05T11:46:09.030525+0000","last_undegraded":"2022-07-05T11:46:09.030525+0000","last_fullsized":"2022-07-05T11:46:09.030525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407205+0000","last_change":"2022-07-05T11:46:04.205557+0000","last_active":"2022-07-05T11:46:10.407205+0000","last_peered":"2022-07-05T11:46:10.407205+0000","last_clean":"2022-07-05T11:46:10.407205+0000","last_became_active":"2022-07-05T11:46:04.203760+0000","last_became_peered":"2022-07-05T11:46:04.203760+0000","last_unstale":"2022-07-05T11:46:10.407205+0000","last_undegraded":"2022-07-05T11:46:10.407205+0000","last_fullsized":"2022-07-05T11:46:10.407205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027789+0000","last_change":"2022-07-05T11:45:58.489958+0000","last_active":"2022-07-05T11:46:09.027789+0000","last_peered":"2022-07-05T11:46:09.027789+0000","last_clean":"2022-07-05T11:46:09.027789+0000","last_became_active":"2022-07-05T11:45:58.489710+0000","last_became_peered":"2022-07-05T11:45:58.489710+0000","last_unstale":"2022-07-05T11:46:09.027789+0000","last_undegraded":"2022-07-05T11:46:09.027789+0000","last_fullsized":"2022-07-05T11:46:09.027789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_clean_scrub_stamp":"2022-07-05T11:45:57.143009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012518+0000","last_change":"2022-07-05T11:46:01.154008+0000","last_active":"2022-07-05T11:46:09.012518+0000","last_peered":"2022-07-05T11:46:09.012518+0000","last_clean":"2022-07-05T11:46:09.012518+0000","last_became_active":"2022-07-05T11:46:01.153653+0000","last_became_peered":"2022-07-05T11:46:01.153653+0000","last_unstale":"2022-07-05T11:46:09.012518+0000","last_undegraded":"2022-07-05T11:46:09.012518+0000","last_fullsized":"2022-07-05T11:46:09.012518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029959+0000","last_change":"2022-07-05T11:46:04.597444+0000","last_active":"2022-07-05T11:46:09.029959+0000","last_peered":"2022-07-05T11:46:09.029959+0000","last_clean":"2022-07-05T11:46:09.029959+0000","last_became_active":"2022-07-05T11:46:04.597199+0000","last_became_peered":"2022-07-05T11:46:04.597199+0000","last_unstale":"2022-07-05T11:46:09.029959+0000","last_undegraded":"2022-07-05T11:46:09.029959+0000","last_fullsized":"2022-07-05T11:46:09.029959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028215+0000","last_change":"2022-07-05T11:46:09.017084+0000","last_active":"2022-07-05T11:46:09.028215+0000","last_peered":"2022-07-05T11:46:09.028215+0000","last_clean":"2022-07-05T11:46:09.028215+0000","last_became_active":"2022-07-05T11:46:09.016658+0000","last_became_peered":"2022-07-05T11:46:09.016658+0000","last_unstale":"2022-07-05T11:46:09.028215+0000","last_undegraded":"2022-07-05T11:46:09.028215+0000","last_fullsized":"2022-07-05T11:46:09.028215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358568+0000","last_change":"2022-07-05T11:46:04.209767+0000","last_active":"2022-07-05T11:46:21.358568+0000","last_peered":"2022-07-05T11:46:21.358568+0000","last_clean":"2022-07-05T11:46:21.358568+0000","last_became_active":"2022-07-05T11:46:04.209524+0000","last_became_peered":"2022-07-05T11:46:04.209524+0000","last_unstale":"2022-07-05T11:46:21.358568+0000","last_undegraded":"2022-07-05T11:46:21.358568+0000","last_fullsized":"2022-07-05T11:46:21.358568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028541+0000","last_change":"2022-07-05T11:46:01.118061+0000","last_active":"2022-07-05T11:46:09.028541+0000","last_peered":"2022-07-05T11:46:09.028541+0000","last_clean":"2022-07-05T11:46:09.028541+0000","last_became_active":"2022-07-05T11:46:01.117762+0000","last_became_peered":"2022-07-05T11:46:01.117762+0000","last_unstale":"2022-07-05T11:46:09.028541+0000","last_undegraded":"2022-07-05T11:46:09.028541+0000","last_fullsized":"2022-07-05T11:46:09.028541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028916+0000","last_change":"2022-07-05T11:46:04.594377+0000","last_active":"2022-07-05T11:46:09.028916+0000","last_peered":"2022-07-05T11:46:09.028916+0000","last_clean":"2022-07-05T11:46:09.028916+0000","last_became_active":"2022-07-05T11:46:04.594103+0000","last_became_peered":"2022-07-05T11:46:04.594103+0000","last_unstale":"2022-07-05T11:46:09.028916+0000","last_undegraded":"2022-07-05T11:46:09.028916+0000","last_fullsized":"2022-07-05T11:46:09.028916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017137+0000","last_change":"2022-07-05T11:46:09.014687+0000","last_active":"2022-07-05T11:46:09.017137+0000","last_peered":"2022-07-05T11:46:09.017137+0000","last_clean":"2022-07-05T11:46:09.017137+0000","last_became_active":"2022-07-05T11:46:09.014298+0000","last_became_peered":"2022-07-05T11:46:09.014298+0000","last_unstale":"2022-07-05T11:46:09.017137+0000","last_undegraded":"2022-07-05T11:46:09.017137+0000","last_fullsized":"2022-07-05T11:46:09.017137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028627+0000","last_change":"2022-07-05T11:46:04.593068+0000","last_active":"2022-07-05T11:46:09.028627+0000","last_peered":"2022-07-05T11:46:09.028627+0000","last_clean":"2022-07-05T11:46:09.028627+0000","last_became_active":"2022-07-05T11:46:04.592770+0000","last_became_peered":"2022-07-05T11:46:04.592770+0000","last_unstale":"2022-07-05T11:46:09.028627+0000","last_undegraded":"2022-07-05T11:46:09.028627+0000","last_fullsized":"2022-07-05T11:46:09.028627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:22.362211+0000","last_change":"2022-07-05T11:46:04.205846+0000","last_active":"2022-07-05T11:46:22.362211+0000","last_peered":"2022-07-05T11:46:22.362211+0000","last_clean":"2022-07-05T11:46:22.362211+0000","last_became_active":"2022-07-05T11:46:04.205358+0000","last_became_peered":"2022-07-05T11:46:04.205358+0000","last_unstale":"2022-07-05T11:46:22.362211+0000","last_undegraded":"2022-07-05T11:46:22.362211+0000","last_fullsized":"2022-07-05T11:46:22.362211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028856+0000","last_change":"2022-07-05T11:46:00.171709+0000","last_active":"2022-07-05T11:46:09.028856+0000","last_peered":"2022-07-05T11:46:09.028856+0000","last_clean":"2022-07-05T11:46:09.028856+0000","last_became_active":"2022-07-05T11:46:00.171328+0000","last_became_peered":"2022-07-05T11:46:00.171328+0000","last_unstale":"2022-07-05T11:46:09.028856+0000","last_undegraded":"2022-07-05T11:46:09.028856+0000","last_fullsized":"2022-07-05T11:46:09.028856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017640+0000","last_change":"2022-07-05T11:46:09.015332+0000","last_active":"2022-07-05T11:46:09.017640+0000","last_peered":"2022-07-05T11:46:09.017640+0000","last_clean":"2022-07-05T11:46:09.017640+0000","last_became_active":"2022-07-05T11:46:09.013688+0000","last_became_peered":"2022-07-05T11:46:09.013688+0000","last_unstale":"2022-07-05T11:46:09.017640+0000","last_undegraded":"2022-07-05T11:46:09.017640+0000","last_fullsized":"2022-07-05T11:46:09.017640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028419+0000","last_change":"2022-07-05T11:46:04.600986+0000","last_active":"2022-07-05T11:46:09.028419+0000","last_peered":"2022-07-05T11:46:09.028419+0000","last_clean":"2022-07-05T11:46:09.028419+0000","last_became_active":"2022-07-05T11:46:04.600619+0000","last_became_peered":"2022-07-05T11:46:04.600619+0000","last_unstale":"2022-07-05T11:46:09.028419+0000","last_undegraded":"2022-07-05T11:46:09.028419+0000","last_fullsized":"2022-07-05T11:46:09.028419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030201+0000","last_change":"2022-07-05T11:46:04.201044+0000","last_active":"2022-07-05T11:46:09.030201+0000","last_peered":"2022-07-05T11:46:09.030201+0000","last_clean":"2022-07-05T11:46:09.030201+0000","last_became_active":"2022-07-05T11:46:04.200743+0000","last_became_peered":"2022-07-05T11:46:04.200743+0000","last_unstale":"2022-07-05T11:46:09.030201+0000","last_undegraded":"2022-07-05T11:46:09.030201+0000","last_fullsized":"2022-07-05T11:46:09.030201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974024+0000","last_change":"2022-07-05T11:46:00.406891+0000","last_active":"2022-07-05T11:46:08.974024+0000","last_peered":"2022-07-05T11:46:08.974024+0000","last_clean":"2022-07-05T11:46:08.974024+0000","last_became_active":"2022-07-05T11:46:00.406555+0000","last_became_peered":"2022-07-05T11:46:00.406555+0000","last_unstale":"2022-07-05T11:46:08.974024+0000","last_undegraded":"2022-07-05T11:46:08.974024+0000","last_fullsized":"2022-07-05T11:46:08.974024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027228+0000","last_change":"2022-07-05T11:46:09.014076+0000","last_active":"2022-07-05T11:46:09.027228+0000","last_peered":"2022-07-05T11:46:09.027228+0000","last_clean":"2022-07-05T11:46:09.027228+0000","last_became_active":"2022-07-05T11:46:09.013674+0000","last_became_peered":"2022-07-05T11:46:09.013674+0000","last_unstale":"2022-07-05T11:46:09.027228+0000","last_undegraded":"2022-07-05T11:46:09.027228+0000","last_fullsized":"2022-07-05T11:46:09.027228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974896+0000","last_change":"2022-07-05T11:46:04.204890+0000","last_active":"2022-07-05T11:46:08.974896+0000","last_peered":"2022-07-05T11:46:08.974896+0000","last_clean":"2022-07-05T11:46:08.974896+0000","last_became_active":"2022-07-05T11:46:04.204615+0000","last_became_peered":"2022-07-05T11:46:04.204615+0000","last_unstale":"2022-07-05T11:46:08.974896+0000","last_undegraded":"2022-07-05T11:46:08.974896+0000","last_fullsized":"2022-07-05T11:46:08.974896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974109+0000","last_change":"2022-07-05T11:46:04.592359+0000","last_active":"2022-07-05T11:46:08.974109+0000","last_peered":"2022-07-05T11:46:08.974109+0000","last_clean":"2022-07-05T11:46:08.974109+0000","last_became_active":"2022-07-05T11:46:04.592112+0000","last_became_peered":"2022-07-05T11:46:04.592112+0000","last_unstale":"2022-07-05T11:46:08.974109+0000","last_undegraded":"2022-07-05T11:46:08.974109+0000","last_fullsized":"2022-07-05T11:46:08.974109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027403+0000","last_change":"2022-07-05T11:46:09.016814+0000","last_active":"2022-07-05T11:46:09.027403+0000","last_peered":"2022-07-05T11:46:09.027403+0000","last_clean":"2022-07-05T11:46:09.027403+0000","last_became_active":"2022-07-05T11:46:09.016282+0000","last_became_peered":"2022-07-05T11:46:09.016282+0000","last_unstale":"2022-07-05T11:46:09.027403+0000","last_undegraded":"2022-07-05T11:46:09.027403+0000","last_fullsized":"2022-07-05T11:46:09.027403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353211+0000","last_change":"2022-07-05T11:46:04.199484+0000","last_active":"2022-07-05T11:46:20.353211+0000","last_peered":"2022-07-05T11:46:20.353211+0000","last_clean":"2022-07-05T11:46:20.353211+0000","last_became_active":"2022-07-05T11:46:04.199190+0000","last_became_peered":"2022-07-05T11:46:04.199190+0000","last_unstale":"2022-07-05T11:46:20.353211+0000","last_undegraded":"2022-07-05T11:46:20.353211+0000","last_fullsized":"2022-07-05T11:46:20.353211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012845+0000","last_change":"2022-07-05T11:46:04.594175+0000","last_active":"2022-07-05T11:46:09.012845+0000","last_peered":"2022-07-05T11:46:09.012845+0000","last_clean":"2022-07-05T11:46:09.012845+0000","last_became_active":"2022-07-05T11:46:04.593700+0000","last_became_peered":"2022-07-05T11:46:04.593700+0000","last_unstale":"2022-07-05T11:46:09.012845+0000","last_undegraded":"2022-07-05T11:46:09.012845+0000","last_fullsized":"2022-07-05T11:46:09.012845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013139+0000","last_change":"2022-07-05T11:46:08.614509+0000","last_active":"2022-07-05T11:46:09.013139+0000","last_peered":"2022-07-05T11:46:09.013139+0000","last_clean":"2022-07-05T11:46:09.013139+0000","last_became_active":"2022-07-05T11:46:08.613935+0000","last_became_peered":"2022-07-05T11:46:08.613935+0000","last_unstale":"2022-07-05T11:46:09.013139+0000","last_undegraded":"2022-07-05T11:46:09.013139+0000","last_fullsized":"2022-07-05T11:46:09.013139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028943+0000","last_change":"2022-07-05T11:46:04.210344+0000","last_active":"2022-07-05T11:46:09.028943+0000","last_peered":"2022-07-05T11:46:09.028943+0000","last_clean":"2022-07-05T11:46:09.028943+0000","last_became_active":"2022-07-05T11:46:04.210054+0000","last_became_peered":"2022-07-05T11:46:04.210054+0000","last_unstale":"2022-07-05T11:46:09.028943+0000","last_undegraded":"2022-07-05T11:46:09.028943+0000","last_fullsized":"2022-07-05T11:46:09.028943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013018+0000","last_change":"2022-07-05T11:46:04.601851+0000","last_active":"2022-07-05T11:46:09.013018+0000","last_peered":"2022-07-05T11:46:09.013018+0000","last_clean":"2022-07-05T11:46:09.013018+0000","last_became_active":"2022-07-05T11:46:04.601528+0000","last_became_peered":"2022-07-05T11:46:04.601528+0000","last_unstale":"2022-07-05T11:46:09.013018+0000","last_undegraded":"2022-07-05T11:46:09.013018+0000","last_fullsized":"2022-07-05T11:46:09.013018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029283+0000","last_change":"2022-07-05T11:46:08.613389+0000","last_active":"2022-07-05T11:46:09.029283+0000","last_peered":"2022-07-05T11:46:09.029283+0000","last_clean":"2022-07-05T11:46:09.029283+0000","last_became_active":"2022-07-05T11:46:08.612988+0000","last_became_peered":"2022-07-05T11:46:08.612988+0000","last_unstale":"2022-07-05T11:46:09.029283+0000","last_undegraded":"2022-07-05T11:46:09.029283+0000","last_fullsized":"2022-07-05T11:46:09.029283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407358+0000","last_change":"2022-07-05T11:46:04.203173+0000","last_active":"2022-07-05T11:46:10.407358+0000","last_peered":"2022-07-05T11:46:10.407358+0000","last_clean":"2022-07-05T11:46:10.407358+0000","last_became_active":"2022-07-05T11:46:04.202879+0000","last_became_peered":"2022-07-05T11:46:04.202879+0000","last_unstale":"2022-07-05T11:46:10.407358+0000","last_undegraded":"2022-07-05T11:46:10.407358+0000","last_fullsized":"2022-07-05T11:46:10.407358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013005+0000","last_change":"2022-07-05T11:46:04.593203+0000","last_active":"2022-07-05T11:46:09.013005+0000","last_peered":"2022-07-05T11:46:09.013005+0000","last_clean":"2022-07-05T11:46:09.013005+0000","last_became_active":"2022-07-05T11:46:04.592953+0000","last_became_peered":"2022-07-05T11:46:04.592953+0000","last_unstale":"2022-07-05T11:46:09.013005+0000","last_undegraded":"2022-07-05T11:46:09.013005+0000","last_fullsized":"2022-07-05T11:46:09.013005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975419+0000","last_change":"2022-07-05T11:46:08.617348+0000","last_active":"2022-07-05T11:46:08.975419+0000","last_peered":"2022-07-05T11:46:08.975419+0000","last_clean":"2022-07-05T11:46:08.975419+0000","last_became_active":"2022-07-05T11:46:08.616964+0000","last_became_peered":"2022-07-05T11:46:08.616964+0000","last_unstale":"2022-07-05T11:46:08.975419+0000","last_undegraded":"2022-07-05T11:46:08.975419+0000","last_fullsized":"2022-07-05T11:46:08.975419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.213520+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.213132+0000","last_became_peered":"2022-07-05T11:46:04.213132+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027579+0000","last_change":"2022-07-05T11:46:04.589449+0000","last_active":"2022-07-05T11:46:09.027579+0000","last_peered":"2022-07-05T11:46:09.027579+0000","last_clean":"2022-07-05T11:46:09.027579+0000","last_became_active":"2022-07-05T11:46:04.589174+0000","last_became_peered":"2022-07-05T11:46:04.589174+0000","last_unstale":"2022-07-05T11:46:09.027579+0000","last_undegraded":"2022-07-05T11:46:09.027579+0000","last_fullsized":"2022-07-05T11:46:09.027579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027455+0000","last_change":"2022-07-05T11:46:08.617763+0000","last_active":"2022-07-05T11:46:09.027455+0000","last_peered":"2022-07-05T11:46:09.027455+0000","last_clean":"2022-07-05T11:46:09.027455+0000","last_became_active":"2022-07-05T11:46:08.617423+0000","last_became_peered":"2022-07-05T11:46:08.617423+0000","last_unstale":"2022-07-05T11:46:09.027455+0000","last_undegraded":"2022-07-05T11:46:09.027455+0000","last_fullsized":"2022-07-05T11:46:09.027455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030147+0000","last_change":"2022-07-05T11:46:04.211055+0000","last_active":"2022-07-05T11:46:09.030147+0000","last_peered":"2022-07-05T11:46:09.030147+0000","last_clean":"2022-07-05T11:46:09.030147+0000","last_became_active":"2022-07-05T11:46:04.210609+0000","last_became_peered":"2022-07-05T11:46:04.210609+0000","last_unstale":"2022-07-05T11:46:09.030147+0000","last_undegraded":"2022-07-05T11:46:09.030147+0000","last_fullsized":"2022-07-05T11:46:09.030147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028195+0000","last_change":"2022-07-05T11:46:04.583067+0000","last_active":"2022-07-05T11:46:09.028195+0000","last_peered":"2022-07-05T11:46:09.028195+0000","last_clean":"2022-07-05T11:46:09.028195+0000","last_became_active":"2022-07-05T11:46:04.582776+0000","last_became_peered":"2022-07-05T11:46:04.582776+0000","last_unstale":"2022-07-05T11:46:09.028195+0000","last_undegraded":"2022-07-05T11:46:09.028195+0000","last_fullsized":"2022-07-05T11:46:09.028195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975477+0000","last_change":"2022-07-05T11:46:08.619668+0000","last_active":"2022-07-05T11:46:08.975477+0000","last_peered":"2022-07-05T11:46:08.975477+0000","last_clean":"2022-07-05T11:46:08.975477+0000","last_became_active":"2022-07-05T11:46:08.619010+0000","last_became_peered":"2022-07-05T11:46:08.619010+0000","last_unstale":"2022-07-05T11:46:08.975477+0000","last_undegraded":"2022-07-05T11:46:08.975477+0000","last_fullsized":"2022-07-05T11:46:08.975477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975957+0000","last_change":"2022-07-05T11:46:04.202962+0000","last_active":"2022-07-05T11:46:08.975957+0000","last_peered":"2022-07-05T11:46:08.975957+0000","last_clean":"2022-07-05T11:46:08.975957+0000","last_became_active":"2022-07-05T11:46:04.202639+0000","last_became_peered":"2022-07-05T11:46:04.202639+0000","last_unstale":"2022-07-05T11:46:08.975957+0000","last_undegraded":"2022-07-05T11:46:08.975957+0000","last_fullsized":"2022-07-05T11:46:08.975957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975054+0000","last_change":"2022-07-05T11:46:04.595796+0000","last_active":"2022-07-05T11:46:08.975054+0000","last_peered":"2022-07-05T11:46:08.975054+0000","last_clean":"2022-07-05T11:46:08.975054+0000","last_became_active":"2022-07-05T11:46:04.595457+0000","last_became_peered":"2022-07-05T11:46:04.595457+0000","last_unstale":"2022-07-05T11:46:08.975054+0000","last_undegraded":"2022-07-05T11:46:08.975054+0000","last_fullsized":"2022-07-05T11:46:08.975054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027470+0000","last_change":"2022-07-05T11:46:08.617306+0000","last_active":"2022-07-05T11:46:09.027470+0000","last_peered":"2022-07-05T11:46:09.027470+0000","last_clean":"2022-07-05T11:46:09.027470+0000","last_became_active":"2022-07-05T11:46:08.616927+0000","last_became_peered":"2022-07-05T11:46:08.616927+0000","last_unstale":"2022-07-05T11:46:09.027470+0000","last_undegraded":"2022-07-05T11:46:09.027470+0000","last_fullsized":"2022-07-05T11:46:09.027470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.171485+0000","last_change":"2022-07-05T11:46:04.205780+0000","last_active":"2022-07-05T11:46:10.171485+0000","last_peered":"2022-07-05T11:46:10.171485+0000","last_clean":"2022-07-05T11:46:10.171485+0000","last_became_active":"2022-07-05T11:46:04.205486+0000","last_became_peered":"2022-07-05T11:46:04.205486+0000","last_unstale":"2022-07-05T11:46:10.171485+0000","last_undegraded":"2022-07-05T11:46:10.171485+0000","last_fullsized":"2022-07-05T11:46:10.171485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974611+0000","last_change":"2022-07-05T11:46:04.606819+0000","last_active":"2022-07-05T11:46:08.974611+0000","last_peered":"2022-07-05T11:46:08.974611+0000","last_clean":"2022-07-05T11:46:08.974611+0000","last_became_active":"2022-07-05T11:46:04.606484+0000","last_became_peered":"2022-07-05T11:46:04.606484+0000","last_unstale":"2022-07-05T11:46:08.974611+0000","last_undegraded":"2022-07-05T11:46:08.974611+0000","last_fullsized":"2022-07-05T11:46:08.974611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028555+0000","last_change":"2022-07-05T11:46:08.617224+0000","last_active":"2022-07-05T11:46:09.028555+0000","last_peered":"2022-07-05T11:46:09.028555+0000","last_clean":"2022-07-05T11:46:09.028555+0000","last_became_active":"2022-07-05T11:46:08.616821+0000","last_became_peered":"2022-07-05T11:46:08.616821+0000","last_unstale":"2022-07-05T11:46:09.028555+0000","last_undegraded":"2022-07-05T11:46:09.028555+0000","last_fullsized":"2022-07-05T11:46:09.028555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.170891+0000","last_change":"2022-07-05T11:46:04.204034+0000","last_active":"2022-07-05T11:46:10.170891+0000","last_peered":"2022-07-05T11:46:10.170891+0000","last_clean":"2022-07-05T11:46:10.170891+0000","last_became_active":"2022-07-05T11:46:04.203694+0000","last_became_peered":"2022-07-05T11:46:04.203694+0000","last_unstale":"2022-07-05T11:46:10.170891+0000","last_undegraded":"2022-07-05T11:46:10.170891+0000","last_fullsized":"2022-07-05T11:46:10.170891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974125+0000","last_change":"2022-07-05T11:46:04.593441+0000","last_active":"2022-07-05T11:46:08.974125+0000","last_peered":"2022-07-05T11:46:08.974125+0000","last_clean":"2022-07-05T11:46:08.974125+0000","last_became_active":"2022-07-05T11:46:04.593175+0000","last_became_peered":"2022-07-05T11:46:04.593175+0000","last_unstale":"2022-07-05T11:46:08.974125+0000","last_undegraded":"2022-07-05T11:46:08.974125+0000","last_fullsized":"2022-07-05T11:46:08.974125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028366+0000","last_change":"2022-07-05T11:46:09.016544+0000","last_active":"2022-07-05T11:46:09.028366+0000","last_peered":"2022-07-05T11:46:09.028366+0000","last_clean":"2022-07-05T11:46:09.028366+0000","last_became_active":"2022-07-05T11:46:09.016045+0000","last_became_peered":"2022-07-05T11:46:09.016045+0000","last_unstale":"2022-07-05T11:46:09.028366+0000","last_undegraded":"2022-07-05T11:46:09.028366+0000","last_fullsized":"2022-07-05T11:46:09.028366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'3","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.388311+0000","last_change":"2022-07-05T11:46:04.207209+0000","last_active":"2022-07-05T11:46:40.388311+0000","last_peered":"2022-07-05T11:46:40.388311+0000","last_clean":"2022-07-05T11:46:40.388311+0000","last_became_active":"2022-07-05T11:46:04.206333+0000","last_became_peered":"2022-07-05T11:46:04.206333+0000","last_unstale":"2022-07-05T11:46:40.388311+0000","last_undegraded":"2022-07-05T11:46:40.388311+0000","last_fullsized":"2022-07-05T11:46:40.388311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029985+0000","last_change":"2022-07-05T11:46:04.591635+0000","last_active":"2022-07-05T11:46:09.029985+0000","last_peered":"2022-07-05T11:46:09.029985+0000","last_clean":"2022-07-05T11:46:09.029985+0000","last_became_active":"2022-07-05T11:46:04.591370+0000","last_became_peered":"2022-07-05T11:46:04.591370+0000","last_unstale":"2022-07-05T11:46:09.029985+0000","last_undegraded":"2022-07-05T11:46:09.029985+0000","last_fullsized":"2022-07-05T11:46:09.029985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029798+0000","last_change":"2022-07-05T11:46:08.617287+0000","last_active":"2022-07-05T11:46:09.029798+0000","last_peered":"2022-07-05T11:46:09.029798+0000","last_clean":"2022-07-05T11:46:09.029798+0000","last_became_active":"2022-07-05T11:46:08.616929+0000","last_became_peered":"2022-07-05T11:46:08.616929+0000","last_unstale":"2022-07-05T11:46:09.029798+0000","last_undegraded":"2022-07-05T11:46:09.029798+0000","last_fullsized":"2022-07-05T11:46:09.029798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352160+0000","last_change":"2022-07-05T11:46:04.207520+0000","last_active":"2022-07-05T11:46:20.352160+0000","last_peered":"2022-07-05T11:46:20.352160+0000","last_clean":"2022-07-05T11:46:20.352160+0000","last_became_active":"2022-07-05T11:46:04.207167+0000","last_became_peered":"2022-07-05T11:46:04.207167+0000","last_unstale":"2022-07-05T11:46:20.352160+0000","last_undegraded":"2022-07-05T11:46:20.352160+0000","last_fullsized":"2022-07-05T11:46:20.352160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975400+0000","last_change":"2022-07-05T11:46:04.606473+0000","last_active":"2022-07-05T11:46:08.975400+0000","last_peered":"2022-07-05T11:46:08.975400+0000","last_clean":"2022-07-05T11:46:08.975400+0000","last_became_active":"2022-07-05T11:46:04.606183+0000","last_became_peered":"2022-07-05T11:46:04.606183+0000","last_unstale":"2022-07-05T11:46:08.975400+0000","last_undegraded":"2022-07-05T11:46:08.975400+0000","last_fullsized":"2022-07-05T11:46:08.975400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029169+0000","last_change":"2022-07-05T11:46:08.615322+0000","last_active":"2022-07-05T11:46:09.029169+0000","last_peered":"2022-07-05T11:46:09.029169+0000","last_clean":"2022-07-05T11:46:09.029169+0000","last_became_active":"2022-07-05T11:46:08.614916+0000","last_became_peered":"2022-07-05T11:46:08.614916+0000","last_unstale":"2022-07-05T11:46:09.029169+0000","last_undegraded":"2022-07-05T11:46:09.029169+0000","last_fullsized":"2022-07-05T11:46:09.029169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352984+0000","last_change":"2022-07-05T11:46:04.207417+0000","last_active":"2022-07-05T11:46:20.352984+0000","last_peered":"2022-07-05T11:46:20.352984+0000","last_clean":"2022-07-05T11:46:20.352984+0000","last_became_active":"2022-07-05T11:46:04.207078+0000","last_became_peered":"2022-07-05T11:46:04.207078+0000","last_unstale":"2022-07-05T11:46:20.352984+0000","last_undegraded":"2022-07-05T11:46:20.352984+0000","last_fullsized":"2022-07-05T11:46:20.352984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976049+0000","last_change":"2022-07-05T11:46:04.597152+0000","last_active":"2022-07-05T11:46:08.976049+0000","last_peered":"2022-07-05T11:46:08.976049+0000","last_clean":"2022-07-05T11:46:08.976049+0000","last_became_active":"2022-07-05T11:46:04.596847+0000","last_became_peered":"2022-07-05T11:46:04.596847+0000","last_unstale":"2022-07-05T11:46:08.976049+0000","last_undegraded":"2022-07-05T11:46:08.976049+0000","last_fullsized":"2022-07-05T11:46:08.976049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029455+0000","last_change":"2022-07-05T11:46:08.615281+0000","last_active":"2022-07-05T11:46:09.029455+0000","last_peered":"2022-07-05T11:46:09.029455+0000","last_clean":"2022-07-05T11:46:09.029455+0000","last_became_active":"2022-07-05T11:46:08.614859+0000","last_became_peered":"2022-07-05T11:46:08.614859+0000","last_unstale":"2022-07-05T11:46:09.029455+0000","last_undegraded":"2022-07-05T11:46:09.029455+0000","last_fullsized":"2022-07-05T11:46:09.029455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'2","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.386826+0000","last_change":"2022-07-05T11:46:04.209548+0000","last_active":"2022-07-05T11:46:40.386826+0000","last_peered":"2022-07-05T11:46:40.386826+0000","last_clean":"2022-07-05T11:46:40.386826+0000","last_became_active":"2022-07-05T11:46:04.209278+0000","last_became_peered":"2022-07-05T11:46:04.209278+0000","last_unstale":"2022-07-05T11:46:40.386826+0000","last_undegraded":"2022-07-05T11:46:40.386826+0000","last_fullsized":"2022-07-05T11:46:40.386826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012545+0000","last_change":"2022-07-05T11:46:04.601803+0000","last_active":"2022-07-05T11:46:09.012545+0000","last_peered":"2022-07-05T11:46:09.012545+0000","last_clean":"2022-07-05T11:46:09.012545+0000","last_became_active":"2022-07-05T11:46:04.601475+0000","last_became_peered":"2022-07-05T11:46:04.601475+0000","last_unstale":"2022-07-05T11:46:09.012545+0000","last_undegraded":"2022-07-05T11:46:09.012545+0000","last_fullsized":"2022-07-05T11:46:09.012545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028752+0000","last_change":"2022-07-05T11:46:08.617939+0000","last_active":"2022-07-05T11:46:09.028752+0000","last_peered":"2022-07-05T11:46:09.028752+0000","last_clean":"2022-07-05T11:46:09.028752+0000","last_became_active":"2022-07-05T11:46:08.617538+0000","last_became_peered":"2022-07-05T11:46:08.617538+0000","last_unstale":"2022-07-05T11:46:09.028752+0000","last_undegraded":"2022-07-05T11:46:09.028752+0000","last_fullsized":"2022-07-05T11:46:09.028752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352085+0000","last_change":"2022-07-05T11:46:04.199561+0000","last_active":"2022-07-05T11:46:20.352085+0000","last_peered":"2022-07-05T11:46:20.352085+0000","last_clean":"2022-07-05T11:46:20.352085+0000","last_became_active":"2022-07-05T11:46:04.199232+0000","last_became_peered":"2022-07-05T11:46:04.199232+0000","last_unstale":"2022-07-05T11:46:20.352085+0000","last_undegraded":"2022-07-05T11:46:20.352085+0000","last_fullsized":"2022-07-05T11:46:20.352085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973881+0000","last_change":"2022-07-05T11:46:04.601813+0000","last_active":"2022-07-05T11:46:08.973881+0000","last_peered":"2022-07-05T11:46:08.973881+0000","last_clean":"2022-07-05T11:46:08.973881+0000","last_became_active":"2022-07-05T11:46:04.601595+0000","last_became_peered":"2022-07-05T11:46:04.601595+0000","last_unstale":"2022-07-05T11:46:08.973881+0000","last_undegraded":"2022-07-05T11:46:08.973881+0000","last_fullsized":"2022-07-05T11:46:08.973881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975282+0000","last_change":"2022-07-05T11:46:08.621246+0000","last_active":"2022-07-05T11:46:08.975282+0000","last_peered":"2022-07-05T11:46:08.975282+0000","last_clean":"2022-07-05T11:46:08.975282+0000","last_became_active":"2022-07-05T11:46:08.620839+0000","last_became_peered":"2022-07-05T11:46:08.620839+0000","last_unstale":"2022-07-05T11:46:08.975282+0000","last_undegraded":"2022-07-05T11:46:08.975282+0000","last_fullsized":"2022-07-05T11:46:08.975282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029752+0000","last_change":"2022-07-05T11:46:04.204062+0000","last_active":"2022-07-05T11:46:09.029752+0000","last_peered":"2022-07-05T11:46:09.029752+0000","last_clean":"2022-07-05T11:46:09.029752+0000","last_became_active":"2022-07-05T11:46:04.203763+0000","last_became_peered":"2022-07-05T11:46:04.203763+0000","last_unstale":"2022-07-05T11:46:09.029752+0000","last_undegraded":"2022-07-05T11:46:09.029752+0000","last_fullsized":"2022-07-05T11:46:09.029752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029094+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.029094+0000","last_peered":"2022-07-05T11:46:09.029094+0000","last_clean":"2022-07-05T11:46:09.029094+0000","last_became_active":"2022-07-05T11:46:04.595288+0000","last_became_peered":"2022-07-05T11:46:04.595288+0000","last_unstale":"2022-07-05T11:46:09.029094+0000","last_undegraded":"2022-07-05T11:46:09.029094+0000","last_fullsized":"2022-07-05T11:46:09.029094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027709+0000","last_change":"2022-07-05T11:46:08.617183+0000","last_active":"2022-07-05T11:46:09.027709+0000","last_peered":"2022-07-05T11:46:09.027709+0000","last_clean":"2022-07-05T11:46:09.027709+0000","last_became_active":"2022-07-05T11:46:08.616762+0000","last_became_peered":"2022-07-05T11:46:08.616762+0000","last_unstale":"2022-07-05T11:46:09.027709+0000","last_undegraded":"2022-07-05T11:46:09.027709+0000","last_fullsized":"2022-07-05T11:46:09.027709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.526543+0000","last_change":"2022-07-05T11:46:04.206938+0000","last_active":"2022-07-05T11:46:40.526543+0000","last_peered":"2022-07-05T11:46:40.526543+0000","last_clean":"2022-07-05T11:46:40.526543+0000","last_became_active":"2022-07-05T11:46:04.206676+0000","last_became_peered":"2022-07-05T11:46:04.206676+0000","last_unstale":"2022-07-05T11:46:40.526543+0000","last_undegraded":"2022-07-05T11:46:40.526543+0000","last_fullsized":"2022-07-05T11:46:40.526543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973848+0000","last_change":"2022-07-05T11:46:04.589404+0000","last_active":"2022-07-05T11:46:08.973848+0000","last_peered":"2022-07-05T11:46:08.973848+0000","last_clean":"2022-07-05T11:46:08.973848+0000","last_became_active":"2022-07-05T11:46:04.589158+0000","last_became_peered":"2022-07-05T11:46:04.589158+0000","last_unstale":"2022-07-05T11:46:08.973848+0000","last_undegraded":"2022-07-05T11:46:08.973848+0000","last_fullsized":"2022-07-05T11:46:08.973848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028490+0000","last_change":"2022-07-05T11:46:08.619220+0000","last_active":"2022-07-05T11:46:09.028490+0000","last_peered":"2022-07-05T11:46:09.028490+0000","last_clean":"2022-07-05T11:46:09.028490+0000","last_became_active":"2022-07-05T11:46:08.618815+0000","last_became_peered":"2022-07-05T11:46:08.618815+0000","last_unstale":"2022-07-05T11:46:09.028490+0000","last_undegraded":"2022-07-05T11:46:09.028490+0000","last_fullsized":"2022-07-05T11:46:09.028490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974161+0000","last_change":"2022-07-05T11:46:08.617688+0000","last_active":"2022-07-05T11:46:08.974161+0000","last_peered":"2022-07-05T11:46:08.974161+0000","last_clean":"2022-07-05T11:46:08.974161+0000","last_became_active":"2022-07-05T11:46:08.617331+0000","last_became_peered":"2022-07-05T11:46:08.617331+0000","last_unstale":"2022-07-05T11:46:08.974161+0000","last_undegraded":"2022-07-05T11:46:08.974161+0000","last_fullsized":"2022-07-05T11:46:08.974161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029067+0000","last_change":"2022-07-05T11:46:04.199672+0000","last_active":"2022-07-05T11:46:09.029067+0000","last_peered":"2022-07-05T11:46:09.029067+0000","last_clean":"2022-07-05T11:46:09.029067+0000","last_became_active":"2022-07-05T11:46:04.199366+0000","last_became_peered":"2022-07-05T11:46:04.199366+0000","last_unstale":"2022-07-05T11:46:09.029067+0000","last_undegraded":"2022-07-05T11:46:09.029067+0000","last_fullsized":"2022-07-05T11:46:09.029067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976202+0000","last_change":"2022-07-05T11:46:04.598274+0000","last_active":"2022-07-05T11:46:08.976202+0000","last_peered":"2022-07-05T11:46:08.976202+0000","last_clean":"2022-07-05T11:46:08.976202+0000","last_became_active":"2022-07-05T11:46:04.597995+0000","last_became_peered":"2022-07-05T11:46:04.597995+0000","last_unstale":"2022-07-05T11:46:08.976202+0000","last_undegraded":"2022-07-05T11:46:08.976202+0000","last_fullsized":"2022-07-05T11:46:08.976202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030310+0000","last_change":"2022-07-05T11:46:08.612501+0000","last_active":"2022-07-05T11:46:09.030310+0000","last_peered":"2022-07-05T11:46:09.030310+0000","last_clean":"2022-07-05T11:46:09.030310+0000","last_became_active":"2022-07-05T11:46:08.611956+0000","last_became_peered":"2022-07-05T11:46:08.611956+0000","last_unstale":"2022-07-05T11:46:09.030310+0000","last_undegraded":"2022-07-05T11:46:09.030310+0000","last_fullsized":"2022-07-05T11:46:09.030310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973916+0000","last_change":"2022-07-05T11:46:04.212557+0000","last_active":"2022-07-05T11:46:08.973916+0000","last_peered":"2022-07-05T11:46:08.973916+0000","last_clean":"2022-07-05T11:46:08.973916+0000","last_became_active":"2022-07-05T11:46:04.212259+0000","last_became_peered":"2022-07-05T11:46:04.212259+0000","last_unstale":"2022-07-05T11:46:08.973916+0000","last_undegraded":"2022-07-05T11:46:08.973916+0000","last_fullsized":"2022-07-05T11:46:08.973916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028001+0000","last_change":"2022-07-05T11:46:04.593690+0000","last_active":"2022-07-05T11:46:09.028001+0000","last_peered":"2022-07-05T11:46:09.028001+0000","last_clean":"2022-07-05T11:46:09.028001+0000","last_became_active":"2022-07-05T11:46:04.593427+0000","last_became_peered":"2022-07-05T11:46:04.593427+0000","last_unstale":"2022-07-05T11:46:09.028001+0000","last_undegraded":"2022-07-05T11:46:09.028001+0000","last_fullsized":"2022-07-05T11:46:09.028001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028319+0000","last_change":"2022-07-05T11:46:04.204419+0000","last_active":"2022-07-05T11:46:09.028319+0000","last_peered":"2022-07-05T11:46:09.028319+0000","last_clean":"2022-07-05T11:46:09.028319+0000","last_became_active":"2022-07-05T11:46:04.204078+0000","last_became_peered":"2022-07-05T11:46:04.204078+0000","last_unstale":"2022-07-05T11:46:09.028319+0000","last_undegraded":"2022-07-05T11:46:09.028319+0000","last_fullsized":"2022-07-05T11:46:09.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028300+0000","last_change":"2022-07-05T11:46:04.600858+0000","last_active":"2022-07-05T11:46:09.028300+0000","last_peered":"2022-07-05T11:46:09.028300+0000","last_clean":"2022-07-05T11:46:09.028300+0000","last_became_active":"2022-07-05T11:46:04.600564+0000","last_became_peered":"2022-07-05T11:46:04.600564+0000","last_unstale":"2022-07-05T11:46:09.028300+0000","last_undegraded":"2022-07-05T11:46:09.028300+0000","last_fullsized":"2022-07-05T11:46:09.028300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017952+0000","last_change":"2022-07-05T11:46:09.017127+0000","last_active":"2022-07-05T11:46:09.017952+0000","last_peered":"2022-07-05T11:46:09.017952+0000","last_clean":"2022-07-05T11:46:09.017952+0000","last_became_active":"2022-07-05T11:46:09.016451+0000","last_became_peered":"2022-07-05T11:46:09.016451+0000","last_unstale":"2022-07-05T11:46:09.017952+0000","last_undegraded":"2022-07-05T11:46:09.017952+0000","last_fullsized":"2022-07-05T11:46:09.017952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7400,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":141,"num_read_kb":83,"num_write":130,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5348,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366492,"statfs":{"total":96636764160,"available":96631287808,"internally_reserved":0,"allocated":356352,"data_stored":165443,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":166661,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":9,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":8,"up_from":17,"seq":73014444044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164957,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":163725,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":17,"seq":73014444044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":1,"up_from":17,"seq":73014444043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":164777,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":0,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163647,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163717,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444043,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":168709,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5404,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366436,"statfs":{"total":96636764160,"available":96631230464,"internally_reserved":0,"allocated":348160,"data_stored":165107,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-07-05T11:46:45.258 INFO:tasks.fwd_scrub.ceph_manager:clean! 2022-07-05T11:46:45.259 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-07-05T11:46:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.402+0000 7ff4449d9700 1 Processor -- start 2022-07-05T11:46:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.402+0000 7ff4449d9700 1 -- start start 2022-07-05T11:46:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.403+0000 7ff4449d9700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff44017a170 0x7ff44017ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.403+0000 7ff4449d9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff44017aff0 0x7ff44017b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.403+0000 7ff4449d9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff440178770 con 0x7ff440174b30 2022-07-05T11:46:45.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.403+0000 7ff4449d9700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4401795d0 con 0x7ff44017a170 2022-07-05T11:46:45.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.403+0000 7ff4449d9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4400eb360 con 0x7ff44017aff0 2022-07-05T11:46:45.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff44017aff0 0x7ff44017b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff44017aff0 0x7ff44017b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39396/0 (socket says 172.21.15.90:39396) 2022-07-05T11:46:45.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 -- 172.21.15.90:0/2999743104 learned_addr learned my addr 172.21.15.90:0/2999743104 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:45.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43e59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff440174b30 0x7ff440179a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:47180/0 (socket says 172.21.15.90:47180) 2022-07-05T11:46:45.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43dd9b700 1 --2- 172.21.15.90:0/2999743104 >> v2:172.21.15.110:3300/0 conn(0x7ff44017a170 0x7ff44017ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 -- 172.21.15.90:0/2999743104 >> v2:172.21.15.110:3300/0 conn(0x7ff44017a170 msgr2=0x7ff44017ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:45.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 --2- 172.21.15.90:0/2999743104 >> v2:172.21.15.110:3300/0 conn(0x7ff44017a170 0x7ff44017ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 -- 172.21.15.90:0/2999743104 >> v1:172.21.15.149:6789/0 conn(0x7ff440174b30 legacy=0x7ff440179a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43d59a700 1 -- 172.21.15.90:0/2999743104 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130923188 0 0) 0x7ff440178770 con 0x7ff440174b30 2022-07-05T11:46:45.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 -- 172.21.15.90:0/2999743104 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4401789c0 con 0x7ff44017aff0 2022-07-05T11:46:45.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43ed9d700 1 --2- 172.21.15.90:0/2999743104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44017aff0 0x7ff44017b480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff4400e8000 tx=0x7ff4380090f0).ready entity=mon.2 client_cookie=8f958fcf09d4dda9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43d59a700 1 -- 172.21.15.90:0/2999743104 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800b520 con 0x7ff44017aff0 2022-07-05T11:46:45.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43d59a700 1 -- 172.21.15.90:0/2999743104 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800b680 con 0x7ff44017aff0 2022-07-05T11:46:45.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.404+0000 7ff43d59a700 1 -- 172.21.15.90:0/2999743104 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800ba20 con 0x7ff44017aff0 2022-07-05T11:46:45.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 -- 172.21.15.90:0/2999743104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44017aff0 msgr2=0x7ff44017b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2999743104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44017aff0 0x7ff44017b480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff4400e8000 tx=0x7ff4380090f0).stop 2022-07-05T11:46:45.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 -- 172.21.15.90:0/2999743104 shutdown_connections 2022-07-05T11:46:45.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2999743104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44017aff0 0x7ff44017b480 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2999743104 >> v2:172.21.15.110:3300/0 conn(0x7ff44017a170 0x7ff44017ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 -- 172.21.15.90:0/2999743104 >> 172.21.15.90:0/2999743104 conn(0x7ff4400ee510 msgr2=0x7ff440083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:45.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 -- 172.21.15.90:0/2999743104 shutdown_connections 2022-07-05T11:46:45.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.405+0000 7ff4449d9700 1 -- 172.21.15.90:0/2999743104 wait complete. 2022-07-05T11:46:45.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.406+0000 7ff4449d9700 1 Processor -- start 2022-07-05T11:46:45.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.406+0000 7ff4449d9700 1 -- start start 2022-07-05T11:46:45.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff4449d9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff440174b30 0x7ff4400c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff4449d9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44017a170 0x7ff44017b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff4449d9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff44017aff0 0x7ff4400c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff4449d9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400c85d0 con 0x7ff44017a170 2022-07-05T11:46:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff4449d9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44017be00 con 0x7ff44017aff0 2022-07-05T11:46:45.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff4449d9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400c76e0 con 0x7ff440174b30 2022-07-05T11:46:45.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff43dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44017a170 0x7ff44017b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff43dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44017a170 0x7ff44017b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58004/0 (socket says 172.21.15.90:58004) 2022-07-05T11:46:45.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.407+0000 7ff43dd9b700 1 -- 172.21.15.90:0/2863525782 learned_addr learned my addr 172.21.15.90:0/2863525782 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:45.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43e59c700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff440174b30 0x7ff4400c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43ed9d700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff44017aff0 0x7ff4400c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43dd9b700 1 -- 172.21.15.90:0/2863525782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff440174b30 msgr2=0x7ff4400c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43dd9b700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff440174b30 0x7ff4400c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43dd9b700 1 -- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff44017aff0 msgr2=0x7ff4400c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43dd9b700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff44017aff0 0x7ff4400c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43dd9b700 1 -- 172.21.15.90:0/2863525782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009370 con 0x7ff44017a170 2022-07-05T11:46:45.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43ed9d700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff44017aff0 0x7ff4400c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:45.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff43dd9b700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44017a170 0x7ff44017b910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7ff42800e950 tx=0x7ff428009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff4367fc700 1 -- 172.21.15.90:0/2863525782 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42800c850 con 0x7ff44017a170 2022-07-05T11:46:45.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff4367fc700 1 -- 172.21.15.90:0/2863525782 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42800c9b0 con 0x7ff44017a170 2022-07-05T11:46:45.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4400c79c0 con 0x7ff44017a170 2022-07-05T11:46:45.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff4367fc700 1 -- 172.21.15.90:0/2863525782 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42800cd30 con 0x7ff44017a170 2022-07-05T11:46:45.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.408+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4400c7f80 con 0x7ff44017a170 2022-07-05T11:46:45.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.409+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4400c8740 con 0x7ff44017a170 2022-07-05T11:46:45.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.410+0000 7ff4367fc700 1 -- 172.21.15.90:0/2863525782 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff428022070 con 0x7ff44017a170 2022-07-05T11:46:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.410+0000 7ff4367fc700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42408ba40 0x7ff42408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.410+0000 7ff4367fc700 1 -- 172.21.15.90:0/2863525782 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff4280b0d90 con 0x7ff44017a170 2022-07-05T11:46:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.410+0000 7ff43e59c700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42408ba40 0x7ff42408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.411+0000 7ff43e59c700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42408ba40 0x7ff42408df00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff430007fd0 tx=0x7ff430007dd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.414+0000 7ff4367fc700 1 -- 172.21.15.90:0/2863525782 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7ff4280b4030 con 0x7ff44017a170 2022-07-05T11:46:45.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.572+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 --> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff44006be40 con 0x7ff42408ba40 2022-07-05T11:46:45.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.585+0000 7ff4367fc700 1 -- 172.21.15.90:0/2863525782 <== mgr.4105 v2:172.21.15.110:6800/36906 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434329 (secure 0 0 0) 0x7ff44006be40 con 0x7ff42408ba40 2022-07-05T11:46:45.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:45.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42408ba40 msgr2=0x7ff42408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42408ba40 0x7ff42408df00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff430007fd0 tx=0x7ff430007dd0).stop 2022-07-05T11:46:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44017a170 msgr2=0x7ff44017b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44017a170 0x7ff44017b910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7ff42800e950 tx=0x7ff428009060).stop 2022-07-05T11:46:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 shutdown_connections 2022-07-05T11:46:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42408ba40 0x7ff42408df00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff44017aff0 0x7ff4400c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff440174b30 0x7ff4400c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 --2- 172.21.15.90:0/2863525782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44017a170 0x7ff44017b910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 >> 172.21.15.90:0/2863525782 conn(0x7ff4400ee510 msgr2=0x7ff44017a570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 shutdown_connections 2022-07-05T11:46:45.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.589+0000 7ff4449d9700 1 -- 172.21.15.90:0/2863525782 wait complete. 2022-07-05T11:46:45.605 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2022-07-05T11:46:45.607 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2022-07-05T11:46:45.126796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7400,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":141,"num_read_kb":83,"num_write":130,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":64192,"kb_used_data":4000,"kb_used_omap":0,"kb_used_meta":60096,"kb_avail":1132397888,"statfs":{"total":1159641169920,"available":1159575437312,"internally_reserved":0,"allocated":4096000,"data_stored":1977484,"data_compressed":167460,"data_compressed_allocated":245760,"data_compressed_original":491520,"omap_allocated":0,"internal_metadata":61538304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004277"},"pg_stats":[{"pgid":"3.3f","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360284+0000","last_change":"2022-07-05T11:46:04.211228+0000","last_active":"2022-07-05T11:46:21.360284+0000","last_peered":"2022-07-05T11:46:21.360284+0000","last_clean":"2022-07-05T11:46:21.360284+0000","last_became_active":"2022-07-05T11:46:04.210963+0000","last_became_peered":"2022-07-05T11:46:04.210963+0000","last_unstale":"2022-07-05T11:46:21.360284+0000","last_undegraded":"2022-07-05T11:46:21.360284+0000","last_fullsized":"2022-07-05T11:46:21.360284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029059+0000","last_change":"2022-07-05T11:46:04.590106+0000","last_active":"2022-07-05T11:46:09.029059+0000","last_peered":"2022-07-05T11:46:09.029059+0000","last_clean":"2022-07-05T11:46:09.029059+0000","last_became_active":"2022-07-05T11:46:04.589807+0000","last_became_peered":"2022-07-05T11:46:04.589807+0000","last_unstale":"2022-07-05T11:46:09.029059+0000","last_undegraded":"2022-07-05T11:46:09.029059+0000","last_fullsized":"2022-07-05T11:46:09.029059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.408147+0000","last_change":"2022-07-05T11:46:04.202921+0000","last_active":"2022-07-05T11:46:10.408147+0000","last_peered":"2022-07-05T11:46:10.408147+0000","last_clean":"2022-07-05T11:46:10.408147+0000","last_became_active":"2022-07-05T11:46:04.202631+0000","last_became_peered":"2022-07-05T11:46:04.202631+0000","last_unstale":"2022-07-05T11:46:10.408147+0000","last_undegraded":"2022-07-05T11:46:10.408147+0000","last_fullsized":"2022-07-05T11:46:10.408147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028341+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.028341+0000","last_peered":"2022-07-05T11:46:09.028341+0000","last_clean":"2022-07-05T11:46:09.028341+0000","last_became_active":"2022-07-05T11:46:04.595253+0000","last_became_peered":"2022-07-05T11:46:04.595253+0000","last_unstale":"2022-07-05T11:46:09.028341+0000","last_undegraded":"2022-07-05T11:46:09.028341+0000","last_fullsized":"2022-07-05T11:46:09.028341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360892+0000","last_change":"2022-07-05T11:46:04.211131+0000","last_active":"2022-07-05T11:46:21.360892+0000","last_peered":"2022-07-05T11:46:21.360892+0000","last_clean":"2022-07-05T11:46:21.360892+0000","last_became_active":"2022-07-05T11:46:04.210828+0000","last_became_peered":"2022-07-05T11:46:04.210828+0000","last_unstale":"2022-07-05T11:46:21.360892+0000","last_undegraded":"2022-07-05T11:46:21.360892+0000","last_fullsized":"2022-07-05T11:46:21.360892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012401+0000","last_change":"2022-07-05T11:46:04.592905+0000","last_active":"2022-07-05T11:46:09.012401+0000","last_peered":"2022-07-05T11:46:09.012401+0000","last_clean":"2022-07-05T11:46:09.012401+0000","last_became_active":"2022-07-05T11:46:04.592593+0000","last_became_peered":"2022-07-05T11:46:04.592593+0000","last_unstale":"2022-07-05T11:46:09.012401+0000","last_undegraded":"2022-07-05T11:46:09.012401+0000","last_fullsized":"2022-07-05T11:46:09.012401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012779+0000","last_change":"2022-07-05T11:46:04.209903+0000","last_active":"2022-07-05T11:46:09.012779+0000","last_peered":"2022-07-05T11:46:09.012779+0000","last_clean":"2022-07-05T11:46:09.012779+0000","last_became_active":"2022-07-05T11:46:04.204575+0000","last_became_peered":"2022-07-05T11:46:04.204575+0000","last_unstale":"2022-07-05T11:46:09.012779+0000","last_undegraded":"2022-07-05T11:46:09.012779+0000","last_fullsized":"2022-07-05T11:46:09.012779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974869+0000","last_change":"2022-07-05T11:46:04.595822+0000","last_active":"2022-07-05T11:46:08.974869+0000","last_peered":"2022-07-05T11:46:08.974869+0000","last_clean":"2022-07-05T11:46:08.974869+0000","last_became_active":"2022-07-05T11:46:04.595306+0000","last_became_peered":"2022-07-05T11:46:04.595306+0000","last_unstale":"2022-07-05T11:46:08.974869+0000","last_undegraded":"2022-07-05T11:46:08.974869+0000","last_fullsized":"2022-07-05T11:46:08.974869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"25'1","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029038+0000","last_change":"2022-07-05T11:46:04.202298+0000","last_active":"2022-07-05T11:46:09.029038+0000","last_peered":"2022-07-05T11:46:09.029038+0000","last_clean":"2022-07-05T11:46:09.029038+0000","last_became_active":"2022-07-05T11:46:04.202010+0000","last_became_peered":"2022-07-05T11:46:04.202010+0000","last_unstale":"2022-07-05T11:46:09.029038+0000","last_undegraded":"2022-07-05T11:46:09.029038+0000","last_fullsized":"2022-07-05T11:46:09.029038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029758+0000","last_change":"2022-07-05T11:46:04.590970+0000","last_active":"2022-07-05T11:46:09.029758+0000","last_peered":"2022-07-05T11:46:09.029758+0000","last_clean":"2022-07-05T11:46:09.029758+0000","last_became_active":"2022-07-05T11:46:04.590714+0000","last_became_peered":"2022-07-05T11:46:04.590714+0000","last_unstale":"2022-07-05T11:46:09.029758+0000","last_undegraded":"2022-07-05T11:46:09.029758+0000","last_fullsized":"2022-07-05T11:46:09.029758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358625+0000","last_change":"2022-07-05T11:46:04.204607+0000","last_active":"2022-07-05T11:46:21.358625+0000","last_peered":"2022-07-05T11:46:21.358625+0000","last_clean":"2022-07-05T11:46:21.358625+0000","last_became_active":"2022-07-05T11:46:04.204287+0000","last_became_peered":"2022-07-05T11:46:04.204287+0000","last_unstale":"2022-07-05T11:46:21.358625+0000","last_undegraded":"2022-07-05T11:46:21.358625+0000","last_fullsized":"2022-07-05T11:46:21.358625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012802+0000","last_change":"2022-07-05T11:46:04.606655+0000","last_active":"2022-07-05T11:46:09.012802+0000","last_peered":"2022-07-05T11:46:09.012802+0000","last_clean":"2022-07-05T11:46:09.012802+0000","last_became_active":"2022-07-05T11:46:04.606370+0000","last_became_peered":"2022-07-05T11:46:04.606370+0000","last_unstale":"2022-07-05T11:46:09.012802+0000","last_undegraded":"2022-07-05T11:46:09.012802+0000","last_fullsized":"2022-07-05T11:46:09.012802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360703+0000","last_change":"2022-07-05T11:46:04.206427+0000","last_active":"2022-07-05T11:46:21.360703+0000","last_peered":"2022-07-05T11:46:21.360703+0000","last_clean":"2022-07-05T11:46:21.360703+0000","last_became_active":"2022-07-05T11:46:04.206192+0000","last_became_peered":"2022-07-05T11:46:04.206192+0000","last_unstale":"2022-07-05T11:46:21.360703+0000","last_undegraded":"2022-07-05T11:46:21.360703+0000","last_fullsized":"2022-07-05T11:46:21.360703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028587+0000","last_change":"2022-07-05T11:46:04.599321+0000","last_active":"2022-07-05T11:46:09.028587+0000","last_peered":"2022-07-05T11:46:09.028587+0000","last_clean":"2022-07-05T11:46:09.028587+0000","last_became_active":"2022-07-05T11:46:04.597626+0000","last_became_peered":"2022-07-05T11:46:04.597626+0000","last_unstale":"2022-07-05T11:46:09.028587+0000","last_undegraded":"2022-07-05T11:46:09.028587+0000","last_fullsized":"2022-07-05T11:46:09.028587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407177+0000","last_change":"2022-07-05T11:46:04.204458+0000","last_active":"2022-07-05T11:46:10.407177+0000","last_peered":"2022-07-05T11:46:10.407177+0000","last_clean":"2022-07-05T11:46:10.407177+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:10.407177+0000","last_undegraded":"2022-07-05T11:46:10.407177+0000","last_fullsized":"2022-07-05T11:46:10.407177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028708+0000","last_change":"2022-07-05T11:46:04.598830+0000","last_active":"2022-07-05T11:46:09.028708+0000","last_peered":"2022-07-05T11:46:09.028708+0000","last_clean":"2022-07-05T11:46:09.028708+0000","last_became_active":"2022-07-05T11:46:04.597158+0000","last_became_peered":"2022-07-05T11:46:04.597158+0000","last_unstale":"2022-07-05T11:46:09.028708+0000","last_undegraded":"2022-07-05T11:46:09.028708+0000","last_fullsized":"2022-07-05T11:46:09.028708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029721+0000","last_change":"2022-07-05T11:46:04.207355+0000","last_active":"2022-07-05T11:46:09.029721+0000","last_peered":"2022-07-05T11:46:09.029721+0000","last_clean":"2022-07-05T11:46:09.029721+0000","last_became_active":"2022-07-05T11:46:04.207059+0000","last_became_peered":"2022-07-05T11:46:04.207059+0000","last_unstale":"2022-07-05T11:46:09.029721+0000","last_undegraded":"2022-07-05T11:46:09.029721+0000","last_fullsized":"2022-07-05T11:46:09.029721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012425+0000","last_change":"2022-07-05T11:46:04.595782+0000","last_active":"2022-07-05T11:46:09.012425+0000","last_peered":"2022-07-05T11:46:09.012425+0000","last_clean":"2022-07-05T11:46:09.012425+0000","last_became_active":"2022-07-05T11:46:04.595530+0000","last_became_peered":"2022-07-05T11:46:04.595530+0000","last_unstale":"2022-07-05T11:46:09.012425+0000","last_undegraded":"2022-07-05T11:46:09.012425+0000","last_fullsized":"2022-07-05T11:46:09.012425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.351876+0000","last_change":"2022-07-05T11:46:04.210209+0000","last_active":"2022-07-05T11:46:20.351876+0000","last_peered":"2022-07-05T11:46:20.351876+0000","last_clean":"2022-07-05T11:46:20.351876+0000","last_became_active":"2022-07-05T11:46:04.209883+0000","last_became_peered":"2022-07-05T11:46:04.209883+0000","last_unstale":"2022-07-05T11:46:20.351876+0000","last_undegraded":"2022-07-05T11:46:20.351876+0000","last_fullsized":"2022-07-05T11:46:20.351876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028150+0000","last_change":"2022-07-05T11:46:04.600375+0000","last_active":"2022-07-05T11:46:09.028150+0000","last_peered":"2022-07-05T11:46:09.028150+0000","last_clean":"2022-07-05T11:46:09.028150+0000","last_became_active":"2022-07-05T11:46:04.600101+0000","last_became_peered":"2022-07-05T11:46:04.600101+0000","last_unstale":"2022-07-05T11:46:09.028150+0000","last_undegraded":"2022-07-05T11:46:09.028150+0000","last_fullsized":"2022-07-05T11:46:09.028150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030246+0000","last_change":"2022-07-05T11:46:04.204891+0000","last_active":"2022-07-05T11:46:09.030246+0000","last_peered":"2022-07-05T11:46:09.030246+0000","last_clean":"2022-07-05T11:46:09.030246+0000","last_became_active":"2022-07-05T11:46:04.204619+0000","last_became_peered":"2022-07-05T11:46:04.204619+0000","last_unstale":"2022-07-05T11:46:09.030246+0000","last_undegraded":"2022-07-05T11:46:09.030246+0000","last_fullsized":"2022-07-05T11:46:09.030246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028234+0000","last_change":"2022-07-05T11:46:04.600335+0000","last_active":"2022-07-05T11:46:09.028234+0000","last_peered":"2022-07-05T11:46:09.028234+0000","last_clean":"2022-07-05T11:46:09.028234+0000","last_became_active":"2022-07-05T11:46:04.600026+0000","last_became_peered":"2022-07-05T11:46:04.600026+0000","last_unstale":"2022-07-05T11:46:09.028234+0000","last_undegraded":"2022-07-05T11:46:09.028234+0000","last_fullsized":"2022-07-05T11:46:09.028234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'9","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.387268+0000","last_change":"2022-07-05T11:46:04.210563+0000","last_active":"2022-07-05T11:46:40.387268+0000","last_peered":"2022-07-05T11:46:40.387268+0000","last_clean":"2022-07-05T11:46:40.387268+0000","last_became_active":"2022-07-05T11:46:04.210264+0000","last_became_peered":"2022-07-05T11:46:04.210264+0000","last_unstale":"2022-07-05T11:46:40.387268+0000","last_undegraded":"2022-07-05T11:46:40.387268+0000","last_fullsized":"2022-07-05T11:46:40.387268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3070,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975654+0000","last_change":"2022-07-05T11:46:04.596566+0000","last_active":"2022-07-05T11:46:08.975654+0000","last_peered":"2022-07-05T11:46:08.975654+0000","last_clean":"2022-07-05T11:46:08.975654+0000","last_became_active":"2022-07-05T11:46:04.596385+0000","last_became_peered":"2022-07-05T11:46:04.596385+0000","last_unstale":"2022-07-05T11:46:08.975654+0000","last_undegraded":"2022-07-05T11:46:08.975654+0000","last_fullsized":"2022-07-05T11:46:08.975654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359717+0000","last_change":"2022-07-05T11:46:04.205836+0000","last_active":"2022-07-05T11:46:21.359717+0000","last_peered":"2022-07-05T11:46:21.359717+0000","last_clean":"2022-07-05T11:46:21.359717+0000","last_became_active":"2022-07-05T11:46:04.205522+0000","last_became_peered":"2022-07-05T11:46:04.205522+0000","last_unstale":"2022-07-05T11:46:21.359717+0000","last_undegraded":"2022-07-05T11:46:21.359717+0000","last_fullsized":"2022-07-05T11:46:21.359717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027942+0000","last_change":"2022-07-05T11:46:04.600047+0000","last_active":"2022-07-05T11:46:09.027942+0000","last_peered":"2022-07-05T11:46:09.027942+0000","last_clean":"2022-07-05T11:46:09.027942+0000","last_became_active":"2022-07-05T11:46:04.599735+0000","last_became_peered":"2022-07-05T11:46:04.599735+0000","last_unstale":"2022-07-05T11:46:09.027942+0000","last_undegraded":"2022-07-05T11:46:09.027942+0000","last_fullsized":"2022-07-05T11:46:09.027942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027527+0000","last_change":"2022-07-05T11:46:04.204754+0000","last_active":"2022-07-05T11:46:09.027527+0000","last_peered":"2022-07-05T11:46:09.027527+0000","last_clean":"2022-07-05T11:46:09.027527+0000","last_became_active":"2022-07-05T11:46:04.204466+0000","last_became_peered":"2022-07-05T11:46:04.204466+0000","last_unstale":"2022-07-05T11:46:09.027527+0000","last_undegraded":"2022-07-05T11:46:09.027527+0000","last_fullsized":"2022-07-05T11:46:09.027527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012900+0000","last_change":"2022-07-05T11:46:04.594552+0000","last_active":"2022-07-05T11:46:09.012900+0000","last_peered":"2022-07-05T11:46:09.012900+0000","last_clean":"2022-07-05T11:46:09.012900+0000","last_became_active":"2022-07-05T11:46:04.594285+0000","last_became_peered":"2022-07-05T11:46:04.594285+0000","last_unstale":"2022-07-05T11:46:09.012900+0000","last_undegraded":"2022-07-05T11:46:09.012900+0000","last_fullsized":"2022-07-05T11:46:09.012900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027421+0000","last_change":"2022-07-05T11:46:04.206416+0000","last_active":"2022-07-05T11:46:09.027421+0000","last_peered":"2022-07-05T11:46:09.027421+0000","last_clean":"2022-07-05T11:46:09.027421+0000","last_became_active":"2022-07-05T11:46:04.206118+0000","last_became_peered":"2022-07-05T11:46:04.206118+0000","last_unstale":"2022-07-05T11:46:09.027421+0000","last_undegraded":"2022-07-05T11:46:09.027421+0000","last_fullsized":"2022-07-05T11:46:09.027421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975854+0000","last_change":"2022-07-05T11:46:04.596814+0000","last_active":"2022-07-05T11:46:08.975854+0000","last_peered":"2022-07-05T11:46:08.975854+0000","last_clean":"2022-07-05T11:46:08.975854+0000","last_became_active":"2022-07-05T11:46:04.596492+0000","last_became_peered":"2022-07-05T11:46:04.596492+0000","last_unstale":"2022-07-05T11:46:08.975854+0000","last_undegraded":"2022-07-05T11:46:08.975854+0000","last_fullsized":"2022-07-05T11:46:08.975854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'10","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.359758+0000","last_change":"2022-07-05T11:46:04.208748+0000","last_active":"2022-07-05T11:46:21.359758+0000","last_peered":"2022-07-05T11:46:21.359758+0000","last_clean":"2022-07-05T11:46:21.359758+0000","last_became_active":"2022-07-05T11:46:04.208440+0000","last_became_peered":"2022-07-05T11:46:04.208440+0000","last_unstale":"2022-07-05T11:46:21.359758+0000","last_undegraded":"2022-07-05T11:46:21.359758+0000","last_fullsized":"2022-07-05T11:46:21.359758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974079+0000","last_change":"2022-07-05T11:46:04.592371+0000","last_active":"2022-07-05T11:46:08.974079+0000","last_peered":"2022-07-05T11:46:08.974079+0000","last_clean":"2022-07-05T11:46:08.974079+0000","last_became_active":"2022-07-05T11:46:04.592201+0000","last_became_peered":"2022-07-05T11:46:04.592201+0000","last_unstale":"2022-07-05T11:46:08.974079+0000","last_undegraded":"2022-07-05T11:46:08.974079+0000","last_fullsized":"2022-07-05T11:46:08.974079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.982904+0000","last_change":"2022-07-05T11:46:04.211261+0000","last_active":"2022-07-05T11:46:09.982904+0000","last_peered":"2022-07-05T11:46:09.982904+0000","last_clean":"2022-07-05T11:46:09.982904+0000","last_became_active":"2022-07-05T11:46:04.211004+0000","last_became_peered":"2022-07-05T11:46:04.211004+0000","last_unstale":"2022-07-05T11:46:09.982904+0000","last_undegraded":"2022-07-05T11:46:09.982904+0000","last_fullsized":"2022-07-05T11:46:09.982904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974789+0000","last_change":"2022-07-05T11:46:04.597787+0000","last_active":"2022-07-05T11:46:08.974789+0000","last_peered":"2022-07-05T11:46:08.974789+0000","last_clean":"2022-07-05T11:46:08.974789+0000","last_became_active":"2022-07-05T11:46:04.597433+0000","last_became_peered":"2022-07-05T11:46:04.597433+0000","last_unstale":"2022-07-05T11:46:08.974789+0000","last_undegraded":"2022-07-05T11:46:08.974789+0000","last_fullsized":"2022-07-05T11:46:08.974789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974038+0000","last_change":"2022-07-05T11:46:04.211347+0000","last_active":"2022-07-05T11:46:08.974038+0000","last_peered":"2022-07-05T11:46:08.974038+0000","last_clean":"2022-07-05T11:46:08.974038+0000","last_became_active":"2022-07-05T11:46:04.211045+0000","last_became_peered":"2022-07-05T11:46:04.211045+0000","last_unstale":"2022-07-05T11:46:08.974038+0000","last_undegraded":"2022-07-05T11:46:08.974038+0000","last_fullsized":"2022-07-05T11:46:08.974038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973840+0000","last_change":"2022-07-05T11:46:04.587177+0000","last_active":"2022-07-05T11:46:08.973840+0000","last_peered":"2022-07-05T11:46:08.973840+0000","last_clean":"2022-07-05T11:46:08.973840+0000","last_became_active":"2022-07-05T11:46:04.586915+0000","last_became_peered":"2022-07-05T11:46:04.586915+0000","last_unstale":"2022-07-05T11:46:08.973840+0000","last_undegraded":"2022-07-05T11:46:08.973840+0000","last_fullsized":"2022-07-05T11:46:08.973840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317123+0000","last_change":"2022-07-05T11:46:04.213135+0000","last_active":"2022-07-05T11:46:10.317123+0000","last_peered":"2022-07-05T11:46:10.317123+0000","last_clean":"2022-07-05T11:46:10.317123+0000","last_became_active":"2022-07-05T11:46:04.212877+0000","last_became_peered":"2022-07-05T11:46:04.212877+0000","last_unstale":"2022-07-05T11:46:10.317123+0000","last_undegraded":"2022-07-05T11:46:10.317123+0000","last_fullsized":"2022-07-05T11:46:10.317123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975178+0000","last_change":"2022-07-05T11:46:04.598414+0000","last_active":"2022-07-05T11:46:08.975178+0000","last_peered":"2022-07-05T11:46:08.975178+0000","last_clean":"2022-07-05T11:46:08.975178+0000","last_became_active":"2022-07-05T11:46:04.595082+0000","last_became_peered":"2022-07-05T11:46:04.595082+0000","last_unstale":"2022-07-05T11:46:08.975178+0000","last_undegraded":"2022-07-05T11:46:08.975178+0000","last_fullsized":"2022-07-05T11:46:08.975178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360365+0000","last_change":"2022-07-05T11:46:04.208533+0000","last_active":"2022-07-05T11:46:21.360365+0000","last_peered":"2022-07-05T11:46:21.360365+0000","last_clean":"2022-07-05T11:46:21.360365+0000","last_became_active":"2022-07-05T11:46:04.208198+0000","last_became_peered":"2022-07-05T11:46:04.208198+0000","last_unstale":"2022-07-05T11:46:21.360365+0000","last_undegraded":"2022-07-05T11:46:21.360365+0000","last_fullsized":"2022-07-05T11:46:21.360365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029685+0000","last_change":"2022-07-05T11:46:04.590329+0000","last_active":"2022-07-05T11:46:09.029685+0000","last_peered":"2022-07-05T11:46:09.029685+0000","last_clean":"2022-07-05T11:46:09.029685+0000","last_became_active":"2022-07-05T11:46:04.590046+0000","last_became_peered":"2022-07-05T11:46:04.590046+0000","last_unstale":"2022-07-05T11:46:09.029685+0000","last_undegraded":"2022-07-05T11:46:09.029685+0000","last_fullsized":"2022-07-05T11:46:09.029685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352181+0000","last_change":"2022-07-05T11:46:04.207526+0000","last_active":"2022-07-05T11:46:20.352181+0000","last_peered":"2022-07-05T11:46:20.352181+0000","last_clean":"2022-07-05T11:46:20.352181+0000","last_became_active":"2022-07-05T11:46:04.207209+0000","last_became_peered":"2022-07-05T11:46:04.207209+0000","last_unstale":"2022-07-05T11:46:20.352181+0000","last_undegraded":"2022-07-05T11:46:20.352181+0000","last_fullsized":"2022-07-05T11:46:20.352181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029663+0000","last_change":"2022-07-05T11:46:04.590203+0000","last_active":"2022-07-05T11:46:09.029663+0000","last_peered":"2022-07-05T11:46:09.029663+0000","last_clean":"2022-07-05T11:46:09.029663+0000","last_became_active":"2022-07-05T11:46:04.589893+0000","last_became_peered":"2022-07-05T11:46:04.589893+0000","last_unstale":"2022-07-05T11:46:09.029663+0000","last_undegraded":"2022-07-05T11:46:09.029663+0000","last_fullsized":"2022-07-05T11:46:09.029663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407980+0000","last_change":"2022-07-05T11:46:04.207726+0000","last_active":"2022-07-05T11:46:10.407980+0000","last_peered":"2022-07-05T11:46:10.407980+0000","last_clean":"2022-07-05T11:46:10.407980+0000","last_became_active":"2022-07-05T11:46:04.207398+0000","last_became_peered":"2022-07-05T11:46:04.207398+0000","last_unstale":"2022-07-05T11:46:10.407980+0000","last_undegraded":"2022-07-05T11:46:10.407980+0000","last_fullsized":"2022-07-05T11:46:10.407980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028460+0000","last_change":"2022-07-05T11:46:04.598660+0000","last_active":"2022-07-05T11:46:09.028460+0000","last_peered":"2022-07-05T11:46:09.028460+0000","last_clean":"2022-07-05T11:46:09.028460+0000","last_became_active":"2022-07-05T11:46:04.598419+0000","last_became_peered":"2022-07-05T11:46:04.598419+0000","last_unstale":"2022-07-05T11:46:09.028460+0000","last_undegraded":"2022-07-05T11:46:09.028460+0000","last_fullsized":"2022-07-05T11:46:09.028460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028769+0000","last_change":"2022-07-05T11:46:04.214164+0000","last_active":"2022-07-05T11:46:09.028769+0000","last_peered":"2022-07-05T11:46:09.028769+0000","last_clean":"2022-07-05T11:46:09.028769+0000","last_became_active":"2022-07-05T11:46:04.213794+0000","last_became_peered":"2022-07-05T11:46:04.213794+0000","last_unstale":"2022-07-05T11:46:09.028769+0000","last_undegraded":"2022-07-05T11:46:09.028769+0000","last_fullsized":"2022-07-05T11:46:09.028769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.599315+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.599091+0000","last_became_peered":"2022-07-05T11:46:04.599091+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353175+0000","last_change":"2022-07-05T11:46:04.208200+0000","last_active":"2022-07-05T11:46:20.353175+0000","last_peered":"2022-07-05T11:46:20.353175+0000","last_clean":"2022-07-05T11:46:20.353175+0000","last_became_active":"2022-07-05T11:46:04.207891+0000","last_became_peered":"2022-07-05T11:46:04.207891+0000","last_unstale":"2022-07-05T11:46:20.353175+0000","last_undegraded":"2022-07-05T11:46:20.353175+0000","last_fullsized":"2022-07-05T11:46:20.353175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028740+0000","last_change":"2022-07-05T11:46:04.594011+0000","last_active":"2022-07-05T11:46:09.028740+0000","last_peered":"2022-07-05T11:46:09.028740+0000","last_clean":"2022-07-05T11:46:09.028740+0000","last_became_active":"2022-07-05T11:46:04.593800+0000","last_became_peered":"2022-07-05T11:46:04.593800+0000","last_unstale":"2022-07-05T11:46:09.028740+0000","last_undegraded":"2022-07-05T11:46:09.028740+0000","last_fullsized":"2022-07-05T11:46:09.028740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353238+0000","last_change":"2022-07-05T11:46:04.206715+0000","last_active":"2022-07-05T11:46:20.353238+0000","last_peered":"2022-07-05T11:46:20.353238+0000","last_clean":"2022-07-05T11:46:20.353238+0000","last_became_active":"2022-07-05T11:46:04.206230+0000","last_became_peered":"2022-07-05T11:46:04.206230+0000","last_unstale":"2022-07-05T11:46:20.353238+0000","last_undegraded":"2022-07-05T11:46:20.353238+0000","last_fullsized":"2022-07-05T11:46:20.353238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029238+0000","last_change":"2022-07-05T11:46:04.590527+0000","last_active":"2022-07-05T11:46:09.029238+0000","last_peered":"2022-07-05T11:46:09.029238+0000","last_clean":"2022-07-05T11:46:09.029238+0000","last_became_active":"2022-07-05T11:46:04.589992+0000","last_became_peered":"2022-07-05T11:46:04.589992+0000","last_unstale":"2022-07-05T11:46:09.029238+0000","last_undegraded":"2022-07-05T11:46:09.029238+0000","last_fullsized":"2022-07-05T11:46:09.029238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.317357+0000","last_change":"2022-07-05T11:46:04.209943+0000","last_active":"2022-07-05T11:46:10.317357+0000","last_peered":"2022-07-05T11:46:10.317357+0000","last_clean":"2022-07-05T11:46:10.317357+0000","last_became_active":"2022-07-05T11:46:04.209640+0000","last_became_peered":"2022-07-05T11:46:04.209640+0000","last_unstale":"2022-07-05T11:46:10.317357+0000","last_undegraded":"2022-07-05T11:46:10.317357+0000","last_fullsized":"2022-07-05T11:46:10.317357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028615+0000","last_change":"2022-07-05T11:46:04.593997+0000","last_active":"2022-07-05T11:46:09.028615+0000","last_peered":"2022-07-05T11:46:09.028615+0000","last_clean":"2022-07-05T11:46:09.028615+0000","last_became_active":"2022-07-05T11:46:04.593708+0000","last_became_peered":"2022-07-05T11:46:04.593708+0000","last_unstale":"2022-07-05T11:46:09.028615+0000","last_undegraded":"2022-07-05T11:46:09.028615+0000","last_fullsized":"2022-07-05T11:46:09.028615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352932+0000","last_change":"2022-07-05T11:46:04.203818+0000","last_active":"2022-07-05T11:46:20.352932+0000","last_peered":"2022-07-05T11:46:20.352932+0000","last_clean":"2022-07-05T11:46:20.352932+0000","last_became_active":"2022-07-05T11:46:04.203504+0000","last_became_peered":"2022-07-05T11:46:04.203504+0000","last_unstale":"2022-07-05T11:46:20.352932+0000","last_undegraded":"2022-07-05T11:46:20.352932+0000","last_fullsized":"2022-07-05T11:46:20.352932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975098+0000","last_change":"2022-07-05T11:46:04.598669+0000","last_active":"2022-07-05T11:46:08.975098+0000","last_peered":"2022-07-05T11:46:08.975098+0000","last_clean":"2022-07-05T11:46:08.975098+0000","last_became_active":"2022-07-05T11:46:04.598400+0000","last_became_peered":"2022-07-05T11:46:04.598400+0000","last_unstale":"2022-07-05T11:46:08.975098+0000","last_undegraded":"2022-07-05T11:46:08.975098+0000","last_fullsized":"2022-07-05T11:46:08.975098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028775+0000","last_change":"2022-07-05T11:46:04.212247+0000","last_active":"2022-07-05T11:46:09.028775+0000","last_peered":"2022-07-05T11:46:09.028775+0000","last_clean":"2022-07-05T11:46:09.028775+0000","last_became_active":"2022-07-05T11:46:04.211958+0000","last_became_peered":"2022-07-05T11:46:04.211958+0000","last_unstale":"2022-07-05T11:46:09.028775+0000","last_undegraded":"2022-07-05T11:46:09.028775+0000","last_fullsized":"2022-07-05T11:46:09.028775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029158+0000","last_change":"2022-07-05T11:46:04.599477+0000","last_active":"2022-07-05T11:46:09.029158+0000","last_peered":"2022-07-05T11:46:09.029158+0000","last_clean":"2022-07-05T11:46:09.029158+0000","last_became_active":"2022-07-05T11:46:04.599214+0000","last_became_peered":"2022-07-05T11:46:04.599214+0000","last_unstale":"2022-07-05T11:46:09.029158+0000","last_undegraded":"2022-07-05T11:46:09.029158+0000","last_fullsized":"2022-07-05T11:46:09.029158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027608+0000","last_change":"2022-07-05T11:46:04.209196+0000","last_active":"2022-07-05T11:46:09.027608+0000","last_peered":"2022-07-05T11:46:09.027608+0000","last_clean":"2022-07-05T11:46:09.027608+0000","last_became_active":"2022-07-05T11:46:04.208918+0000","last_became_peered":"2022-07-05T11:46:04.208918+0000","last_unstale":"2022-07-05T11:46:09.027608+0000","last_undegraded":"2022-07-05T11:46:09.027608+0000","last_fullsized":"2022-07-05T11:46:09.027608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975167+0000","last_change":"2022-07-05T11:46:04.594414+0000","last_active":"2022-07-05T11:46:08.975167+0000","last_peered":"2022-07-05T11:46:08.975167+0000","last_clean":"2022-07-05T11:46:08.975167+0000","last_became_active":"2022-07-05T11:46:04.594114+0000","last_became_peered":"2022-07-05T11:46:04.594114+0000","last_unstale":"2022-07-05T11:46:08.975167+0000","last_undegraded":"2022-07-05T11:46:08.975167+0000","last_fullsized":"2022-07-05T11:46:08.975167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027763+0000","last_change":"2022-07-05T11:46:04.215006+0000","last_active":"2022-07-05T11:46:09.027763+0000","last_peered":"2022-07-05T11:46:09.027763+0000","last_clean":"2022-07-05T11:46:09.027763+0000","last_became_active":"2022-07-05T11:46:04.214585+0000","last_became_peered":"2022-07-05T11:46:04.214585+0000","last_unstale":"2022-07-05T11:46:09.027763+0000","last_undegraded":"2022-07-05T11:46:09.027763+0000","last_fullsized":"2022-07-05T11:46:09.027763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030101+0000","last_change":"2022-07-05T11:46:04.601912+0000","last_active":"2022-07-05T11:46:09.030101+0000","last_peered":"2022-07-05T11:46:09.030101+0000","last_clean":"2022-07-05T11:46:09.030101+0000","last_became_active":"2022-07-05T11:46:04.601605+0000","last_became_peered":"2022-07-05T11:46:04.601605+0000","last_unstale":"2022-07-05T11:46:09.030101+0000","last_undegraded":"2022-07-05T11:46:09.030101+0000","last_fullsized":"2022-07-05T11:46:09.030101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.387919+0000","last_change":"2022-07-05T11:46:04.208064+0000","last_active":"2022-07-05T11:46:40.387919+0000","last_peered":"2022-07-05T11:46:40.387919+0000","last_clean":"2022-07-05T11:46:40.387919+0000","last_became_active":"2022-07-05T11:46:04.207845+0000","last_became_peered":"2022-07-05T11:46:04.207845+0000","last_unstale":"2022-07-05T11:46:40.387919+0000","last_undegraded":"2022-07-05T11:46:40.387919+0000","last_fullsized":"2022-07-05T11:46:40.387919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030056+0000","last_change":"2022-07-05T11:46:04.589990+0000","last_active":"2022-07-05T11:46:09.030056+0000","last_peered":"2022-07-05T11:46:09.030056+0000","last_clean":"2022-07-05T11:46:09.030056+0000","last_became_active":"2022-07-05T11:46:04.589734+0000","last_became_peered":"2022-07-05T11:46:04.589734+0000","last_unstale":"2022-07-05T11:46:09.030056+0000","last_undegraded":"2022-07-05T11:46:09.030056+0000","last_fullsized":"2022-07-05T11:46:09.030056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974955+0000","last_change":"2022-07-05T11:46:04.208275+0000","last_active":"2022-07-05T11:46:08.974955+0000","last_peered":"2022-07-05T11:46:08.974955+0000","last_clean":"2022-07-05T11:46:08.974955+0000","last_became_active":"2022-07-05T11:46:04.208001+0000","last_became_peered":"2022-07-05T11:46:04.208001+0000","last_unstale":"2022-07-05T11:46:08.974955+0000","last_undegraded":"2022-07-05T11:46:08.974955+0000","last_fullsized":"2022-07-05T11:46:08.974955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028628+0000","last_change":"2022-07-05T11:46:04.597446+0000","last_active":"2022-07-05T11:46:09.028628+0000","last_peered":"2022-07-05T11:46:09.028628+0000","last_clean":"2022-07-05T11:46:09.028628+0000","last_became_active":"2022-07-05T11:46:04.596828+0000","last_became_peered":"2022-07-05T11:46:04.596828+0000","last_unstale":"2022-07-05T11:46:09.028628+0000","last_undegraded":"2022-07-05T11:46:09.028628+0000","last_fullsized":"2022-07-05T11:46:09.028628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.360630+0000","last_change":"2022-07-05T11:46:04.211080+0000","last_active":"2022-07-05T11:46:21.360630+0000","last_peered":"2022-07-05T11:46:21.360630+0000","last_clean":"2022-07-05T11:46:21.360630+0000","last_became_active":"2022-07-05T11:46:04.210805+0000","last_became_peered":"2022-07-05T11:46:04.210805+0000","last_unstale":"2022-07-05T11:46:21.360630+0000","last_undegraded":"2022-07-05T11:46:21.360630+0000","last_fullsized":"2022-07-05T11:46:21.360630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012330+0000","last_change":"2022-07-05T11:46:04.594116+0000","last_active":"2022-07-05T11:46:09.012330+0000","last_peered":"2022-07-05T11:46:09.012330+0000","last_clean":"2022-07-05T11:46:09.012330+0000","last_became_active":"2022-07-05T11:46:04.593716+0000","last_became_peered":"2022-07-05T11:46:04.593716+0000","last_unstale":"2022-07-05T11:46:09.012330+0000","last_undegraded":"2022-07-05T11:46:09.012330+0000","last_fullsized":"2022-07-05T11:46:09.012330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017611+0000","last_change":"2022-07-05T11:46:09.014114+0000","last_active":"2022-07-05T11:46:09.017611+0000","last_peered":"2022-07-05T11:46:09.017611+0000","last_clean":"2022-07-05T11:46:09.017611+0000","last_became_active":"2022-07-05T11:46:09.013707+0000","last_became_peered":"2022-07-05T11:46:09.013707+0000","last_unstale":"2022-07-05T11:46:09.017611+0000","last_undegraded":"2022-07-05T11:46:09.017611+0000","last_fullsized":"2022-07-05T11:46:09.017611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029324+0000","last_change":"2022-07-05T11:46:04.213375+0000","last_active":"2022-07-05T11:46:09.029324+0000","last_peered":"2022-07-05T11:46:09.029324+0000","last_clean":"2022-07-05T11:46:09.029324+0000","last_became_active":"2022-07-05T11:46:04.213094+0000","last_became_peered":"2022-07-05T11:46:04.213094+0000","last_unstale":"2022-07-05T11:46:09.029324+0000","last_undegraded":"2022-07-05T11:46:09.029324+0000","last_fullsized":"2022-07-05T11:46:09.029324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027648+0000","last_change":"2022-07-05T11:46:04.599779+0000","last_active":"2022-07-05T11:46:09.027648+0000","last_peered":"2022-07-05T11:46:09.027648+0000","last_clean":"2022-07-05T11:46:09.027648+0000","last_became_active":"2022-07-05T11:46:04.597330+0000","last_became_peered":"2022-07-05T11:46:04.597330+0000","last_unstale":"2022-07-05T11:46:09.027648+0000","last_undegraded":"2022-07-05T11:46:09.027648+0000","last_fullsized":"2022-07-05T11:46:09.027648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012222+0000","last_change":"2022-07-05T11:46:08.615050+0000","last_active":"2022-07-05T11:46:09.012222+0000","last_peered":"2022-07-05T11:46:09.012222+0000","last_clean":"2022-07-05T11:46:09.012222+0000","last_became_active":"2022-07-05T11:46:08.614715+0000","last_became_peered":"2022-07-05T11:46:08.614715+0000","last_unstale":"2022-07-05T11:46:09.012222+0000","last_undegraded":"2022-07-05T11:46:09.012222+0000","last_fullsized":"2022-07-05T11:46:09.012222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975318+0000","last_change":"2022-07-05T11:46:04.206835+0000","last_active":"2022-07-05T11:46:08.975318+0000","last_peered":"2022-07-05T11:46:08.975318+0000","last_clean":"2022-07-05T11:46:08.975318+0000","last_became_active":"2022-07-05T11:46:04.206389+0000","last_became_peered":"2022-07-05T11:46:04.206389+0000","last_unstale":"2022-07-05T11:46:08.975318+0000","last_undegraded":"2022-07-05T11:46:08.975318+0000","last_fullsized":"2022-07-05T11:46:08.975318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012352+0000","last_change":"2022-07-05T11:46:04.595704+0000","last_active":"2022-07-05T11:46:09.012352+0000","last_peered":"2022-07-05T11:46:09.012352+0000","last_clean":"2022-07-05T11:46:09.012352+0000","last_became_active":"2022-07-05T11:46:04.594581+0000","last_became_peered":"2022-07-05T11:46:04.594581+0000","last_unstale":"2022-07-05T11:46:09.012352+0000","last_undegraded":"2022-07-05T11:46:09.012352+0000","last_fullsized":"2022-07-05T11:46:09.012352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028313+0000","last_change":"2022-07-05T11:46:08.618434+0000","last_active":"2022-07-05T11:46:09.028313+0000","last_peered":"2022-07-05T11:46:09.028313+0000","last_clean":"2022-07-05T11:46:09.028313+0000","last_became_active":"2022-07-05T11:46:08.618022+0000","last_became_peered":"2022-07-05T11:46:08.618022+0000","last_unstale":"2022-07-05T11:46:09.028313+0000","last_undegraded":"2022-07-05T11:46:09.028313+0000","last_fullsized":"2022-07-05T11:46:09.028313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029453+0000","last_change":"2022-07-05T11:46:04.213103+0000","last_active":"2022-07-05T11:46:09.029453+0000","last_peered":"2022-07-05T11:46:09.029453+0000","last_clean":"2022-07-05T11:46:09.029453+0000","last_became_active":"2022-07-05T11:46:04.211627+0000","last_became_peered":"2022-07-05T11:46:04.211627+0000","last_unstale":"2022-07-05T11:46:09.029453+0000","last_undegraded":"2022-07-05T11:46:09.029453+0000","last_fullsized":"2022-07-05T11:46:09.029453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012463+0000","last_change":"2022-07-05T11:46:04.593912+0000","last_active":"2022-07-05T11:46:09.012463+0000","last_peered":"2022-07-05T11:46:09.012463+0000","last_clean":"2022-07-05T11:46:09.012463+0000","last_became_active":"2022-07-05T11:46:04.593631+0000","last_became_peered":"2022-07-05T11:46:04.593631+0000","last_unstale":"2022-07-05T11:46:09.012463+0000","last_undegraded":"2022-07-05T11:46:09.012463+0000","last_fullsized":"2022-07-05T11:46:09.012463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028223+0000","last_change":"2022-07-05T11:46:09.013932+0000","last_active":"2022-07-05T11:46:09.028223+0000","last_peered":"2022-07-05T11:46:09.028223+0000","last_clean":"2022-07-05T11:46:09.028223+0000","last_became_active":"2022-07-05T11:46:09.013609+0000","last_became_peered":"2022-07-05T11:46:09.013609+0000","last_unstale":"2022-07-05T11:46:09.028223+0000","last_undegraded":"2022-07-05T11:46:09.028223+0000","last_fullsized":"2022-07-05T11:46:09.028223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028226+0000","last_change":"2022-07-05T11:46:09.016568+0000","last_active":"2022-07-05T11:46:09.028226+0000","last_peered":"2022-07-05T11:46:09.028226+0000","last_clean":"2022-07-05T11:46:09.028226+0000","last_became_active":"2022-07-05T11:46:09.016162+0000","last_became_peered":"2022-07-05T11:46:09.016162+0000","last_unstale":"2022-07-05T11:46:09.028226+0000","last_undegraded":"2022-07-05T11:46:09.028226+0000","last_fullsized":"2022-07-05T11:46:09.028226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:41.395640+0000","last_change":"2022-07-05T11:46:04.208656+0000","last_active":"2022-07-05T11:46:41.395640+0000","last_peered":"2022-07-05T11:46:41.395640+0000","last_clean":"2022-07-05T11:46:41.395640+0000","last_became_active":"2022-07-05T11:46:04.208394+0000","last_became_peered":"2022-07-05T11:46:04.208394+0000","last_unstale":"2022-07-05T11:46:41.395640+0000","last_undegraded":"2022-07-05T11:46:41.395640+0000","last_fullsized":"2022-07-05T11:46:41.395640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":830,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027906+0000","last_change":"2022-07-05T11:46:04.600156+0000","last_active":"2022-07-05T11:46:09.027906+0000","last_peered":"2022-07-05T11:46:09.027906+0000","last_clean":"2022-07-05T11:46:09.027906+0000","last_became_active":"2022-07-05T11:46:04.599836+0000","last_became_peered":"2022-07-05T11:46:04.599836+0000","last_unstale":"2022-07-05T11:46:09.027906+0000","last_undegraded":"2022-07-05T11:46:09.027906+0000","last_fullsized":"2022-07-05T11:46:09.027906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027863+0000","last_change":"2022-07-05T11:46:04.599555+0000","last_active":"2022-07-05T11:46:09.027863+0000","last_peered":"2022-07-05T11:46:09.027863+0000","last_clean":"2022-07-05T11:46:09.027863+0000","last_became_active":"2022-07-05T11:46:04.597036+0000","last_became_peered":"2022-07-05T11:46:04.597036+0000","last_unstale":"2022-07-05T11:46:09.027863+0000","last_undegraded":"2022-07-05T11:46:09.027863+0000","last_fullsized":"2022-07-05T11:46:09.027863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.357392+0000","last_change":"2022-07-05T11:46:04.215037+0000","last_active":"2022-07-05T11:46:21.357392+0000","last_peered":"2022-07-05T11:46:21.357392+0000","last_clean":"2022-07-05T11:46:21.357392+0000","last_became_active":"2022-07-05T11:46:04.214699+0000","last_became_peered":"2022-07-05T11:46:04.214699+0000","last_unstale":"2022-07-05T11:46:21.357392+0000","last_undegraded":"2022-07-05T11:46:21.357392+0000","last_fullsized":"2022-07-05T11:46:21.357392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012966+0000","last_change":"2022-07-05T11:46:00.405416+0000","last_active":"2022-07-05T11:46:09.012966+0000","last_peered":"2022-07-05T11:46:09.012966+0000","last_clean":"2022-07-05T11:46:09.012966+0000","last_became_active":"2022-07-05T11:46:00.405179+0000","last_became_peered":"2022-07-05T11:46:00.405179+0000","last_unstale":"2022-07-05T11:46:09.012966+0000","last_undegraded":"2022-07-05T11:46:09.012966+0000","last_fullsized":"2022-07-05T11:46:09.012966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027570+0000","last_change":"2022-07-05T11:46:08.616541+0000","last_active":"2022-07-05T11:46:09.027570+0000","last_peered":"2022-07-05T11:46:09.027570+0000","last_clean":"2022-07-05T11:46:09.027570+0000","last_became_active":"2022-07-05T11:46:08.616124+0000","last_became_peered":"2022-07-05T11:46:08.616124+0000","last_unstale":"2022-07-05T11:46:09.027570+0000","last_undegraded":"2022-07-05T11:46:09.027570+0000","last_fullsized":"2022-07-05T11:46:09.027570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028425+0000","last_change":"2022-07-05T11:46:04.584095+0000","last_active":"2022-07-05T11:46:09.028425+0000","last_peered":"2022-07-05T11:46:09.028425+0000","last_clean":"2022-07-05T11:46:09.028425+0000","last_became_active":"2022-07-05T11:46:04.583806+0000","last_became_peered":"2022-07-05T11:46:04.583806+0000","last_unstale":"2022-07-05T11:46:09.028425+0000","last_undegraded":"2022-07-05T11:46:09.028425+0000","last_fullsized":"2022-07-05T11:46:09.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974096+0000","last_change":"2022-07-05T11:46:00.174377+0000","last_active":"2022-07-05T11:46:08.974096+0000","last_peered":"2022-07-05T11:46:08.974096+0000","last_clean":"2022-07-05T11:46:08.974096+0000","last_became_active":"2022-07-05T11:46:00.174041+0000","last_became_peered":"2022-07-05T11:46:00.174041+0000","last_unstale":"2022-07-05T11:46:08.974096+0000","last_undegraded":"2022-07-05T11:46:08.974096+0000","last_fullsized":"2022-07-05T11:46:08.974096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029651+0000","last_change":"2022-07-05T11:46:04.201186+0000","last_active":"2022-07-05T11:46:09.029651+0000","last_peered":"2022-07-05T11:46:09.029651+0000","last_clean":"2022-07-05T11:46:09.029651+0000","last_became_active":"2022-07-05T11:46:04.200331+0000","last_became_peered":"2022-07-05T11:46:04.200331+0000","last_unstale":"2022-07-05T11:46:09.029651+0000","last_undegraded":"2022-07-05T11:46:09.029651+0000","last_fullsized":"2022-07-05T11:46:09.029651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012267+0000","last_change":"2022-07-05T11:46:08.617187+0000","last_active":"2022-07-05T11:46:09.012267+0000","last_peered":"2022-07-05T11:46:09.012267+0000","last_clean":"2022-07-05T11:46:09.012267+0000","last_became_active":"2022-07-05T11:46:08.616787+0000","last_became_peered":"2022-07-05T11:46:08.616787+0000","last_unstale":"2022-07-05T11:46:09.012267+0000","last_undegraded":"2022-07-05T11:46:09.012267+0000","last_fullsized":"2022-07-05T11:46:09.012267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974758+0000","last_change":"2022-07-05T11:46:04.595606+0000","last_active":"2022-07-05T11:46:08.974758+0000","last_peered":"2022-07-05T11:46:08.974758+0000","last_clean":"2022-07-05T11:46:08.974758+0000","last_became_active":"2022-07-05T11:46:04.594962+0000","last_became_peered":"2022-07-05T11:46:04.594962+0000","last_unstale":"2022-07-05T11:46:08.974758+0000","last_undegraded":"2022-07-05T11:46:08.974758+0000","last_fullsized":"2022-07-05T11:46:08.974758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028691+0000","last_change":"2022-07-05T11:46:04.208492+0000","last_active":"2022-07-05T11:46:09.028691+0000","last_peered":"2022-07-05T11:46:09.028691+0000","last_clean":"2022-07-05T11:46:09.028691+0000","last_became_active":"2022-07-05T11:46:04.208135+0000","last_became_peered":"2022-07-05T11:46:04.208135+0000","last_unstale":"2022-07-05T11:46:09.028691+0000","last_undegraded":"2022-07-05T11:46:09.028691+0000","last_fullsized":"2022-07-05T11:46:09.028691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028400+0000","last_change":"2022-07-05T11:46:01.122048+0000","last_active":"2022-07-05T11:46:09.028400+0000","last_peered":"2022-07-05T11:46:09.028400+0000","last_clean":"2022-07-05T11:46:09.028400+0000","last_became_active":"2022-07-05T11:46:01.121724+0000","last_became_peered":"2022-07-05T11:46:01.121724+0000","last_unstale":"2022-07-05T11:46:09.028400+0000","last_undegraded":"2022-07-05T11:46:09.028400+0000","last_fullsized":"2022-07-05T11:46:09.028400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029610+0000","last_change":"2022-07-05T11:46:08.614936+0000","last_active":"2022-07-05T11:46:09.029610+0000","last_peered":"2022-07-05T11:46:09.029610+0000","last_clean":"2022-07-05T11:46:09.029610+0000","last_became_active":"2022-07-05T11:46:08.613212+0000","last_became_peered":"2022-07-05T11:46:08.613212+0000","last_unstale":"2022-07-05T11:46:09.029610+0000","last_undegraded":"2022-07-05T11:46:09.029610+0000","last_fullsized":"2022-07-05T11:46:09.029610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358743+0000","last_change":"2022-07-05T11:46:04.207235+0000","last_active":"2022-07-05T11:46:21.358743+0000","last_peered":"2022-07-05T11:46:21.358743+0000","last_clean":"2022-07-05T11:46:21.358743+0000","last_became_active":"2022-07-05T11:46:04.206912+0000","last_became_peered":"2022-07-05T11:46:04.206912+0000","last_unstale":"2022-07-05T11:46:21.358743+0000","last_undegraded":"2022-07-05T11:46:21.358743+0000","last_fullsized":"2022-07-05T11:46:21.358743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027868+0000","last_change":"2022-07-05T11:46:00.387606+0000","last_active":"2022-07-05T11:46:09.027868+0000","last_peered":"2022-07-05T11:46:09.027868+0000","last_clean":"2022-07-05T11:46:09.027868+0000","last_became_active":"2022-07-05T11:46:00.387285+0000","last_became_peered":"2022-07-05T11:46:00.387285+0000","last_unstale":"2022-07-05T11:46:09.027868+0000","last_undegraded":"2022-07-05T11:46:09.027868+0000","last_fullsized":"2022-07-05T11:46:09.027868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975087+0000","last_change":"2022-07-05T11:46:04.597434+0000","last_active":"2022-07-05T11:46:08.975087+0000","last_peered":"2022-07-05T11:46:08.975087+0000","last_clean":"2022-07-05T11:46:08.975087+0000","last_became_active":"2022-07-05T11:46:04.596283+0000","last_became_peered":"2022-07-05T11:46:04.596283+0000","last_unstale":"2022-07-05T11:46:08.975087+0000","last_undegraded":"2022-07-05T11:46:08.975087+0000","last_fullsized":"2022-07-05T11:46:08.975087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030525+0000","last_change":"2022-07-05T11:46:08.618008+0000","last_active":"2022-07-05T11:46:09.030525+0000","last_peered":"2022-07-05T11:46:09.030525+0000","last_clean":"2022-07-05T11:46:09.030525+0000","last_became_active":"2022-07-05T11:46:08.617640+0000","last_became_peered":"2022-07-05T11:46:08.617640+0000","last_unstale":"2022-07-05T11:46:09.030525+0000","last_undegraded":"2022-07-05T11:46:09.030525+0000","last_fullsized":"2022-07-05T11:46:09.030525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407205+0000","last_change":"2022-07-05T11:46:04.205557+0000","last_active":"2022-07-05T11:46:10.407205+0000","last_peered":"2022-07-05T11:46:10.407205+0000","last_clean":"2022-07-05T11:46:10.407205+0000","last_became_active":"2022-07-05T11:46:04.203760+0000","last_became_peered":"2022-07-05T11:46:04.203760+0000","last_unstale":"2022-07-05T11:46:10.407205+0000","last_undegraded":"2022-07-05T11:46:10.407205+0000","last_fullsized":"2022-07-05T11:46:10.407205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027789+0000","last_change":"2022-07-05T11:45:58.489958+0000","last_active":"2022-07-05T11:46:09.027789+0000","last_peered":"2022-07-05T11:46:09.027789+0000","last_clean":"2022-07-05T11:46:09.027789+0000","last_became_active":"2022-07-05T11:45:58.489710+0000","last_became_peered":"2022-07-05T11:45:58.489710+0000","last_unstale":"2022-07-05T11:46:09.027789+0000","last_undegraded":"2022-07-05T11:46:09.027789+0000","last_fullsized":"2022-07-05T11:46:09.027789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:57.143009+0000","last_clean_scrub_stamp":"2022-07-05T11:45:57.143009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012518+0000","last_change":"2022-07-05T11:46:01.154008+0000","last_active":"2022-07-05T11:46:09.012518+0000","last_peered":"2022-07-05T11:46:09.012518+0000","last_clean":"2022-07-05T11:46:09.012518+0000","last_became_active":"2022-07-05T11:46:01.153653+0000","last_became_peered":"2022-07-05T11:46:01.153653+0000","last_unstale":"2022-07-05T11:46:09.012518+0000","last_undegraded":"2022-07-05T11:46:09.012518+0000","last_fullsized":"2022-07-05T11:46:09.012518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029959+0000","last_change":"2022-07-05T11:46:04.597444+0000","last_active":"2022-07-05T11:46:09.029959+0000","last_peered":"2022-07-05T11:46:09.029959+0000","last_clean":"2022-07-05T11:46:09.029959+0000","last_became_active":"2022-07-05T11:46:04.597199+0000","last_became_peered":"2022-07-05T11:46:04.597199+0000","last_unstale":"2022-07-05T11:46:09.029959+0000","last_undegraded":"2022-07-05T11:46:09.029959+0000","last_fullsized":"2022-07-05T11:46:09.029959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028215+0000","last_change":"2022-07-05T11:46:09.017084+0000","last_active":"2022-07-05T11:46:09.028215+0000","last_peered":"2022-07-05T11:46:09.028215+0000","last_clean":"2022-07-05T11:46:09.028215+0000","last_became_active":"2022-07-05T11:46:09.016658+0000","last_became_peered":"2022-07-05T11:46:09.016658+0000","last_unstale":"2022-07-05T11:46:09.028215+0000","last_undegraded":"2022-07-05T11:46:09.028215+0000","last_fullsized":"2022-07-05T11:46:09.028215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:21.358568+0000","last_change":"2022-07-05T11:46:04.209767+0000","last_active":"2022-07-05T11:46:21.358568+0000","last_peered":"2022-07-05T11:46:21.358568+0000","last_clean":"2022-07-05T11:46:21.358568+0000","last_became_active":"2022-07-05T11:46:04.209524+0000","last_became_peered":"2022-07-05T11:46:04.209524+0000","last_unstale":"2022-07-05T11:46:21.358568+0000","last_undegraded":"2022-07-05T11:46:21.358568+0000","last_fullsized":"2022-07-05T11:46:21.358568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028541+0000","last_change":"2022-07-05T11:46:01.118061+0000","last_active":"2022-07-05T11:46:09.028541+0000","last_peered":"2022-07-05T11:46:09.028541+0000","last_clean":"2022-07-05T11:46:09.028541+0000","last_became_active":"2022-07-05T11:46:01.117762+0000","last_became_peered":"2022-07-05T11:46:01.117762+0000","last_unstale":"2022-07-05T11:46:09.028541+0000","last_undegraded":"2022-07-05T11:46:09.028541+0000","last_fullsized":"2022-07-05T11:46:09.028541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028916+0000","last_change":"2022-07-05T11:46:04.594377+0000","last_active":"2022-07-05T11:46:09.028916+0000","last_peered":"2022-07-05T11:46:09.028916+0000","last_clean":"2022-07-05T11:46:09.028916+0000","last_became_active":"2022-07-05T11:46:04.594103+0000","last_became_peered":"2022-07-05T11:46:04.594103+0000","last_unstale":"2022-07-05T11:46:09.028916+0000","last_undegraded":"2022-07-05T11:46:09.028916+0000","last_fullsized":"2022-07-05T11:46:09.028916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017137+0000","last_change":"2022-07-05T11:46:09.014687+0000","last_active":"2022-07-05T11:46:09.017137+0000","last_peered":"2022-07-05T11:46:09.017137+0000","last_clean":"2022-07-05T11:46:09.017137+0000","last_became_active":"2022-07-05T11:46:09.014298+0000","last_became_peered":"2022-07-05T11:46:09.014298+0000","last_unstale":"2022-07-05T11:46:09.017137+0000","last_undegraded":"2022-07-05T11:46:09.017137+0000","last_fullsized":"2022-07-05T11:46:09.017137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028627+0000","last_change":"2022-07-05T11:46:04.593068+0000","last_active":"2022-07-05T11:46:09.028627+0000","last_peered":"2022-07-05T11:46:09.028627+0000","last_clean":"2022-07-05T11:46:09.028627+0000","last_became_active":"2022-07-05T11:46:04.592770+0000","last_became_peered":"2022-07-05T11:46:04.592770+0000","last_unstale":"2022-07-05T11:46:09.028627+0000","last_undegraded":"2022-07-05T11:46:09.028627+0000","last_fullsized":"2022-07-05T11:46:09.028627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:22.362211+0000","last_change":"2022-07-05T11:46:04.205846+0000","last_active":"2022-07-05T11:46:22.362211+0000","last_peered":"2022-07-05T11:46:22.362211+0000","last_clean":"2022-07-05T11:46:22.362211+0000","last_became_active":"2022-07-05T11:46:04.205358+0000","last_became_peered":"2022-07-05T11:46:04.205358+0000","last_unstale":"2022-07-05T11:46:22.362211+0000","last_undegraded":"2022-07-05T11:46:22.362211+0000","last_fullsized":"2022-07-05T11:46:22.362211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028856+0000","last_change":"2022-07-05T11:46:00.171709+0000","last_active":"2022-07-05T11:46:09.028856+0000","last_peered":"2022-07-05T11:46:09.028856+0000","last_clean":"2022-07-05T11:46:09.028856+0000","last_became_active":"2022-07-05T11:46:00.171328+0000","last_became_peered":"2022-07-05T11:46:00.171328+0000","last_unstale":"2022-07-05T11:46:09.028856+0000","last_undegraded":"2022-07-05T11:46:09.028856+0000","last_fullsized":"2022-07-05T11:46:09.028856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017640+0000","last_change":"2022-07-05T11:46:09.015332+0000","last_active":"2022-07-05T11:46:09.017640+0000","last_peered":"2022-07-05T11:46:09.017640+0000","last_clean":"2022-07-05T11:46:09.017640+0000","last_became_active":"2022-07-05T11:46:09.013688+0000","last_became_peered":"2022-07-05T11:46:09.013688+0000","last_unstale":"2022-07-05T11:46:09.017640+0000","last_undegraded":"2022-07-05T11:46:09.017640+0000","last_fullsized":"2022-07-05T11:46:09.017640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028419+0000","last_change":"2022-07-05T11:46:04.600986+0000","last_active":"2022-07-05T11:46:09.028419+0000","last_peered":"2022-07-05T11:46:09.028419+0000","last_clean":"2022-07-05T11:46:09.028419+0000","last_became_active":"2022-07-05T11:46:04.600619+0000","last_became_peered":"2022-07-05T11:46:04.600619+0000","last_unstale":"2022-07-05T11:46:09.028419+0000","last_undegraded":"2022-07-05T11:46:09.028419+0000","last_fullsized":"2022-07-05T11:46:09.028419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030201+0000","last_change":"2022-07-05T11:46:04.201044+0000","last_active":"2022-07-05T11:46:09.030201+0000","last_peered":"2022-07-05T11:46:09.030201+0000","last_clean":"2022-07-05T11:46:09.030201+0000","last_became_active":"2022-07-05T11:46:04.200743+0000","last_became_peered":"2022-07-05T11:46:04.200743+0000","last_unstale":"2022-07-05T11:46:09.030201+0000","last_undegraded":"2022-07-05T11:46:09.030201+0000","last_fullsized":"2022-07-05T11:46:09.030201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974024+0000","last_change":"2022-07-05T11:46:00.406891+0000","last_active":"2022-07-05T11:46:08.974024+0000","last_peered":"2022-07-05T11:46:08.974024+0000","last_clean":"2022-07-05T11:46:08.974024+0000","last_became_active":"2022-07-05T11:46:00.406555+0000","last_became_peered":"2022-07-05T11:46:00.406555+0000","last_unstale":"2022-07-05T11:46:08.974024+0000","last_undegraded":"2022-07-05T11:46:08.974024+0000","last_fullsized":"2022-07-05T11:46:08.974024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:45:59.162044+0000","last_clean_scrub_stamp":"2022-07-05T11:45:59.162044+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027228+0000","last_change":"2022-07-05T11:46:09.014076+0000","last_active":"2022-07-05T11:46:09.027228+0000","last_peered":"2022-07-05T11:46:09.027228+0000","last_clean":"2022-07-05T11:46:09.027228+0000","last_became_active":"2022-07-05T11:46:09.013674+0000","last_became_peered":"2022-07-05T11:46:09.013674+0000","last_unstale":"2022-07-05T11:46:09.027228+0000","last_undegraded":"2022-07-05T11:46:09.027228+0000","last_fullsized":"2022-07-05T11:46:09.027228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974896+0000","last_change":"2022-07-05T11:46:04.204890+0000","last_active":"2022-07-05T11:46:08.974896+0000","last_peered":"2022-07-05T11:46:08.974896+0000","last_clean":"2022-07-05T11:46:08.974896+0000","last_became_active":"2022-07-05T11:46:04.204615+0000","last_became_peered":"2022-07-05T11:46:04.204615+0000","last_unstale":"2022-07-05T11:46:08.974896+0000","last_undegraded":"2022-07-05T11:46:08.974896+0000","last_fullsized":"2022-07-05T11:46:08.974896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974109+0000","last_change":"2022-07-05T11:46:04.592359+0000","last_active":"2022-07-05T11:46:08.974109+0000","last_peered":"2022-07-05T11:46:08.974109+0000","last_clean":"2022-07-05T11:46:08.974109+0000","last_became_active":"2022-07-05T11:46:04.592112+0000","last_became_peered":"2022-07-05T11:46:04.592112+0000","last_unstale":"2022-07-05T11:46:08.974109+0000","last_undegraded":"2022-07-05T11:46:08.974109+0000","last_fullsized":"2022-07-05T11:46:08.974109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027403+0000","last_change":"2022-07-05T11:46:09.016814+0000","last_active":"2022-07-05T11:46:09.027403+0000","last_peered":"2022-07-05T11:46:09.027403+0000","last_clean":"2022-07-05T11:46:09.027403+0000","last_became_active":"2022-07-05T11:46:09.016282+0000","last_became_peered":"2022-07-05T11:46:09.016282+0000","last_unstale":"2022-07-05T11:46:09.027403+0000","last_undegraded":"2022-07-05T11:46:09.027403+0000","last_fullsized":"2022-07-05T11:46:09.027403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.353211+0000","last_change":"2022-07-05T11:46:04.199484+0000","last_active":"2022-07-05T11:46:20.353211+0000","last_peered":"2022-07-05T11:46:20.353211+0000","last_clean":"2022-07-05T11:46:20.353211+0000","last_became_active":"2022-07-05T11:46:04.199190+0000","last_became_peered":"2022-07-05T11:46:04.199190+0000","last_unstale":"2022-07-05T11:46:20.353211+0000","last_undegraded":"2022-07-05T11:46:20.353211+0000","last_fullsized":"2022-07-05T11:46:20.353211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012845+0000","last_change":"2022-07-05T11:46:04.594175+0000","last_active":"2022-07-05T11:46:09.012845+0000","last_peered":"2022-07-05T11:46:09.012845+0000","last_clean":"2022-07-05T11:46:09.012845+0000","last_became_active":"2022-07-05T11:46:04.593700+0000","last_became_peered":"2022-07-05T11:46:04.593700+0000","last_unstale":"2022-07-05T11:46:09.012845+0000","last_undegraded":"2022-07-05T11:46:09.012845+0000","last_fullsized":"2022-07-05T11:46:09.012845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013139+0000","last_change":"2022-07-05T11:46:08.614509+0000","last_active":"2022-07-05T11:46:09.013139+0000","last_peered":"2022-07-05T11:46:09.013139+0000","last_clean":"2022-07-05T11:46:09.013139+0000","last_became_active":"2022-07-05T11:46:08.613935+0000","last_became_peered":"2022-07-05T11:46:08.613935+0000","last_unstale":"2022-07-05T11:46:09.013139+0000","last_undegraded":"2022-07-05T11:46:09.013139+0000","last_fullsized":"2022-07-05T11:46:09.013139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028943+0000","last_change":"2022-07-05T11:46:04.210344+0000","last_active":"2022-07-05T11:46:09.028943+0000","last_peered":"2022-07-05T11:46:09.028943+0000","last_clean":"2022-07-05T11:46:09.028943+0000","last_became_active":"2022-07-05T11:46:04.210054+0000","last_became_peered":"2022-07-05T11:46:04.210054+0000","last_unstale":"2022-07-05T11:46:09.028943+0000","last_undegraded":"2022-07-05T11:46:09.028943+0000","last_fullsized":"2022-07-05T11:46:09.028943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013018+0000","last_change":"2022-07-05T11:46:04.601851+0000","last_active":"2022-07-05T11:46:09.013018+0000","last_peered":"2022-07-05T11:46:09.013018+0000","last_clean":"2022-07-05T11:46:09.013018+0000","last_became_active":"2022-07-05T11:46:04.601528+0000","last_became_peered":"2022-07-05T11:46:04.601528+0000","last_unstale":"2022-07-05T11:46:09.013018+0000","last_undegraded":"2022-07-05T11:46:09.013018+0000","last_fullsized":"2022-07-05T11:46:09.013018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029283+0000","last_change":"2022-07-05T11:46:08.613389+0000","last_active":"2022-07-05T11:46:09.029283+0000","last_peered":"2022-07-05T11:46:09.029283+0000","last_clean":"2022-07-05T11:46:09.029283+0000","last_became_active":"2022-07-05T11:46:08.612988+0000","last_became_peered":"2022-07-05T11:46:08.612988+0000","last_unstale":"2022-07-05T11:46:09.029283+0000","last_undegraded":"2022-07-05T11:46:09.029283+0000","last_fullsized":"2022-07-05T11:46:09.029283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.407358+0000","last_change":"2022-07-05T11:46:04.203173+0000","last_active":"2022-07-05T11:46:10.407358+0000","last_peered":"2022-07-05T11:46:10.407358+0000","last_clean":"2022-07-05T11:46:10.407358+0000","last_became_active":"2022-07-05T11:46:04.202879+0000","last_became_peered":"2022-07-05T11:46:04.202879+0000","last_unstale":"2022-07-05T11:46:10.407358+0000","last_undegraded":"2022-07-05T11:46:10.407358+0000","last_fullsized":"2022-07-05T11:46:10.407358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.013005+0000","last_change":"2022-07-05T11:46:04.593203+0000","last_active":"2022-07-05T11:46:09.013005+0000","last_peered":"2022-07-05T11:46:09.013005+0000","last_clean":"2022-07-05T11:46:09.013005+0000","last_became_active":"2022-07-05T11:46:04.592953+0000","last_became_peered":"2022-07-05T11:46:04.592953+0000","last_unstale":"2022-07-05T11:46:09.013005+0000","last_undegraded":"2022-07-05T11:46:09.013005+0000","last_fullsized":"2022-07-05T11:46:09.013005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975419+0000","last_change":"2022-07-05T11:46:08.617348+0000","last_active":"2022-07-05T11:46:08.975419+0000","last_peered":"2022-07-05T11:46:08.975419+0000","last_clean":"2022-07-05T11:46:08.975419+0000","last_became_active":"2022-07-05T11:46:08.616964+0000","last_became_peered":"2022-07-05T11:46:08.616964+0000","last_unstale":"2022-07-05T11:46:08.975419+0000","last_undegraded":"2022-07-05T11:46:08.975419+0000","last_fullsized":"2022-07-05T11:46:08.975419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028733+0000","last_change":"2022-07-05T11:46:04.213520+0000","last_active":"2022-07-05T11:46:09.028733+0000","last_peered":"2022-07-05T11:46:09.028733+0000","last_clean":"2022-07-05T11:46:09.028733+0000","last_became_active":"2022-07-05T11:46:04.213132+0000","last_became_peered":"2022-07-05T11:46:04.213132+0000","last_unstale":"2022-07-05T11:46:09.028733+0000","last_undegraded":"2022-07-05T11:46:09.028733+0000","last_fullsized":"2022-07-05T11:46:09.028733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027579+0000","last_change":"2022-07-05T11:46:04.589449+0000","last_active":"2022-07-05T11:46:09.027579+0000","last_peered":"2022-07-05T11:46:09.027579+0000","last_clean":"2022-07-05T11:46:09.027579+0000","last_became_active":"2022-07-05T11:46:04.589174+0000","last_became_peered":"2022-07-05T11:46:04.589174+0000","last_unstale":"2022-07-05T11:46:09.027579+0000","last_undegraded":"2022-07-05T11:46:09.027579+0000","last_fullsized":"2022-07-05T11:46:09.027579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027455+0000","last_change":"2022-07-05T11:46:08.617763+0000","last_active":"2022-07-05T11:46:09.027455+0000","last_peered":"2022-07-05T11:46:09.027455+0000","last_clean":"2022-07-05T11:46:09.027455+0000","last_became_active":"2022-07-05T11:46:08.617423+0000","last_became_peered":"2022-07-05T11:46:08.617423+0000","last_unstale":"2022-07-05T11:46:09.027455+0000","last_undegraded":"2022-07-05T11:46:09.027455+0000","last_fullsized":"2022-07-05T11:46:09.027455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030147+0000","last_change":"2022-07-05T11:46:04.211055+0000","last_active":"2022-07-05T11:46:09.030147+0000","last_peered":"2022-07-05T11:46:09.030147+0000","last_clean":"2022-07-05T11:46:09.030147+0000","last_became_active":"2022-07-05T11:46:04.210609+0000","last_became_peered":"2022-07-05T11:46:04.210609+0000","last_unstale":"2022-07-05T11:46:09.030147+0000","last_undegraded":"2022-07-05T11:46:09.030147+0000","last_fullsized":"2022-07-05T11:46:09.030147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028195+0000","last_change":"2022-07-05T11:46:04.583067+0000","last_active":"2022-07-05T11:46:09.028195+0000","last_peered":"2022-07-05T11:46:09.028195+0000","last_clean":"2022-07-05T11:46:09.028195+0000","last_became_active":"2022-07-05T11:46:04.582776+0000","last_became_peered":"2022-07-05T11:46:04.582776+0000","last_unstale":"2022-07-05T11:46:09.028195+0000","last_undegraded":"2022-07-05T11:46:09.028195+0000","last_fullsized":"2022-07-05T11:46:09.028195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975477+0000","last_change":"2022-07-05T11:46:08.619668+0000","last_active":"2022-07-05T11:46:08.975477+0000","last_peered":"2022-07-05T11:46:08.975477+0000","last_clean":"2022-07-05T11:46:08.975477+0000","last_became_active":"2022-07-05T11:46:08.619010+0000","last_became_peered":"2022-07-05T11:46:08.619010+0000","last_unstale":"2022-07-05T11:46:08.975477+0000","last_undegraded":"2022-07-05T11:46:08.975477+0000","last_fullsized":"2022-07-05T11:46:08.975477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975957+0000","last_change":"2022-07-05T11:46:04.202962+0000","last_active":"2022-07-05T11:46:08.975957+0000","last_peered":"2022-07-05T11:46:08.975957+0000","last_clean":"2022-07-05T11:46:08.975957+0000","last_became_active":"2022-07-05T11:46:04.202639+0000","last_became_peered":"2022-07-05T11:46:04.202639+0000","last_unstale":"2022-07-05T11:46:08.975957+0000","last_undegraded":"2022-07-05T11:46:08.975957+0000","last_fullsized":"2022-07-05T11:46:08.975957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975054+0000","last_change":"2022-07-05T11:46:04.595796+0000","last_active":"2022-07-05T11:46:08.975054+0000","last_peered":"2022-07-05T11:46:08.975054+0000","last_clean":"2022-07-05T11:46:08.975054+0000","last_became_active":"2022-07-05T11:46:04.595457+0000","last_became_peered":"2022-07-05T11:46:04.595457+0000","last_unstale":"2022-07-05T11:46:08.975054+0000","last_undegraded":"2022-07-05T11:46:08.975054+0000","last_fullsized":"2022-07-05T11:46:08.975054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027470+0000","last_change":"2022-07-05T11:46:08.617306+0000","last_active":"2022-07-05T11:46:09.027470+0000","last_peered":"2022-07-05T11:46:09.027470+0000","last_clean":"2022-07-05T11:46:09.027470+0000","last_became_active":"2022-07-05T11:46:08.616927+0000","last_became_peered":"2022-07-05T11:46:08.616927+0000","last_unstale":"2022-07-05T11:46:09.027470+0000","last_undegraded":"2022-07-05T11:46:09.027470+0000","last_fullsized":"2022-07-05T11:46:09.027470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.171485+0000","last_change":"2022-07-05T11:46:04.205780+0000","last_active":"2022-07-05T11:46:10.171485+0000","last_peered":"2022-07-05T11:46:10.171485+0000","last_clean":"2022-07-05T11:46:10.171485+0000","last_became_active":"2022-07-05T11:46:04.205486+0000","last_became_peered":"2022-07-05T11:46:04.205486+0000","last_unstale":"2022-07-05T11:46:10.171485+0000","last_undegraded":"2022-07-05T11:46:10.171485+0000","last_fullsized":"2022-07-05T11:46:10.171485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974611+0000","last_change":"2022-07-05T11:46:04.606819+0000","last_active":"2022-07-05T11:46:08.974611+0000","last_peered":"2022-07-05T11:46:08.974611+0000","last_clean":"2022-07-05T11:46:08.974611+0000","last_became_active":"2022-07-05T11:46:04.606484+0000","last_became_peered":"2022-07-05T11:46:04.606484+0000","last_unstale":"2022-07-05T11:46:08.974611+0000","last_undegraded":"2022-07-05T11:46:08.974611+0000","last_fullsized":"2022-07-05T11:46:08.974611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028555+0000","last_change":"2022-07-05T11:46:08.617224+0000","last_active":"2022-07-05T11:46:09.028555+0000","last_peered":"2022-07-05T11:46:09.028555+0000","last_clean":"2022-07-05T11:46:09.028555+0000","last_became_active":"2022-07-05T11:46:08.616821+0000","last_became_peered":"2022-07-05T11:46:08.616821+0000","last_unstale":"2022-07-05T11:46:09.028555+0000","last_undegraded":"2022-07-05T11:46:09.028555+0000","last_fullsized":"2022-07-05T11:46:09.028555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:10.170891+0000","last_change":"2022-07-05T11:46:04.204034+0000","last_active":"2022-07-05T11:46:10.170891+0000","last_peered":"2022-07-05T11:46:10.170891+0000","last_clean":"2022-07-05T11:46:10.170891+0000","last_became_active":"2022-07-05T11:46:04.203694+0000","last_became_peered":"2022-07-05T11:46:04.203694+0000","last_unstale":"2022-07-05T11:46:10.170891+0000","last_undegraded":"2022-07-05T11:46:10.170891+0000","last_fullsized":"2022-07-05T11:46:10.170891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974125+0000","last_change":"2022-07-05T11:46:04.593441+0000","last_active":"2022-07-05T11:46:08.974125+0000","last_peered":"2022-07-05T11:46:08.974125+0000","last_clean":"2022-07-05T11:46:08.974125+0000","last_became_active":"2022-07-05T11:46:04.593175+0000","last_became_peered":"2022-07-05T11:46:04.593175+0000","last_unstale":"2022-07-05T11:46:08.974125+0000","last_undegraded":"2022-07-05T11:46:08.974125+0000","last_fullsized":"2022-07-05T11:46:08.974125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028366+0000","last_change":"2022-07-05T11:46:09.016544+0000","last_active":"2022-07-05T11:46:09.028366+0000","last_peered":"2022-07-05T11:46:09.028366+0000","last_clean":"2022-07-05T11:46:09.028366+0000","last_became_active":"2022-07-05T11:46:09.016045+0000","last_became_peered":"2022-07-05T11:46:09.016045+0000","last_unstale":"2022-07-05T11:46:09.028366+0000","last_undegraded":"2022-07-05T11:46:09.028366+0000","last_fullsized":"2022-07-05T11:46:09.028366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'3","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.388311+0000","last_change":"2022-07-05T11:46:04.207209+0000","last_active":"2022-07-05T11:46:40.388311+0000","last_peered":"2022-07-05T11:46:40.388311+0000","last_clean":"2022-07-05T11:46:40.388311+0000","last_became_active":"2022-07-05T11:46:04.206333+0000","last_became_peered":"2022-07-05T11:46:04.206333+0000","last_unstale":"2022-07-05T11:46:40.388311+0000","last_undegraded":"2022-07-05T11:46:40.388311+0000","last_fullsized":"2022-07-05T11:46:40.388311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029985+0000","last_change":"2022-07-05T11:46:04.591635+0000","last_active":"2022-07-05T11:46:09.029985+0000","last_peered":"2022-07-05T11:46:09.029985+0000","last_clean":"2022-07-05T11:46:09.029985+0000","last_became_active":"2022-07-05T11:46:04.591370+0000","last_became_peered":"2022-07-05T11:46:04.591370+0000","last_unstale":"2022-07-05T11:46:09.029985+0000","last_undegraded":"2022-07-05T11:46:09.029985+0000","last_fullsized":"2022-07-05T11:46:09.029985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029798+0000","last_change":"2022-07-05T11:46:08.617287+0000","last_active":"2022-07-05T11:46:09.029798+0000","last_peered":"2022-07-05T11:46:09.029798+0000","last_clean":"2022-07-05T11:46:09.029798+0000","last_became_active":"2022-07-05T11:46:08.616929+0000","last_became_peered":"2022-07-05T11:46:08.616929+0000","last_unstale":"2022-07-05T11:46:09.029798+0000","last_undegraded":"2022-07-05T11:46:09.029798+0000","last_fullsized":"2022-07-05T11:46:09.029798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352160+0000","last_change":"2022-07-05T11:46:04.207520+0000","last_active":"2022-07-05T11:46:20.352160+0000","last_peered":"2022-07-05T11:46:20.352160+0000","last_clean":"2022-07-05T11:46:20.352160+0000","last_became_active":"2022-07-05T11:46:04.207167+0000","last_became_peered":"2022-07-05T11:46:04.207167+0000","last_unstale":"2022-07-05T11:46:20.352160+0000","last_undegraded":"2022-07-05T11:46:20.352160+0000","last_fullsized":"2022-07-05T11:46:20.352160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975400+0000","last_change":"2022-07-05T11:46:04.606473+0000","last_active":"2022-07-05T11:46:08.975400+0000","last_peered":"2022-07-05T11:46:08.975400+0000","last_clean":"2022-07-05T11:46:08.975400+0000","last_became_active":"2022-07-05T11:46:04.606183+0000","last_became_peered":"2022-07-05T11:46:04.606183+0000","last_unstale":"2022-07-05T11:46:08.975400+0000","last_undegraded":"2022-07-05T11:46:08.975400+0000","last_fullsized":"2022-07-05T11:46:08.975400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029169+0000","last_change":"2022-07-05T11:46:08.615322+0000","last_active":"2022-07-05T11:46:09.029169+0000","last_peered":"2022-07-05T11:46:09.029169+0000","last_clean":"2022-07-05T11:46:09.029169+0000","last_became_active":"2022-07-05T11:46:08.614916+0000","last_became_peered":"2022-07-05T11:46:08.614916+0000","last_unstale":"2022-07-05T11:46:09.029169+0000","last_undegraded":"2022-07-05T11:46:09.029169+0000","last_fullsized":"2022-07-05T11:46:09.029169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352984+0000","last_change":"2022-07-05T11:46:04.207417+0000","last_active":"2022-07-05T11:46:20.352984+0000","last_peered":"2022-07-05T11:46:20.352984+0000","last_clean":"2022-07-05T11:46:20.352984+0000","last_became_active":"2022-07-05T11:46:04.207078+0000","last_became_peered":"2022-07-05T11:46:04.207078+0000","last_unstale":"2022-07-05T11:46:20.352984+0000","last_undegraded":"2022-07-05T11:46:20.352984+0000","last_fullsized":"2022-07-05T11:46:20.352984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976049+0000","last_change":"2022-07-05T11:46:04.597152+0000","last_active":"2022-07-05T11:46:08.976049+0000","last_peered":"2022-07-05T11:46:08.976049+0000","last_clean":"2022-07-05T11:46:08.976049+0000","last_became_active":"2022-07-05T11:46:04.596847+0000","last_became_peered":"2022-07-05T11:46:04.596847+0000","last_unstale":"2022-07-05T11:46:08.976049+0000","last_undegraded":"2022-07-05T11:46:08.976049+0000","last_fullsized":"2022-07-05T11:46:08.976049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029455+0000","last_change":"2022-07-05T11:46:08.615281+0000","last_active":"2022-07-05T11:46:09.029455+0000","last_peered":"2022-07-05T11:46:09.029455+0000","last_clean":"2022-07-05T11:46:09.029455+0000","last_became_active":"2022-07-05T11:46:08.614859+0000","last_became_peered":"2022-07-05T11:46:08.614859+0000","last_unstale":"2022-07-05T11:46:09.029455+0000","last_undegraded":"2022-07-05T11:46:09.029455+0000","last_fullsized":"2022-07-05T11:46:09.029455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'2","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.386826+0000","last_change":"2022-07-05T11:46:04.209548+0000","last_active":"2022-07-05T11:46:40.386826+0000","last_peered":"2022-07-05T11:46:40.386826+0000","last_clean":"2022-07-05T11:46:40.386826+0000","last_became_active":"2022-07-05T11:46:04.209278+0000","last_became_peered":"2022-07-05T11:46:04.209278+0000","last_unstale":"2022-07-05T11:46:40.386826+0000","last_undegraded":"2022-07-05T11:46:40.386826+0000","last_fullsized":"2022-07-05T11:46:40.386826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.012545+0000","last_change":"2022-07-05T11:46:04.601803+0000","last_active":"2022-07-05T11:46:09.012545+0000","last_peered":"2022-07-05T11:46:09.012545+0000","last_clean":"2022-07-05T11:46:09.012545+0000","last_became_active":"2022-07-05T11:46:04.601475+0000","last_became_peered":"2022-07-05T11:46:04.601475+0000","last_unstale":"2022-07-05T11:46:09.012545+0000","last_undegraded":"2022-07-05T11:46:09.012545+0000","last_fullsized":"2022-07-05T11:46:09.012545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028752+0000","last_change":"2022-07-05T11:46:08.617939+0000","last_active":"2022-07-05T11:46:09.028752+0000","last_peered":"2022-07-05T11:46:09.028752+0000","last_clean":"2022-07-05T11:46:09.028752+0000","last_became_active":"2022-07-05T11:46:08.617538+0000","last_became_peered":"2022-07-05T11:46:08.617538+0000","last_unstale":"2022-07-05T11:46:09.028752+0000","last_undegraded":"2022-07-05T11:46:09.028752+0000","last_fullsized":"2022-07-05T11:46:09.028752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:20.352085+0000","last_change":"2022-07-05T11:46:04.199561+0000","last_active":"2022-07-05T11:46:20.352085+0000","last_peered":"2022-07-05T11:46:20.352085+0000","last_clean":"2022-07-05T11:46:20.352085+0000","last_became_active":"2022-07-05T11:46:04.199232+0000","last_became_peered":"2022-07-05T11:46:04.199232+0000","last_unstale":"2022-07-05T11:46:20.352085+0000","last_undegraded":"2022-07-05T11:46:20.352085+0000","last_fullsized":"2022-07-05T11:46:20.352085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973881+0000","last_change":"2022-07-05T11:46:04.601813+0000","last_active":"2022-07-05T11:46:08.973881+0000","last_peered":"2022-07-05T11:46:08.973881+0000","last_clean":"2022-07-05T11:46:08.973881+0000","last_became_active":"2022-07-05T11:46:04.601595+0000","last_became_peered":"2022-07-05T11:46:04.601595+0000","last_unstale":"2022-07-05T11:46:08.973881+0000","last_undegraded":"2022-07-05T11:46:08.973881+0000","last_fullsized":"2022-07-05T11:46:08.973881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.975282+0000","last_change":"2022-07-05T11:46:08.621246+0000","last_active":"2022-07-05T11:46:08.975282+0000","last_peered":"2022-07-05T11:46:08.975282+0000","last_clean":"2022-07-05T11:46:08.975282+0000","last_became_active":"2022-07-05T11:46:08.620839+0000","last_became_peered":"2022-07-05T11:46:08.620839+0000","last_unstale":"2022-07-05T11:46:08.975282+0000","last_undegraded":"2022-07-05T11:46:08.975282+0000","last_fullsized":"2022-07-05T11:46:08.975282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029752+0000","last_change":"2022-07-05T11:46:04.204062+0000","last_active":"2022-07-05T11:46:09.029752+0000","last_peered":"2022-07-05T11:46:09.029752+0000","last_clean":"2022-07-05T11:46:09.029752+0000","last_became_active":"2022-07-05T11:46:04.203763+0000","last_became_peered":"2022-07-05T11:46:04.203763+0000","last_unstale":"2022-07-05T11:46:09.029752+0000","last_undegraded":"2022-07-05T11:46:09.029752+0000","last_fullsized":"2022-07-05T11:46:09.029752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029094+0000","last_change":"2022-07-05T11:46:04.595571+0000","last_active":"2022-07-05T11:46:09.029094+0000","last_peered":"2022-07-05T11:46:09.029094+0000","last_clean":"2022-07-05T11:46:09.029094+0000","last_became_active":"2022-07-05T11:46:04.595288+0000","last_became_peered":"2022-07-05T11:46:04.595288+0000","last_unstale":"2022-07-05T11:46:09.029094+0000","last_undegraded":"2022-07-05T11:46:09.029094+0000","last_fullsized":"2022-07-05T11:46:09.029094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.027709+0000","last_change":"2022-07-05T11:46:08.617183+0000","last_active":"2022-07-05T11:46:09.027709+0000","last_peered":"2022-07-05T11:46:09.027709+0000","last_clean":"2022-07-05T11:46:09.027709+0000","last_became_active":"2022-07-05T11:46:08.616762+0000","last_became_peered":"2022-07-05T11:46:08.616762+0000","last_unstale":"2022-07-05T11:46:09.027709+0000","last_undegraded":"2022-07-05T11:46:09.027709+0000","last_fullsized":"2022-07-05T11:46:09.027709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-07-05T11:46:40.526543+0000","last_change":"2022-07-05T11:46:04.206938+0000","last_active":"2022-07-05T11:46:40.526543+0000","last_peered":"2022-07-05T11:46:40.526543+0000","last_clean":"2022-07-05T11:46:40.526543+0000","last_became_active":"2022-07-05T11:46:04.206676+0000","last_became_peered":"2022-07-05T11:46:04.206676+0000","last_unstale":"2022-07-05T11:46:40.526543+0000","last_undegraded":"2022-07-05T11:46:40.526543+0000","last_fullsized":"2022-07-05T11:46:40.526543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973848+0000","last_change":"2022-07-05T11:46:04.589404+0000","last_active":"2022-07-05T11:46:08.973848+0000","last_peered":"2022-07-05T11:46:08.973848+0000","last_clean":"2022-07-05T11:46:08.973848+0000","last_became_active":"2022-07-05T11:46:04.589158+0000","last_became_peered":"2022-07-05T11:46:04.589158+0000","last_unstale":"2022-07-05T11:46:08.973848+0000","last_undegraded":"2022-07-05T11:46:08.973848+0000","last_fullsized":"2022-07-05T11:46:08.973848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028490+0000","last_change":"2022-07-05T11:46:08.619220+0000","last_active":"2022-07-05T11:46:09.028490+0000","last_peered":"2022-07-05T11:46:09.028490+0000","last_clean":"2022-07-05T11:46:09.028490+0000","last_became_active":"2022-07-05T11:46:08.618815+0000","last_became_peered":"2022-07-05T11:46:08.618815+0000","last_unstale":"2022-07-05T11:46:09.028490+0000","last_undegraded":"2022-07-05T11:46:09.028490+0000","last_fullsized":"2022-07-05T11:46:09.028490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.974161+0000","last_change":"2022-07-05T11:46:08.617688+0000","last_active":"2022-07-05T11:46:08.974161+0000","last_peered":"2022-07-05T11:46:08.974161+0000","last_clean":"2022-07-05T11:46:08.974161+0000","last_became_active":"2022-07-05T11:46:08.617331+0000","last_became_peered":"2022-07-05T11:46:08.617331+0000","last_unstale":"2022-07-05T11:46:08.974161+0000","last_undegraded":"2022-07-05T11:46:08.974161+0000","last_fullsized":"2022-07-05T11:46:08.974161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.029067+0000","last_change":"2022-07-05T11:46:04.199672+0000","last_active":"2022-07-05T11:46:09.029067+0000","last_peered":"2022-07-05T11:46:09.029067+0000","last_clean":"2022-07-05T11:46:09.029067+0000","last_became_active":"2022-07-05T11:46:04.199366+0000","last_became_peered":"2022-07-05T11:46:04.199366+0000","last_unstale":"2022-07-05T11:46:09.029067+0000","last_undegraded":"2022-07-05T11:46:09.029067+0000","last_fullsized":"2022-07-05T11:46:09.029067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.976202+0000","last_change":"2022-07-05T11:46:04.598274+0000","last_active":"2022-07-05T11:46:08.976202+0000","last_peered":"2022-07-05T11:46:08.976202+0000","last_clean":"2022-07-05T11:46:08.976202+0000","last_became_active":"2022-07-05T11:46:04.597995+0000","last_became_peered":"2022-07-05T11:46:04.597995+0000","last_unstale":"2022-07-05T11:46:08.976202+0000","last_undegraded":"2022-07-05T11:46:08.976202+0000","last_fullsized":"2022-07-05T11:46:08.976202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.030310+0000","last_change":"2022-07-05T11:46:08.612501+0000","last_active":"2022-07-05T11:46:09.030310+0000","last_peered":"2022-07-05T11:46:09.030310+0000","last_clean":"2022-07-05T11:46:09.030310+0000","last_became_active":"2022-07-05T11:46:08.611956+0000","last_became_peered":"2022-07-05T11:46:08.611956+0000","last_unstale":"2022-07-05T11:46:09.030310+0000","last_undegraded":"2022-07-05T11:46:09.030310+0000","last_fullsized":"2022-07-05T11:46:09.030310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:08.973916+0000","last_change":"2022-07-05T11:46:04.212557+0000","last_active":"2022-07-05T11:46:08.973916+0000","last_peered":"2022-07-05T11:46:08.973916+0000","last_clean":"2022-07-05T11:46:08.973916+0000","last_became_active":"2022-07-05T11:46:04.212259+0000","last_became_peered":"2022-07-05T11:46:04.212259+0000","last_unstale":"2022-07-05T11:46:08.973916+0000","last_undegraded":"2022-07-05T11:46:08.973916+0000","last_fullsized":"2022-07-05T11:46:08.973916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028001+0000","last_change":"2022-07-05T11:46:04.593690+0000","last_active":"2022-07-05T11:46:09.028001+0000","last_peered":"2022-07-05T11:46:09.028001+0000","last_clean":"2022-07-05T11:46:09.028001+0000","last_became_active":"2022-07-05T11:46:04.593427+0000","last_became_peered":"2022-07-05T11:46:04.593427+0000","last_unstale":"2022-07-05T11:46:09.028001+0000","last_undegraded":"2022-07-05T11:46:09.028001+0000","last_fullsized":"2022-07-05T11:46:09.028001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028319+0000","last_change":"2022-07-05T11:46:04.204419+0000","last_active":"2022-07-05T11:46:09.028319+0000","last_peered":"2022-07-05T11:46:09.028319+0000","last_clean":"2022-07-05T11:46:09.028319+0000","last_became_active":"2022-07-05T11:46:04.204078+0000","last_became_peered":"2022-07-05T11:46:04.204078+0000","last_unstale":"2022-07-05T11:46:09.028319+0000","last_undegraded":"2022-07-05T11:46:09.028319+0000","last_fullsized":"2022-07-05T11:46:09.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:03.180664+0000","last_clean_scrub_stamp":"2022-07-05T11:46:03.180664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.028300+0000","last_change":"2022-07-05T11:46:04.600858+0000","last_active":"2022-07-05T11:46:09.028300+0000","last_peered":"2022-07-05T11:46:09.028300+0000","last_clean":"2022-07-05T11:46:09.028300+0000","last_became_active":"2022-07-05T11:46:04.600564+0000","last_became_peered":"2022-07-05T11:46:04.600564+0000","last_unstale":"2022-07-05T11:46:09.028300+0000","last_undegraded":"2022-07-05T11:46:09.028300+0000","last_fullsized":"2022-07-05T11:46:09.028300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:04.184965+0000","last_clean_scrub_stamp":"2022-07-05T11:46:04.184965+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-07-05T11:46:09.017952+0000","last_change":"2022-07-05T11:46:09.017127+0000","last_active":"2022-07-05T11:46:09.017952+0000","last_peered":"2022-07-05T11:46:09.017952+0000","last_clean":"2022-07-05T11:46:09.017952+0000","last_became_active":"2022-07-05T11:46:09.016451+0000","last_became_peered":"2022-07-05T11:46:09.016451+0000","last_unstale":"2022-07-05T11:46:09.017952+0000","last_undegraded":"2022-07-05T11:46:09.017952+0000","last_fullsized":"2022-07-05T11:46:09.017952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-07-05T11:46:07.591195+0000","last_clean_scrub_stamp":"2022-07-05T11:46:07.591195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":7400,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":141,"num_read_kb":83,"num_write":130,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5348,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366492,"statfs":{"total":96636764160,"available":96631287808,"internally_reserved":0,"allocated":356352,"data_stored":165443,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":166661,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":9,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":8,"up_from":17,"seq":73014444044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5344,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366496,"statfs":{"total":96636764160,"available":96631291904,"internally_reserved":0,"allocated":352256,"data_stored":164957,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":163725,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":17,"seq":73014444044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":163557,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":1,"up_from":17,"seq":73014444043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366504,"statfs":{"total":96636764160,"available":96631300096,"internally_reserved":0,"allocated":344064,"data_stored":164777,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":0,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163647,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":163717,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444043,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":163627,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":168709,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5404,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366436,"statfs":{"total":96636764160,"available":96631230464,"internally_reserved":0,"allocated":348160,"data_stored":165107,"data_compressed":13955,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-07-05T11:46:45.619 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:45.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.758+0000 7f573d98f700 1 Processor -- start 2022-07-05T11:46:45.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.758+0000 7f573d98f700 1 -- start start 2022-07-05T11:46:45.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.759+0000 7f573d98f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57380c6a50 0x7f573817fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.759+0000 7f573d98f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380c3320 con 0x7f573817ba60 2022-07-05T11:46:45.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.759+0000 7f573d98f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380c2430 con 0x7f573817b680 2022-07-05T11:46:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.759+0000 7f573d98f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380c4610 con 0x7f57380c6a50 2022-07-05T11:46:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f573d18e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57380c6a50 0x7f573817fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f573d18e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57380c6a50 0x7f573817fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:34334/0 (socket says 172.21.15.90:34334) 2022-07-05T11:46:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f5737fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f573817ba60 0x7f5738083570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:60550/0 (socket says 172.21.15.90:60550) 2022-07-05T11:46:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f573d18e700 1 -- 172.21.15.90:0/3172365423 learned_addr learned my addr 172.21.15.90:0/3172365423 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f57377fe700 1 -- 172.21.15.90:0/3172365423 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64662476 0 0) 0x7f57380c2430 con 0x7f573817b680 2022-07-05T11:46:45.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f57377fe700 1 -- 172.21.15.90:0/3172365423 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57240033f0 con 0x7f573817b680 2022-07-05T11:46:45.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f57377fe700 1 -- 172.21.15.90:0/3172365423 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343542652 0 0) 0x7f57380c3320 con 0x7f573817ba60 2022-07-05T11:46:45.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f573d18e700 1 -- 172.21.15.90:0/3172365423 >> v1:172.21.15.149:6789/0 conn(0x7f573817b680 legacy=0x7f573817f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f573d18e700 1 -- 172.21.15.90:0/3172365423 >> v1:172.21.15.110:6789/0 conn(0x7f573817ba60 legacy=0x7f5738083570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f573d18e700 1 -- 172.21.15.90:0/3172365423 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380c2710 con 0x7f57380c6a50 2022-07-05T11:46:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f573d18e700 1 --2- 172.21.15.90:0/3172365423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 0x7f573817fe50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5730009f20 tx=0x7f5730009840).ready entity=mon.1 client_cookie=7769d6802d5d8561 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f57377fe700 1 -- 172.21.15.90:0/3172365423 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000e070 con 0x7f57380c6a50 2022-07-05T11:46:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f57377fe700 1 -- 172.21.15.90:0/3172365423 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573000b9d0 con 0x7f57380c6a50 2022-07-05T11:46:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.760+0000 7f57377fe700 1 -- 172.21.15.90:0/3172365423 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000bd50 con 0x7f57380c6a50 2022-07-05T11:46:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.761+0000 7f573d98f700 1 -- 172.21.15.90:0/3172365423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 msgr2=0x7f573817fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.761+0000 7f573d98f700 1 --2- 172.21.15.90:0/3172365423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 0x7f573817fe50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5730009f20 tx=0x7f5730009840).stop 2022-07-05T11:46:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.761+0000 7f573d98f700 1 -- 172.21.15.90:0/3172365423 shutdown_connections 2022-07-05T11:46:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.761+0000 7f573d98f700 1 --2- 172.21.15.90:0/3172365423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 0x7f573817fe50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.761+0000 7f573d98f700 1 -- 172.21.15.90:0/3172365423 >> 172.21.15.90:0/3172365423 conn(0x7f57380ee1a0 msgr2=0x7f57380ee5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.761+0000 7f573d98f700 1 -- 172.21.15.90:0/3172365423 shutdown_connections 2022-07-05T11:46:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.761+0000 7f573d98f700 1 -- 172.21.15.90:0/3172365423 wait complete. 2022-07-05T11:46:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.762+0000 7f573d98f700 1 Processor -- start 2022-07-05T11:46:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.762+0000 7f573d98f700 1 -- start start 2022-07-05T11:46:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f573d98f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 0x7f573818e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f573d98f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573817b680 0x7f57380e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f573d98f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573817ba60 0x7f5738180e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f573d98f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57381809f0 con 0x7f573817b680 2022-07-05T11:46:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f573d98f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573818e800 con 0x7f57380c6a50 2022-07-05T11:46:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f573d98f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57380e5dc0 con 0x7f573817ba60 2022-07-05T11:46:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f5737fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573817b680 0x7f57380e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f5737fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573817b680 0x7f57380e58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58018/0 (socket says 172.21.15.90:58018) 2022-07-05T11:46:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.763+0000 7f5737fff700 1 -- 172.21.15.90:0/2265782571 learned_addr learned my addr 172.21.15.90:0/2265782571 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f573c98d700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 0x7f573818e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f573d18e700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573817ba60 0x7f5738180e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5737fff700 1 -- 172.21.15.90:0/2265782571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573817ba60 msgr2=0x7f5738180e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5737fff700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573817ba60 0x7f5738180e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5737fff700 1 -- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 msgr2=0x7f573818e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5737fff700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 0x7f573818e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5737fff700 1 -- 172.21.15.90:0/2265782571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009ae0 con 0x7f573817b680 2022-07-05T11:46:45.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f573d18e700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573817ba60 0x7f5738180e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5737fff700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573817b680 0x7f57380e58d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f572c00c4c0 tx=0x7f572c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5734ff9700 1 -- 172.21.15.90:0/2265782571 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c0072e0 con 0x7f573817b680 2022-07-05T11:46:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5734ff9700 1 -- 172.21.15.90:0/2265782571 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c007460 con 0x7f573817b680 2022-07-05T11:46:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f5734ff9700 1 -- 172.21.15.90:0/2265782571 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c005930 con 0x7f573817b680 2022-07-05T11:46:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573818ea50 con 0x7f573817b680 2022-07-05T11:46:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.764+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573818f010 con 0x7f573817b680 2022-07-05T11:46:45.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.765+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573806be40 con 0x7f573817b680 2022-07-05T11:46:45.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.766+0000 7f5734ff9700 1 -- 172.21.15.90:0/2265782571 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f572c010070 con 0x7f573817b680 2022-07-05T11:46:45.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.767+0000 7f5734ff9700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571808ba40 0x7f571808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:45.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.767+0000 7f5734ff9700 1 -- 172.21.15.90:0/2265782571 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f572c0afef0 con 0x7f573817b680 2022-07-05T11:46:45.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.767+0000 7f573c98d700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571808ba40 0x7f571808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:45.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.767+0000 7f573c98d700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571808ba40 0x7f571808df00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f5728001010 tx=0x7f5728009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:45.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.771+0000 7f5734ff9700 1 -- 172.21.15.90:0/2265782571 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f572c080b30 con 0x7f573817b680 2022-07-05T11:46:45.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.932+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57380ec8c0 con 0x7f573817b680 2022-07-05T11:46:45.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.933+0000 7f5734ff9700 1 -- 172.21.15.90:0/2265782571 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f572c084150 con 0x7f573817b680 2022-07-05T11:46:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:45.935 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:45.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571808ba40 msgr2=0x7f571808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571808ba40 0x7f571808df00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f5728001010 tx=0x7f5728009040).stop 2022-07-05T11:46:45.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573817b680 msgr2=0x7f57380e58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:45.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573817b680 0x7f57380e58d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f572c00c4c0 tx=0x7f572c007db0).stop 2022-07-05T11:46:45.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 shutdown_connections 2022-07-05T11:46:45.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f571808ba40 0x7f571808df00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573817ba60 0x7f5738180e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57380c6a50 0x7f573818e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 --2- 172.21.15.90:0/2265782571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573817b680 0x7f57380e58d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:45.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 >> 172.21.15.90:0/2265782571 conn(0x7f57380ee1a0 msgr2=0x7f57380ee580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:45.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 shutdown_connections 2022-07-05T11:46:45.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:45.935+0000 7f573d98f700 1 -- 172.21.15.90:0/2265782571 wait complete. 2022-07-05T11:46:45.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-07-05T11:45:56.171931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-07-05T11:45:58.679519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-07-05T11:46:03.055092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-07-05T11:46:03.515295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-07-05T11:46:06.613134+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-07-05T11:46:45.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-07-05T11:46:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.064+0000 7f660b826700 1 Processor -- start 2022-07-05T11:46:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.064+0000 7f660b826700 1 -- start start 2022-07-05T11:46:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.065+0000 7f660b826700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6604182a30 0x7f66040eed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.065+0000 7f660b826700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66040ee170 con 0x7f660417e750 2022-07-05T11:46:46.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.065+0000 7f660b826700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660417c3f0 con 0x7f660417bda0 2022-07-05T11:46:46.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.065+0000 7f660b826700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66040ed280 con 0x7f6604182a30 2022-07-05T11:46:46.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f66095c2700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f660417bda0 0x7f66040ee600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:47206/0 (socket says 172.21.15.90:47206) 2022-07-05T11:46:46.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f66095c2700 1 -- 172.21.15.90:0/944160476 learned_addr learned my addr 172.21.15.90:0/944160476 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:46.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6608dc1700 1 --2- 172.21.15.90:0/944160476 >> v2:172.21.15.110:3300/0 conn(0x7f6604182a30 0x7f66040eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6603fff700 1 -- 172.21.15.90:0/944160476 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671124432 0 0) 0x7f660417c3f0 con 0x7f660417bda0 2022-07-05T11:46:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6603fff700 1 -- 172.21.15.90:0/944160476 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f00033f0 con 0x7f660417bda0 2022-07-05T11:46:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6608dc1700 1 -- 172.21.15.90:0/944160476 >> v1:172.21.15.149:6789/0 conn(0x7f660417bda0 legacy=0x7f66040ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6603fff700 1 -- 172.21.15.90:0/944160476 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542092565 0 0) 0x7f66040ee170 con 0x7f660417e750 2022-07-05T11:46:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6608dc1700 1 -- 172.21.15.90:0/944160476 >> v1:172.21.15.110:6789/0 conn(0x7f660417e750 legacy=0x7f660417ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6608dc1700 1 -- 172.21.15.90:0/944160476 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040ed560 con 0x7f6604182a30 2022-07-05T11:46:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6608dc1700 1 --2- 172.21.15.90:0/944160476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604182a30 0x7f66040eed10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f65f8009760 tx=0x7f65f8009060).ready entity=mon.1 client_cookie=bbd4c37aab8b406a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6603fff700 1 -- 172.21.15.90:0/944160476 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800f510 con 0x7f6604182a30 2022-07-05T11:46:46.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6603fff700 1 -- 172.21.15.90:0/944160476 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f800f670 con 0x7f6604182a30 2022-07-05T11:46:46.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.066+0000 7f6603fff700 1 -- 172.21.15.90:0/944160476 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800f9f0 con 0x7f6604182a30 2022-07-05T11:46:46.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.067+0000 7f660b826700 1 -- 172.21.15.90:0/944160476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604182a30 msgr2=0x7f66040eed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.067+0000 7f660b826700 1 --2- 172.21.15.90:0/944160476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604182a30 0x7f66040eed10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f65f8009760 tx=0x7f65f8009060).stop 2022-07-05T11:46:46.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.067+0000 7f660b826700 1 -- 172.21.15.90:0/944160476 shutdown_connections 2022-07-05T11:46:46.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.067+0000 7f660b826700 1 --2- 172.21.15.90:0/944160476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604182a30 0x7f66040eed10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.067+0000 7f660b826700 1 -- 172.21.15.90:0/944160476 >> 172.21.15.90:0/944160476 conn(0x7f66040f21d0 msgr2=0x7f6604069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:46.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.067+0000 7f660b826700 1 -- 172.21.15.90:0/944160476 shutdown_connections 2022-07-05T11:46:46.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.067+0000 7f660b826700 1 -- 172.21.15.90:0/944160476 wait complete. 2022-07-05T11:46:46.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.068+0000 7f660b826700 1 Processor -- start 2022-07-05T11:46:46.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.068+0000 7f660b826700 1 -- start start 2022-07-05T11:46:46.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.069+0000 7f660b826700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f660417bda0 0x7f6604171e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.069+0000 7f660b826700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660417e750 0x7f6604172350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.069+0000 7f660b826700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6604182a30 0x7f66040cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f660b826700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660418ea20 con 0x7f6604182a30 2022-07-05T11:46:46.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f660b826700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660418ec60 con 0x7f660417e750 2022-07-05T11:46:46.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f660b826700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660418ef40 con 0x7f660417bda0 2022-07-05T11:46:46.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6604182a30 0x7f66040cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6604182a30 0x7f66040cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58034/0 (socket says 172.21.15.90:58034) 2022-07-05T11:46:46.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 -- 172.21.15.90:0/1871205671 learned_addr learned my addr 172.21.15.90:0/1871205671 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:46.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f66095c2700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f660417bda0 0x7f6604171e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6608dc1700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660417e750 0x7f6604172350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 -- 172.21.15.90:0/1871205671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f660417bda0 msgr2=0x7f6604171e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f660417bda0 0x7f6604171e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 -- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660417e750 msgr2=0x7f6604172350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660417e750 0x7f6604172350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 -- 172.21.15.90:0/1871205671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80092a0 con 0x7f6604182a30 2022-07-05T11:46:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f6609dc3700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6604182a30 0x7f66040cbb70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f65fc00c440 tx=0x7f65fc007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f66017fa700 1 -- 172.21.15.90:0/1871205671 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc012400 con 0x7f6604182a30 2022-07-05T11:46:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f66017fa700 1 -- 172.21.15.90:0/1871205671 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc012580 con 0x7f6604182a30 2022-07-05T11:46:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f66017fa700 1 -- 172.21.15.90:0/1871205671 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc012940 con 0x7f6604182a30 2022-07-05T11:46:46.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660418f220 con 0x7f6604182a30 2022-07-05T11:46:46.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.070+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660418f7e0 con 0x7f6604182a30 2022-07-05T11:46:46.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.071+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660418fdd0 con 0x7f6604182a30 2022-07-05T11:46:46.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.072+0000 7f66017fa700 1 -- 172.21.15.90:0/1871205671 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f65fc019030 con 0x7f6604182a30 2022-07-05T11:46:46.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.072+0000 7f66017fa700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f65e408ba40 0x7f65e408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.073+0000 7f66017fa700 1 -- 172.21.15.90:0/1871205671 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f65fc0afba0 con 0x7f6604182a30 2022-07-05T11:46:46.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.073+0000 7f66095c2700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f65e408ba40 0x7f65e408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.073+0000 7f66095c2700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f65e408ba40 0x7f65e408df00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f65f4005ad0 tx=0x7f65f4016040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.076+0000 7f66017fa700 1 -- 172.21.15.90:0/1871205671 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f65fc080860 con 0x7f6604182a30 2022-07-05T11:46:46.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.238+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f660406b1e0 con 0x7f6604182a30 2022-07-05T11:46:46.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.238+0000 7f66017fa700 1 -- 172.21.15.90:0/1871205671 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f65fc017030 con 0x7f6604182a30 2022-07-05T11:46:46.239 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2022-07-05T11:46:46.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f65e408ba40 msgr2=0x7f65e408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f65e408ba40 0x7f65e408df00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f65f4005ad0 tx=0x7f65f4016040).stop 2022-07-05T11:46:46.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6604182a30 msgr2=0x7f66040cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6604182a30 0x7f66040cbb70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f65fc00c440 tx=0x7f65fc007b90).stop 2022-07-05T11:46:46.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 shutdown_connections 2022-07-05T11:46:46.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f65e408ba40 0x7f65e408df00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6604182a30 0x7f66040cbb70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f660417bda0 0x7f6604171e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 --2- 172.21.15.90:0/1871205671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660417e750 0x7f6604172350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 >> 172.21.15.90:0/1871205671 conn(0x7f66040f21d0 msgr2=0x7f660417dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:46.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 shutdown_connections 2022-07-05T11:46:46.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.240+0000 7f660b826700 1 -- 172.21.15.90:0/1871205671 wait complete. 2022-07-05T11:46:46.252 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-07-05T11:46:46.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.366+0000 7f72cd958700 1 Processor -- start 2022-07-05T11:46:46.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.366+0000 7f72cd958700 1 -- start start 2022-07-05T11:46:46.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.367+0000 7f72cd958700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f72c817dc70 0x7f72c817e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.367+0000 7f72cd958700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c817fdf0 con 0x7f72c8181170 2022-07-05T11:46:46.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.367+0000 7f72cd958700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c81800d0 con 0x7f72c81815f0 2022-07-05T11:46:46.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.367+0000 7f72cd958700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c817f7f0 con 0x7f72c817dc70 2022-07-05T11:46:46.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c6ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f72c817dc70 0x7f72c817e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c67fc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f72c8181170 0x7f72c817e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50980/0 (socket says 172.21.15.90:50980) 2022-07-05T11:46:46.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c6ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f72c817dc70 0x7f72c817e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58038/0 (socket says 172.21.15.90:58038) 2022-07-05T11:46:46.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c67fc700 1 -- 172.21.15.90:0/2256062810 learned_addr learned my addr 172.21.15.90:0/2256062810 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:46.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c6ffd700 1 -- 172.21.15.90:0/2256062810 >> v1:172.21.15.110:6789/0 conn(0x7f72c81815f0 legacy=0x7f72c817f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c6ffd700 1 -- 172.21.15.90:0/2256062810 >> v1:172.21.15.90:6789/0 conn(0x7f72c8181170 legacy=0x7f72c817e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c6ffd700 1 -- 172.21.15.90:0/2256062810 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c81803b0 con 0x7f72c817dc70 2022-07-05T11:46:46.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c5ffb700 1 -- 172.21.15.90:0/2256062810 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847895482 0 0) 0x7f72c817fdf0 con 0x7f72c8181170 2022-07-05T11:46:46.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c6ffd700 1 --2- 172.21.15.90:0/2256062810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c817dc70 0x7f72c817e050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f72b8009e60 tx=0x7f72b8009780).ready entity=mon.0 client_cookie=4fa2f466682c716a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c5ffb700 1 -- 172.21.15.90:0/2256062810 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800e070 con 0x7f72c817dc70 2022-07-05T11:46:46.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c5ffb700 1 -- 172.21.15.90:0/2256062810 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b800bc30 con 0x7f72c817dc70 2022-07-05T11:46:46.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72c5ffb700 1 -- 172.21.15.90:0/2256062810 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8012410 con 0x7f72c817dc70 2022-07-05T11:46:46.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72cd958700 1 -- 172.21.15.90:0/2256062810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c817dc70 msgr2=0x7f72c817e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.368+0000 7f72cd958700 1 --2- 172.21.15.90:0/2256062810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c817dc70 0x7f72c817e050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f72b8009e60 tx=0x7f72b8009780).stop 2022-07-05T11:46:46.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.369+0000 7f72cd958700 1 -- 172.21.15.90:0/2256062810 shutdown_connections 2022-07-05T11:46:46.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.369+0000 7f72cd958700 1 --2- 172.21.15.90:0/2256062810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c817dc70 0x7f72c817e050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.369+0000 7f72cd958700 1 -- 172.21.15.90:0/2256062810 >> 172.21.15.90:0/2256062810 conn(0x7f72c805d9a0 msgr2=0x7f72c805ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:46.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.369+0000 7f72cd958700 1 -- 172.21.15.90:0/2256062810 shutdown_connections 2022-07-05T11:46:46.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.369+0000 7f72cd958700 1 -- 172.21.15.90:0/2256062810 wait complete. 2022-07-05T11:46:46.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.370+0000 7f72cd958700 1 Processor -- start 2022-07-05T11:46:46.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.370+0000 7f72cd958700 1 -- start start 2022-07-05T11:46:46.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72cd958700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c817dc70 0x7f72c8062f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72cd958700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c8181170 0x7f72c818fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72cd958700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c81815f0 0x7f72c81652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72cd958700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8063790 con 0x7f72c8181170 2022-07-05T11:46:46.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72cd958700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8063a70 con 0x7f72c81815f0 2022-07-05T11:46:46.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72cd958700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8063d50 con 0x7f72c817dc70 2022-07-05T11:46:46.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c8181170 0x7f72c818fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c8181170 0x7f72c818fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58046/0 (socket says 172.21.15.90:58046) 2022-07-05T11:46:46.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 -- 172.21.15.90:0/376810505 learned_addr learned my addr 172.21.15.90:0/376810505 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:46.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c77fe700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c81815f0 0x7f72c81652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 -- 172.21.15.90:0/376810505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c817dc70 msgr2=0x7f72c8062f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c6ffd700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c817dc70 0x7f72c8062f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c817dc70 0x7f72c8062f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 -- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c81815f0 msgr2=0x7f72c81652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c81815f0 0x7f72c81652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c67fc700 1 -- 172.21.15.90:0/376810505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b8009a20 con 0x7f72c8181170 2022-07-05T11:46:46.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.371+0000 7f72c77fe700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c81815f0 0x7f72c81652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:46.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.372+0000 7f72c67fc700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c8181170 0x7f72c818fca0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f72b000c4e0 tx=0x7f72b0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.372+0000 7f72beffd700 1 -- 172.21.15.90:0/376810505 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00072e0 con 0x7f72c8181170 2022-07-05T11:46:46.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.372+0000 7f72beffd700 1 -- 172.21.15.90:0/376810505 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0007440 con 0x7f72c8181170 2022-07-05T11:46:46.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.372+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c8064030 con 0x7f72c8181170 2022-07-05T11:46:46.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.372+0000 7f72beffd700 1 -- 172.21.15.90:0/376810505 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00057a0 con 0x7f72c8181170 2022-07-05T11:46:46.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.372+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c80645f0 con 0x7f72c8181170 2022-07-05T11:46:46.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.373+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c806be40 con 0x7f72c8181170 2022-07-05T11:46:46.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.373+0000 7f72beffd700 1 -- 172.21.15.90:0/376810505 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f72b001a060 con 0x7f72c8181170 2022-07-05T11:46:46.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.374+0000 7f72beffd700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f72ac08ba40 0x7f72ac08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.374+0000 7f72beffd700 1 -- 172.21.15.90:0/376810505 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f72b00b01e0 con 0x7f72c8181170 2022-07-05T11:46:46.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.374+0000 7f72c6ffd700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f72ac08ba40 0x7f72ac08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.374+0000 7f72c6ffd700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f72ac08ba40 0x7f72ac08df00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f72b8009e60 tx=0x7f72b8009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.378+0000 7f72beffd700 1 -- 172.21.15.90:0/376810505 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f72b0080ea0 con 0x7f72c8181170 2022-07-05T11:46:46.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.536+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72c8084bd0 con 0x7f72c8181170 2022-07-05T11:46:46.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.537+0000 7f72beffd700 1 -- 172.21.15.90:0/376810505 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72b0018020 con 0x7f72c8181170 2022-07-05T11:46:46.539 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2022-07-05T11:46:46.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f72ac08ba40 msgr2=0x7f72ac08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f72ac08ba40 0x7f72ac08df00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f72b8009e60 tx=0x7f72b8009780).stop 2022-07-05T11:46:46.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c8181170 msgr2=0x7f72c818fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c8181170 0x7f72c818fca0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f72b000c4e0 tx=0x7f72b0007c70).stop 2022-07-05T11:46:46.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 shutdown_connections 2022-07-05T11:46:46.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f72ac08ba40 0x7f72ac08df00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c81815f0 0x7f72c81652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c817dc70 0x7f72c8062f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 --2- 172.21.15.90:0/376810505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c8181170 0x7f72c818fca0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 >> 172.21.15.90:0/376810505 conn(0x7f72c805d9a0 msgr2=0x7f72c8168a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:46.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 shutdown_connections 2022-07-05T11:46:46.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.539+0000 7f72cd958700 1 -- 172.21.15.90:0/376810505 wait complete. 2022-07-05T11:46:46.551 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-07-05T11:46:46.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.665+0000 7f16d6183700 1 Processor -- start 2022-07-05T11:46:46.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.665+0000 7f16d6183700 1 -- start start 2022-07-05T11:46:46.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16d6183700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16d017ded0 0x7f16d00ec470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16d6183700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00ebfe0 con 0x7f16d017daf0 2022-07-05T11:46:46.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16d6183700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d0180830 con 0x7f16d00ec960 2022-07-05T11:46:46.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16d6183700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d0180af0 con 0x7f16d017ded0 2022-07-05T11:46:46.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16d5181700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f16d017daf0 0x7f16d017eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50992/0 (socket says 172.21.15.90:50992) 2022-07-05T11:46:46.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16d5181700 1 -- 172.21.15.90:0/2987209153 learned_addr learned my addr 172.21.15.90:0/2987209153 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:46.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16d4980700 1 --2- 172.21.15.90:0/2987209153 >> v2:172.21.15.110:3300/0 conn(0x7f16d017ded0 0x7f16d00ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039996112 0 0) 0x7f16d00ebfe0 con 0x7f16d017daf0 2022-07-05T11:46:46.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc0033f0 con 0x7f16d017daf0 2022-07-05T11:46:46.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1268911499 0 0) 0x7f16bc0033f0 con 0x7f16d017daf0 2022-07-05T11:46:46.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 >> v2:172.21.15.110:3300/0 conn(0x7f16d017ded0 msgr2=0x7f16d00ec470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:46.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 --2- 172.21.15.90:0/2987209153 >> v2:172.21.15.110:3300/0 conn(0x7f16d017ded0 0x7f16d00ec470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 >> v1:172.21.15.149:6789/0 conn(0x7f16d00ec960 legacy=0x7f16d00ef410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0180dd0 con 0x7f16d017daf0 2022-07-05T11:46:46.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.666+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f16c00017f0 con 0x7f16d017daf0 2022-07-05T11:46:46.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 >> v1:172.21.15.90:6789/0 conn(0x7f16d017daf0 legacy=0x7f16d017eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16bc0038e0 0x7f16bc003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc004690 0x7f16bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16bc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0180af0 con 0x7f16bc005000 2022-07-05T11:46:46.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc00bee0 con 0x7f16bc004690 2022-07-05T11:46:46.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc00c0a0 con 0x7f16bc0038e0 2022-07-05T11:46:46.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16bc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5181700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16bc0038e0 0x7f16bc003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d4980700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc004690 0x7f16bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 -- 172.21.15.90:0/2987209153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16bc0038e0 msgr2=0x7f16bc003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:46.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16bc0038e0 0x7f16bc003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 -- 172.21.15.90:0/2987209153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc004690 msgr2=0x7f16bc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:46.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16bc004690 0x7f16bc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 -- 172.21.15.90:0/2987209153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0033f0 con 0x7f16bc005000 2022-07-05T11:46:46.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 -- 172.21.15.90:0/2987209153 reap_dead start 2022-07-05T11:46:46.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16d5982700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16bc00b8e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f16c8001820 tx=0x7f16c8007b90).ready entity=mon.0 client_cookie=8a019ddbb8414d0d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8007ea0 con 0x7f16bc005000 2022-07-05T11:46:46.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8012400 con 0x7f16bc005000 2022-07-05T11:46:46.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.667+0000 7f16cffff700 1 -- 172.21.15.90:0/2987209153 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c80127c0 con 0x7f16bc005000 2022-07-05T11:46:46.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.668+0000 7f16d6183700 1 -- 172.21.15.90:0/2987209153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 msgr2=0x7f16bc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.668+0000 7f16d6183700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16bc00b8e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f16c8001820 tx=0x7f16c8007b90).stop 2022-07-05T11:46:46.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.668+0000 7f16d6183700 1 -- 172.21.15.90:0/2987209153 shutdown_connections 2022-07-05T11:46:46.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.668+0000 7f16d6183700 1 --2- 172.21.15.90:0/2987209153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16bc00b8e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.668+0000 7f16d6183700 1 -- 172.21.15.90:0/2987209153 >> 172.21.15.90:0/2987209153 conn(0x7f16d00f1510 msgr2=0x7f16d00f1920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:46.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.668+0000 7f16d6183700 1 -- 172.21.15.90:0/2987209153 shutdown_connections 2022-07-05T11:46:46.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.668+0000 7f16d6183700 1 -- 172.21.15.90:0/2987209153 wait complete. 2022-07-05T11:46:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.669+0000 7f16d6183700 1 Processor -- start 2022-07-05T11:46:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.669+0000 7f16d6183700 1 -- start start 2022-07-05T11:46:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d6183700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16d0064c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d6183700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d00c92a0 0x7f16d0062f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d6183700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d01703b0 0x7f16d016ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d6183700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0064770 con 0x7f16bc005000 2022-07-05T11:46:46.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d6183700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0063880 con 0x7f16d01703b0 2022-07-05T11:46:46.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d6183700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0063b60 con 0x7f16d00c92a0 2022-07-05T11:46:46.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d5181700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16d0064c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d5181700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16d0064c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58064/0 (socket says 172.21.15.90:58064) 2022-07-05T11:46:46.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.670+0000 7f16d5181700 1 -- 172.21.15.90:0/2539265144 learned_addr learned my addr 172.21.15.90:0/2539265144 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:46.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d4980700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d00c92a0 0x7f16d0062f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d5181700 1 -- 172.21.15.90:0/2539265144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d00c92a0 msgr2=0x7f16d0062f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d5181700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d00c92a0 0x7f16d0062f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d5181700 1 -- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d01703b0 msgr2=0x7f16d016ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d5982700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d01703b0 0x7f16d016ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d5181700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d01703b0 0x7f16d016ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d5181700 1 -- 172.21.15.90:0/2539265144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0063e40 con 0x7f16bc005000 2022-07-05T11:46:46.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d5181700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16d0064c00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f16c0007710 tx=0x7f16d017e350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16cd7fa700 1 -- 172.21.15.90:0/2539265144 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000f870 con 0x7f16bc005000 2022-07-05T11:46:46.702 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16cd7fa700 1 -- 172.21.15.90:0/2539265144 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c000f9d0 con 0x7f16bc005000 2022-07-05T11:46:46.702 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d0064120 con 0x7f16bc005000 2022-07-05T11:46:46.702 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16cd7fa700 1 -- 172.21.15.90:0/2539265144 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000fd70 con 0x7f16bc005000 2022-07-05T11:46:46.702 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.671+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d0063440 con 0x7f16bc005000 2022-07-05T11:46:46.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.672+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d006be40 con 0x7f16bc005000 2022-07-05T11:46:46.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.673+0000 7f16cd7fa700 1 -- 172.21.15.90:0/2539265144 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f16c001b030 con 0x7f16bc005000 2022-07-05T11:46:46.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.673+0000 7f16cd7fa700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16b008ba40 0x7f16b008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.673+0000 7f16cd7fa700 1 -- 172.21.15.90:0/2539265144 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f16c00b0570 con 0x7f16bc005000 2022-07-05T11:46:46.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.674+0000 7f16d4980700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16b008ba40 0x7f16b008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.674+0000 7f16d4980700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16b008ba40 0x7f16b008df00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f16d0178e80 tx=0x7f16c4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.677+0000 7f16cd7fa700 1 -- 172.21.15.90:0/2539265144 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f16c00811b0 con 0x7f16bc005000 2022-07-05T11:46:46.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.837+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16d00ec740 con 0x7f16bc005000 2022-07-05T11:46:46.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.837+0000 7f16cd7fa700 1 -- 172.21.15.90:0/2539265144 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16c0019020 con 0x7f16bc005000 2022-07-05T11:46:46.838 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:46.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16b008ba40 msgr2=0x7f16b008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16b008ba40 0x7f16b008df00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f16d0178e80 tx=0x7f16c4008040).stop 2022-07-05T11:46:46.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 msgr2=0x7f16d0064c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16d0064c00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f16c0007710 tx=0x7f16d017e350).stop 2022-07-05T11:46:46.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 shutdown_connections 2022-07-05T11:46:46.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16b008ba40 0x7f16b008df00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d01703b0 0x7f16d016ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16bc005000 0x7f16d0064c00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 --2- 172.21.15.90:0/2539265144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d00c92a0 0x7f16d0062f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 >> 172.21.15.90:0/2539265144 conn(0x7f16d00f1510 msgr2=0x7f16d00f18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:46.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 shutdown_connections 2022-07-05T11:46:46.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.839+0000 7f16d6183700 1 -- 172.21.15.90:0/2539265144 wait complete. 2022-07-05T11:46:46.851 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-07-05T11:46:46.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.965+0000 7ff012e7d700 1 Processor -- start 2022-07-05T11:46:46.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.965+0000 7ff012e7d700 1 -- start start 2022-07-05T11:46:46.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff012e7d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff00c17bda0 0x7ff00c0ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff012e7d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff00c182a30 0x7ff00c0eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff012e7d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c0ee170 con 0x7ff00c061f10 2022-07-05T11:46:46.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff012e7d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00c17f760 con 0x7ff00c182a30 2022-07-05T11:46:46.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff012e7d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00c17c3f0 con 0x7ff00c17bda0 2022-07-05T11:46:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff00bfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff00c182a30 0x7ff00c0eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff00bfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff00c182a30 0x7ff00c0eeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58072/0 (socket says 172.21.15.90:58072) 2022-07-05T11:46:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.966+0000 7ff00bfff700 1 -- 172.21.15.90:0/1916005127 learned_addr learned my addr 172.21.15.90:0/1916005127 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:46.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00bfff700 1 -- 172.21.15.90:0/1916005127 >> v2:172.21.15.110:3300/0 conn(0x7ff00c17bda0 msgr2=0x7ff00c0ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:46.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00bfff700 1 --2- 172.21.15.90:0/1916005127 >> v2:172.21.15.110:3300/0 conn(0x7ff00c17bda0 0x7ff00c0ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:46.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00bfff700 1 -- 172.21.15.90:0/1916005127 >> v1:172.21.15.110:6789/0 conn(0x7ff00c061f10 legacy=0x7ff00c0623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:46.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00bfff700 1 -- 172.21.15.90:0/1916005127 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c0ed280 con 0x7ff00c182a30 2022-07-05T11:46:46.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00bfff700 1 --2- 172.21.15.90:0/1916005127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c182a30 0x7ff00c0eeaf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7ff00c06b170 tx=0x7feffc009840).ready entity=mon.0 client_cookie=2e051575e774489d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00b7fe700 1 -- 172.21.15.90:0/1916005127 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc00e070 con 0x7ff00c182a30 2022-07-05T11:46:46.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00b7fe700 1 -- 172.21.15.90:0/1916005127 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc00ba10 con 0x7ff00c182a30 2022-07-05T11:46:46.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff00b7fe700 1 -- 172.21.15.90:0/1916005127 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc00bd90 con 0x7ff00c182a30 2022-07-05T11:46:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 -- 172.21.15.90:0/1916005127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c182a30 msgr2=0x7ff00c0eeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 --2- 172.21.15.90:0/1916005127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c182a30 0x7ff00c0eeaf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7ff00c06b170 tx=0x7feffc009840).stop 2022-07-05T11:46:46.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 -- 172.21.15.90:0/1916005127 shutdown_connections 2022-07-05T11:46:46.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 --2- 172.21.15.90:0/1916005127 >> v2:172.21.15.110:3300/0 conn(0x7ff00c17bda0 0x7ff00c0ee600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:46.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 --2- 172.21.15.90:0/1916005127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c182a30 0x7ff00c0eeaf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 -- 172.21.15.90:0/1916005127 >> 172.21.15.90:0/1916005127 conn(0x7ff00c0f21d0 msgr2=0x7ff00c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:46.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 -- 172.21.15.90:0/1916005127 shutdown_connections 2022-07-05T11:46:46.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.967+0000 7ff012e7d700 1 -- 172.21.15.90:0/1916005127 wait complete. 2022-07-05T11:46:46.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.969+0000 7ff012e7d700 1 Processor -- start 2022-07-05T11:46:46.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.969+0000 7ff012e7d700 1 -- start start 2022-07-05T11:46:46.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff012e7d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff00c061f10 0x7ff00c166530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff012e7d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c17bda0 0x7ff00c18f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff012e7d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00c182a30 0x7ff00c18f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff012e7d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0cb870 con 0x7ff00c17bda0 2022-07-05T11:46:46.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff012e7d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0ca980 con 0x7ff00c182a30 2022-07-05T11:46:46.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff012e7d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0cac60 con 0x7ff00c061f10 2022-07-05T11:46:46.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c17bda0 0x7ff00c18f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c17bda0 0x7ff00c18f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58076/0 (socket says 172.21.15.90:58076) 2022-07-05T11:46:46.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 -- 172.21.15.90:0/2152878164 learned_addr learned my addr 172.21.15.90:0/2152878164 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:46.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff01141a700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00c182a30 0x7ff00c18f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff010c19700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff00c061f10 0x7ff00c166530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 -- 172.21.15.90:0/2152878164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff00c061f10 msgr2=0x7ff00c166530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff00c061f10 0x7ff00c166530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 -- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00c182a30 msgr2=0x7ff00c18f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:46.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00c182a30 0x7ff00c18f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:46.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 -- 172.21.15.90:0/2152878164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc009ae0 con 0x7ff00c17bda0 2022-07-05T11:46:46.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff010c19700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff00c061f10 0x7ff00c166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:46.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff00bfff700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c17bda0 0x7ff00c18f400 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7ff00c088960 tx=0x7feffc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff008ff9700 1 -- 172.21.15.90:0/2152878164 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc013b40 con 0x7ff00c17bda0 2022-07-05T11:46:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff008ff9700 1 -- 172.21.15.90:0/2152878164 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc013ca0 con 0x7ff00c17bda0 2022-07-05T11:46:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.970+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c0caf40 con 0x7ff00c17bda0 2022-07-05T11:46:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.971+0000 7ff008ff9700 1 -- 172.21.15.90:0/2152878164 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc01c610 con 0x7ff00c17bda0 2022-07-05T11:46:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.971+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c0cb500 con 0x7ff00c17bda0 2022-07-05T11:46:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.971+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00c06b1e0 con 0x7ff00c17bda0 2022-07-05T11:46:46.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.972+0000 7ff008ff9700 1 -- 172.21.15.90:0/2152878164 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7feffc01ca40 con 0x7ff00c17bda0 2022-07-05T11:46:46.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.973+0000 7ff008ff9700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff008ba40 0x7feff008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:46.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.973+0000 7ff008ff9700 1 -- 172.21.15.90:0/2152878164 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7feffc0b22b0 con 0x7ff00c17bda0 2022-07-05T11:46:46.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.973+0000 7ff010c19700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff008ba40 0x7feff008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:46.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.973+0000 7ff010c19700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff008ba40 0x7feff008df00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7ff004006fd0 tx=0x7ff004008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:46.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:46.977+0000 7ff008ff9700 1 -- 172.21.15.90:0/2152878164 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7feffc082f70 con 0x7ff00c17bda0 2022-07-05T11:46:47.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.135+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff00c06b1e0 con 0x7ff00c17bda0 2022-07-05T11:46:47.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.136+0000 7ff008ff9700 1 -- 172.21.15.90:0/2152878164 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7feffc023310 con 0x7ff00c17bda0 2022-07-05T11:46:47.140 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2022-07-05T11:46:47.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff008ba40 msgr2=0x7feff008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff008ba40 0x7feff008df00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7ff004006fd0 tx=0x7ff004008040).stop 2022-07-05T11:46:47.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c17bda0 msgr2=0x7ff00c18f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c17bda0 0x7ff00c18f400 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7ff00c088960 tx=0x7feffc009840).stop 2022-07-05T11:46:47.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 shutdown_connections 2022-07-05T11:46:47.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff008ba40 0x7feff008df00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00c182a30 0x7ff00c18f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff00c061f10 0x7ff00c166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 --2- 172.21.15.90:0/2152878164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff00c17bda0 0x7ff00c18f400 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.137+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 >> 172.21.15.90:0/2152878164 conn(0x7ff00c0f21d0 msgr2=0x7ff00c0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:47.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.138+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 shutdown_connections 2022-07-05T11:46:47.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.138+0000 7ff012e7d700 1 -- 172.21.15.90:0/2152878164 wait complete. 2022-07-05T11:46:47.151 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-07-05T11:46:47.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.265+0000 7f7f3ea0d700 1 Processor -- start 2022-07-05T11:46:47.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.265+0000 7f7f3ea0d700 1 -- start start 2022-07-05T11:46:47.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f3ea0d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7f380691f0 0x7f7f380eb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f3ea0d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f380eb880 0x7f7f380ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f3ea0d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f38068650 con 0x7f7f3817e030 2022-07-05T11:46:47.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f3ea0d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f38067d60 con 0x7f7f380691f0 2022-07-05T11:46:47.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f3ea0d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f380ecab0 con 0x7f7f380eb880 2022-07-05T11:46:47.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7f380691f0 0x7f7f380eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7f380691f0 0x7f7f380eb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58088/0 (socket says 172.21.15.90:58088) 2022-07-05T11:46:47.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 -- 172.21.15.90:0/3757822018 learned_addr learned my addr 172.21.15.90:0/3757822018 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:47.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f3cfaa700 1 --2- 172.21.15.90:0/3757822018 >> v2:172.21.15.110:3300/0 conn(0x7f7f380eb880 0x7f7f380ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 -- 172.21.15.90:0/3757822018 >> v2:172.21.15.110:3300/0 conn(0x7f7f380eb880 msgr2=0x7f7f380ebcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:47.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 --2- 172.21.15.90:0/3757822018 >> v2:172.21.15.110:3300/0 conn(0x7f7f380eb880 0x7f7f380ebcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 -- 172.21.15.90:0/3757822018 >> v1:172.21.15.110:6789/0 conn(0x7f7f3817e030 legacy=0x7f7f38068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 -- 172.21.15.90:0/3757822018 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38068000 con 0x7f7f380691f0 2022-07-05T11:46:47.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f3cfaa700 1 --2- 172.21.15.90:0/3757822018 >> v2:172.21.15.110:3300/0 conn(0x7f7f380eb880 0x7f7f380ebcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:47.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f377fe700 1 --2- 172.21.15.90:0/3757822018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f380691f0 0x7f7f380eb390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f7f38086f00 tx=0x7f7f2c0090f0).ready entity=mon.0 client_cookie=53be22f680db9b40 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f36ffd700 1 -- 172.21.15.90:0/3757822018 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00b600 con 0x7f7f380691f0 2022-07-05T11:46:47.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f36ffd700 1 -- 172.21.15.90:0/3757822018 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c00b760 con 0x7f7f380691f0 2022-07-05T11:46:47.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.266+0000 7f7f36ffd700 1 -- 172.21.15.90:0/3757822018 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00bae0 con 0x7f7f380691f0 2022-07-05T11:46:47.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/3757822018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f380691f0 msgr2=0x7f7f380eb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/3757822018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f380691f0 0x7f7f380eb390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f7f38086f00 tx=0x7f7f2c0090f0).stop 2022-07-05T11:46:47.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/3757822018 shutdown_connections 2022-07-05T11:46:47.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/3757822018 >> v2:172.21.15.110:3300/0 conn(0x7f7f380eb880 0x7f7f380ebcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/3757822018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f380691f0 0x7f7f380eb390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/3757822018 >> 172.21.15.90:0/3757822018 conn(0x7f7f380ef4b0 msgr2=0x7f7f380ef8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:47.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/3757822018 shutdown_connections 2022-07-05T11:46:47.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.267+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/3757822018 wait complete. 2022-07-05T11:46:47.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.268+0000 7f7f3ea0d700 1 Processor -- start 2022-07-05T11:46:47.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.268+0000 7f7f3ea0d700 1 -- start start 2022-07-05T11:46:47.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.269+0000 7f7f3ea0d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f380691f0 0x7f7f3816e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.269+0000 7f7f3ea0d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f380eb880 0x7f7f3816e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3ea0d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3817e030 0x7f7f381917e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3ea0d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38190250 con 0x7f7f3817e030 2022-07-05T11:46:47.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3ea0d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38191350 con 0x7f7f380eb880 2022-07-05T11:46:47.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3ea0d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38190460 con 0x7f7f380691f0 2022-07-05T11:46:47.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3817e030 0x7f7f381917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3817e030 0x7f7f381917e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58094/0 (socket says 172.21.15.90:58094) 2022-07-05T11:46:47.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 -- 172.21.15.90:0/2852717534 learned_addr learned my addr 172.21.15.90:0/2852717534 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:47.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f377fe700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f380eb880 0x7f7f3816e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 -- 172.21.15.90:0/2852717534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f380691f0 msgr2=0x7f7f3816e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f380691f0 0x7f7f3816e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:47.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 -- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f380eb880 msgr2=0x7f7f3816e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f380eb880 0x7f7f3816e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 -- 172.21.15.90:0/2852717534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c009370 con 0x7f7f3817e030 2022-07-05T11:46:47.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f377fe700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f380eb880 0x7f7f3816e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:47.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3cfaa700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3817e030 0x7f7f381917e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f7f3000d180 tx=0x7f7f30009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f1ffff700 1 -- 172.21.15.90:0/2852717534 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000de20 con 0x7f7f3817e030 2022-07-05T11:46:47.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f1ffff700 1 -- 172.21.15.90:0/2852717534 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3000f040 con 0x7f7f3817e030 2022-07-05T11:46:47.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f38190740 con 0x7f7f3817e030 2022-07-05T11:46:47.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f1ffff700 1 -- 172.21.15.90:0/2852717534 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30013620 con 0x7f7f3817e030 2022-07-05T11:46:47.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.270+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f38190d00 con 0x7f7f3817e030 2022-07-05T11:46:47.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.271+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3806b1e0 con 0x7f7f3817e030 2022-07-05T11:46:47.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.272+0000 7f7f1ffff700 1 -- 172.21.15.90:0/2852717534 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7f30013a10 con 0x7f7f3817e030 2022-07-05T11:46:47.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.272+0000 7f7f1ffff700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7f1808ba40 0x7f7f1808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.273+0000 7f7f1ffff700 1 -- 172.21.15.90:0/2852717534 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7f300b1230 con 0x7f7f3817e030 2022-07-05T11:46:47.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.273+0000 7f7f37fff700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7f1808ba40 0x7f7f1808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.273+0000 7f7f37fff700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7f1808ba40 0x7f7f1808df00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f7f28007fd0 tx=0x7f7f28007910).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.276+0000 7f7f1ffff700 1 -- 172.21.15.90:0/2852717534 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f7f30081e70 con 0x7f7f3817e030 2022-07-05T11:46:47.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.435+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7f381920f0 con 0x7f7f3817e030 2022-07-05T11:46:47.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.436+0000 7f7f1ffff700 1 -- 172.21.15.90:0/2852717534 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7f30085490 con 0x7f7f3817e030 2022-07-05T11:46:47.506 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2022-07-05T11:46:47.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7f1808ba40 msgr2=0x7f7f1808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7f1808ba40 0x7f7f1808df00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f7f28007fd0 tx=0x7f7f28007910).stop 2022-07-05T11:46:47.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3817e030 msgr2=0x7f7f381917e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3817e030 0x7f7f381917e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f7f3000d180 tx=0x7f7f30009a50).stop 2022-07-05T11:46:47.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 shutdown_connections 2022-07-05T11:46:47.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f7f1808ba40 0x7f7f1808df00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f3817e030 0x7f7f381917e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f380691f0 0x7f7f3816e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:47.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 --2- 172.21.15.90:0/2852717534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f380eb880 0x7f7f3816e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.437+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 >> 172.21.15.90:0/2852717534 conn(0x7f7f380ef4b0 msgr2=0x7f7f380ed3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:47.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.438+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 shutdown_connections 2022-07-05T11:46:47.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.438+0000 7f7f3ea0d700 1 -- 172.21.15.90:0/2852717534 wait complete. 2022-07-05T11:46:47.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-07-05T11:46:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.625+0000 7f11fe117700 1 Processor -- start 2022-07-05T11:46:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.625+0000 7f11fe117700 1 -- start start 2022-07-05T11:46:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.626+0000 7f11fe117700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11f817de40 0x7f11f80c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.626+0000 7f11fe117700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80c9090 con 0x7f11f817da60 2022-07-05T11:46:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.626+0000 7f11fe117700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80ca120 con 0x7f11f80c7d00 2022-07-05T11:46:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.626+0000 7f11fe117700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80c81a0 con 0x7f11f817de40 2022-07-05T11:46:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.626+0000 7f11f77fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f11f817da60 0x7f11f817eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51038/0 (socket says 172.21.15.90:51038) 2022-07-05T11:46:47.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.626+0000 7f11f77fe700 1 -- 172.21.15.90:0/214031832 learned_addr learned my addr 172.21.15.90:0/214031832 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:47.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f7fff700 1 --2- 172.21.15.90:0/214031832 >> v2:172.21.15.110:3300/0 conn(0x7f11f817de40 0x7f11f80c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731669643 0 0) 0x7f11f80c9090 con 0x7f11f817da60 2022-07-05T11:46:47.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e40033f0 con 0x7f11f817da60 2022-07-05T11:46:47.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513078072 0 0) 0x7f11f80ca120 con 0x7f11f80c7d00 2022-07-05T11:46:47.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f80c9090 con 0x7f11f80c7d00 2022-07-05T11:46:47.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f7fff700 1 -- 172.21.15.90:0/214031832 >> v1:172.21.15.149:6789/0 conn(0x7f11f80c7d00 legacy=0x7f11f80c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886028794 0 0) 0x7f11e40033f0 con 0x7f11f817da60 2022-07-05T11:46:47.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f7fff700 1 -- 172.21.15.90:0/214031832 >> v1:172.21.15.90:6789/0 conn(0x7f11f817da60 legacy=0x7f11f817eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f7fff700 1 -- 172.21.15.90:0/214031832 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80c8480 con 0x7f11f817de40 2022-07-05T11:46:47.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f7fff700 1 --2- 172.21.15.90:0/214031832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f817de40 0x7f11f80c9c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f11f0009760 tx=0x7f11f0009060).ready entity=mon.1 client_cookie=cc4a715d258dd1c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80017f0 con 0x7f11f817de40 2022-07-05T11:46:47.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f0011400 con 0x7f11f817de40 2022-07-05T11:46:47.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.627+0000 7f11f67fc700 1 -- 172.21.15.90:0/214031832 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0011780 con 0x7f11f817de40 2022-07-05T11:46:47.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.628+0000 7f11fe117700 1 -- 172.21.15.90:0/214031832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f817de40 msgr2=0x7f11f80c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.628+0000 7f11fe117700 1 --2- 172.21.15.90:0/214031832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f817de40 0x7f11f80c9c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f11f0009760 tx=0x7f11f0009060).stop 2022-07-05T11:46:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.628+0000 7f11fe117700 1 -- 172.21.15.90:0/214031832 shutdown_connections 2022-07-05T11:46:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.628+0000 7f11fe117700 1 --2- 172.21.15.90:0/214031832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f817de40 0x7f11f80c9c30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.628+0000 7f11fe117700 1 -- 172.21.15.90:0/214031832 >> 172.21.15.90:0/214031832 conn(0x7f11f80f4b70 msgr2=0x7f11f80f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.628+0000 7f11fe117700 1 -- 172.21.15.90:0/214031832 shutdown_connections 2022-07-05T11:46:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.628+0000 7f11fe117700 1 -- 172.21.15.90:0/214031832 wait complete. 2022-07-05T11:46:47.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.629+0000 7f11fe117700 1 Processor -- start 2022-07-05T11:46:47.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.629+0000 7f11fe117700 1 -- start start 2022-07-05T11:46:47.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11fe117700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f80c7d00 0x7f11f8171c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11fe117700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11f817da60 0x7f11f80c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11fe117700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11f817de40 0x7f11f80c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11fe117700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80ebc90 con 0x7f11f817de40 2022-07-05T11:46:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11fe117700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c6530 con 0x7f11f80c7d00 2022-07-05T11:46:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11fe117700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c6810 con 0x7f11f817da60 2022-07-05T11:46:47.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11f7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11f817de40 0x7f11f80c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11f7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11f817de40 0x7f11f80c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58106/0 (socket says 172.21.15.90:58106) 2022-07-05T11:46:47.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.630+0000 7f11f7fff700 1 -- 172.21.15.90:0/3340376537 learned_addr learned my addr 172.21.15.90:0/3340376537 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:47.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f77fe700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f80c7d00 0x7f11f8171c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f6ffd700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11f817da60 0x7f11f80c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f7fff700 1 -- 172.21.15.90:0/3340376537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11f817da60 msgr2=0x7f11f80c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f7fff700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11f817da60 0x7f11f80c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f7fff700 1 -- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f80c7d00 msgr2=0x7f11f8171c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f7fff700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f80c7d00 0x7f11f8171c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f7fff700 1 -- 172.21.15.90:0/3340376537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f00092a0 con 0x7f11f817de40 2022-07-05T11:46:47.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f6ffd700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11f817da60 0x7f11f80c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:47.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11f7fff700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11f817de40 0x7f11f80c5ea0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f11f0009d50 tx=0x7f11f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11df7fe700 1 -- 172.21.15.90:0/3340376537 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0010bf0 con 0x7f11f817de40 2022-07-05T11:46:47.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11df7fe700 1 -- 172.21.15.90:0/3340376537 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f0010d50 con 0x7f11f817de40 2022-07-05T11:46:47.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f80c6af0 con 0x7f11f817de40 2022-07-05T11:46:47.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11df7fe700 1 -- 172.21.15.90:0/3340376537 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f001d660 con 0x7f11f817de40 2022-07-05T11:46:47.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.631+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f80ec210 con 0x7f11f817de40 2022-07-05T11:46:47.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.632+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f80ec430 con 0x7f11f817de40 2022-07-05T11:46:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.633+0000 7f11df7fe700 1 -- 172.21.15.90:0/3340376537 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f11f000f070 con 0x7f11f817de40 2022-07-05T11:46:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.633+0000 7f11df7fe700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f11d808ba40 0x7f11d808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.633+0000 7f11df7fe700 1 -- 172.21.15.90:0/3340376537 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f11f00b2af0 con 0x7f11f817de40 2022-07-05T11:46:47.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.634+0000 7f11f77fe700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f11d808ba40 0x7f11d808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.634+0000 7f11f77fe700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f11d808ba40 0x7f11d808df00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f11e8001370 tx=0x7f11e8001dd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.637+0000 7f11df7fe700 1 -- 172.21.15.90:0/3340376537 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7f11f0083730 con 0x7f11f817de40 2022-07-05T11:46:47.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.836+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11f80c6c80 con 0x7f11f817de40 2022-07-05T11:46:47.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.837+0000 7f11df7fe700 1 -- 172.21.15.90:0/3340376537 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+10607 (secure 0 0 0) 0x7f11f0086d50 con 0x7f11f817de40 2022-07-05T11:46:47.838 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:47.838 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6838/2666079679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6837","nonce":2666079679},{"type":"v1","addr":"172.21.15.90:6838","nonce":2666079679}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3502841935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3502841935},{"type":"v1","addr":"172.21.15.90:6833","nonce":3502841935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/311669249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":311669249},{"type":"v1","addr":"172.21.15.90:6835","nonce":311669249}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1727876762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1727876762},{"type":"v1","addr":"172.21.15.110:6839","nonce":1727876762}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/2936291229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2936291229},{"type":"v1","addr":"172.21.15.90:6839","nonce":2936291229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4330,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/2518233371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":2518233371},{"type":"v1","addr":"172.21.15.110:6841","nonce":2518233371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-07-05T11:46:04.574721+0000","modified":"2022-07-05T11:46:22.354922+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4371,"mds_1":4362,"mds_2":4346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4340":{"gid":4340,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/2788360445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2788360445},{"type":"v1","addr":"172.21.15.149:6835","nonce":2788360445}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4341":{"gid":4341,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6836/701705434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":701705434},{"type":"v1","addr":"172.21.15.110:6836","nonce":701705434}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4344":{"gid":4344,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/3239498851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3239498851},{"type":"v1","addr":"172.21.15.110:6837","nonce":3239498851}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4346":{"gid":4346,"name":"l","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6839/4158465025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":4158465025},{"type":"v1","addr":"172.21.15.149:6839","nonce":4158465025}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4362":{"gid":4362,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6833/4013403095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":4013403095},{"type":"v1","addr":"172.21.15.149:6833","nonce":4013403095}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4371":{"gid":4371,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3440068716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3440068716},{"type":"v1","addr":"172.21.15.149:6837","nonce":3440068716}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-07-05T11:46:47.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f11d808ba40 msgr2=0x7f11d808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f11d808ba40 0x7f11d808df00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f11e8001370 tx=0x7f11e8001dd0).stop 2022-07-05T11:46:47.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11f817de40 msgr2=0x7f11f80c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11f817de40 0x7f11f80c5ea0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f11f0009d50 tx=0x7f11f0016000).stop 2022-07-05T11:46:47.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 shutdown_connections 2022-07-05T11:46:47.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f11d808ba40 0x7f11d808df00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11f817de40 0x7f11f80c5ea0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11f80c7d00 0x7f11f8171c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 --2- 172.21.15.90:0/3340376537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11f817da60 0x7f11f80c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 >> 172.21.15.90:0/3340376537 conn(0x7f11f80f4b70 msgr2=0x7f11f8177090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:47.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 shutdown_connections 2022-07-05T11:46:47.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.838+0000 7f11fe117700 1 -- 172.21.15.90:0/3340376537 wait complete. 2022-07-05T11:46:47.847 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2022-07-05T11:46:47.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-07-05T11:46:47.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.966+0000 7fdd0ee71700 1 Processor -- start 2022-07-05T11:46:47.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.966+0000 7fdd0ee71700 1 -- start start 2022-07-05T11:46:47.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0ee71700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdd0817de40 0x7fdd080c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0ee71700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd080c9090 con 0x7fdd080c7d00 2022-07-05T11:46:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0ee71700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd080ca120 con 0x7fdd0817da60 2022-07-05T11:46:47.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0ee71700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080c81a0 con 0x7fdd0817de40 2022-07-05T11:46:47.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0d40e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdd0817de40 0x7fdd080c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0d40e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdd0817de40 0x7fdd080c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39510/0 (socket says 172.21.15.90:39510) 2022-07-05T11:46:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0d40e700 1 -- 172.21.15.90:0/416955214 learned_addr learned my addr 172.21.15.90:0/416955214 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.967+0000 7fdd0cc0d700 1 --1- 172.21.15.90:0/416955214 >> v1:172.21.15.149:6789/0 conn(0x7fdd0817da60 0x7fdd0817eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:47294/0 (socket says 172.21.15.90:47294) 2022-07-05T11:46:47.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0d40e700 1 -- 172.21.15.90:0/416955214 >> v1:172.21.15.149:6789/0 conn(0x7fdd0817da60 legacy=0x7fdd0817eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd077fe700 1 -- 172.21.15.90:0/416955214 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266090956 0 0) 0x7fdd080c9090 con 0x7fdd080c7d00 2022-07-05T11:46:47.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0d40e700 1 -- 172.21.15.90:0/416955214 >> v1:172.21.15.110:6789/0 conn(0x7fdd080c7d00 legacy=0x7fdd080c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0d40e700 1 -- 172.21.15.90:0/416955214 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080c8480 con 0x7fdd0817de40 2022-07-05T11:46:47.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0d40e700 1 --2- 172.21.15.90:0/416955214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd080c9c30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdcf0006fd0 tx=0x7fdcf00090f0).ready entity=mon.2 client_cookie=ab8dd072a8ab95c2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd077fe700 1 -- 172.21.15.90:0/416955214 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000f510 con 0x7fdd0817de40 2022-07-05T11:46:47.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd077fe700 1 -- 172.21.15.90:0/416955214 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf000f670 con 0x7fdd0817de40 2022-07-05T11:46:47.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd077fe700 1 -- 172.21.15.90:0/416955214 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000f9f0 con 0x7fdd0817de40 2022-07-05T11:46:47.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0ee71700 1 -- 172.21.15.90:0/416955214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 msgr2=0x7fdd080c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/416955214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd080c9c30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdcf0006fd0 tx=0x7fdcf00090f0).stop 2022-07-05T11:46:47.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0ee71700 1 -- 172.21.15.90:0/416955214 shutdown_connections 2022-07-05T11:46:47.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/416955214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd080c9c30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0ee71700 1 -- 172.21.15.90:0/416955214 >> 172.21.15.90:0/416955214 conn(0x7fdd080f4b70 msgr2=0x7fdd080f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:47.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0ee71700 1 -- 172.21.15.90:0/416955214 shutdown_connections 2022-07-05T11:46:47.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.968+0000 7fdd0ee71700 1 -- 172.21.15.90:0/416955214 wait complete. 2022-07-05T11:46:47.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.970+0000 7fdd0ee71700 1 Processor -- start 2022-07-05T11:46:47.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.970+0000 7fdd0ee71700 1 -- start start 2022-07-05T11:46:47.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0ee71700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd080c7d00 0x7fdd0818f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0ee71700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd0817da60 0x7fdd081509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0ee71700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd08150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0ee71700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08190660 con 0x7fdd0817da60 2022-07-05T11:46:47.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0ee71700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080c6040 con 0x7fdd080c7d00 2022-07-05T11:46:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0ee71700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0818fa50 con 0x7fdd0817de40 2022-07-05T11:46:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd0817da60 0x7fdd081509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd0817da60 0x7fdd081509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58122/0 (socket says 172.21.15.90:58122) 2022-07-05T11:46:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 -- 172.21.15.90:0/3229193691 learned_addr learned my addr 172.21.15.90:0/3229193691 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:47.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0cc0d700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd080c7d00 0x7fdd0818f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0d40e700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd08150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 -- 172.21.15.90:0/3229193691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 msgr2=0x7fdd08150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd08150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 -- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd080c7d00 msgr2=0x7fdd0818f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:47.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd080c7d00 0x7fdd0818f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:47.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 -- 172.21.15.90:0/3229193691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf0009370 con 0x7fdd0817da60 2022-07-05T11:46:47.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd0d40e700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd08150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:47.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.971+0000 7fdd07fff700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd0817da60 0x7fdd081509a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fdcf800c810 tx=0x7fdcf8001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.972+0000 7fdd04ff9700 1 -- 172.21.15.90:0/3229193691 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8010510 con 0x7fdd0817da60 2022-07-05T11:46:47.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.972+0000 7fdd04ff9700 1 -- 172.21.15.90:0/3229193691 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8010690 con 0x7fdd0817da60 2022-07-05T11:46:47.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.972+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0818fd30 con 0x7fdd0817da60 2022-07-05T11:46:47.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.972+0000 7fdd04ff9700 1 -- 172.21.15.90:0/3229193691 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8010a50 con 0x7fdd0817da60 2022-07-05T11:46:47.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.972+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd081902f0 con 0x7fdd0817da60 2022-07-05T11:46:47.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.973+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd081907d0 con 0x7fdd0817da60 2022-07-05T11:46:47.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.973+0000 7fdd04ff9700 1 -- 172.21.15.90:0/3229193691 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fdcf8019030 con 0x7fdd0817da60 2022-07-05T11:46:47.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.974+0000 7fdd04ff9700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdcec08ba10 0x7fdcec08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:47.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.974+0000 7fdd04ff9700 1 -- 172.21.15.90:0/3229193691 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fdcf80b0060 con 0x7fdd0817da60 2022-07-05T11:46:47.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.974+0000 7fdd0cc0d700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdcec08ba10 0x7fdcec08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:47.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.974+0000 7fdd0cc0d700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdcec08ba10 0x7fdcec08ded0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fdd000047d0 tx=0x7fdd00007cf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:47.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:47.978+0000 7fdd04ff9700 1 -- 172.21.15.90:0/3229193691 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161305 (secure 0 0 0) 0x7fdcf8080d20 con 0x7fdd0817da60 2022-07-05T11:46:48.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.138+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd0806be40 con 0x7fdd0817da60 2022-07-05T11:46:48.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.139+0000 7fdd04ff9700 1 -- 172.21.15.90:0/3229193691 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7fdcf8017020 con 0x7fdd0817da60 2022-07-05T11:46:48.140 INFO:teuthology.orchestra.run.smithi090.stdout: 2022-07-05T11:46:48.140 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"fc926128-a7e6-49db-b76e-e89bbf4193cc","created":"2022-07-05T11:45:44.580027+0000","modified":"2022-07-05T11:46:09.972066+0000","last_up_change":"2022-07-05T11:45:56.133053+0000","last_in_change":"2022-07-05T11:45:49.064611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-07-05T11:45:56.171931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-07-05T11:45:58.679519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-07-05T11:46:03.055092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-07-05T11:46:03.515295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-07-05T11:46:06.613134+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e594880d-164a-4adc-8b41-18c6f1737dda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":37452},{"type":"v1","addr":"172.21.15.90:6809","nonce":37452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":37452},{"type":"v1","addr":"172.21.15.90:6811","nonce":37452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":37452},{"type":"v1","addr":"172.21.15.90:6815","nonce":37452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":37452},{"type":"v1","addr":"172.21.15.90:6813","nonce":37452}]},"public_addr":"172.21.15.90:6809/37452","cluster_addr":"172.21.15.90:6811/37452","heartbeat_back_addr":"172.21.15.90:6815/37452","heartbeat_front_addr":"172.21.15.90:6813/37452","state":["exists","up"]},{"osd":1,"uuid":"cd1bca41-12c0-411b-aff7-cabdd7a16b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37187},{"type":"v1","addr":"172.21.15.110:6811","nonce":37187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37187},{"type":"v1","addr":"172.21.15.110:6813","nonce":37187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":37187},{"type":"v1","addr":"172.21.15.110:6817","nonce":37187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37187},{"type":"v1","addr":"172.21.15.110:6815","nonce":37187}]},"public_addr":"172.21.15.110:6811/37187","cluster_addr":"172.21.15.110:6813/37187","heartbeat_back_addr":"172.21.15.110:6817/37187","heartbeat_front_addr":"172.21.15.110:6815/37187","state":["exists","up"]},{"osd":2,"uuid":"42d0ffc3-80f3-408d-903d-59b721062ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":37786},{"type":"v1","addr":"172.21.15.149:6805","nonce":37786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":37786},{"type":"v1","addr":"172.21.15.149:6811","nonce":37786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":37786},{"type":"v1","addr":"172.21.15.149:6822","nonce":37786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":37786},{"type":"v1","addr":"172.21.15.149:6817","nonce":37786}]},"public_addr":"172.21.15.149:6805/37786","cluster_addr":"172.21.15.149:6811/37786","heartbeat_back_addr":"172.21.15.149:6822/37786","heartbeat_front_addr":"172.21.15.149:6817/37786","state":["exists","up"]},{"osd":3,"uuid":"f5f6a0c1-08c3-4f62-a4bf-a510e124cff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":37449},{"type":"v1","addr":"172.21.15.90:6801","nonce":37449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":37449},{"type":"v1","addr":"172.21.15.90:6803","nonce":37449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":37449},{"type":"v1","addr":"172.21.15.90:6807","nonce":37449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":37449},{"type":"v1","addr":"172.21.15.90:6805","nonce":37449}]},"public_addr":"172.21.15.90:6801/37449","cluster_addr":"172.21.15.90:6803/37449","heartbeat_back_addr":"172.21.15.90:6807/37449","heartbeat_front_addr":"172.21.15.90:6805/37449","state":["exists","up"]},{"osd":4,"uuid":"1edda2e9-dd13-4bcc-bd89-682ddd1622cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37188},{"type":"v1","addr":"172.21.15.110:6803","nonce":37188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37188},{"type":"v1","addr":"172.21.15.110:6805","nonce":37188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37188},{"type":"v1","addr":"172.21.15.110:6809","nonce":37188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37188},{"type":"v1","addr":"172.21.15.110:6807","nonce":37188}]},"public_addr":"172.21.15.110:6803/37188","cluster_addr":"172.21.15.110:6805/37188","heartbeat_back_addr":"172.21.15.110:6809/37188","heartbeat_front_addr":"172.21.15.110:6807/37188","state":["exists","up"]},{"osd":5,"uuid":"c0888e0d-d7f2-42ed-a663-b4ba75aaa317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":37784},{"type":"v1","addr":"172.21.15.149:6806","nonce":37784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":37784},{"type":"v1","addr":"172.21.15.149:6813","nonce":37784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":37784},{"type":"v1","addr":"172.21.15.149:6823","nonce":37784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":37784},{"type":"v1","addr":"172.21.15.149:6819","nonce":37784}]},"public_addr":"172.21.15.149:6806/37784","cluster_addr":"172.21.15.149:6813/37784","heartbeat_back_addr":"172.21.15.149:6823/37784","heartbeat_front_addr":"172.21.15.149:6819/37784","state":["exists","up"]},{"osd":6,"uuid":"1f2f25f7-edcb-4d89-8da2-50fccda7e3d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":37464},{"type":"v1","addr":"172.21.15.90:6817","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":37464},{"type":"v1","addr":"172.21.15.90:6819","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":37464},{"type":"v1","addr":"172.21.15.90:6827","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":37464},{"type":"v1","addr":"172.21.15.90:6823","nonce":37464}]},"public_addr":"172.21.15.90:6817/37464","cluster_addr":"172.21.15.90:6819/37464","heartbeat_back_addr":"172.21.15.90:6827/37464","heartbeat_front_addr":"172.21.15.90:6823/37464","state":["exists","up"]},{"osd":7,"uuid":"fc77b6e9-acfd-43fd-8c29-0eb5beccee23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6821","nonce":37189},{"type":"v1","addr":"172.21.15.110:6823","nonce":37189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6825","nonce":37189},{"type":"v1","addr":"172.21.15.110:6827","nonce":37189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37189},{"type":"v1","addr":"172.21.15.110:6833","nonce":37189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6829","nonce":37189},{"type":"v1","addr":"172.21.15.110:6831","nonce":37189}]},"public_addr":"172.21.15.110:6823/37189","cluster_addr":"172.21.15.110:6827/37189","heartbeat_back_addr":"172.21.15.110:6833/37189","heartbeat_front_addr":"172.21.15.110:6831/37189","state":["exists","up"]},{"osd":8,"uuid":"e7cdf0c2-efcd-4675-ad9c-a09056aad4bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":37785},{"type":"v1","addr":"172.21.15.149:6801","nonce":37785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":37785},{"type":"v1","addr":"172.21.15.149:6807","nonce":37785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":37785},{"type":"v1","addr":"172.21.15.149:6818","nonce":37785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":37785},{"type":"v1","addr":"172.21.15.149:6812","nonce":37785}]},"public_addr":"172.21.15.149:6801/37785","cluster_addr":"172.21.15.149:6807/37785","heartbeat_back_addr":"172.21.15.149:6818/37785","heartbeat_front_addr":"172.21.15.149:6812/37785","state":["exists","up"]},{"osd":9,"uuid":"2c21e4e7-faf0-4c6e-8db8-8d82fcc948dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":37470},{"type":"v1","addr":"172.21.15.90:6822","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":37470},{"type":"v1","addr":"172.21.15.90:6826","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":37470},{"type":"v1","addr":"172.21.15.90:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":37470},{"type":"v1","addr":"172.21.15.90:6829","nonce":37470}]},"public_addr":"172.21.15.90:6822/37470","cluster_addr":"172.21.15.90:6826/37470","heartbeat_back_addr":"172.21.15.90:6831/37470","heartbeat_front_addr":"172.21.15.90:6829/37470","state":["exists","up"]},{"osd":10,"uuid":"9dd57505-dedd-4a00-a0e0-8f300c1ed971","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37190},{"type":"v1","addr":"172.21.15.110:6819","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37190},{"type":"v1","addr":"172.21.15.110:6822","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37190},{"type":"v1","addr":"172.21.15.110:6830","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37190},{"type":"v1","addr":"172.21.15.110:6826","nonce":37190}]},"public_addr":"172.21.15.110:6819/37190","cluster_addr":"172.21.15.110:6822/37190","heartbeat_back_addr":"172.21.15.110:6830/37190","heartbeat_front_addr":"172.21.15.110:6826/37190","state":["exists","up"]},{"osd":11,"uuid":"ca9c1921-128a-4639-9879-9494fcbec477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37830},{"type":"v1","addr":"172.21.15.149:6825","nonce":37830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":37830},{"type":"v1","addr":"172.21.15.149:6827","nonce":37830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":37830},{"type":"v1","addr":"172.21.15.149:6831","nonce":37830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":37830},{"type":"v1","addr":"172.21.15.149:6829","nonce":37830}]},"public_addr":"172.21.15.149:6825/37830","cluster_addr":"172.21.15.149:6827/37830","heartbeat_back_addr":"172.21.15.149:6831/37830","heartbeat_front_addr":"172.21.15.149:6829/37830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.187815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.235036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.471737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.137516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.167073+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.461100+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.250724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.271858+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.159966+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.256271+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.202542+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-07-05T11:45:54.523819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-07-05T11:46:48.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdcec08ba10 msgr2=0x7fdcec08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdcec08ba10 0x7fdcec08ded0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fdd000047d0 tx=0x7fdd00007cf0).stop 2022-07-05T11:46:48.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd0817da60 msgr2=0x7fdd081509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd0817da60 0x7fdd081509a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fdcf800c810 tx=0x7fdcf8001530).stop 2022-07-05T11:46:48.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 shutdown_connections 2022-07-05T11:46:48.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdcec08ba10 0x7fdcec08ded0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd0817de40 0x7fdd08150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd080c7d00 0x7fdd0818f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 --2- 172.21.15.90:0/3229193691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd0817da60 0x7fdd081509a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 >> 172.21.15.90:0/3229193691 conn(0x7fdd080f4b70 msgr2=0x7fdd080ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 shutdown_connections 2022-07-05T11:46:48.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.141+0000 7fdd0ee71700 1 -- 172.21.15.90:0/3229193691 wait complete. 2022-07-05T11:46:48.155 DEBUG:tasks.fwd_scrub:Yielding 2022-07-05T11:46:48.156 INFO:teuthology.run_tasks:Running task check-counter... 2022-07-05T11:46:48.178 INFO:teuthology.run_tasks:Running task workunit... 2022-07-05T11:46:48.191 INFO:tasks.workunit:Pulling workunits from ref c4a8e5d15163d588b25b033c25ae416600cffaa5 2022-07-05T11:46:48.193 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-07-05T11:46:48.194 INFO:tasks.workunit:timeout=3h 2022-07-05T11:46:48.194 INFO:tasks.workunit:cleanup=True 2022-07-05T11:46:48.195 DEBUG:teuthology.orchestra.run.smithi090:> stat -- /home/ubuntu/cephtest/mnt.0 2022-07-05T11:46:48.196 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2022-07-05T11:46:48.197 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2022-07-05T11:46:48.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2022-07-05T11:46:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-07-05T11:46:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-07-05T11:46:48.214 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 2fh/47d Inode: 1 Links: 2 2022-07-05T11:46:48.214 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-07-05T11:46:48.214 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:cephfs_t:s0 2022-07-05T11:46:48.214 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-07-05T11:46:48.215 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2022-07-05 11:46:04.577374304 +0000 2022-07-05T11:46:48.215 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2022-07-05 11:46:17.354045385 +0000 2022-07-05T11:46:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2022-07-05T11:46:48.215 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-07-05T11:46:48.216 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-07-05T11:46:48.290 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:46:48.292 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4a8e5d15163d588b25b033c25ae416600cffaa5 2022-07-05T11:46:48.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.316+0000 7f16681a8700 1 Processor -- start 2022-07-05T11:46:48.319 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:46:48.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.316+0000 7f16681a8700 1 -- start start 2022-07-05T11:46:48.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.317+0000 7f16681a8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1660182980 0x7f16600c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.317+0000 7f16681a8700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16600ecad0 con 0x7f16600c7ff0 2022-07-05T11:46:48.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.317+0000 7f16681a8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16600ecdb0 con 0x7f166017df90 2022-07-05T11:46:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.317+0000 7f16681a8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1660182e00 con 0x7f1660182980 2022-07-05T11:46:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1666745700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f16600c7ff0 0x7f16600c34d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51072/0 (socket says 172.21.15.90:51072) 2022-07-05T11:46:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1666745700 1 -- 172.21.15.90:0/1205533210 learned_addr learned my addr 172.21.15.90:0/1205533210 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:46:48.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1665743700 1 --2- 172.21.15.90:0/1205533210 >> v2:172.21.15.110:3300/0 conn(0x7f1660182980 0x7f16600c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32420823 0 0) 0x7f16600ecad0 con 0x7f16600c7ff0 2022-07-05T11:46:48.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16480033f0 con 0x7f16600c7ff0 2022-07-05T11:46:48.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874194138 0 0) 0x7f16600ecdb0 con 0x7f166017df90 2022-07-05T11:46:48.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16600ecad0 con 0x7f166017df90 2022-07-05T11:46:48.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2143335286 0 0) 0x7f16480033f0 con 0x7f16600c7ff0 2022-07-05T11:46:48.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 >> v2:172.21.15.110:3300/0 conn(0x7f1660182980 msgr2=0x7f16600c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 --2- 172.21.15.90:0/1205533210 >> v2:172.21.15.110:3300/0 conn(0x7f1660182980 0x7f16600c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 >> v1:172.21.15.149:6789/0 conn(0x7f166017df90 legacy=0x7f1660182270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600ed090 con 0x7f16600c7ff0 2022-07-05T11:46:48.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f16580017f0 con 0x7f16600c7ff0 2022-07-05T11:46:48.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 >> v1:172.21.15.90:6789/0 conn(0x7f16600c7ff0 legacy=0x7f16600c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1648003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1648004690 0x7f1648004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648005000 0x7f164800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164800be80 con 0x7f1648003ac0 2022-07-05T11:46:48.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164800bff0 con 0x7f1648005000 2022-07-05T11:46:48.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164800c1b0 con 0x7f1648004690 2022-07-05T11:46:48.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1665f44700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1648003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1665743700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1648004690 0x7f1648004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.318+0000 7f1666745700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648005000 0x7f164800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1665f44700 1 -- 172.21.15.90:0/1205533210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1648004690 msgr2=0x7f1648004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1665f44700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1648004690 0x7f1648004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1665f44700 1 -- 172.21.15.90:0/1205533210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648005000 msgr2=0x7f164800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1665f44700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1648005000 0x7f164800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1665f44700 1 -- 172.21.15.90:0/1205533210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480033f0 con 0x7f1648003ac0 2022-07-05T11:46:48.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1666745700 1 -- 172.21.15.90:0/1205533210 reap_dead start 2022-07-05T11:46:48.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1665f44700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1648003ec0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f165c0018e0 tx=0x7f165c007c00).ready entity=mon.0 client_cookie=b9a9e8261ceb9a44 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c007020 con 0x7f1648003ac0 2022-07-05T11:46:48.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c007180 con 0x7f1648003ac0 2022-07-05T11:46:48.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f1664f42700 1 -- 172.21.15.90:0/1205533210 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c007520 con 0x7f1648003ac0 2022-07-05T11:46:48.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f16681a8700 1 -- 172.21.15.90:0/1205533210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 msgr2=0x7f1648003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f16681a8700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1648003ec0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f165c0018e0 tx=0x7f165c007c00).stop 2022-07-05T11:46:48.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f16681a8700 1 -- 172.21.15.90:0/1205533210 shutdown_connections 2022-07-05T11:46:48.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f16681a8700 1 --2- 172.21.15.90:0/1205533210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1648003ec0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.319+0000 7f16681a8700 1 -- 172.21.15.90:0/1205533210 >> 172.21.15.90:0/1205533210 conn(0x7f16600edaa0 msgr2=0x7f16600edeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.320+0000 7f16681a8700 1 -- 172.21.15.90:0/1205533210 shutdown_connections 2022-07-05T11:46:48.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.320+0000 7f16681a8700 1 -- 172.21.15.90:0/1205533210 wait complete. 2022-07-05T11:46:48.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:46:48.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.321+0000 7f16681a8700 1 Processor -- start 2022-07-05T11:46:48.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.321+0000 7f16681a8700 1 -- start start 2022-07-05T11:46:48.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f16681a8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1660170060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f16681a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166017f510 0x7f16600c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f16681a8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16600c3790 0x7f1660181da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f16681a8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c3c10 con 0x7f1648003ac0 2022-07-05T11:46:48.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f16681a8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1660181910 con 0x7f16600c3790 2022-07-05T11:46:48.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f16681a8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c3e20 con 0x7f166017f510 2022-07-05T11:46:48.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1660170060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1660170060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58140/0 (socket says 172.21.15.90:58140) 2022-07-05T11:46:48.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 -- 172.21.15.90:0/3776166938 learned_addr learned my addr 172.21.15.90:0/3776166938 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665743700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166017f510 0x7f16600c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1666745700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16600c3790 0x7f1660181da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 -- 172.21.15.90:0/3776166938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166017f510 msgr2=0x7f16600c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166017f510 0x7f16600c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 -- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16600c3790 msgr2=0x7f1660181da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16600c3790 0x7f1660181da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 -- 172.21.15.90:0/3776166938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600c4100 con 0x7f1648003ac0 2022-07-05T11:46:48.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1666745700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16600c3790 0x7f1660181da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:48.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.322+0000 7f1665f44700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1660170060 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f165c001ed0 tx=0x7f165c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.323+0000 7f164dffb700 1 -- 172.21.15.90:0/3776166938 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c018030 con 0x7f1648003ac0 2022-07-05T11:46:48.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.323+0000 7f164dffb700 1 -- 172.21.15.90:0/3776166938 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c013670 con 0x7f1648003ac0 2022-07-05T11:46:48.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.323+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1660180fe0 con 0x7f1648003ac0 2022-07-05T11:46:48.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.323+0000 7f164dffb700 1 -- 172.21.15.90:0/3776166938 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c013a10 con 0x7f1648003ac0 2022-07-05T11:46:48.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.323+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16601815a0 con 0x7f1648003ac0 2022-07-05T11:46:48.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.325+0000 7f164dffb700 1 -- 172.21.15.90:0/3776166938 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f165c026070 con 0x7f1648003ac0 2022-07-05T11:46:48.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.326+0000 7f164dffb700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f164008ba40 0x7f164008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.326+0000 7f164dffb700 1 -- 172.21.15.90:0/3776166938 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f165c0b0e50 con 0x7f1648003ac0 2022-07-05T11:46:48.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.326+0000 7f1665743700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f164008ba40 0x7f164008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.326+0000 7f1665743700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f164008ba40 0x7f164008df00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f16600c7fc0 tx=0x7f1650009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.327+0000 7f1679b34b80 1 Processor -- start 2022-07-05T11:46:48.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.327+0000 7f1679b34b80 1 -- start start 2022-07-05T11:46:48.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b90c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b90cd30 0x55865b95aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b950ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1679b34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b8d6350 con 0x55865b950440 2022-07-05T11:46:48.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1679b34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b84db20 con 0x55865b950820 2022-07-05T11:46:48.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1679b34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b8629d0 con 0x55865b90cd30 2022-07-05T11:46:48.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1665f44700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b90c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1665f44700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b90c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58148/0 (socket says 172.21.15.90:58148) 2022-07-05T11:46:48.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1665f44700 1 -- 172.21.15.90:0/901768297 learned_addr learned my addr 172.21.15.90:0/901768297 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1665743700 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b90cd30 0x55865b95aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.328+0000 7f1666745700 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b950ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1665f44700 1 -- 172.21.15.90:0/901768297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b90cd30 msgr2=0x55865b95aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1665f44700 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b90cd30 0x55865b95aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1665f44700 1 -- 172.21.15.90:0/901768297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 msgr2=0x55865b950ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1665f44700 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b950ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1665f44700 1 -- 172.21.15.90:0/901768297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55865b694a60 con 0x55865b950440 2022-07-05T11:46:48.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1665f44700 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b90c840 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f165c0856d0 tx=0x7f165c001600).ready entity=mon.0 client_cookie=ae8df5b419c6e245 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1646ffd700 1 -- 172.21.15.90:0/901768297 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c08b0b0 con 0x55865b950440 2022-07-05T11:46:48.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1646ffd700 1 -- 172.21.15.90:0/901768297 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c089070 con 0x55865b950440 2022-07-05T11:46:48.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.329+0000 7f1646ffd700 1 -- 172.21.15.90:0/901768297 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c013e00 con 0x55865b950440 2022-07-05T11:46:48.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 -- 172.21.15.90:0/901768297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 msgr2=0x55865b90c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b90c840 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f165c0856d0 tx=0x7f165c001600).stop 2022-07-05T11:46:48.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 -- 172.21.15.90:0/901768297 shutdown_connections 2022-07-05T11:46:48.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b950ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b90c840 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 --2- 172.21.15.90:0/901768297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b90cd30 0x55865b95aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 -- 172.21.15.90:0/901768297 >> 172.21.15.90:0/901768297 conn(0x55865b77b240 msgr2=0x55865b90fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 -- 172.21.15.90:0/901768297 shutdown_connections 2022-07-05T11:46:48.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 -- 172.21.15.90:0/901768297 wait complete. 2022-07-05T11:46:48.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.330+0000 7f1679b34b80 1 -- start start 2022-07-05T11:46:48.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.331+0000 7f1679b34b80 1 Processor -- start 2022-07-05T11:46:48.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b94a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b98ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 0x55865b945230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1679b34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b82a1a0 con 0x55865b950440 2022-07-05T11:46:48.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1679b34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b990bf0 con 0x55865b90cd30 2022-07-05T11:46:48.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1679b34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b98f480 con 0x55865b950820 2022-07-05T11:46:48.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1679b34b80 10 client.0 ll_register_callbacks cb 0x55865b8d0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:48.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b98ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b98ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58156/0 (socket says 172.21.15.90:58156) 2022-07-05T11:46:48.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 -- 172.21.15.90:0/2289903660 learned_addr learned my addr 172.21.15.90:0/2289903660 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665f44700 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b94a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 -- 172.21.15.90:0/2289903660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 msgr2=0x55865b945230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 0x55865b945230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:48.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 -- 172.21.15.90:0/2289903660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 msgr2=0x55865b94a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b94a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 -- 172.21.15.90:0/2289903660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16601815a0 con 0x55865b950440 2022-07-05T11:46:48.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f1665743700 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b98ff20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f1650006d80 tx=0x7f165001a000).ready entity=mon.0 client_cookie=98e82172fc39eca1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f163bfff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:48.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.332+0000 7f163bfff700 1 -- 172.21.15.90:0/2289903660 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16500216f0 con 0x55865b950440 2022-07-05T11:46:48.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f163bfff700 1 -- 172.21.15.90:0/2289903660 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1650021850 con 0x55865b950440 2022-07-05T11:46:48.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55865b90a4c0 con 0x55865b950440 2022-07-05T11:46:48.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f163bfff700 1 -- 172.21.15.90:0/2289903660 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1650021a10 con 0x55865b950440 2022-07-05T11:46:48.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 10 client.5172 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:48.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55865b703d50 con 0x55865b950440 2022-07-05T11:46:48.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f163bfff700 1 -- 172.21.15.90:0/2289903660 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55865b90a4c0 con 0x55865b950440 2022-07-05T11:46:48.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f163bfff700 1 -- 172.21.15.90:0/2289903660 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f1650021b70 con 0x55865b950440 2022-07-05T11:46:48.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 10 client.5172 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:48.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 10 client.5172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:46:48.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 20 client.5172 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:48.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b98e3d0 0x55865b98e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 4 client.5172 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:48.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55865b858870 con 0x55865b98e3d0 2022-07-05T11:46:48.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.333+0000 7f1665f44700 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b98e3d0 0x55865b98e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.334+0000 7f1665f44700 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b98e3d0 0x55865b98e7b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c294fd3bfcaa3f6d server_cookie=9b27909d1872d0b9 in_seq=0 out_seq=0 2022-07-05T11:46:48.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.334+0000 7f163bfff700 10 client.5172 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.334+0000 7f163bfff700 1 -- 172.21.15.90:0/2289903660 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55865b858870 con 0x55865b98e3d0 2022-07-05T11:46:48.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.334+0000 7f163bfff700 10 client.5172 handle_command_reply: tid=0 2022-07-05T11:46:48.397 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-07-05T11:46:48.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.334+0000 7f1679b34b80 1 client.5172 shutdown 2022-07-05T11:46:48.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 msgr2=0x55865b98ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b98ff20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f1650006d80 tx=0x7f165001a000).stop 2022-07-05T11:46:48.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 shutdown_connections 2022-07-05T11:46:48.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b98e3d0 0x55865b98e7b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 0x55865b945230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:48.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b94a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2289903660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b98ff20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f163bfff700 0 client.5172 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 >> 172.21.15.90:0/2289903660 conn(0x55865b77b240 msgr2=0x55865b97d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 shutdown_connections 2022-07-05T11:46:48.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 1 -- 172.21.15.90:0/2289903660 wait complete. 2022-07-05T11:46:48.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.335+0000 7f1679b34b80 20 client.5172 trim_cache size 0 max 16384 2022-07-05T11:46:48.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.351+0000 7f1679b34b80 1 Processor -- start 2022-07-05T11:46:48.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.351+0000 7f1679b34b80 1 -- start start 2022-07-05T11:46:48.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b90cd30 0x55865b990670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950440 0x55865b94a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b90fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1679b34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b94c800 con 0x55865b90cd30 2022-07-05T11:46:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1679b34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b94a500 con 0x55865b950820 2022-07-05T11:46:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1679b34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b94be40 con 0x55865b950440 2022-07-05T11:46:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b90cd30 0x55865b990670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b90cd30 0x55865b990670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58164/0 (socket says 172.21.15.90:58164) 2022-07-05T11:46:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 -- 172.21.15.90:0/2692585009 learned_addr learned my addr 172.21.15.90:0/2692585009 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1666745700 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b90fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665743700 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950440 0x55865b94a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 -- 172.21.15.90:0/2692585009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950440 msgr2=0x55865b94a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950440 0x55865b94a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 -- 172.21.15.90:0/2692585009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 msgr2=0x55865b90fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b90fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 -- 172.21.15.90:0/2692585009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55865b9107f0 con 0x55865b90cd30 2022-07-05T11:46:48.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1666745700 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b90fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:46:48.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.352+0000 7f1665f44700 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b90cd30 0x55865b990670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f165c054010 tx=0x7f165c094280).ready entity=mon.0 client_cookie=71f7d760c4dca230 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f16477fe700 1 -- 172.21.15.90:0/2692585009 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c08b0b0 con 0x55865b90cd30 2022-07-05T11:46:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f16477fe700 1 -- 172.21.15.90:0/2692585009 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c013e00 con 0x55865b90cd30 2022-07-05T11:46:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f16477fe700 1 -- 172.21.15.90:0/2692585009 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c013460 con 0x55865b90cd30 2022-07-05T11:46:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 -- 172.21.15.90:0/2692585009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b90cd30 msgr2=0x55865b990670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b90cd30 0x55865b990670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f165c054010 tx=0x7f165c094280).stop 2022-07-05T11:46:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 -- 172.21.15.90:0/2692585009 shutdown_connections 2022-07-05T11:46:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b950820 0x55865b90fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b90cd30 0x55865b990670 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2692585009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950440 0x55865b94a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 -- 172.21.15.90:0/2692585009 >> 172.21.15.90:0/2692585009 conn(0x55865b77b240 msgr2=0x55865b98af00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 -- 172.21.15.90:0/2692585009 shutdown_connections 2022-07-05T11:46:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.353+0000 7f1679b34b80 1 -- 172.21.15.90:0/2692585009 wait complete. 2022-07-05T11:46:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.354+0000 7f1679b34b80 1 -- start start 2022-07-05T11:46:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.354+0000 7f1679b34b80 1 Processor -- start 2022-07-05T11:46:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b949f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b9d39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1679b34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 0x55865b90e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1679b34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b94a480 con 0x55865b950440 2022-07-05T11:46:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1679b34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b9e4940 con 0x55865b90cd30 2022-07-05T11:46:48.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1679b34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865b9d3ec0 con 0x55865b950820 2022-07-05T11:46:48.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1679b34b80 10 client.0 ll_register_callbacks cb 0x55865b8d0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:48.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1665743700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b9d39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1665743700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b9d39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58172/0 (socket says 172.21.15.90:58172) 2022-07-05T11:46:48.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.355+0000 7f1665743700 1 -- 172.21.15.90:0/2091056770 learned_addr learned my addr 172.21.15.90:0/2091056770 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1665f44700 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b949f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1665743700 1 -- 172.21.15.90:0/2091056770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 msgr2=0x55865b90e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1665743700 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 0x55865b90e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:48.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1665743700 1 -- 172.21.15.90:0/2091056770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 msgr2=0x55865b949f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1665743700 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b949f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1665743700 1 -- 172.21.15.90:0/2091056770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c056040 con 0x55865b950440 2022-07-05T11:46:48.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1665743700 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b9d39d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f1650003080 tx=0x7f165001b000).ready entity=mon.0 client_cookie=b2ada84a83538981 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f163bfff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:48.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f163bfff700 1 -- 172.21.15.90:0/2091056770 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650021a20 con 0x55865b950440 2022-07-05T11:46:48.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f163bfff700 1 -- 172.21.15.90:0/2091056770 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1650021b80 con 0x55865b950440 2022-07-05T11:46:48.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f165c089070 con 0x55865b950440 2022-07-05T11:46:48.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f163bfff700 1 -- 172.21.15.90:0/2091056770 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f165002a6c0 con 0x55865b950440 2022-07-05T11:46:48.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 10 client.5178 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:48.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55865b6d2050 con 0x55865b950440 2022-07-05T11:46:48.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f163bfff700 1 -- 172.21.15.90:0/2091056770 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c089070 con 0x55865b950440 2022-07-05T11:46:48.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f163bfff700 1 -- 172.21.15.90:0/2091056770 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f165002a820 con 0x55865b950440 2022-07-05T11:46:48.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 10 client.5178 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:48.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 10 client.5178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:46:48.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 20 client.5178 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:48.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b9e8240 0x55865b948cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 4 client.5178 mds_command: new command op to 4371 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2022-07-05T11:46:48.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.356+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55865b84f710 con 0x55865b9e8240 2022-07-05T11:46:48.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.357+0000 7f1665f44700 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b9e8240 0x55865b948cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.357+0000 7f163bfff700 10 client.5178 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.357+0000 7f1665f44700 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b9e8240 0x55865b948cd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3e0a591d3a989df7 server_cookie=52091504dc62fd31 in_seq=0 out_seq=0 2022-07-05T11:46:48.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f163bfff700 1 -- 172.21.15.90:0/2091056770 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55865b84f710 con 0x55865b9e8240 2022-07-05T11:46:48.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f163bfff700 10 client.5178 handle_command_reply: tid=0 2022-07-05T11:46:48.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 client.5178 shutdown 2022-07-05T11:46:48.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 msgr2=0x55865b9d39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b9d39d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f1650003080 tx=0x7f165001b000).stop 2022-07-05T11:46:48.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 shutdown_connections 2022-07-05T11:46:48.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55865b9e8240 0x55865b948cd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55865b950820 0x55865b90e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:46:48.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b90cd30 0x55865b949f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f163bfff700 0 client.5178 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 --2- 172.21.15.90:0/2091056770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55865b950440 0x55865b9d39d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 >> 172.21.15.90:0/2091056770 conn(0x55865b77b240 msgr2=0x55865b98af00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 shutdown_connections 2022-07-05T11:46:48.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 1 -- 172.21.15.90:0/2091056770 wait complete. 2022-07-05T11:46:48.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.358+0000 7f1679b34b80 20 client.5178 trim_cache size 0 max 16384 2022-07-05T11:46:48.432 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:48.433 INFO:teuthology.orchestra.run.smithi090.stdout: "return_code": 0, 2022-07-05T11:46:48.433 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_tag": "cfa29cbe-14b7-444d-bc3e-c82cb32ca148", 2022-07-05T11:46:48.433 INFO:teuthology.orchestra.run.smithi090.stdout: "mode": "asynchronous" 2022-07-05T11:46:48.433 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:48.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f164008ba40 msgr2=0x7f164008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f164008ba40 0x7f164008df00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f16600c7fc0 tx=0x7f1650009060).stop 2022-07-05T11:46:48.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 msgr2=0x7f1660170060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1660170060 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f165c001ed0 tx=0x7f165c015000).stop 2022-07-05T11:46:48.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 shutdown_connections 2022-07-05T11:46:48.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f164008ba40 0x7f164008df00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16600c3790 0x7f1660181da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1648003ac0 0x7f1660170060 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 --2- 172.21.15.90:0/3776166938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166017f510 0x7f16600c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 >> 172.21.15.90:0/3776166938 conn(0x7f16600edaa0 msgr2=0x7f16600c2540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 shutdown_connections 2022-07-05T11:46:48.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.359+0000 7f16681a8700 1 -- 172.21.15.90:0/3776166938 wait complete. 2022-07-05T11:46:48.438 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:46:48.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.595+0000 7f6afdae3700 1 Processor -- start 2022-07-05T11:46:48.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.595+0000 7f6afdae3700 1 -- start start 2022-07-05T11:46:48.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.596+0000 7f6afdae3700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6af817bb10 0x7f6af80643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.596+0000 7f6afdae3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6af80ca610 0x7f6af817feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.596+0000 7f6afdae3700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af80caac0 con 0x7f6af81803a0 2022-07-05T11:46:48.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.596+0000 7f6afdae3700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af817f5e0 con 0x7f6af817bb10 2022-07-05T11:46:48.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.596+0000 7f6afdae3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af80c9f20 con 0x7f6af80ca610 2022-07-05T11:46:48.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6af80ca610 0x7f6af817feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6af80ca610 0x7f6af817feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39574/0 (socket says 172.21.15.90:39574) 2022-07-05T11:46:48.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 -- 172.21.15.90:0/1971335227 learned_addr learned my addr 172.21.15.90:0/1971335227 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6af77fe700 1 --2- 172.21.15.90:0/1971335227 >> v2:172.21.15.110:3300/0 conn(0x7f6af817bb10 0x7f6af80643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 -- 172.21.15.90:0/1971335227 >> v2:172.21.15.110:3300/0 conn(0x7f6af817bb10 msgr2=0x7f6af80643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 --2- 172.21.15.90:0/1971335227 >> v2:172.21.15.110:3300/0 conn(0x7f6af817bb10 0x7f6af80643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 -- 172.21.15.90:0/1971335227 >> v1:172.21.15.110:6789/0 conn(0x7f6af81803a0 legacy=0x7f6af8083570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 -- 172.21.15.90:0/1971335227 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af80cad50 con 0x7f6af80ca610 2022-07-05T11:46:48.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6aeffff700 1 --2- 172.21.15.90:0/1971335227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af80ca610 0x7f6af817feb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6af805e0a0 tx=0x7f6ae00090f0).ready entity=mon.2 client_cookie=16dcfca1b12845ef server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6af6ffd700 1 -- 172.21.15.90:0/1971335227 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000b520 con 0x7f6af80ca610 2022-07-05T11:46:48.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6af6ffd700 1 -- 172.21.15.90:0/1971335227 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000b680 con 0x7f6af80ca610 2022-07-05T11:46:48.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.597+0000 7f6af6ffd700 1 -- 172.21.15.90:0/1971335227 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000ba00 con 0x7f6af80ca610 2022-07-05T11:46:48.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 -- 172.21.15.90:0/1971335227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af80ca610 msgr2=0x7f6af817feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 --2- 172.21.15.90:0/1971335227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af80ca610 0x7f6af817feb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6af805e0a0 tx=0x7f6ae00090f0).stop 2022-07-05T11:46:48.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 -- 172.21.15.90:0/1971335227 shutdown_connections 2022-07-05T11:46:48.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 --2- 172.21.15.90:0/1971335227 >> v2:172.21.15.110:3300/0 conn(0x7f6af817bb10 0x7f6af80643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 --2- 172.21.15.90:0/1971335227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af80ca610 0x7f6af817feb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 -- 172.21.15.90:0/1971335227 >> 172.21.15.90:0/1971335227 conn(0x7f6af80f1680 msgr2=0x7f6af80f1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 -- 172.21.15.90:0/1971335227 shutdown_connections 2022-07-05T11:46:48.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.598+0000 7f6afdae3700 1 -- 172.21.15.90:0/1971335227 wait complete. 2022-07-05T11:46:48.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.600+0000 7f6afdae3700 1 Processor -- start 2022-07-05T11:46:48.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.600+0000 7f6afdae3700 1 -- start start 2022-07-05T11:46:48.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6afdae3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af80ca610 0x7f6af815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6afdae3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af817bb10 0x7f6af817bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6afdae3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af81803a0 0x7f6af817c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6afdae3700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af817c8d0 con 0x7f6af81803a0 2022-07-05T11:46:48.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6afdae3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af817cb10 con 0x7f6af80ca610 2022-07-05T11:46:48.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6afdae3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af817cdf0 con 0x7f6af817bb10 2022-07-05T11:46:48.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af81803a0 0x7f6af817c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af81803a0 0x7f6af817c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58186/0 (socket says 172.21.15.90:58186) 2022-07-05T11:46:48.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 -- 172.21.15.90:0/86104267 learned_addr learned my addr 172.21.15.90:0/86104267 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6aeffff700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af817bb10 0x7f6af817bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af77fe700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af80ca610 0x7f6af815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 -- 172.21.15.90:0/86104267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af817bb10 msgr2=0x7f6af817bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af817bb10 0x7f6af817bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 -- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af80ca610 msgr2=0x7f6af815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af80ca610 0x7f6af815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 -- 172.21.15.90:0/86104267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0009370 con 0x7f6af81803a0 2022-07-05T11:46:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6af7fff700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af81803a0 0x7f6af817c3e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f6af000c7c0 tx=0x7f6af0001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6aef7fe700 1 -- 172.21.15.90:0/86104267 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000e4a0 con 0x7f6af81803a0 2022-07-05T11:46:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6aef7fe700 1 -- 172.21.15.90:0/86104267 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af000e600 con 0x7f6af81803a0 2022-07-05T11:46:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6aef7fe700 1 -- 172.21.15.90:0/86104267 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000e980 con 0x7f6af81803a0 2022-07-05T11:46:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.601+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af817d0d0 con 0x7f6af81803a0 2022-07-05T11:46:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.602+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af817d690 con 0x7f6af81803a0 2022-07-05T11:46:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.603+0000 7f6aef7fe700 1 -- 172.21.15.90:0/86104267 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6af0010070 con 0x7f6af81803a0 2022-07-05T11:46:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.604+0000 7f6aef7fe700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6adc08ba70 0x7f6adc08df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.604+0000 7f6aef7fe700 1 -- 172.21.15.90:0/86104267 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6af00aff80 con 0x7f6af81803a0 2022-07-05T11:46:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.604+0000 7f6af77fe700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6adc08ba70 0x7f6adc08df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.605+0000 7f6af77fe700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6adc08ba70 0x7f6adc08df30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f6ae8009c30 tx=0x7f6ae8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.606+0000 7f6b0f46fb80 1 Processor -- start 2022-07-05T11:46:48.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.606+0000 7f6b0f46fb80 1 -- start start 2022-07-05T11:46:48.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c439990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c3b52d0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c32caa0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c341950 con 0x55dd9c42f3c0 2022-07-05T11:46:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c439990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c439990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58190/0 (socket says 172.21.15.90:58190) 2022-07-05T11:46:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6aeffff700 1 -- 172.21.15.90:0/808265188 learned_addr learned my addr 172.21.15.90:0/808265188 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6af77fe700 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6af7fff700 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.607+0000 7f6aeffff700 1 -- 172.21.15.90:0/808265188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 msgr2=0x55dd9c3eb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aeffff700 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3eb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aeffff700 1 -- 172.21.15.90:0/808265188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 msgr2=0x55dd9c42fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aeffff700 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aeffff700 1 -- 172.21.15.90:0/808265188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd9c1739e0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aeffff700 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c439990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f6ae0006e90 tx=0x7f6ae0017000).ready entity=mon.0 client_cookie=42ff5dbb0ac91460 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aecff9700 1 -- 172.21.15.90:0/808265188 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000bdc0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aecff9700 1 -- 172.21.15.90:0/808265188 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0000bc0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6aecff9700 1 -- 172.21.15.90:0/808265188 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000ba00 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/808265188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 msgr2=0x55dd9c439990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.608+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c439990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f6ae0006e90 tx=0x7f6ae0017000).stop 2022-07-05T11:46:48.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/808265188 shutdown_connections 2022-07-05T11:46:48.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/808265188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c439990 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/808265188 >> 172.21.15.90:0/808265188 conn(0x55dd9c25a1c0 msgr2=0x55dd9c3eeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/808265188 shutdown_connections 2022-07-05T11:46:48.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/808265188 wait complete. 2022-07-05T11:46:48.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 -- start start 2022-07-05T11:46:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.609+0000 7f6b0f46fb80 1 Processor -- start 2022-07-05T11:46:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.610+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c424320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.610+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.610+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c3e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.610+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c309120 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.610+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c42b0b0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.610+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c4293d0 con 0x55dd9c42f3c0 2022-07-05T11:46:48.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6b0f46fb80 10 client.0 ll_register_callbacks cb 0x55dd9c3af1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:48.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c424320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c424320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58194/0 (socket says 172.21.15.90:58194) 2022-07-05T11:46:48.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 -- 172.21.15.90:0/237477693 learned_addr learned my addr 172.21.15.90:0/237477693 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6aeffff700 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af7fff700 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c3e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 -- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 msgr2=0x55dd9c42a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 -- 172.21.15.90:0/237477693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 msgr2=0x55dd9c3e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c3e9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 -- 172.21.15.90:0/237477693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af80cad50 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6af77fe700 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c424320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f6ae8014820 tx=0x7f6ae8017000).ready entity=mon.0 client_cookie=aa4cf1031994efbe server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6ad5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:48.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/237477693 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8020510 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/237477693 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6ae8020670 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd9c3e9440 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/237477693 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ae8020a40 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6b0f46fb80 10 client.5187 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.611+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55dd9c1e2cd0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/237477693 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd9c3e9440 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/237477693 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f6ae8020ba0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6b0f46fb80 10 client.5187 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6b0f46fb80 10 client.5187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:46:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6b0f46fb80 20 client.5187 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c470e00 0x55dd9c4711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6b0f46fb80 4 client.5187 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:46:48.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd9c3377f0 con 0x55dd9c470e00 2022-07-05T11:46:48.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6aeffff700 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c470e00 0x55dd9c4711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6ad5ffb700 10 client.5187 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.612+0000 7f6aeffff700 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c470e00 0x55dd9c4711e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ba6da09ffce51aab server_cookie=49d10e75d0d5a0c7 in_seq=0 out_seq=0 2022-07-05T11:46:48.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/237477693 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55dd9c3377f0 con 0x55dd9c470e00 2022-07-05T11:46:48.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6ad5ffb700 10 client.5187 handle_command_reply: tid=0 2022-07-05T11:46:48.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 client.5187 shutdown 2022-07-05T11:46:48.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 msgr2=0x55dd9c424320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c424320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f6ae8014820 tx=0x7f6ae8017000).stop 2022-07-05T11:46:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 shutdown_connections 2022-07-05T11:46:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c470e00 0x55dd9c4711e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f7a0 0x55dd9c3e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c424320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/237477693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 >> 172.21.15.90:0/237477693 conn(0x55dd9c25a1c0 msgr2=0x55dd9c45c150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6ad5ffb700 0 client.5187 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 shutdown_connections 2022-07-05T11:46:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.613+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/237477693 wait complete. 2022-07-05T11:46:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.614+0000 7f6b0f46fb80 20 client.5187 trim_cache size 0 max 16384 2022-07-05T11:46:48.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.630+0000 7f6b0f46fb80 1 Processor -- start 2022-07-05T11:46:48.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.630+0000 7f6b0f46fb80 1 -- start start 2022-07-05T11:46:48.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.631+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c42b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.631+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3efef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.631+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.631+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c3ec710 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.631+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c42a4f0 con 0x55dd9c42f3c0 2022-07-05T11:46:48.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.631+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c3ed6b0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c42b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c42b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58202/0 (socket says 172.21.15.90:58202) 2022-07-05T11:46:48.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 -- 172.21.15.90:0/4150979148 learned_addr learned my addr 172.21.15.90:0/4150979148 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af7fff700 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6aeffff700 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 -- 172.21.15.90:0/4150979148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f7a0 msgr2=0x55dd9c42e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 -- 172.21.15.90:0/4150979148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f3c0 msgr2=0x55dd9c3efef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3efef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 -- 172.21.15.90:0/4150979148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd9c1b0fd0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af7fff700 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:48.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6aeffff700 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3efef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:46:48.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6af77fe700 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c42b590 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f6ae8009560 tx=0x7f6ae8026000).ready entity=mon.0 client_cookie=60d036df0845a503 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6aed7fa700 1 -- 172.21.15.90:0/4150979148 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8014440 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6aed7fa700 1 -- 172.21.15.90:0/4150979148 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae8038070 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.632+0000 7f6aed7fa700 1 -- 172.21.15.90:0/4150979148 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8020440 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/4150979148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 msgr2=0x55dd9c42b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c42b590 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f6ae8009560 tx=0x7f6ae8026000).stop 2022-07-05T11:46:48.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/4150979148 shutdown_connections 2022-07-05T11:46:48.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c42b590 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/4150979148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c42f3c0 0x55dd9c3efef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/4150979148 >> 172.21.15.90:0/4150979148 conn(0x55dd9c25a1c0 msgr2=0x55dd9c42bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/4150979148 shutdown_connections 2022-07-05T11:46:48.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/4150979148 wait complete. 2022-07-05T11:46:48.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.633+0000 7f6b0f46fb80 1 -- start start 2022-07-05T11:46:48.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.634+0000 7f6b0f46fb80 1 Processor -- start 2022-07-05T11:46:48.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c3e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c436b20 con 0x55dd9c42f7a0 2022-07-05T11:46:48.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c4238f0 con 0x55dd9c3ebcb0 2022-07-05T11:46:48.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c4c7080 con 0x55dd9c42f3c0 2022-07-05T11:46:48.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 10 client.0 ll_register_callbacks cb 0x55dd9c3af1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:46:48.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58212/0 (socket says 172.21.15.90:58212) 2022-07-05T11:46:48.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 -- 172.21.15.90:0/987239818 learned_addr learned my addr 172.21.15.90:0/987239818 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:46:48.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6aeffff700 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af77fe700 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c3e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 -- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 msgr2=0x55dd9c42fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 -- 172.21.15.90:0/987239818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c3ebcb0 msgr2=0x55dd9c3e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:46:48.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c3e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 -- 172.21.15.90:0/987239818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd9c1e2cd0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6af7fff700 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e5e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f6af000cdb0 tx=0x7f6af00af040).ready entity=mon.0 client_cookie=6084eaf86aaa7eef server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:46:48.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6ad5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:46:48.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/987239818 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af008a1c0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/987239818 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6af0080ff0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ae0000bc0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/987239818 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6af0083fe0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 10 client.5193 fetch_fsmap learned FSMap version 14 2022-07-05T11:46:48.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55dd9c436460 con 0x55dd9c42f7a0 2022-07-05T11:46:48.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.635+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/987239818 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0000bc0 con 0x55dd9c42f7a0 2022-07-05T11:46:48.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/987239818 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f6af0089d30 con 0x55dd9c42f7a0 2022-07-05T11:46:48.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 10 client.5193 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:46:48.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 10 client.5193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:46:48.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 20 client.5193 populate_metadata read hostname 'smithi090' 2022-07-05T11:46:48.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c3f62c0 0x55dd9c4c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:46:48.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 4 client.5193 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:46:48.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dd9c32e690 con 0x55dd9c3f62c0 2022-07-05T11:46:48.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6af77fe700 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c3f62c0 0x55dd9c4c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:46:48.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6ad5ffb700 10 client.5193 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6af77fe700 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c3f62c0 0x55dd9c4c63d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b9e2a264349f2a6a server_cookie=57b400b776677c1a in_seq=0 out_seq=0 2022-07-05T11:46:48.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6ad5ffb700 1 -- 172.21.15.90:0/987239818 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55dd9c32e690 con 0x55dd9c3f62c0 2022-07-05T11:46:48.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6ad5ffb700 10 client.5193 handle_command_reply: tid=0 2022-07-05T11:46:48.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 1 client.5193 shutdown 2022-07-05T11:46:48.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c42f7a0 msgr2=0x55dd9c42e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.636+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e5e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f6af000cdb0 tx=0x7f6af00af040).stop 2022-07-05T11:46:48.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 shutdown_connections 2022-07-05T11:46:48.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55dd9c3f62c0 0x55dd9c4c63d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dd9c42f7a0 0x55dd9c42e5e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd9c3ebcb0 0x55dd9c3e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 --2- 172.21.15.90:0/987239818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dd9c42f3c0 0x55dd9c42fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6ad5ffb700 0 client.5193 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:46:48.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 >> 172.21.15.90:0/987239818 conn(0x55dd9c25a1c0 msgr2=0x55dd9c4621d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 shutdown_connections 2022-07-05T11:46:48.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 1 -- 172.21.15.90:0/987239818 wait complete. 2022-07-05T11:46:48.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6b0f46fb80 20 client.5193 trim_cache size 0 max 16384 2022-07-05T11:46:48.668 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:46:48.668 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:46:48.668 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:46:48.669 INFO:teuthology.orchestra.run.smithi090.stdout: "cfa29cbe-14b7-444d-bc3e-c82cb32ca148": { 2022-07-05T11:46:48.669 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:46:48.669 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "cfa29cbe-14b7-444d-bc3e-c82cb32ca148", 2022-07-05T11:46:48.669 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:46:48.669 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:46:48.670 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:46:48.670 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:46:48.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6adc08ba70 msgr2=0x7f6adc08df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6adc08ba70 0x7f6adc08df30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f6ae8009c30 tx=0x7f6ae8009060).stop 2022-07-05T11:46:48.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af81803a0 msgr2=0x7f6af817c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:46:48.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af81803a0 0x7f6af817c3e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f6af000c7c0 tx=0x7f6af0001510).stop 2022-07-05T11:46:48.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 shutdown_connections 2022-07-05T11:46:48.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6adc08ba70 0x7f6adc08df30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af81803a0 0x7f6af817c3e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af80ca610 0x7f6af815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 --2- 172.21.15.90:0/86104267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6af817bb10 0x7f6af817bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:46:48.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 >> 172.21.15.90:0/86104267 conn(0x7f6af80f1680 msgr2=0x7f6af8087db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:46:48.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 shutdown_connections 2022-07-05T11:46:48.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:46:48.637+0000 7f6afdae3700 1 -- 172.21.15.90:0/86104267 wait complete. 2022-07-05T11:46:48.674 INFO:tasks.cephfs.filesystem:scrub status for tag:cfa29cbe-14b7-444d-bc3e-c82cb32ca148 - {'path': '/', 'tag': 'cfa29cbe-14b7-444d-bc3e-c82cb32ca148', 'options': 'recursive,force'} 2022-07-05T11:47:18.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:47:18.447 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:47:18.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:47:18.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:47:18.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.792+0000 7f548128c700 1 Processor -- start 2022-07-05T11:47:18.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.792+0000 7f548128c700 1 -- start start 2022-07-05T11:47:18.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f548128c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f547c17dec0 0x7f547c0c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f548128c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c17e2a0 con 0x7f547c0c2a00 2022-07-05T11:47:18.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f548128c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0c80d0 con 0x7f547c1820c0 2022-07-05T11:47:18.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f548128c700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c0c0fb0 con 0x7f547c17dec0 2022-07-05T11:47:18.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f547a7fc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f547c0c2a00 0x7f547c1819b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51158/0 (socket says 172.21.15.90:51158) 2022-07-05T11:47:18.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f547a7fc700 1 -- 172.21.15.90:0/3635270545 learned_addr learned my addr 172.21.15.90:0/3635270545 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:47:18.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f547affd700 1 --2- 172.21.15.90:0/3635270545 >> v2:172.21.15.110:3300/0 conn(0x7f547c17dec0 0x7f547c0c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f5479ffb700 1 -- 172.21.15.90:0/3635270545 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149821726 0 0) 0x7f547c17e2a0 con 0x7f547c0c2a00 2022-07-05T11:47:18.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f5479ffb700 1 -- 172.21.15.90:0/3635270545 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f545c0033f0 con 0x7f547c0c2a00 2022-07-05T11:47:18.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f547affd700 1 -- 172.21.15.90:0/3635270545 >> v1:172.21.15.149:6789/0 conn(0x7f547c1820c0 legacy=0x7f547c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.794+0000 7f547affd700 1 -- 172.21.15.90:0/3635270545 >> v1:172.21.15.90:6789/0 conn(0x7f547c0c2a00 legacy=0x7f547c1819b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.795+0000 7f547affd700 1 -- 172.21.15.90:0/3635270545 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0c2eb0 con 0x7f547c17dec0 2022-07-05T11:47:18.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.795+0000 7f547affd700 1 --2- 172.21.15.90:0/3635270545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c17dec0 0x7f547c0c2510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5474009760 tx=0x7f5474009060).ready entity=mon.1 client_cookie=b1c6caff1d59ee41 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:18.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.795+0000 7f5479ffb700 1 -- 172.21.15.90:0/3635270545 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464001470 con 0x7f547c17dec0 2022-07-05T11:47:18.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.795+0000 7f5479ffb700 1 -- 172.21.15.90:0/3635270545 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474012410 con 0x7f547c17dec0 2022-07-05T11:47:18.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.795+0000 7f5479ffb700 1 -- 172.21.15.90:0/3635270545 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474012790 con 0x7f547c17dec0 2022-07-05T11:47:18.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.796+0000 7f548128c700 1 -- 172.21.15.90:0/3635270545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c17dec0 msgr2=0x7f547c0c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.796+0000 7f548128c700 1 --2- 172.21.15.90:0/3635270545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c17dec0 0x7f547c0c2510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5474009760 tx=0x7f5474009060).stop 2022-07-05T11:47:18.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.796+0000 7f548128c700 1 -- 172.21.15.90:0/3635270545 shutdown_connections 2022-07-05T11:47:18.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.796+0000 7f548128c700 1 --2- 172.21.15.90:0/3635270545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c17dec0 0x7f547c0c2510 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.796+0000 7f548128c700 1 -- 172.21.15.90:0/3635270545 >> 172.21.15.90:0/3635270545 conn(0x7f547c0ee4f0 msgr2=0x7f547c083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:18.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.796+0000 7f548128c700 1 -- 172.21.15.90:0/3635270545 shutdown_connections 2022-07-05T11:47:18.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.796+0000 7f548128c700 1 -- 172.21.15.90:0/3635270545 wait complete. 2022-07-05T11:47:18.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.797+0000 7f548128c700 1 Processor -- start 2022-07-05T11:47:18.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.797+0000 7f548128c700 1 -- start start 2022-07-05T11:47:18.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f548128c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0c2a00 0x7f547c0e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f548128c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c17dec0 0x7f547c1660f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f548128c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f547c1820c0 0x7f547c171620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f548128c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c069dd0 con 0x7f547c17dec0 2022-07-05T11:47:18.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f548128c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c181730 con 0x7f547c0c2a00 2022-07-05T11:47:18.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f548128c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c180840 con 0x7f547c1820c0 2022-07-05T11:47:18.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f547a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c17dec0 0x7f547c1660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f547a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c17dec0 0x7f547c1660f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58226/0 (socket says 172.21.15.90:58226) 2022-07-05T11:47:18.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.798+0000 7f547a7fc700 1 -- 172.21.15.90:0/1857113409 learned_addr learned my addr 172.21.15.90:0/1857113409 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:18.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547affd700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0c2a00 0x7f547c0e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547b7fe700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f547c1820c0 0x7f547c171620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547a7fc700 1 -- 172.21.15.90:0/1857113409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f547c1820c0 msgr2=0x7f547c171620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547a7fc700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f547c1820c0 0x7f547c171620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547a7fc700 1 -- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0c2a00 msgr2=0x7f547c0e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547a7fc700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0c2a00 0x7f547c0e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547a7fc700 1 -- 172.21.15.90:0/1857113409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54740092a0 con 0x7f547c17dec0 2022-07-05T11:47:18.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547b7fe700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f547c1820c0 0x7f547c171620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:18.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f547a7fc700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c17dec0 0x7f547c1660f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f546400c910 tx=0x7f5464001c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:18.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f5472ffd700 1 -- 172.21.15.90:0/1857113409 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464007170 con 0x7f547c17dec0 2022-07-05T11:47:18.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f5472ffd700 1 -- 172.21.15.90:0/1857113409 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54640072d0 con 0x7f547c17dec0 2022-07-05T11:47:18.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f5472ffd700 1 -- 172.21.15.90:0/1857113409 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640048c0 con 0x7f547c17dec0 2022-07-05T11:47:18.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c180b20 con 0x7f547c17dec0 2022-07-05T11:47:18.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.799+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c1810e0 con 0x7f547c17dec0 2022-07-05T11:47:18.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.802+0000 7f5472ffd700 1 -- 172.21.15.90:0/1857113409 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f5464010070 con 0x7f547c17dec0 2022-07-05T11:47:18.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.803+0000 7f5472ffd700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f546008ba40 0x7f546008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.803+0000 7f5472ffd700 1 -- 172.21.15.90:0/1857113409 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f54640b0530 con 0x7f547c17dec0 2022-07-05T11:47:18.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.803+0000 7f547affd700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f546008ba40 0x7f546008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.803+0000 7f5492c18b80 1 Processor -- start 2022-07-05T11:47:18.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.804+0000 7f5492c18b80 1 -- start start 2022-07-05T11:47:18.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.804+0000 7f547affd700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f546008ba40 0x7f546008df00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5474009760 tx=0x7f5474015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:18.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e7923388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792338da0 0x55e792386a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c890 0x55e79237cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f5492c18b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7923022d0 con 0x55e79237c4b0 2022-07-05T11:47:18.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f5492c18b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e792279aa0 con 0x55e79237c890 2022-07-05T11:47:18.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f5492c18b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e79228e950 con 0x55e792338da0 2022-07-05T11:47:18.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e7923388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e7923388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58230/0 (socket says 172.21.15.90:58230) 2022-07-05T11:47:18.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 -- 172.21.15.90:0/1768094886 learned_addr learned my addr 172.21.15.90:0/1768094886 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:18.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547a7fc700 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792338da0 0x55e792386a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547b7fe700 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c890 0x55e79237cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 -- 172.21.15.90:0/1768094886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792338da0 msgr2=0x55e792386a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792338da0 0x55e792386a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 -- 172.21.15.90:0/1768094886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c890 msgr2=0x55e79237cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c890 0x55e79237cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 -- 172.21.15.90:0/1768094886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7920c09e0 con 0x55e79237c4b0 2022-07-05T11:47:18.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f547affd700 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e7923388b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f5474009e00 tx=0x7f5474020000).ready entity=mon.0 client_cookie=e001cd92acbb1bc2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:18.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f545bfff700 1 -- 172.21.15.90:0/1768094886 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547402e070 con 0x55e79237c4b0 2022-07-05T11:47:18.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f545bfff700 1 -- 172.21.15.90:0/1768094886 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547401f920 con 0x55e79237c4b0 2022-07-05T11:47:18.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.805+0000 7f545bfff700 1 -- 172.21.15.90:0/1768094886 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547401fa90 con 0x55e79237c4b0 2022-07-05T11:47:18.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 -- 172.21.15.90:0/1768094886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 msgr2=0x55e7923388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e7923388b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f5474009e00 tx=0x7f5474020000).stop 2022-07-05T11:47:18.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 -- 172.21.15.90:0/1768094886 shutdown_connections 2022-07-05T11:47:18.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c890 0x55e79237cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e7923388b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1768094886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792338da0 0x55e792386a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 -- 172.21.15.90:0/1768094886 >> 172.21.15.90:0/1768094886 conn(0x55e7921a71c0 msgr2=0x55e79233bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:18.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 -- 172.21.15.90:0/1768094886 shutdown_connections 2022-07-05T11:47:18.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.806+0000 7f5492c18b80 1 -- 172.21.15.90:0/1768094886 wait complete. 2022-07-05T11:47:18.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.807+0000 7f5492c18b80 1 -- start start 2022-07-05T11:47:18.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.808+0000 7f5492c18b80 1 Processor -- start 2022-07-05T11:47:18.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.809+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792338da0 0x55e792376880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.809+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e792371220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c890 0x55e79237b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f5492c18b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e792256120 con 0x55e79237c4b0 2022-07-05T11:47:18.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f5492c18b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e792376430 con 0x55e792338da0 2022-07-05T11:47:18.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f5492c18b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e79233d290 con 0x55e79237c890 2022-07-05T11:47:18.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f5492c18b80 10 client.0 ll_register_callbacks cb 0x55e7922fc380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:18.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e792371220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e792371220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58238/0 (socket says 172.21.15.90:58238) 2022-07-05T11:47:18.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 -- 172.21.15.90:0/1017453296 learned_addr learned my addr 172.21.15.90:0/1017453296 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:18.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547b7fe700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c890 0x55e79237b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547affd700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792338da0 0x55e792376880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 -- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c890 msgr2=0x55e79237b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c890 0x55e79237b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 -- 172.21.15.90:0/1017453296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792338da0 msgr2=0x55e792376880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792338da0 0x55e792376880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 -- 172.21.15.90:0/1017453296 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5474016040 con 0x55e79237c4b0 2022-07-05T11:47:18.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547b7fe700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c890 0x55e79237b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:18.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f547a7fc700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e792371220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5464004db0 tx=0x7f5464081240).ready entity=mon.0 client_cookie=d8e78f4c31470098 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:18.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f54597fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:18.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f54597fa700 1 -- 172.21.15.90:0/1017453296 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640b0380 con 0x55e79237c4b0 2022-07-05T11:47:18.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f54597fa700 1 -- 172.21.15.90:0/1017453296 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5464081580 con 0x55e79237c4b0 2022-07-05T11:47:18.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.810+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e792336690 con 0x55e79237c4b0 2022-07-05T11:47:18.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f54597fa700 1 -- 172.21.15.90:0/1017453296 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5464081740 con 0x55e79237c4b0 2022-07-05T11:47:18.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 10 client.5205 fetch_fsmap learned FSMap version 14 2022-07-05T11:47:18.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55e79212fcd0 con 0x55e79237c4b0 2022-07-05T11:47:18.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f54597fa700 1 -- 172.21.15.90:0/1017453296 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e792336690 con 0x55e79237c4b0 2022-07-05T11:47:18.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f54597fa700 1 -- 172.21.15.90:0/1017453296 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f5464084360 con 0x55e79237c4b0 2022-07-05T11:47:18.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 10 client.5205 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:47:18.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 10 client.5205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:18.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 20 client.5205 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:18.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e792378cf0 0x55e7923bdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 4 client.5205 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:47:18.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.811+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7922847f0 con 0x55e792378cf0 2022-07-05T11:47:18.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.812+0000 7f547affd700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e792378cf0 0x55e7923bdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.812+0000 7f547affd700 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e792378cf0 0x55e7923bdbb0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a30e5fa47d1b877f server_cookie=5ef0998d90217508 in_seq=0 out_seq=0 2022-07-05T11:47:18.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.812+0000 7f54597fa700 10 client.5205 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:18.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f54597fa700 1 -- 172.21.15.90:0/1017453296 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55e7922847f0 con 0x55e792378cf0 2022-07-05T11:47:18.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f54597fa700 10 client.5205 handle_command_reply: tid=0 2022-07-05T11:47:18.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 client.5205 shutdown 2022-07-05T11:47:18.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 msgr2=0x55e792371220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e792371220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5464004db0 tx=0x7f5464081240).stop 2022-07-05T11:47:18.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 shutdown_connections 2022-07-05T11:47:18.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e792378cf0 0x55e7923bdbb0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c890 0x55e79237b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f54597fa700 0 client.5205 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:18.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792338da0 0x55e792376880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 --2- 172.21.15.90:0/1017453296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e79237c4b0 0x55e792371220 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 >> 172.21.15.90:0/1017453296 conn(0x55e7921a71c0 msgr2=0x55e7923398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:18.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 shutdown_connections 2022-07-05T11:47:18.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 1 -- 172.21.15.90:0/1017453296 wait complete. 2022-07-05T11:47:18.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.813+0000 7f5492c18b80 20 client.5205 trim_cache size 0 max 16384 2022-07-05T11:47:18.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.829+0000 7f5492c18b80 1 Processor -- start 2022-07-05T11:47:18.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.829+0000 7f5492c18b80 1 -- start start 2022-07-05T11:47:18.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e792377f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792378cf0 0x55e7923abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c4b0 0x55e7923bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f5492c18b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e792343c60 con 0x55e792338da0 2022-07-05T11:47:18.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f5492c18b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e792385620 con 0x55e792378cf0 2022-07-05T11:47:18.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f5492c18b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e792383e40 con 0x55e79237c4b0 2022-07-05T11:47:18.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f547affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e792377f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f547affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e792377f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58244/0 (socket says 172.21.15.90:58244) 2022-07-05T11:47:18.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f547affd700 1 -- 172.21.15.90:0/591980813 learned_addr learned my addr 172.21.15.90:0/591980813 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:18.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.830+0000 7f547a7fc700 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792378cf0 0x55e7923abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f547b7fe700 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c4b0 0x55e7923bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f547affd700 1 -- 172.21.15.90:0/591980813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c4b0 msgr2=0x55e7923bdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f547affd700 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c4b0 0x55e7923bdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f547affd700 1 -- 172.21.15.90:0/591980813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792378cf0 msgr2=0x55e7923abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f547affd700 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792378cf0 0x55e7923abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f547affd700 1 -- 172.21.15.90:0/591980813 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7920fdfd0 con 0x55e792338da0 2022-07-05T11:47:18.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f547affd700 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e792377f00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x55e7923aed60 tx=0x7f547403a280).ready entity=mon.0 client_cookie=a50bc261b9e0cb2b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:18.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f5470ff9700 1 -- 172.21.15.90:0/591980813 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547402e040 con 0x55e792338da0 2022-07-05T11:47:18.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f5470ff9700 1 -- 172.21.15.90:0/591980813 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474020e90 con 0x55e792338da0 2022-07-05T11:47:18.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.831+0000 7f5470ff9700 1 -- 172.21.15.90:0/591980813 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547402a440 con 0x55e792338da0 2022-07-05T11:47:18.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 -- 172.21.15.90:0/591980813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 msgr2=0x55e792377f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e792377f00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x55e7923aed60 tx=0x7f547403a280).stop 2022-07-05T11:47:18.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 -- 172.21.15.90:0/591980813 shutdown_connections 2022-07-05T11:47:18.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e79237c4b0 0x55e7923bdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e792377f00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 --2- 172.21.15.90:0/591980813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e792378cf0 0x55e7923abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 -- 172.21.15.90:0/591980813 >> 172.21.15.90:0/591980813 conn(0x55e7921a71c0 msgr2=0x55e79237cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:18.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 -- 172.21.15.90:0/591980813 shutdown_connections 2022-07-05T11:47:18.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.832+0000 7f5492c18b80 1 -- 172.21.15.90:0/591980813 wait complete. 2022-07-05T11:47:18.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.833+0000 7f5492c18b80 1 -- start start 2022-07-05T11:47:18.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.833+0000 7f5492c18b80 1 Processor -- start 2022-07-05T11:47:18.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e7923ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792378cf0 0x55e792411120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f5492c18b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c4b0 0x55e792339ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f5492c18b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7923ac560 con 0x55e792338da0 2022-07-05T11:47:18.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f5492c18b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7923bac40 con 0x55e79237c4b0 2022-07-05T11:47:18.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f5492c18b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e79237d480 con 0x55e792378cf0 2022-07-05T11:47:18.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f5492c18b80 10 client.0 ll_register_callbacks cb 0x55e7922fc380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:18.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f547affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e7923ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f547affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e7923ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58250/0 (socket says 172.21.15.90:58250) 2022-07-05T11:47:18.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f547affd700 1 -- 172.21.15.90:0/2495625343 learned_addr learned my addr 172.21.15.90:0/2495625343 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:18.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.835+0000 7f547a7fc700 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792378cf0 0x55e792411120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f547affd700 1 -- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792378cf0 msgr2=0x55e792411120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f547affd700 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792378cf0 0x55e792411120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f547affd700 1 -- 172.21.15.90:0/2495625343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c4b0 msgr2=0x55e792339ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:18.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f547affd700 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c4b0 0x55e792339ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:47:18.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f547affd700 1 -- 172.21.15.90:0/2495625343 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7920c09e0 con 0x55e792338da0 2022-07-05T11:47:18.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f547a7fc700 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792378cf0 0x55e792411120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:47:18.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f547affd700 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e7923ac070 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f5474012bf0 tx=0x7f5474037040).ready entity=mon.0 client_cookie=e55d79d8a262bf7d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:18.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f54597fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:18.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f54597fa700 1 -- 172.21.15.90:0/2495625343 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547402e040 con 0x55e792338da0 2022-07-05T11:47:18.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f547401f920 con 0x55e792338da0 2022-07-05T11:47:18.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f54597fa700 1 -- 172.21.15.90:0/2495625343 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f547402abd0 con 0x55e792338da0 2022-07-05T11:47:18.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f54597fa700 1 -- 172.21.15.90:0/2495625343 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f547404a430 con 0x55e792338da0 2022-07-05T11:47:18.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 10 client.5211 fetch_fsmap learned FSMap version 14 2022-07-05T11:47:18.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55e79237cec0 con 0x55e792338da0 2022-07-05T11:47:18.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f54597fa700 1 -- 172.21.15.90:0/2495625343 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547404e020 con 0x55e792338da0 2022-07-05T11:47:18.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f54597fa700 1 -- 172.21.15.90:0/2495625343 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f5474027030 con 0x55e792338da0 2022-07-05T11:47:18.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 10 client.5211 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:47:18.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 10 client.5211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:18.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 20 client.5211 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:18.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e79237c890 0x55e79240ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:18.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 4 client.5211 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:47:18.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.836+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e79227b690 con 0x55e79237c890 2022-07-05T11:47:18.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f547a7fc700 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e79237c890 0x55e79240ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:18.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f54597fa700 10 client.5211 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:18.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f547a7fc700 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e79237c890 0x55e79240ffb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=195698bb23307458 server_cookie=6ecb9a6936e0173e in_seq=0 out_seq=0 2022-07-05T11:47:18.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f54597fa700 1 -- 172.21.15.90:0/2495625343 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e79227b690 con 0x55e79237c890 2022-07-05T11:47:18.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f54597fa700 10 client.5211 handle_command_reply: tid=0 2022-07-05T11:47:18.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f5492c18b80 1 client.5211 shutdown 2022-07-05T11:47:18.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 msgr2=0x55e7923ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.837+0000 7f5492c18b80 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e7923ac070 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f5474012bf0 tx=0x7f5474037040).stop 2022-07-05T11:47:18.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 shutdown_connections 2022-07-05T11:47:18.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e79237c890 0x55e79240ffb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e79237c4b0 0x55e792339ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:47:18.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f54597fa700 0 client.5211 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:18.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e792338da0 0x55e7923ac070 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 --2- 172.21.15.90:0/2495625343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e792378cf0 0x55e792411120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 >> 172.21.15.90:0/2495625343 conn(0x55e7921a71c0 msgr2=0x55e7923be470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:18.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 shutdown_connections 2022-07-05T11:47:18.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 1 -- 172.21.15.90:0/2495625343 wait complete. 2022-07-05T11:47:18.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f5492c18b80 20 client.5211 trim_cache size 0 max 16384 2022-07-05T11:47:18.866 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:47:18.867 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "no active scrubs running", 2022-07-05T11:47:18.867 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": {} 2022-07-05T11:47:18.867 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:47:18.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f546008ba40 msgr2=0x7f546008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f546008ba40 0x7f546008df00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5474009760 tx=0x7f5474015000).stop 2022-07-05T11:47:18.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c17dec0 msgr2=0x7f547c1660f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:18.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c17dec0 0x7f547c1660f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f546400c910 tx=0x7f5464001c90).stop 2022-07-05T11:47:18.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 shutdown_connections 2022-07-05T11:47:18.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f546008ba40 0x7f546008df00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f547c1820c0 0x7f547c171620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0c2a00 0x7f547c0e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 --2- 172.21.15.90:0/1857113409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c17dec0 0x7f547c1660f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:18.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 >> 172.21.15.90:0/1857113409 conn(0x7f547c0ee4f0 msgr2=0x7f547c083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:18.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 shutdown_connections 2022-07-05T11:47:18.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:18.838+0000 7f548128c700 1 -- 172.21.15.90:0/1857113409 wait complete. 2022-07-05T11:47:18.872 INFO:tasks.cephfs.filesystem:all active scrubs completed 2022-07-05T11:47:19.874 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2022-07-05T11:47:19.875 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2022-07-05T11:47:19.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.993+0000 7f12eae3c700 1 Processor -- start 2022-07-05T11:47:19.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.994+0000 7f12eae3c700 1 -- start start 2022-07-05T11:47:19.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12eae3c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12e40c1aa0 0x7f12e40c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:19.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12eae3c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f12e40c2410 0x7f12e417e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12eae3c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e40c8140 con 0x7f12e417ab20 2022-07-05T11:47:20.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12eae3c700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e40c7250 con 0x7f12e40c1aa0 2022-07-05T11:47:20.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12eae3c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e40c7530 con 0x7f12e40c2410 2022-07-05T11:47:20.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12e9639700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12e40c1aa0 0x7f12e40c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12e9639700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12e40c1aa0 0x7f12e40c1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:34580/0 (socket says 172.21.15.90:34580) 2022-07-05T11:47:20.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12e9e3a700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f12e417ab20 0x7f12e40c9970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:60796/0 (socket says 172.21.15.90:60796) 2022-07-05T11:47:20.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12e9639700 1 -- 172.21.15.90:0/2010057060 learned_addr learned my addr 172.21.15.90:0/2010057060 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12ea63b700 1 --2- 172.21.15.90:0/2010057060 >> v2:172.21.15.149:3300/0 conn(0x7f12e40c2410 0x7f12e417e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.995+0000 7f12e9639700 1 -- 172.21.15.90:0/2010057060 >> v2:172.21.15.149:3300/0 conn(0x7f12e40c2410 msgr2=0x7f12e417e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.996+0000 7f12e9639700 1 --2- 172.21.15.90:0/2010057060 >> v2:172.21.15.149:3300/0 conn(0x7f12e40c2410 0x7f12e417e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.996+0000 7f12e9639700 1 -- 172.21.15.90:0/2010057060 >> v1:172.21.15.110:6789/0 conn(0x7f12e417ab20 legacy=0x7f12e40c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.996+0000 7f12e9639700 1 -- 172.21.15.90:0/2010057060 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40c7810 con 0x7f12e40c1aa0 2022-07-05T11:47:20.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.996+0000 7f12e9639700 1 --2- 172.21.15.90:0/2010057060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e40c1f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f12e4085a30 tx=0x7f12d40090f0).ready entity=mon.1 client_cookie=487a9a713079c89b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.996+0000 7f12e8e38700 1 -- 172.21.15.90:0/2010057060 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400d4a0 con 0x7f12e40c1aa0 2022-07-05T11:47:20.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.996+0000 7f12e8e38700 1 -- 172.21.15.90:0/2010057060 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400d600 con 0x7f12e40c1aa0 2022-07-05T11:47:20.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.996+0000 7f12e8e38700 1 -- 172.21.15.90:0/2010057060 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400d980 con 0x7f12e40c1aa0 2022-07-05T11:47:20.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 -- 172.21.15.90:0/2010057060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 msgr2=0x7f12e40c1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 --2- 172.21.15.90:0/2010057060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e40c1f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f12e4085a30 tx=0x7f12d40090f0).stop 2022-07-05T11:47:20.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 -- 172.21.15.90:0/2010057060 shutdown_connections 2022-07-05T11:47:20.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 --2- 172.21.15.90:0/2010057060 >> v2:172.21.15.149:3300/0 conn(0x7f12e40c2410 0x7f12e417e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 --2- 172.21.15.90:0/2010057060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e40c1f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 -- 172.21.15.90:0/2010057060 >> 172.21.15.90:0/2010057060 conn(0x7f12e40f2150 msgr2=0x7f12e40ee120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 -- 172.21.15.90:0/2010057060 shutdown_connections 2022-07-05T11:47:20.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.997+0000 7f12eae3c700 1 -- 172.21.15.90:0/2010057060 wait complete. 2022-07-05T11:47:20.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.999+0000 7f12eae3c700 1 Processor -- start 2022-07-05T11:47:20.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:19.999+0000 7f12eae3c700 1 -- start start 2022-07-05T11:47:20.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12eae3c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12eae3c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12e40c2410 0x7f12e414c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12eae3c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e417ab20 0x7f12e4182210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12eae3c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4179930 con 0x7f12e417ab20 2022-07-05T11:47:20.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12eae3c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4181d80 con 0x7f12e40c1aa0 2022-07-05T11:47:20.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12eae3c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4179650 con 0x7f12e40c2410 2022-07-05T11:47:20.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e417ab20 0x7f12e4182210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e417ab20 0x7f12e4182210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58266/0 (socket says 172.21.15.90:58266) 2022-07-05T11:47:20.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 -- 172.21.15.90:0/4022723773 learned_addr learned my addr 172.21.15.90:0/4022723773 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12e9639700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12e40c2410 0x7f12e414c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 -- 172.21.15.90:0/4022723773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12e40c2410 msgr2=0x7f12e414c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12e40c2410 0x7f12e414c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 -- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 msgr2=0x7f12e414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e414c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 -- 172.21.15.90:0/4022723773 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4009370 con 0x7f12e417ab20 2022-07-05T11:47:20.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:20.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.001+0000 7f12ea63b700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e417ab20 0x7f12e4182210 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f12dc009e20 tx=0x7f12dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.002+0000 7f12d1ffb700 1 -- 172.21.15.90:0/4022723773 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00cb50 con 0x7f12e417ab20 2022-07-05T11:47:20.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.002+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e4181450 con 0x7f12e417ab20 2022-07-05T11:47:20.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.002+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e4181a10 con 0x7f12e417ab20 2022-07-05T11:47:20.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.002+0000 7f12d1ffb700 1 -- 172.21.15.90:0/4022723773 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00f040 con 0x7f12e417ab20 2022-07-05T11:47:20.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.002+0000 7f12d1ffb700 1 -- 172.21.15.90:0/4022723773 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00cec0 con 0x7f12e417ab20 2022-07-05T11:47:20.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.004+0000 7f12d1ffb700 1 -- 172.21.15.90:0/4022723773 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f12dc013610 con 0x7f12e417ab20 2022-07-05T11:47:20.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.005+0000 7f12d1ffb700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f12c408ba40 0x7f12c408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.005+0000 7f12d1ffb700 1 -- 172.21.15.90:0/4022723773 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f12dc0b11a0 con 0x7f12e417ab20 2022-07-05T11:47:20.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.005+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f12c408ba40 0x7f12c408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.006+0000 7f12fda2ab80 1 Processor -- start 2022-07-05T11:47:20.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.006+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f12c408ba40 0x7f12c408df00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f12e00112f0 tx=0x7f12e000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.006+0000 7f12fda2ab80 1 -- start start 2022-07-05T11:47:20.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838530 0x55bab87f4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8842b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8838d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab87be350 con 0x55bab8838910 2022-07-05T11:47:20.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab8735b20 con 0x55bab8838530 2022-07-05T11:47:20.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab874a9d0 con 0x55bab87f4e20 2022-07-05T11:47:20.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12ea63b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8838d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838530 0x55bab87f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12ea63b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8838d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58276/0 (socket says 172.21.15.90:58276) 2022-07-05T11:47:20.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838530 0x55bab87f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:34592/0 (socket says 172.21.15.90:34592) 2022-07-05T11:47:20.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12ea63b700 1 -- 172.21.15.90:0/3691668883 learned_addr learned my addr 172.21.15.90:0/3691668883 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9639700 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8842b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 -- 172.21.15.90:0/3691668883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 msgr2=0x55bab8842b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8842b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 -- 172.21.15.90:0/3691668883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 msgr2=0x55bab8838d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8838d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 -- 172.21.15.90:0/3691668883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bab857ca60 con 0x55bab8838530 2022-07-05T11:47:20.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12ea63b700 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8838d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:20.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.007+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838530 0x55bab87f4930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f12e0011e40 tx=0x7f12e0015000).ready entity=mon.1 client_cookie=d78ab9bfcb2a5f15 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12caffd700 1 -- 172.21.15.90:0/3691668883 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0020070 con 0x55bab8838530 2022-07-05T11:47:20.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12caffd700 1 -- 172.21.15.90:0/3691668883 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0011e70 con 0x55bab8838530 2022-07-05T11:47:20.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12caffd700 1 -- 172.21.15.90:0/3691668883 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e001bd00 con 0x55bab8838530 2022-07-05T11:47:20.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 -- 172.21.15.90:0/3691668883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838530 msgr2=0x55bab87f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838530 0x55bab87f4930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f12e0011e40 tx=0x7f12e0015000).stop 2022-07-05T11:47:20.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 -- 172.21.15.90:0/3691668883 shutdown_connections 2022-07-05T11:47:20.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8838d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838530 0x55bab87f4930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/3691668883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8842b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 -- 172.21.15.90:0/3691668883 >> 172.21.15.90:0/3691668883 conn(0x55bab8663240 msgr2=0x55bab87f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.008+0000 7f12fda2ab80 1 -- 172.21.15.90:0/3691668883 shutdown_connections 2022-07-05T11:47:20.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.009+0000 7f12fda2ab80 1 -- 172.21.15.90:0/3691668883 wait complete. 2022-07-05T11:47:20.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.009+0000 7f12fda2ab80 1 -- start start 2022-07-05T11:47:20.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.009+0000 7f12fda2ab80 1 Processor -- start 2022-07-05T11:47:20.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8877440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838530 0x55bab882e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab8877e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab87121a0 con 0x55bab8838530 2022-07-05T11:47:20.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab8878b20 con 0x55bab8838910 2022-07-05T11:47:20.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab8869b60 con 0x55bab87f4e20 2022-07-05T11:47:20.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12fda2ab80 10 client.0 ll_register_callbacks cb 0x55bab87b8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:20.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12e9639700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838530 0x55bab882e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12e9639700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838530 0x55bab882e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58280/0 (socket says 172.21.15.90:58280) 2022-07-05T11:47:20.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.011+0000 7f12e9639700 1 -- 172.21.15.90:0/1094738763 learned_addr learned my addr 172.21.15.90:0/1094738763 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8877440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12ea63b700 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab8877e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12e9639700 1 -- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 msgr2=0x55bab8877440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12e9639700 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8877440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12e9639700 1 -- 172.21.15.90:0/1094738763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 msgr2=0x55bab8877e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12e9639700 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab8877e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12e9639700 1 -- 172.21.15.90:0/1094738763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e4181a10 con 0x55bab8838530 2022-07-05T11:47:20.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12e9639700 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838530 0x55bab882e670 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f12d4010000 tx=0x7f12d4016000).ready entity=mon.0 client_cookie=b92db6dcebccbe05 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12bffff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:20.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12bffff700 1 -- 172.21.15.90:0/1094738763 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d401e410 con 0x55bab8838530 2022-07-05T11:47:20.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12bffff700 1 -- 172.21.15.90:0/1094738763 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f12d401e570 con 0x55bab8838530 2022-07-05T11:47:20.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bab87f2710 con 0x55bab8838530 2022-07-05T11:47:20.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12bffff700 1 -- 172.21.15.90:0/1094738763 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12d401e940 con 0x55bab8838530 2022-07-05T11:47:20.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12fda2ab80 10 client.5220 fetch_fsmap learned FSMap version 14 2022-07-05T11:47:20.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f12e0008710 con 0x55bab8838530 2022-07-05T11:47:20.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.012+0000 7f12bffff700 1 -- 172.21.15.90:0/1094738763 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bab87f2710 con 0x55bab8838530 2022-07-05T11:47:20.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12bffff700 1 -- 172.21.15.90:0/1094738763 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f12d4009830 con 0x55bab8838530 2022-07-05T11:47:20.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12fda2ab80 10 client.5220 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:47:20.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12fda2ab80 10 client.5220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:20.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12fda2ab80 20 client.5220 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:20.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab8876d40 0x55bab886a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12fda2ab80 4 client.5220 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:47:20.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bab8740870 con 0x55bab8876d40 2022-07-05T11:47:20.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab8876d40 0x55bab886a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab8876d40 0x55bab886a3e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=78182ab414d83776 server_cookie=3ce64fa375547187 in_seq=0 out_seq=0 2022-07-05T11:47:20.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.013+0000 7f12bffff700 10 client.5220 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12bffff700 1 -- 172.21.15.90:0/1094738763 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55bab8740870 con 0x55bab8876d40 2022-07-05T11:47:20.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12bffff700 10 client.5220 handle_command_reply: tid=0 2022-07-05T11:47:20.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 client.5220 shutdown 2022-07-05T11:47:20.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838530 msgr2=0x55bab882e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838530 0x55bab882e670 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f12d4010000 tx=0x7f12d4016000).stop 2022-07-05T11:47:20.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 shutdown_connections 2022-07-05T11:47:20.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab8876d40 0x55bab886a3e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab8877e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab87f4e20 0x55bab8877440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12bffff700 0 client.5220 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1094738763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838530 0x55bab882e670 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 >> 172.21.15.90:0/1094738763 conn(0x55bab8663240 msgr2=0x55bab87f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 shutdown_connections 2022-07-05T11:47:20.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1094738763 wait complete. 2022-07-05T11:47:20.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.014+0000 7f12fda2ab80 20 client.5220 trim_cache size 0 max 16384 2022-07-05T11:47:20.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.030+0000 7f12fda2ab80 1 Processor -- start 2022-07-05T11:47:20.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.030+0000 7f12fda2ab80 1 -- start start 2022-07-05T11:47:20.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab87f4e20 0x55bab883e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab87ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab87eebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab87ef0a0 con 0x55bab87f4e20 2022-07-05T11:47:20.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab883e630 con 0x55bab8838910 2022-07-05T11:47:20.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab886a920 con 0x55bab8838530 2022-07-05T11:47:20.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12e9e3a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab87f4e20 0x55bab883e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12e9e3a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab87f4e20 0x55bab883e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58286/0 (socket says 172.21.15.90:58286) 2022-07-05T11:47:20.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12e9e3a700 1 -- 172.21.15.90:0/338298704 learned_addr learned my addr 172.21.15.90:0/338298704 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12e9639700 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab87ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12ea63b700 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab87eebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.031+0000 7f12e9e3a700 1 -- 172.21.15.90:0/338298704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 msgr2=0x55bab87ee6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab87ee6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12e9e3a700 1 -- 172.21.15.90:0/338298704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 msgr2=0x55bab87eebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab87eebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12e9e3a700 1 -- 172.21.15.90:0/338298704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bab8834610 con 0x55bab87f4e20 2022-07-05T11:47:20.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab87f4e20 0x55bab883e960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f12e0007000 tx=0x7f12e001d070).ready entity=mon.0 client_cookie=97426cddb6eb78df server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12cb7fe700 1 -- 172.21.15.90:0/338298704 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0009bf0 con 0x55bab87f4e20 2022-07-05T11:47:20.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12cb7fe700 1 -- 172.21.15.90:0/338298704 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e002c040 con 0x55bab87f4e20 2022-07-05T11:47:20.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.032+0000 7f12cb7fe700 1 -- 172.21.15.90:0/338298704 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00082e0 con 0x55bab87f4e20 2022-07-05T11:47:20.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 -- 172.21.15.90:0/338298704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab87f4e20 msgr2=0x55bab883e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab87f4e20 0x55bab883e960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f12e0007000 tx=0x7f12e001d070).stop 2022-07-05T11:47:20.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 -- 172.21.15.90:0/338298704 shutdown_connections 2022-07-05T11:47:20.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab8838910 0x55bab87eebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab87f4e20 0x55bab883e960 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/338298704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab87ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 -- 172.21.15.90:0/338298704 >> 172.21.15.90:0/338298704 conn(0x55bab8663240 msgr2=0x55bab886b180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 -- 172.21.15.90:0/338298704 shutdown_connections 2022-07-05T11:47:20.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.033+0000 7f12fda2ab80 1 -- 172.21.15.90:0/338298704 wait complete. 2022-07-05T11:47:20.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.034+0000 7f12fda2ab80 1 -- start start 2022-07-05T11:47:20.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.034+0000 7f12fda2ab80 1 Processor -- start 2022-07-05T11:47:20.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab87f4e20 0x55bab88c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab88c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12fda2ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8831510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab88c3410 con 0x55bab8838910 2022-07-05T11:47:20.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab87fde20 con 0x55bab87f4e20 2022-07-05T11:47:20.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12fda2ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bab8831080 con 0x55bab8838530 2022-07-05T11:47:20.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12fda2ab80 10 client.0 ll_register_callbacks cb 0x55bab87b8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:20.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8831510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8831510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58294/0 (socket says 172.21.15.90:58294) 2022-07-05T11:47:20.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 -- 172.21.15.90:0/1552354807 learned_addr learned my addr 172.21.15.90:0/1552354807 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab87f4e20 0x55bab88c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12e9639700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab88c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 -- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 msgr2=0x55bab88c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab88c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 -- 172.21.15.90:0/1552354807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab87f4e20 msgr2=0x55bab88c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab87f4e20 0x55bab88c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12ea63b700 1 -- 172.21.15.90:0/1552354807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bab857ca60 con 0x55bab8838910 2022-07-05T11:47:20.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.036+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab87f4e20 0x55bab88c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:20.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12ea63b700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8831510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f12dc009df0 tx=0x7f12dc088040).ready entity=mon.0 client_cookie=98cc76494ba43606 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12bffff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:20.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12bffff700 1 -- 172.21.15.90:0/1552354807 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc057070 con 0x55bab8838910 2022-07-05T11:47:20.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12bffff700 1 -- 172.21.15.90:0/1552354807 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f12dc0851e0 con 0x55bab8838910 2022-07-05T11:47:20.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12e0011e70 con 0x55bab8838910 2022-07-05T11:47:20.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12bffff700 1 -- 172.21.15.90:0/1552354807 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12dc08b440 con 0x55bab8838910 2022-07-05T11:47:20.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 10 client.5226 fetch_fsmap learned FSMap version 14 2022-07-05T11:47:20.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55bab85ebd50 con 0x55bab8838910 2022-07-05T11:47:20.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12bffff700 1 -- 172.21.15.90:0/1552354807 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0011e70 con 0x55bab8838910 2022-07-05T11:47:20.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12bffff700 1 -- 172.21.15.90:0/1552354807 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f12dc01bbf0 con 0x55bab8838910 2022-07-05T11:47:20.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 10 client.5226 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:47:20.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 10 client.5226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:20.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 20 client.5226 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:20.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab883dae0 0x55bab886aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 4 client.5226 mds_command: new command op to 4371 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2022-07-05T11:47:20.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.037+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bab8737710 con 0x55bab883dae0 2022-07-05T11:47:20.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.038+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab883dae0 0x55bab886aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.038+0000 7f12bffff700 10 client.5226 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.038+0000 7f12e9e3a700 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab883dae0 0x55bab886aa60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=aff32c034bd3452f server_cookie=a957a7a9ce24ee63 in_seq=0 out_seq=0 2022-07-05T11:47:20.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12bffff700 1 -- 172.21.15.90:0/1552354807 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bab8737710 con 0x55bab883dae0 2022-07-05T11:47:20.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12bffff700 10 client.5226 handle_command_reply: tid=0 2022-07-05T11:47:20.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 client.5226 shutdown 2022-07-05T11:47:20.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 msgr2=0x55bab8831510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8831510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f12dc009df0 tx=0x7f12dc088040).stop 2022-07-05T11:47:20.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 shutdown_connections 2022-07-05T11:47:20.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bab883dae0 0x55bab886aa60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bab8838910 0x55bab8831510 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bab87f4e20 0x55bab88c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 --2- 172.21.15.90:0/1552354807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bab8838530 0x55bab88c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 >> 172.21.15.90:0/1552354807 conn(0x55bab8663240 msgr2=0x55bab87ee6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12bffff700 0 client.5226 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 shutdown_connections 2022-07-05T11:47:20.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 1 -- 172.21.15.90:0/1552354807 wait complete. 2022-07-05T11:47:20.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.039+0000 7f12fda2ab80 20 client.5226 trim_cache size 0 max 16384 2022-07-05T11:47:20.084 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:47:20.085 INFO:teuthology.orchestra.run.smithi090.stdout: "return_code": 0, 2022-07-05T11:47:20.085 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_tag": "61ce829f-75af-485e-9bb3-ac2780446cff", 2022-07-05T11:47:20.085 INFO:teuthology.orchestra.run.smithi090.stdout: "mode": "asynchronous" 2022-07-05T11:47:20.085 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:47:20.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f12c408ba40 msgr2=0x7f12c408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f12c408ba40 0x7f12c408df00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f12e00112f0 tx=0x7f12e000b040).stop 2022-07-05T11:47:20.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e417ab20 msgr2=0x7f12e4182210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e417ab20 0x7f12e4182210 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f12dc009e20 tx=0x7f12dc00b040).stop 2022-07-05T11:47:20.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 shutdown_connections 2022-07-05T11:47:20.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f12c408ba40 0x7f12c408df00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e417ab20 0x7f12e4182210 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12e40c1aa0 0x7f12e414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 --2- 172.21.15.90:0/4022723773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12e40c2410 0x7f12e414c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 >> 172.21.15.90:0/4022723773 conn(0x7f12e40f2150 msgr2=0x7f12e40c3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 shutdown_connections 2022-07-05T11:47:20.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.040+0000 7f12eae3c700 1 -- 172.21.15.90:0/4022723773 wait complete. 2022-07-05T11:47:20.090 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:47:20.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.206+0000 7f2dd8942700 1 Processor -- start 2022-07-05T11:47:20.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.206+0000 7f2dd8942700 1 -- start start 2022-07-05T11:47:20.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.207+0000 7f2dd8942700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2dd41780e0 0x7f2dd417b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.207+0000 7f2dd8942700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd40e93e0 con 0x7f2dd4177d00 2022-07-05T11:47:20.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.207+0000 7f2dd8942700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd417b540 con 0x7f2dd40e9f80 2022-07-05T11:47:20.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.207+0000 7f2dd8942700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd40c7e50 con 0x7f2dd41780e0 2022-07-05T11:47:20.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.207+0000 7f2dd37fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2dd4177d00 0x7f2dd40e9870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51240/0 (socket says 172.21.15.90:51240) 2022-07-05T11:47:20.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.207+0000 7f2dd37fe700 1 -- 172.21.15.90:0/1274884024 learned_addr learned my addr 172.21.15.90:0/1274884024 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:47:20.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/1274884024 >> v2:172.21.15.110:3300/0 conn(0x7f2dd41780e0 0x7f2dd417b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844788716 0 0) 0x7f2dd40e93e0 con 0x7f2dd4177d00 2022-07-05T11:47:20.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc00033f0 con 0x7f2dd4177d00 2022-07-05T11:47:20.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373836530 0 0) 0x7f2dd417b540 con 0x7f2dd40e9f80 2022-07-05T11:47:20.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd40e93e0 con 0x7f2dd40e9f80 2022-07-05T11:47:20.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/1274884024 >> v1:172.21.15.110:6789/0 conn(0x7f2dd40e9f80 legacy=0x7f2dd40eb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2348545275 0 0) 0x7f2dc00033f0 con 0x7f2dd4177d00 2022-07-05T11:47:20.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/1274884024 >> v1:172.21.15.90:6789/0 conn(0x7f2dd4177d00 legacy=0x7f2dd40e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/1274884024 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd40c8130 con 0x7f2dd41780e0 2022-07-05T11:47:20.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/1274884024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd417b050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f2dc8009760 tx=0x7f2dc8009060).ready entity=mon.1 client_cookie=6bd7d78f9fb474d8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4001470 con 0x7f2dd41780e0 2022-07-05T11:47:20.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8011400 con 0x7f2dd41780e0 2022-07-05T11:47:20.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.208+0000 7f2dd27fc700 1 -- 172.21.15.90:0/1274884024 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011780 con 0x7f2dd41780e0 2022-07-05T11:47:20.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.209+0000 7f2dd8942700 1 -- 172.21.15.90:0/1274884024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 msgr2=0x7f2dd417b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.209+0000 7f2dd8942700 1 --2- 172.21.15.90:0/1274884024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd417b050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f2dc8009760 tx=0x7f2dc8009060).stop 2022-07-05T11:47:20.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.209+0000 7f2dd8942700 1 -- 172.21.15.90:0/1274884024 shutdown_connections 2022-07-05T11:47:20.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.209+0000 7f2dd8942700 1 --2- 172.21.15.90:0/1274884024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd417b050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.209+0000 7f2dd8942700 1 -- 172.21.15.90:0/1274884024 >> 172.21.15.90:0/1274884024 conn(0x7f2dd40ed8d0 msgr2=0x7f2dd40edce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.209+0000 7f2dd8942700 1 -- 172.21.15.90:0/1274884024 shutdown_connections 2022-07-05T11:47:20.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.209+0000 7f2dd8942700 1 -- 172.21.15.90:0/1274884024 wait complete. 2022-07-05T11:47:20.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.210+0000 7f2dd8942700 1 Processor -- start 2022-07-05T11:47:20.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.210+0000 7f2dd8942700 1 -- start start 2022-07-05T11:47:20.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd8942700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40e9f80 0x7f2dd416cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd8942700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd4177d00 0x7f2dd416e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd8942700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd4162b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd8942700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd4163080 con 0x7f2dd40e9f80 2022-07-05T11:47:20.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd8942700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd416e150 con 0x7f2dd41780e0 2022-07-05T11:47:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd8942700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd416d260 con 0x7f2dd4177d00 2022-07-05T11:47:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40e9f80 0x7f2dd416cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40e9f80 0x7f2dd416cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58306/0 (socket says 172.21.15.90:58306) 2022-07-05T11:47:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.211+0000 7f2dd37fe700 1 -- 172.21.15.90:0/819781796 learned_addr learned my addr 172.21.15.90:0/819781796 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd4177d00 0x7f2dd416e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd4162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd37fe700 1 -- 172.21.15.90:0/819781796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd4177d00 msgr2=0x7f2dd416e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd4177d00 0x7f2dd416e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd37fe700 1 -- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 msgr2=0x7f2dd4162b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd4162b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd37fe700 1 -- 172.21.15.90:0/819781796 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80092a0 con 0x7f2dd40e9f80 2022-07-05T11:47:20.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd4162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:20.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd4177d00 0x7f2dd416e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:20.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40e9f80 0x7f2dd416cc00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f2dc400c830 tx=0x7f2dc4001a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dbb7fe700 1 -- 172.21.15.90:0/819781796 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4007170 con 0x7f2dd40e9f80 2022-07-05T11:47:20.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd416d540 con 0x7f2dd40e9f80 2022-07-05T11:47:20.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dbb7fe700 1 -- 172.21.15.90:0/819781796 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc40072d0 con 0x7f2dd40e9f80 2022-07-05T11:47:20.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd416db00 con 0x7f2dd40e9f80 2022-07-05T11:47:20.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.212+0000 7f2dbb7fe700 1 -- 172.21.15.90:0/819781796 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40048c0 con 0x7f2dd40e9f80 2022-07-05T11:47:20.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.215+0000 7f2dbb7fe700 1 -- 172.21.15.90:0/819781796 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2dc4010070 con 0x7f2dd40e9f80 2022-07-05T11:47:20.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.216+0000 7f2dbb7fe700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2db408ba40 0x7f2db408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.216+0000 7f2dbb7fe700 1 -- 172.21.15.90:0/819781796 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f2dc40b03b0 con 0x7f2dd40e9f80 2022-07-05T11:47:20.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.216+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2db408ba40 0x7f2db408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.216+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2db408ba40 0x7f2db408df00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2dd41784c0 tx=0x7f2dc8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.217+0000 7f2deb530b80 1 Processor -- start 2022-07-05T11:47:20.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.217+0000 7f2deb530b80 1 -- start start 2022-07-05T11:47:20.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9a988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ae6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9adcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2deb530b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9a622d0 con 0x55bad9a98da0 2022-07-05T11:47:20.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2deb530b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad99d9aa0 con 0x55bad9adc4b0 2022-07-05T11:47:20.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2deb530b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad99ee950 con 0x55bad9adc890 2022-07-05T11:47:20.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2dd2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ae6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2dd2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ae6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58318/0 (socket says 172.21.15.90:58318) 2022-07-05T11:47:20.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/354368951 learned_addr learned my addr 172.21.15.90:0/354368951 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.218+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9a988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9adcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/354368951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 msgr2=0x55bad9adcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9adcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/354368951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 msgr2=0x55bad9a988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9a988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/354368951 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bad98209e0 con 0x55bad9a98da0 2022-07-05T11:47:20.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9a988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:20.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ae6a80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f2dc8000d90 tx=0x7f2dc801f000).ready entity=mon.0 client_cookie=6b3bbba7104c6983 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2db8ff9700 1 -- 172.21.15.90:0/354368951 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc801e4e0 con 0x55bad9a98da0 2022-07-05T11:47:20.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2db8ff9700 1 -- 172.21.15.90:0/354368951 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc801e640 con 0x55bad9a98da0 2022-07-05T11:47:20.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.219+0000 7f2db8ff9700 1 -- 172.21.15.90:0/354368951 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc801e9c0 con 0x55bad9a98da0 2022-07-05T11:47:20.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 -- 172.21.15.90:0/354368951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 msgr2=0x55bad9ae6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ae6a80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f2dc8000d90 tx=0x7f2dc801f000).stop 2022-07-05T11:47:20.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 -- 172.21.15.90:0/354368951 shutdown_connections 2022-07-05T11:47:20.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9adcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9a988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 --2- 172.21.15.90:0/354368951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ae6a80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 -- 172.21.15.90:0/354368951 >> 172.21.15.90:0/354368951 conn(0x55bad99071c0 msgr2=0x55bad9a9bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 -- 172.21.15.90:0/354368951 shutdown_connections 2022-07-05T11:47:20.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.220+0000 7f2deb530b80 1 -- 172.21.15.90:0/354368951 wait complete. 2022-07-05T11:47:20.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.221+0000 7f2deb530b80 1 -- start start 2022-07-05T11:47:20.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.221+0000 7f2deb530b80 1 Processor -- start 2022-07-05T11:47:20.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9a98da0 0x55bad9b1ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc4b0 0x55bad9b05310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc890 0x55bad9ad6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2deb530b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad99b6120 con 0x55bad9adc890 2022-07-05T11:47:20.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2deb530b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9b1bf60 con 0x55bad9a98da0 2022-07-05T11:47:20.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2deb530b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9b05800 con 0x55bad9adc4b0 2022-07-05T11:47:20.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2deb530b80 10 client.0 ll_register_callbacks cb 0x55bad9a5c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:20.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2dd3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc890 0x55bad9ad6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2dd3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc890 0x55bad9ad6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58322/0 (socket says 172.21.15.90:58322) 2022-07-05T11:47:20.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2dd3fff700 1 -- 172.21.15.90:0/3523302604 learned_addr learned my addr 172.21.15.90:0/3523302604 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9a98da0 0x55bad9b1ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc4b0 0x55bad9b05310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2dd3fff700 1 -- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc4b0 msgr2=0x55bad9b05310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.223+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc4b0 0x55bad9b05310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2dd3fff700 1 -- 172.21.15.90:0/3523302604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9a98da0 msgr2=0x55bad9b1ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9a98da0 0x55bad9b1ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2dd3fff700 1 -- 172.21.15.90:0/3523302604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd416db00 con 0x55bad9adc890 2022-07-05T11:47:20.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc890 0x55bad9ad6710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f2dcc00f600 tx=0x7f2dcc009040).ready entity=mon.0 client_cookie=7eb8d6c5b7573177 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2db1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:20.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2db1ffb700 1 -- 172.21.15.90:0/3523302604 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0114c0 con 0x55bad9adc890 2022-07-05T11:47:20.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2db1ffb700 1 -- 172.21.15.90:0/3523302604 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f2dcc011620 con 0x55bad9adc890 2022-07-05T11:47:20.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bad9a96690 con 0x55bad9adc890 2022-07-05T11:47:20.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2db1ffb700 1 -- 172.21.15.90:0/3523302604 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dcc0119f0 con 0x55bad9adc890 2022-07-05T11:47:20.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2deb530b80 10 client.5238 fetch_fsmap learned FSMap version 14 2022-07-05T11:47:20.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f2dd40c8130 con 0x55bad9adc890 2022-07-05T11:47:20.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2db1ffb700 1 -- 172.21.15.90:0/3523302604 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bad9a96690 con 0x55bad9adc890 2022-07-05T11:47:20.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2db1ffb700 1 -- 172.21.15.90:0/3523302604 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f2dcc012070 con 0x55bad9adc890 2022-07-05T11:47:20.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.224+0000 7f2deb530b80 10 client.5238 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:47:20.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2deb530b80 10 client.5238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:20.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2deb530b80 20 client.5238 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:20.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2deb530b80 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ad6c00 0x55bad9b1dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2deb530b80 4 client.5238 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:47:20.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bad99e47f0 con 0x55bad9ad6c00 2022-07-05T11:47:20.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ad6c00 0x55bad9b1dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2db1ffb700 10 client.5238 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.225+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ad6c00 0x55bad9b1dd80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ec4906252b447a33 server_cookie=9cf0f1ce2964fdb8 in_seq=0 out_seq=0 2022-07-05T11:47:20.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2db1ffb700 1 -- 172.21.15.90:0/3523302604 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55bad99e47f0 con 0x55bad9ad6c00 2022-07-05T11:47:20.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2db1ffb700 10 client.5238 handle_command_reply: tid=0 2022-07-05T11:47:20.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 client.5238 shutdown 2022-07-05T11:47:20.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc890 msgr2=0x55bad9ad6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc890 0x55bad9ad6710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f2dcc00f600 tx=0x7f2dcc009040).stop 2022-07-05T11:47:20.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 shutdown_connections 2022-07-05T11:47:20.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ad6c00 0x55bad9b1dd80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc890 0x55bad9ad6710 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9a98da0 0x55bad9b1ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 --2- 172.21.15.90:0/3523302604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc4b0 0x55bad9b05310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 >> 172.21.15.90:0/3523302604 conn(0x55bad99071c0 msgr2=0x55bad9a9bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2db1ffb700 0 client.5238 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 shutdown_connections 2022-07-05T11:47:20.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 1 -- 172.21.15.90:0/3523302604 wait complete. 2022-07-05T11:47:20.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.226+0000 7f2deb530b80 20 client.5238 trim_cache size 0 max 16384 2022-07-05T11:47:20.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.242+0000 7f2deb530b80 1 Processor -- start 2022-07-05T11:47:20.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.242+0000 7f2deb530b80 1 -- start start 2022-07-05T11:47:20.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ad2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9adda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9b1dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2deb530b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9b0e8d0 con 0x55bad9a98da0 2022-07-05T11:47:20.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2deb530b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9ae5e20 con 0x55bad9adc4b0 2022-07-05T11:47:20.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2deb530b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9ae5340 con 0x55bad9adc890 2022-07-05T11:47:20.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ad2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ad2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58328/0 (socket says 172.21.15.90:58328) 2022-07-05T11:47:20.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 -- 172.21.15.90:0/4191758662 learned_addr learned my addr 172.21.15.90:0/4191758662 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9adda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9b1dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 -- 172.21.15.90:0/4191758662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 msgr2=0x55bad9b1dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9b1dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 -- 172.21.15.90:0/4191758662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 msgr2=0x55bad9adda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9adda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 -- 172.21.15.90:0/4191758662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bad988fcd0 con 0x55bad9a98da0 2022-07-05T11:47:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9b1dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:47:20.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ad2360 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f2dc40849f0 tx=0x7f2dc4016040).ready entity=mon.0 client_cookie=c708a2d0f3d36010 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.243+0000 7f2db97fa700 1 -- 172.21.15.90:0/4191758662 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4090070 con 0x55bad9a98da0 2022-07-05T11:47:20.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2db97fa700 1 -- 172.21.15.90:0/4191758662 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc40b0040 con 0x55bad9a98da0 2022-07-05T11:47:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2db97fa700 1 -- 172.21.15.90:0/4191758662 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40af040 con 0x55bad9a98da0 2022-07-05T11:47:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 -- 172.21.15.90:0/4191758662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 msgr2=0x55bad9ad2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ad2360 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f2dc40849f0 tx=0x7f2dc4016040).stop 2022-07-05T11:47:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 -- 172.21.15.90:0/4191758662 shutdown_connections 2022-07-05T11:47:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9adc890 0x55bad9b1dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9a98da0 0x55bad9ad2360 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 --2- 172.21.15.90:0/4191758662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc4b0 0x55bad9adda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 -- 172.21.15.90:0/4191758662 >> 172.21.15.90:0/4191758662 conn(0x55bad99071c0 msgr2=0x55bad9aa2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 -- 172.21.15.90:0/4191758662 shutdown_connections 2022-07-05T11:47:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.244+0000 7f2deb530b80 1 -- 172.21.15.90:0/4191758662 wait complete. 2022-07-05T11:47:20.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.245+0000 7f2deb530b80 1 -- start start 2022-07-05T11:47:20.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.245+0000 7f2deb530b80 1 Processor -- start 2022-07-05T11:47:20.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9a98da0 0x55bad9b1a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc4b0 0x55bad9ad5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2deb530b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc890 0x55bad9adb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2deb530b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9ad63e0 con 0x55bad9adc4b0 2022-07-05T11:47:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2deb530b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9a97bf0 con 0x55bad9adc890 2022-07-05T11:47:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2deb530b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad9adbe20 con 0x55bad9a98da0 2022-07-05T11:47:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2deb530b80 10 client.0 ll_register_callbacks cb 0x55bad9a5c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2dd37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9a98da0 0x55bad9b1a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2dd2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc4b0 0x55bad9ad5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2dd37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9a98da0 0x55bad9b1a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39730/0 (socket says 172.21.15.90:39730) 2022-07-05T11:47:20.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2dd37fe700 1 -- 172.21.15.90:0/2308747073 learned_addr learned my addr 172.21.15.90:0/2308747073 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:20.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.247+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc890 0x55bad9adb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/2308747073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9a98da0 msgr2=0x55bad9b1a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9a98da0 0x55bad9b1a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/2308747073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc890 msgr2=0x55bad9adb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:20.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc890 0x55bad9adb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2dd2ffd700 1 -- 172.21.15.90:0/2308747073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc4053040 con 0x55bad9adc4b0 2022-07-05T11:47:20.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2dd3fff700 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc890 0x55bad9adb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:20.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2dd2ffd700 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc4b0 0x55bad9ad5ef0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f2dc802b000 tx=0x7f2dc8029000).ready entity=mon.0 client_cookie=6becc28bd9ff976b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2db1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2db1ffb700 1 -- 172.21.15.90:0/2308747073 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011990 con 0x55bad9adc4b0 2022-07-05T11:47:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2db1ffb700 1 -- 172.21.15.90:0/2308747073 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f2dc8033650 con 0x55bad9adc4b0 2022-07-05T11:47:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2dc801e640 con 0x55bad9adc4b0 2022-07-05T11:47:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2db1ffb700 1 -- 172.21.15.90:0/2308747073 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dc8033a20 con 0x55bad9adc4b0 2022-07-05T11:47:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2deb530b80 10 client.5244 fetch_fsmap learned FSMap version 14 2022-07-05T11:47:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.248+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55bad985dfd0 con 0x55bad9adc4b0 2022-07-05T11:47:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2db1ffb700 1 -- 172.21.15.90:0/2308747073 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc801e640 con 0x55bad9adc4b0 2022-07-05T11:47:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2db1ffb700 1 -- 172.21.15.90:0/2308747073 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f2dc8026030 con 0x55bad9adc4b0 2022-07-05T11:47:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2deb530b80 10 client.5244 fetch_fsmap finished waiting for FSMap version 14 2022-07-05T11:47:20.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2deb530b80 10 client.5244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:20.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2deb530b80 20 client.5244 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:20.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2deb530b80 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ade690 0x55bad9a96f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:20.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2deb530b80 4 client.5244 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:47:20.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bad99db690 con 0x55bad9ade690 2022-07-05T11:47:20.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ade690 0x55bad9a96f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:20.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2db1ffb700 10 client.5244 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.249+0000 7f2dd37fe700 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ade690 0x55bad9a96f20 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fe01ff60f2464bb9 server_cookie=fe69fcc046fd683f in_seq=0 out_seq=0 2022-07-05T11:47:20.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2db1ffb700 1 -- 172.21.15.90:0/2308747073 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bad99db690 con 0x55bad9ade690 2022-07-05T11:47:20.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2db1ffb700 10 client.5244 handle_command_reply: tid=0 2022-07-05T11:47:20.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 client.5244 shutdown 2022-07-05T11:47:20.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc4b0 msgr2=0x55bad9ad5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc4b0 0x55bad9ad5ef0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f2dc802b000 tx=0x7f2dc8029000).stop 2022-07-05T11:47:20.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 shutdown_connections 2022-07-05T11:47:20.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bad9ade690 0x55bad9a96f20 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bad9adc890 0x55bad9adb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2db1ffb700 0 client.5244 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:20.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bad9a98da0 0x55bad9b1a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 --2- 172.21.15.90:0/2308747073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bad9adc4b0 0x55bad9ad5ef0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 >> 172.21.15.90:0/2308747073 conn(0x55bad99071c0 msgr2=0x55bad9b1a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 shutdown_connections 2022-07-05T11:47:20.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 1 -- 172.21.15.90:0/2308747073 wait complete. 2022-07-05T11:47:20.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2deb530b80 20 client.5244 trim_cache size 0 max 16384 2022-07-05T11:47:20.311 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:47:20.311 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:47:20.312 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:47:20.312 INFO:teuthology.orchestra.run.smithi090.stdout: "61ce829f-75af-485e-9bb3-ac2780446cff": { 2022-07-05T11:47:20.312 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:47:20.313 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "61ce829f-75af-485e-9bb3-ac2780446cff", 2022-07-05T11:47:20.313 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:47:20.313 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:47:20.313 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:47:20.314 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:47:20.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2db408ba40 msgr2=0x7f2db408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2dd8942700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2db408ba40 0x7f2db408df00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2dd41784c0 tx=0x7f2dc8016000).stop 2022-07-05T11:47:20.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40e9f80 msgr2=0x7f2dd416cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:20.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.250+0000 7f2dd8942700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40e9f80 0x7f2dd416cc00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f2dc400c830 tx=0x7f2dc4001a60).stop 2022-07-05T11:47:20.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 shutdown_connections 2022-07-05T11:47:20.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f2db408ba40 0x7f2db408df00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd41780e0 0x7f2dd4162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40e9f80 0x7f2dd416cc00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 --2- 172.21.15.90:0/819781796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd4177d00 0x7f2dd416e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:20.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 >> 172.21.15.90:0/819781796 conn(0x7f2dd40ed8d0 msgr2=0x7f2dd4179d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:20.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 shutdown_connections 2022-07-05T11:47:20.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:20.251+0000 7f2dd8942700 1 -- 172.21.15.90:0/819781796 wait complete. 2022-07-05T11:47:20.333 INFO:tasks.cephfs.filesystem:scrub status for tag:61ce829f-75af-485e-9bb3-ac2780446cff - {'path': '/', 'tag': '61ce829f-75af-485e-9bb3-ac2780446cff', 'options': 'recursive,force'} 2022-07-05T11:47:32.873 INFO:tasks.workunit.client.0.smithi090.stderr:Note: switching to 'c4a8e5d15163d588b25b033c25ae416600cffaa5'. 2022-07-05T11:47:32.873 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:32.874 INFO:tasks.workunit.client.0.smithi090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-07-05T11:47:32.874 INFO:tasks.workunit.client.0.smithi090.stderr:changes and commit them, and you can discard any commits you make in this 2022-07-05T11:47:32.874 INFO:tasks.workunit.client.0.smithi090.stderr:state without impacting any branches by switching back to a branch. 2022-07-05T11:47:32.875 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:32.875 INFO:tasks.workunit.client.0.smithi090.stderr:If you want to create a new branch to retain commits you create, you may 2022-07-05T11:47:32.876 INFO:tasks.workunit.client.0.smithi090.stderr:do so (now or later) by using -c with the switch command. Example: 2022-07-05T11:47:32.876 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:32.877 INFO:tasks.workunit.client.0.smithi090.stderr: git switch -c 2022-07-05T11:47:32.877 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:32.877 INFO:tasks.workunit.client.0.smithi090.stderr:Or undo this operation with: 2022-07-05T11:47:32.878 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:32.878 INFO:tasks.workunit.client.0.smithi090.stderr: git switch - 2022-07-05T11:47:32.879 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:32.879 INFO:tasks.workunit.client.0.smithi090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-07-05T11:47:32.879 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:32.879 INFO:tasks.workunit.client.0.smithi090.stderr:HEAD is now at c4a8e5d1516 Merge pull request #46531 from rhcs-dashboard/wip-55752-pacific 2022-07-05T11:47:32.882 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-07-05T11:47:32.908 INFO:tasks.workunit.client.0.smithi090.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-07-05T11:47:32.911 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-07-05T11:47:32.911 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-07-05T11:47:33.502 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-07-05T11:47:33.634 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-07-05T11:47:33.671 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-07-05T11:47:33.671 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-07-05T11:47:33.672 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-07-05T11:47:33.705 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-07-05T11:47:33.708 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2022-07-05T11:47:33.709 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2022-07-05T11:47:33.725 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2022-07-05T11:47:33.726 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2022-07-05T11:47:33.727 DEBUG:teuthology.orchestra.run.smithi090:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c4a8e5d15163d588b25b033c25ae416600cffaa5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2022-07-05T11:47:33.792 INFO:tasks.workunit.client.0.smithi090.stdout:getting blogbench 2022-07-05T11:47:33.809 INFO:tasks.workunit.client.0.smithi090.stderr:--2022-07-05 11:47:33-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2022-07-05T11:47:33.810 INFO:tasks.workunit.client.0.smithi090.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2022-07-05T11:47:33.831 INFO:tasks.workunit.client.0.smithi090.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2022-07-05T11:47:33.852 INFO:tasks.workunit.client.0.smithi090.stderr:HTTP request sent, awaiting response... 200 OK 2022-07-05T11:47:33.852 INFO:tasks.workunit.client.0.smithi090.stderr:Length: 103355 (101K) [application/octet-stream] 2022-07-05T11:47:33.853 INFO:tasks.workunit.client.0.smithi090.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2022-07-05T11:47:33.857 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:33.893 INFO:tasks.workunit.client.0.smithi090.stderr: 0K .......... .......... .......... .......... .......... 49% 1.27M 0s 2022-07-05T11:47:33.913 INFO:tasks.workunit.client.0.smithi090.stderr: 50K .......... .......... .......... .......... .......... 99% 2.43M 0s 2022-07-05T11:47:33.914 INFO:tasks.workunit.client.0.smithi090.stderr: 100K 100% 1779G=0.06s 2022-07-05T11:47:33.914 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:33.914 INFO:tasks.workunit.client.0.smithi090.stderr:2022-07-05 11:47:33 (1.69 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2022-07-05T11:47:33.915 INFO:tasks.workunit.client.0.smithi090.stderr: 2022-07-05T11:47:33.939 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/ 2022-07-05T11:47:33.941 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/m4/ 2022-07-05T11:47:33.942 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/m4/acx_pthread.m4 2022-07-05T11:47:33.943 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/man/ 2022-07-05T11:47:33.945 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/man/blogbench.8 2022-07-05T11:47:33.946 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/man/Makefile.am 2022-07-05T11:47:33.946 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/man/Makefile.in 2022-07-05T11:47:33.946 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/ 2022-07-05T11:47:33.949 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/mysnprintf.c 2022-07-05T11:47:33.953 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/mysnprintf.h 2022-07-05T11:47:33.954 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/blogbench.c 2022-07-05T11:47:33.954 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/blogbench.h 2022-07-05T11:47:33.955 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/fakesnprintf.c 2022-07-05T11:47:33.955 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/fakesnprintf.h 2022-07-05T11:47:33.956 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/blogbench_p.h 2022-07-05T11:47:33.956 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/bsd-getopt_long.c 2022-07-05T11:47:33.957 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/bsd-getopt_long.h 2022-07-05T11:47:33.957 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/Makefile.am 2022-07-05T11:47:33.958 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/Makefile.in 2022-07-05T11:47:33.958 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/process.c 2022-07-05T11:47:33.959 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/globals.h 2022-07-05T11:47:33.959 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/commenter.c 2022-07-05T11:47:33.960 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/rewriter.c 2022-07-05T11:47:33.960 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/reader.c 2022-07-05T11:47:33.960 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/writer.c 2022-07-05T11:47:33.961 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/src/helpers.c 2022-07-05T11:47:33.961 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/NEWS 2022-07-05T11:47:33.965 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/compile 2022-07-05T11:47:33.966 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/depcomp 2022-07-05T11:47:33.966 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/aclocal.m4 2022-07-05T11:47:33.966 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/README 2022-07-05T11:47:33.966 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/configure 2022-07-05T11:47:33.968 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/configure.ac 2022-07-05T11:47:33.968 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/config.guess 2022-07-05T11:47:33.970 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/install-sh 2022-07-05T11:47:33.970 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/config.sub 2022-07-05T11:47:33.971 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/missing 2022-07-05T11:47:33.971 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/mkinstalldirs 2022-07-05T11:47:33.971 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/Makefile.am 2022-07-05T11:47:33.971 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/Makefile.in 2022-07-05T11:47:33.972 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/config.h.in 2022-07-05T11:47:33.972 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/AUTHORS 2022-07-05T11:47:33.972 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/INSTALL 2022-07-05T11:47:33.972 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/ChangeLog 2022-07-05T11:47:33.973 INFO:tasks.workunit.client.0.smithi090.stdout:blogbench-1.0/COPYING 2022-07-05T11:47:33.973 INFO:tasks.workunit.client.0.smithi090.stdout:making blogbench 2022-07-05T11:47:34.064 INFO:tasks.workunit.client.0.smithi090.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-07-05T11:47:35.070 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether build environment is sane... yes 2022-07-05T11:47:35.078 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gawk... gawk 2022-07-05T11:47:35.093 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether make sets $(MAKE)... yes 2022-07-05T11:47:35.102 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc... gcc 2022-07-05T11:47:35.153 INFO:tasks.workunit.client.0.smithi090.stdout:checking for C compiler default output file name... a.out 2022-07-05T11:47:35.154 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether the C compiler works... yes 2022-07-05T11:47:35.156 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are cross compiling... no 2022-07-05T11:47:35.192 INFO:tasks.workunit.client.0.smithi090.stdout:checking for suffix of executables... 2022-07-05T11:47:35.226 INFO:tasks.workunit.client.0.smithi090.stdout:checking for suffix of object files... o 2022-07-05T11:47:35.255 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are using the GNU C compiler... yes 2022-07-05T11:47:35.282 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether gcc accepts -g... yes 2022-07-05T11:47:35.347 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc option to accept ANSI C... none needed 2022-07-05T11:47:35.375 INFO:tasks.workunit.client.0.smithi090.stdout:checking for style of include used by make... GNU 2022-07-05T11:47:35.453 INFO:tasks.workunit.client.0.smithi090.stdout:checking dependency style of gcc... gcc3 2022-07-05T11:47:35.454 INFO:tasks.workunit.client.0.smithi090.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-07-05T11:47:35.502 INFO:tasks.workunit.client.0.smithi090.stdout:checking how to run the C preprocessor... gcc -E 2022-07-05T11:47:35.528 INFO:tasks.workunit.client.0.smithi090.stdout:checking for egrep... grep -E 2022-07-05T11:47:35.535 INFO:tasks.workunit.client.0.smithi090.stdout:checking for AIX... no 2022-07-05T11:47:35.591 INFO:tasks.workunit.client.0.smithi090.stdout:checking for library containing strerror... none required 2022-07-05T11:47:35.766 INFO:tasks.workunit.client.0.smithi090.stdout:checking for ANSI C header files... yes 2022-07-05T11:47:35.804 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether time.h and sys/time.h may both be included... yes 2022-07-05T11:47:35.853 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/types.h... yes 2022-07-05T11:47:35.889 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/stat.h... yes 2022-07-05T11:47:35.931 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdlib.h... yes 2022-07-05T11:47:35.974 INFO:tasks.workunit.client.0.smithi090.stdout:checking for string.h... yes 2022-07-05T11:47:36.017 INFO:tasks.workunit.client.0.smithi090.stdout:checking for memory.h... yes 2022-07-05T11:47:36.063 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strings.h... yes 2022-07-05T11:47:36.109 INFO:tasks.workunit.client.0.smithi090.stdout:checking for inttypes.h... yes 2022-07-05T11:47:36.157 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdint.h... yes 2022-07-05T11:47:36.196 INFO:tasks.workunit.client.0.smithi090.stdout:checking for unistd.h... yes 2022-07-05T11:47:36.208 INFO:tasks.workunit.client.0.smithi090.stdout:checking for memory.h... (cached) yes 2022-07-05T11:47:36.212 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strings.h... (cached) yes 2022-07-05T11:47:36.218 INFO:tasks.workunit.client.0.smithi090.stdout:checking for unistd.h... (cached) yes 2022-07-05T11:47:36.283 INFO:tasks.workunit.client.0.smithi090.stdout:checking locale.h usability... yes 2022-07-05T11:47:36.298 INFO:tasks.workunit.client.0.smithi090.stdout:checking locale.h presence... yes 2022-07-05T11:47:36.298 INFO:tasks.workunit.client.0.smithi090.stdout:checking for locale.h... yes 2022-07-05T11:47:36.315 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdlib.h... (cached) yes 2022-07-05T11:47:36.316 INFO:tasks.workunit.client.0.smithi090.stdout:checking for string.h... (cached) yes 2022-07-05T11:47:36.371 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/socket.h usability... yes 2022-07-05T11:47:36.388 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/socket.h presence... yes 2022-07-05T11:47:36.388 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/socket.h... yes 2022-07-05T11:47:36.431 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/time.h usability... yes 2022-07-05T11:47:36.445 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/time.h presence... yes 2022-07-05T11:47:36.446 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/time.h... yes 2022-07-05T11:47:36.491 INFO:tasks.workunit.client.0.smithi090.stdout:checking fcntl.h usability... yes 2022-07-05T11:47:36.505 INFO:tasks.workunit.client.0.smithi090.stdout:checking fcntl.h presence... yes 2022-07-05T11:47:36.505 INFO:tasks.workunit.client.0.smithi090.stdout:checking for fcntl.h... yes 2022-07-05T11:47:36.571 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/fcntl.h usability... yes 2022-07-05T11:47:36.577 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/fcntl.h presence... yes 2022-07-05T11:47:36.577 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/fcntl.h... yes 2022-07-05T11:47:36.668 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/param.h usability... yes 2022-07-05T11:47:36.685 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/param.h presence... yes 2022-07-05T11:47:36.686 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/param.h... yes 2022-07-05T11:47:36.719 INFO:tasks.workunit.client.0.smithi090.stdout:checking ioctl.h usability... no 2022-07-05T11:47:36.735 INFO:tasks.workunit.client.0.smithi090.stdout:checking ioctl.h presence... no 2022-07-05T11:47:36.736 INFO:tasks.workunit.client.0.smithi090.stdout:checking for ioctl.h... no 2022-07-05T11:47:36.781 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/ioctl.h usability... yes 2022-07-05T11:47:36.794 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/ioctl.h presence... yes 2022-07-05T11:47:36.794 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/ioctl.h... yes 2022-07-05T11:47:36.838 INFO:tasks.workunit.client.0.smithi090.stdout:checking return type of signal handlers... void 2022-07-05T11:47:36.871 INFO:tasks.workunit.client.0.smithi090.stdout:checking for size_t... yes 2022-07-05T11:47:36.903 INFO:tasks.workunit.client.0.smithi090.stdout:checking for dev_t... yes 2022-07-05T11:47:36.940 INFO:tasks.workunit.client.0.smithi090.stdout:checking for short... yes 2022-07-05T11:47:37.005 INFO:tasks.workunit.client.0.smithi090.stdout:checking size of short... 2 2022-07-05T11:47:37.044 INFO:tasks.workunit.client.0.smithi090.stdout:checking for int... yes 2022-07-05T11:47:37.103 INFO:tasks.workunit.client.0.smithi090.stdout:checking size of int... 4 2022-07-05T11:47:37.140 INFO:tasks.workunit.client.0.smithi090.stdout:checking for long... yes 2022-07-05T11:47:37.198 INFO:tasks.workunit.client.0.smithi090.stdout:checking size of long... 8 2022-07-05T11:47:37.237 INFO:tasks.workunit.client.0.smithi090.stdout:checking for long long... yes 2022-07-05T11:47:37.294 INFO:tasks.workunit.client.0.smithi090.stdout:checking size of long long... 8 2022-07-05T11:47:37.337 INFO:tasks.workunit.client.0.smithi090.stdout:checking for ssize_t... yes 2022-07-05T11:47:37.363 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sig_atomic_t... yes 2022-07-05T11:47:37.400 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether gcc needs -traditional... no 2022-07-05T11:47:37.428 INFO:tasks.workunit.client.0.smithi090.stdout:checking for an ANSI C-conforming const... yes 2022-07-05T11:47:37.446 INFO:tasks.workunit.client.0.smithi090.stdout:checking for inline... inline 2022-07-05T11:47:37.501 INFO:tasks.workunit.client.0.smithi090.stdout:checking for working alloca.h... yes 2022-07-05T11:47:37.537 INFO:tasks.workunit.client.0.smithi090.stdout:checking for alloca... yes 2022-07-05T11:47:37.596 INFO:tasks.workunit.client.0.smithi090.stdout:checking for working memcmp... yes 2022-07-05T11:47:37.642 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strftime... yes 2022-07-05T11:47:37.706 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2022-07-05T11:47:37.759 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether stat accepts an empty string... no 2022-07-05T11:47:37.806 INFO:tasks.workunit.client.0.smithi090.stdout:checking for vprintf... yes 2022-07-05T11:47:37.855 INFO:tasks.workunit.client.0.smithi090.stdout:checking for _doprnt... no 2022-07-05T11:47:37.877 INFO:tasks.workunit.client.0.smithi090.stdout:checking build system type... x86_64-unknown-linux-gnu 2022-07-05T11:47:37.889 INFO:tasks.workunit.client.0.smithi090.stdout:checking host system type... x86_64-unknown-linux-gnu 2022-07-05T11:47:37.946 INFO:tasks.workunit.client.0.smithi090.stdout:checking for the pthreads library -lpthreads... no 2022-07-05T11:47:37.990 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether pthreads work without any flags... no 2022-07-05T11:47:38.002 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether pthreads work with -Kthread... no 2022-07-05T11:47:38.014 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether pthreads work with -kthread... no 2022-07-05T11:47:38.050 INFO:tasks.workunit.client.0.smithi090.stdout:checking for the pthreads library -llthread... no 2022-07-05T11:47:38.098 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether pthreads work with -pthread... yes 2022-07-05T11:47:38.134 INFO:tasks.workunit.client.0.smithi090.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2022-07-05T11:47:38.135 INFO:tasks.workunit.client.0.smithi090.stdout:checking if more special flags are required for pthreads... no 2022-07-05T11:47:38.135 INFO:tasks.workunit.client.0.smithi090.stdout:checking for cc_r... gcc 2022-07-05T11:47:38.209 INFO:tasks.workunit.client.0.smithi090.stdout:checking for setrlimit... yes 2022-07-05T11:47:38.261 INFO:tasks.workunit.client.0.smithi090.stdout:checking for setproctitle... no 2022-07-05T11:47:38.310 INFO:tasks.workunit.client.0.smithi090.stdout:checking for getopt_long... yes 2022-07-05T11:47:38.365 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strtoull... yes 2022-07-05T11:47:38.415 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strtoq... yes 2022-07-05T11:47:38.467 INFO:tasks.workunit.client.0.smithi090.stdout:checking for snprintf... yes 2022-07-05T11:47:38.521 INFO:tasks.workunit.client.0.smithi090.stdout:checking for vsnprintf... yes 2022-07-05T11:47:38.579 INFO:tasks.workunit.client.0.smithi090.stdout:checking for vfprintf... yes 2022-07-05T11:47:38.628 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gethostname... yes 2022-07-05T11:47:38.681 INFO:tasks.workunit.client.0.smithi090.stdout:checking for setlocale... yes 2022-07-05T11:47:38.732 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sync... yes 2022-07-05T11:47:38.789 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether snprintf is C99 conformant... done 2022-07-05T11:47:38.799 INFO:tasks.workunit.client.0.smithi090.stdout:configure: creating ./config.status 2022-07-05T11:47:38.923 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating Makefile 2022-07-05T11:47:38.937 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating src/Makefile 2022-07-05T11:47:38.952 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating man/Makefile 2022-07-05T11:47:38.959 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating config.h 2022-07-05T11:47:38.999 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: executing depfiles commands 2022-07-05T11:47:39.115 INFO:tasks.workunit.client.0.smithi090.stdout:make all-recursive 2022-07-05T11:47:39.116 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-07-05T11:47:39.117 INFO:tasks.workunit.client.0.smithi090.stdout:Making all in src 2022-07-05T11:47:39.127 INFO:tasks.workunit.client.0.smithi090.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2022-07-05T11:47:39.128 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2022-07-05T11:47:39.128 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2022-07-05T11:47:39.299 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2022-07-05T11:47:39.300 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2022-07-05T11:47:39.397 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2022-07-05T11:47:39.398 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2022-07-05T11:47:39.455 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2022-07-05T11:47:39.457 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2022-07-05T11:47:39.487 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2022-07-05T11:47:39.488 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2022-07-05T11:47:39.529 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2022-07-05T11:47:39.530 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2022-07-05T11:47:39.571 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2022-07-05T11:47:39.572 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2022-07-05T11:47:39.639 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2022-07-05T11:47:39.640 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2022-07-05T11:47:39.676 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2022-07-05T11:47:39.676 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2022-07-05T11:47:39.710 INFO:tasks.workunit.client.0.smithi090.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2022-07-05T11:47:39.711 INFO:tasks.workunit.client.0.smithi090.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2022-07-05T11:47:39.741 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2022-07-05T11:47:39.759 INFO:tasks.workunit.client.0.smithi090.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2022-07-05T11:47:39.759 INFO:tasks.workunit.client.0.smithi090.stdout:Making all in man 2022-07-05T11:47:39.853 INFO:tasks.workunit.client.0.smithi090.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2022-07-05T11:47:39.853 INFO:tasks.workunit.client.0.smithi090.stdout:make[2]: Nothing to be done for 'all'. 2022-07-05T11:47:39.854 INFO:tasks.workunit.client.0.smithi090.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2022-07-05T11:47:39.854 INFO:tasks.workunit.client.0.smithi090.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-07-05T11:47:39.855 INFO:tasks.workunit.client.0.smithi090.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-07-05T11:47:39.855 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-07-05T11:47:39.857 INFO:tasks.workunit.client.0.smithi090.stdout:running blogbench 2022-07-05T11:47:39.858 INFO:tasks.workunit.client.0.smithi090.stdout: 2022-07-05T11:47:39.858 INFO:tasks.workunit.client.0.smithi090.stdout:Frequency = 10 secs 2022-07-05T11:47:39.859 INFO:tasks.workunit.client.0.smithi090.stdout:Scratch dir = [blogtest_in] 2022-07-05T11:47:43.386 INFO:tasks.workunit.client.0.smithi090.stdout:Spawning 3 writers... 2022-07-05T11:47:43.386 INFO:tasks.workunit.client.0.smithi090.stdout:Spawning 1 rewriters... 2022-07-05T11:47:43.386 INFO:tasks.workunit.client.0.smithi090.stdout:Spawning 5 commenters... 2022-07-05T11:47:43.387 INFO:tasks.workunit.client.0.smithi090.stdout:Spawning 100 readers... 2022-07-05T11:47:43.387 INFO:tasks.workunit.client.0.smithi090.stdout:Benchmarking for 30 iterations. 2022-07-05T11:47:43.387 INFO:tasks.workunit.client.0.smithi090.stdout:The test will run during 5 minutes. 2022-07-05T11:47:43.388 INFO:tasks.workunit.client.0.smithi090.stdout: 2022-07-05T11:47:43.388 INFO:tasks.workunit.client.0.smithi090.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2022-07-05T11:47:48.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:47:48.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:47:48.526 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:47:50.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:47:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.459+0000 7f1f9496f700 1 Processor -- start 2022-07-05T11:47:50.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.459+0000 7f1f9496f700 1 -- start start 2022-07-05T11:47:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f9496f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1f901821b0 0x7f1f90182590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f9496f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1f900c35a0 0x7f1f900c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f9496f700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f900c5300 con 0x7f1f901847a0 2022-07-05T11:47:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f9496f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f90184310 con 0x7f1f900c35a0 2022-07-05T11:47:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f9496f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f90182a80 con 0x7f1f901821b0 2022-07-05T11:47:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f8ed9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1f900c35a0 0x7f1f900c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f8dd9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1f901847a0 0x7f1f90184c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51306/0 (socket says 172.21.15.90:51306) 2022-07-05T11:47:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/2660423883 learned_addr learned my addr 172.21.15.90:0/2660423883 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:47:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/2660423883 >> v2:172.21.15.149:3300/0 conn(0x7f1f901821b0 0x7f1f90182590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.461+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/2660423883 >> v2:172.21.15.149:3300/0 conn(0x7f1f901821b0 msgr2=0x7f1f90182590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.462+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/2660423883 >> v2:172.21.15.149:3300/0 conn(0x7f1f901821b0 0x7f1f90182590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.462+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/2660423883 >> v1:172.21.15.90:6789/0 conn(0x7f1f901847a0 legacy=0x7f1f90184c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.462+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/2660423883 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900c4780 con 0x7f1f900c35a0 2022-07-05T11:47:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.462+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/2660423883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f900c35a0 0x7f1f900c3a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1f90084eb0 tx=0x7f1f88009780).ready entity=mon.1 client_cookie=2d47bee6cd6e1585 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:50.466 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.462+0000 7f1f8d59a700 1 -- 172.21.15.90:0/2660423883 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800e070 con 0x7f1f900c35a0 2022-07-05T11:47:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.462+0000 7f1f8d59a700 1 -- 172.21.15.90:0/2660423883 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800bbf0 con 0x7f1f900c35a0 2022-07-05T11:47:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.463+0000 7f1f9496f700 1 -- 172.21.15.90:0/2660423883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f900c35a0 msgr2=0x7f1f900c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.463+0000 7f1f9496f700 1 --2- 172.21.15.90:0/2660423883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f900c35a0 0x7f1f900c3a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1f90084eb0 tx=0x7f1f88009780).stop 2022-07-05T11:47:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.463+0000 7f1f9496f700 1 -- 172.21.15.90:0/2660423883 shutdown_connections 2022-07-05T11:47:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.463+0000 7f1f9496f700 1 --2- 172.21.15.90:0/2660423883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f900c35a0 0x7f1f900c3a30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.463+0000 7f1f9496f700 1 --2- 172.21.15.90:0/2660423883 >> v2:172.21.15.149:3300/0 conn(0x7f1f901821b0 0x7f1f90182590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.463+0000 7f1f9496f700 1 -- 172.21.15.90:0/2660423883 >> 172.21.15.90:0/2660423883 conn(0x7f1f900edd30 msgr2=0x7f1f9005d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.463+0000 7f1f9496f700 1 -- 172.21.15.90:0/2660423883 shutdown_connections 2022-07-05T11:47:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.464+0000 7f1f9496f700 1 -- 172.21.15.90:0/2660423883 wait complete. 2022-07-05T11:47:50.469 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.466+0000 7f1f9496f700 1 Processor -- start 2022-07-05T11:47:50.470 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.466+0000 7f1f9496f700 1 -- start start 2022-07-05T11:47:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f9496f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900c35a0 0x7f1f90171a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f9496f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f901821b0 0x7f1f90193f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f9496f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f901847a0 0x7f1f90194440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f9496f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900ecae0 con 0x7f1f900c35a0 2022-07-05T11:47:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f9496f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90194930 con 0x7f1f901821b0 2022-07-05T11:47:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f9496f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900ebbf0 con 0x7f1f901847a0 2022-07-05T11:47:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f901847a0 0x7f1f90194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f901847a0 0x7f1f90194440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39770/0 (socket says 172.21.15.90:39770) 2022-07-05T11:47:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/3674563294 learned_addr learned my addr 172.21.15.90:0/3674563294 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.467+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900c35a0 0x7f1f90171a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f901821b0 0x7f1f90193f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8e59c700 1 -- 172.21.15.90:0/3674563294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f901847a0 msgr2=0x7f1f90194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f901847a0 0x7f1f90194440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8e59c700 1 -- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f901821b0 msgr2=0x7f1f90193f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f901821b0 0x7f1f90193f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8e59c700 1 -- 172.21.15.90:0/3674563294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009a20 con 0x7f1f900c35a0 2022-07-05T11:47:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f901847a0 0x7f1f90194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f901821b0 0x7f1f90193f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.468+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900c35a0 0x7f1f90171a30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f1f8000d8c0 tx=0x7f1f80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.469+0000 7f1f7e7fc700 1 -- 172.21.15.90:0/3674563294 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80011590 con 0x7f1f900c35a0 2022-07-05T11:47:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.469+0000 7f1f7e7fc700 1 -- 172.21.15.90:0/3674563294 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f800116f0 con 0x7f1f900c35a0 2022-07-05T11:47:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.469+0000 7f1f7e7fc700 1 -- 172.21.15.90:0/3674563294 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80011a70 con 0x7f1f900c35a0 2022-07-05T11:47:50.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.469+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f900ebed0 con 0x7f1f900c35a0 2022-07-05T11:47:50.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.469+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f900ec490 con 0x7f1f900c35a0 2022-07-05T11:47:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.472+0000 7f1f7e7fc700 1 -- 172.21.15.90:0/3674563294 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f1f8001c460 con 0x7f1f900c35a0 2022-07-05T11:47:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.472+0000 7f1f7e7fc700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1f6c08ba90 0x7f1f6c08df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.473+0000 7f1f7e7fc700 1 -- 172.21.15.90:0/3674563294 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f1f800b06f0 con 0x7f1f900c35a0 2022-07-05T11:47:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.473+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1f6c08ba90 0x7f1f6c08df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.473+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1f6c08ba90 0x7f1f6c08df50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f1f901970a0 tx=0x7f1f84009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.474+0000 7f1fa62fbb80 1 Processor -- start 2022-07-05T11:47:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.474+0000 7f1fa62fbb80 1 -- start start 2022-07-05T11:47:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 0x56310599a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059e8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x5631059dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631059642d0 con 0x5631059de7a0 2022-07-05T11:47:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631058dbaa0 con 0x56310599acb0 2022-07-05T11:47:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631058f0950 con 0x5631059de3c0 2022-07-05T11:47:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1f8dd9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059e8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1f8dd9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059e8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:34700/0 (socket says 172.21.15.90:34700) 2022-07-05T11:47:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/528281478 learned_addr learned my addr 172.21.15.90:0/528281478 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.476+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x5631059dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/528281478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 msgr2=0x56310599a7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:47:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 0x56310599a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:47:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/528281478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 msgr2=0x5631059e8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059e8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/528281478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631057229e0 con 0x5631059de7a0 2022-07-05T11:47:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x5631059dec20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f1f8800b6c0 tx=0x7f1f88009780).ready entity=mon.0 client_cookie=1d408f23fde92c10 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f6b7fe700 1 -- 172.21.15.90:0/528281478 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800bee0 con 0x5631059de7a0 2022-07-05T11:47:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f6b7fe700 1 -- 172.21.15.90:0/528281478 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88022070 con 0x5631059de7a0 2022-07-05T11:47:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.477+0000 7f1f6b7fe700 1 -- 172.21.15.90:0/528281478 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88013ba0 con 0x5631059de7a0 2022-07-05T11:47:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.478+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/528281478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 msgr2=0x5631059dec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.478+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x5631059dec20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f1f8800b6c0 tx=0x7f1f88009780).stop 2022-07-05T11:47:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.478+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/528281478 shutdown_connections 2022-07-05T11:47:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.478+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x5631059dec20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.478+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 0x56310599a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:47:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.478+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/528281478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059e8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.478+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/528281478 >> 172.21.15.90:0/528281478 conn(0x5631058091c0 msgr2=0x56310599dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:50.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.479+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/528281478 shutdown_connections 2022-07-05T11:47:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.479+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/528281478 wait complete. 2022-07-05T11:47:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.480+0000 7f1fa62fbb80 1 -- start start 2022-07-05T11:47:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.480+0000 7f1fa62fbb80 1 Processor -- start 2022-07-05T11:47:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.481+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56310599acb0 0x5631059dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.481+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a0f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.481+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631059de7a0 0x5631059d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.481+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631058b8120 con 0x5631059de3c0 2022-07-05T11:47:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.481+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563105a0f410 con 0x5631059de7a0 2022-07-05T11:47:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.481+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631059dc610 con 0x56310599acb0 2022-07-05T11:47:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1fa62fbb80 10 client.0 ll_register_callbacks cb 0x56310595e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a0f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631059de7a0 0x5631059d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a0f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58388/0 (socket says 172.21.15.90:58388) 2022-07-05T11:47:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/3373673561 learned_addr learned my addr 172.21.15.90:0/3373673561 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56310599acb0 0x5631059dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/3373673561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56310599acb0 msgr2=0x5631059dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56310599acb0 0x5631059dc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/3373673561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631059de7a0 msgr2=0x5631059d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631059de7a0 0x5631059d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/3373673561 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f900c4780 con 0x5631059de3c0 2022-07-05T11:47:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631059de7a0 0x5631059d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a0f8a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f1f84005eb0 tx=0x7f1f8401a040).ready entity=mon.0 client_cookie=78366d2119953217 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:50.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:50.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f68ff9700 1 -- 172.21.15.90:0/3373673561 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8401d040 con 0x5631059de3c0 2022-07-05T11:47:50.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f68ff9700 1 -- 172.21.15.90:0/3373673561 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f1f84013420 con 0x5631059de3c0 2022-07-05T11:47:50.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563105998440 con 0x5631059de3c0 2022-07-05T11:47:50.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f68ff9700 1 -- 172.21.15.90:0/3373673561 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f840137f0 con 0x5631059de3c0 2022-07-05T11:47:50.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1fa62fbb80 10 client.5253 fetch_fsmap learned FSMap version 15 2022-07-05T11:47:50.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563105791cd0 con 0x5631059de3c0 2022-07-05T11:47:50.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.482+0000 7f1f68ff9700 1 -- 172.21.15.90:0/3373673561 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563105998440 con 0x5631059de3c0 2022-07-05T11:47:50.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1f68ff9700 1 -- 172.21.15.90:0/3373673561 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 15) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f1f84013950 con 0x5631059de3c0 2022-07-05T11:47:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1fa62fbb80 10 client.5253 fetch_fsmap finished waiting for FSMap version 15 2022-07-05T11:47:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1fa62fbb80 10 client.5253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1fa62fbb80 20 client.5253 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563105a10e60 0x563105a11240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1fa62fbb80 4 client.5253 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:47:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631058e67f0 con 0x563105a10e60 2022-07-05T11:47:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563105a10e60 0x563105a11240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1f68ff9700 10 client.5253 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.483+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563105a10e60 0x563105a11240 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8bbfaac7f9ce10b4 server_cookie=dc0e605df77b6762 in_seq=0 out_seq=0 2022-07-05T11:47:50.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1f68ff9700 1 -- 172.21.15.90:0/3373673561 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5631058e67f0 con 0x563105a10e60 2022-07-05T11:47:50.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1f68ff9700 10 client.5253 handle_command_reply: tid=0 2022-07-05T11:47:50.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 client.5253 shutdown 2022-07-05T11:47:50.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 msgr2=0x563105a0f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a0f8a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f1f84005eb0 tx=0x7f1f8401a040).stop 2022-07-05T11:47:50.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 shutdown_connections 2022-07-05T11:47:50.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563105a10e60 0x563105a11240 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631059de7a0 0x5631059d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56310599acb0 0x5631059dc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/3373673561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a0f8a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 >> 172.21.15.90:0/3373673561 conn(0x5631058091c0 msgr2=0x563105a0b150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.485+0000 7f1f68ff9700 0 client.5253 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.487+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 shutdown_connections 2022-07-05T11:47:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.487+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/3373673561 wait complete. 2022-07-05T11:47:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.487+0000 7f1fa62fbb80 20 client.5253 trim_cache size 0 max 16384 2022-07-05T11:47:50.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.505+0000 7f1fa62fbb80 1 Processor -- start 2022-07-05T11:47:50.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.505+0000 7f1fa62fbb80 1 -- start start 2022-07-05T11:47:50.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059dda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a661d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de7a0 0x563105a6c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631059def20 con 0x5631059de3c0 2022-07-05T11:47:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563105a0f880 con 0x56310599acb0 2022-07-05T11:47:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631059dc250 con 0x5631059de7a0 2022-07-05T11:47:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1f8dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1f8dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a661d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58396/0 (socket says 172.21.15.90:58396) 2022-07-05T11:47:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/2499683322 learned_addr learned my addr 172.21.15.90:0/2499683322 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.506+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de7a0 0x563105a6c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/2499683322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de7a0 msgr2=0x563105a6c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de7a0 0x563105a6c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/2499683322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 msgr2=0x5631059dda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059dda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f8dd9b700 1 -- 172.21.15.90:0/2499683322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56310575ffd0 con 0x5631059de3c0 2022-07-05T11:47:50.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:50.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f8dd9b700 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a661d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f1f84004c50 tx=0x7f1f84013000).ready entity=mon.0 client_cookie=e9cd6a0fb2abe2e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:50.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f6bfff700 1 -- 172.21.15.90:0/2499683322 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8401d040 con 0x5631059de3c0 2022-07-05T11:47:50.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f6bfff700 1 -- 172.21.15.90:0/2499683322 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f840189d0 con 0x5631059de3c0 2022-07-05T11:47:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.507+0000 7f1f6bfff700 1 -- 172.21.15.90:0/2499683322 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84013420 con 0x5631059de3c0 2022-07-05T11:47:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/2499683322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 msgr2=0x563105a661d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a661d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f1f84004c50 tx=0x7f1f84013000).stop 2022-07-05T11:47:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/2499683322 shutdown_connections 2022-07-05T11:47:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de7a0 0x563105a6c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x5631059dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/2499683322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de3c0 0x563105a661d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/2499683322 >> 172.21.15.90:0/2499683322 conn(0x5631058091c0 msgr2=0x563105a0db00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/2499683322 shutdown_connections 2022-07-05T11:47:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.508+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/2499683322 wait complete. 2022-07-05T11:47:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.509+0000 7f1fa62fbb80 1 -- start start 2022-07-05T11:47:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.509+0000 7f1fa62fbb80 1 Processor -- start 2022-07-05T11:47:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x563105994d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 0x563105a75c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1fa62fbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x563105a1c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310599c510 con 0x5631059de7a0 2022-07-05T11:47:50.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563105a1cf20 con 0x56310599acb0 2022-07-05T11:47:50.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1fa62fbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631059e1210 con 0x5631059de3c0 2022-07-05T11:47:50.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1fa62fbb80 10 client.0 ll_register_callbacks cb 0x56310595e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:50.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x563105a1c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1f8dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 0x563105a75c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x563105a1c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58404/0 (socket says 172.21.15.90:58404) 2022-07-05T11:47:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/701983381 learned_addr learned my addr 172.21.15.90:0/701983381 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.510+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x563105994d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/701983381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 msgr2=0x563105a75c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 0x563105a75c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/701983381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 msgr2=0x563105994d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:50.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x563105994d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f8ed9d700 1 -- 172.21.15.90:0/701983381 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f900ec490 con 0x5631059de7a0 2022-07-05T11:47:50.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f8ed9d700 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x563105a1c250 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f1f88009f90 tx=0x7f1f88020070).ready entity=mon.0 client_cookie=25dbc340e6711c46 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:50.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:50.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f68ff9700 1 -- 172.21.15.90:0/701983381 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8802e040 con 0x5631059de7a0 2022-07-05T11:47:50.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f68ff9700 1 -- 172.21.15.90:0/701983381 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f1f880126a0 con 0x5631059de7a0 2022-07-05T11:47:50.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f88022070 con 0x5631059de7a0 2022-07-05T11:47:50.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f68ff9700 1 -- 172.21.15.90:0/701983381 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f88012a70 con 0x5631059de7a0 2022-07-05T11:47:50.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 10 client.5259 fetch_fsmap learned FSMap version 15 2022-07-05T11:47:50.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563105791cd0 con 0x5631059de7a0 2022-07-05T11:47:50.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f68ff9700 1 -- 172.21.15.90:0/701983381 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88022070 con 0x5631059de7a0 2022-07-05T11:47:50.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1f68ff9700 1 -- 172.21.15.90:0/701983381 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 15) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f1f88012bd0 con 0x5631059de7a0 2022-07-05T11:47:50.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 10 client.5259 fetch_fsmap finished waiting for FSMap version 15 2022-07-05T11:47:50.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 10 client.5259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:50.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 20 client.5259 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:50.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5631059e2910 0x5631059e1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:50.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 4 client.5259 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:47:50.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.511+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5631058dd690 con 0x5631059e2910 2022-07-05T11:47:50.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5631059e2910 0x5631059e1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:50.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1f8e59c700 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5631059e2910 0x5631059e1410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=de9dd7f49f2640a9 server_cookie=1dfdc5ec07a35aa2 in_seq=0 out_seq=0 2022-07-05T11:47:50.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1f68ff9700 10 client.5259 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:50.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1f68ff9700 1 -- 172.21.15.90:0/701983381 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5631058dd690 con 0x5631059e2910 2022-07-05T11:47:50.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1f68ff9700 10 client.5259 handle_command_reply: tid=0 2022-07-05T11:47:50.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 client.5259 shutdown 2022-07-05T11:47:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 msgr2=0x563105a1c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x563105a1c250 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f1f88009f90 tx=0x7f1f88020070).stop 2022-07-05T11:47:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 shutdown_connections 2022-07-05T11:47:50.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5631059e2910 0x5631059e1410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631059de7a0 0x563105a1c250 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1f68ff9700 0 client.5259 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56310599acb0 0x563105994d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 --2- 172.21.15.90:0/701983381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631059de3c0 0x563105a75c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 >> 172.21.15.90:0/701983381 conn(0x5631058091c0 msgr2=0x563105a0db00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 shutdown_connections 2022-07-05T11:47:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 1 -- 172.21.15.90:0/701983381 wait complete. 2022-07-05T11:47:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.512+0000 7f1fa62fbb80 20 client.5259 trim_cache size 0 max 16384 2022-07-05T11:47:50.539 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:47:50.540 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "no active scrubs running", 2022-07-05T11:47:50.540 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": {} 2022-07-05T11:47:50.540 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:47:50.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1f6c08ba90 msgr2=0x7f1f6c08df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1f6c08ba90 0x7f1f6c08df50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f1f901970a0 tx=0x7f1f84009040).stop 2022-07-05T11:47:50.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900c35a0 msgr2=0x7f1f90171a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:50.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900c35a0 0x7f1f90171a30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f1f8000d8c0 tx=0x7f1f80008040).stop 2022-07-05T11:47:50.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 shutdown_connections 2022-07-05T11:47:50.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f1f6c08ba90 0x7f1f6c08df50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f901847a0 0x7f1f90194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900c35a0 0x7f1f90171a30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 --2- 172.21.15.90:0/3674563294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f901821b0 0x7f1f90193f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:50.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 >> 172.21.15.90:0/3674563294 conn(0x7f1f900edd30 msgr2=0x7f1f900ef610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:50.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 shutdown_connections 2022-07-05T11:47:50.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:50.513+0000 7f1f9496f700 1 -- 172.21.15.90:0/3674563294 wait complete. 2022-07-05T11:47:50.546 INFO:tasks.cephfs.filesystem:all active scrubs completed 2022-07-05T11:47:51.547 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2022-07-05T11:47:51.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2022-07-05T11:47:51.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.691+0000 7f4042e0b700 1 Processor -- start 2022-07-05T11:47:51.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.691+0000 7f4042e0b700 1 -- start start 2022-07-05T11:47:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.692+0000 7f4042e0b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f403c17df90 0x7f403c182270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4042e0b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c0ecad0 con 0x7f403c182760 2022-07-05T11:47:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4042e0b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c0ecdb0 con 0x7f403c0c8210 2022-07-05T11:47:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4042e0b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403c0ed090 con 0x7f403c17df90 2022-07-05T11:47:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4040ba7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f403c17df90 0x7f403c182270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4040ba7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f403c17df90 0x7f403c182270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58408/0 (socket says 172.21.15.90:58408) 2022-07-05T11:47:51.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4040ba7700 1 -- 172.21.15.90:0/3324009073 learned_addr learned my addr 172.21.15.90:0/3324009073 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f403bfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f403c182760 0x7f403c0c7b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51348/0 (socket says 172.21.15.90:51348) 2022-07-05T11:47:51.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4040ba7700 1 -- 172.21.15.90:0/3324009073 >> v1:172.21.15.110:6789/0 conn(0x7f403c0c8210 legacy=0x7f403c0c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f403b7fe700 1 -- 172.21.15.90:0/3324009073 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433619703 0 0) 0x7f403c0ecdb0 con 0x7f403c0c8210 2022-07-05T11:47:51.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4040ba7700 1 -- 172.21.15.90:0/3324009073 >> v1:172.21.15.90:6789/0 conn(0x7f403c182760 legacy=0x7f403c0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4040ba7700 1 -- 172.21.15.90:0/3324009073 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c0ed370 con 0x7f403c17df90 2022-07-05T11:47:51.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3324009073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c17df90 0x7f403c182270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4034009f70 tx=0x7f4034009840).ready entity=mon.0 client_cookie=8c794083a7124c25 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f403b7fe700 1 -- 172.21.15.90:0/3324009073 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400e070 con 0x7f403c17df90 2022-07-05T11:47:51.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f403b7fe700 1 -- 172.21.15.90:0/3324009073 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400b9d0 con 0x7f403c17df90 2022-07-05T11:47:51.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.693+0000 7f403b7fe700 1 -- 172.21.15.90:0/3324009073 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400bd50 con 0x7f403c17df90 2022-07-05T11:47:51.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.694+0000 7f4042e0b700 1 -- 172.21.15.90:0/3324009073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c17df90 msgr2=0x7f403c182270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.694+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3324009073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c17df90 0x7f403c182270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4034009f70 tx=0x7f4034009840).stop 2022-07-05T11:47:51.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.694+0000 7f4042e0b700 1 -- 172.21.15.90:0/3324009073 shutdown_connections 2022-07-05T11:47:51.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.694+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3324009073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c17df90 0x7f403c182270 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.694+0000 7f4042e0b700 1 -- 172.21.15.90:0/3324009073 >> 172.21.15.90:0/3324009073 conn(0x7f403c0edaa0 msgr2=0x7f403c0edeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.694+0000 7f4042e0b700 1 -- 172.21.15.90:0/3324009073 shutdown_connections 2022-07-05T11:47:51.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.694+0000 7f4042e0b700 1 -- 172.21.15.90:0/3324009073 wait complete. 2022-07-05T11:47:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.696+0000 7f4042e0b700 1 Processor -- start 2022-07-05T11:47:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.696+0000 7f4042e0b700 1 -- start start 2022-07-05T11:47:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4042e0b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c0c8210 0x7f403c178120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4042e0b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f403c17df90 0x7f403c0e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4042e0b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c182760 0x7f403c0e7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4042e0b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0e5d50 con 0x7f403c0c8210 2022-07-05T11:47:51.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4042e0b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0e4e60 con 0x7f403c182760 2022-07-05T11:47:51.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4042e0b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0e5140 con 0x7f403c17df90 2022-07-05T11:47:51.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c0c8210 0x7f403c178120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c0c8210 0x7f403c178120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58414/0 (socket says 172.21.15.90:58414) 2022-07-05T11:47:51.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 -- 172.21.15.90:0/3255831875 learned_addr learned my addr 172.21.15.90:0/3255831875 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f403bfff700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f403c17df90 0x7f403c0e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f40413a8700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c182760 0x7f403c0e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 -- 172.21.15.90:0/3255831875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f403c17df90 msgr2=0x7f403c0e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f403c17df90 0x7f403c0e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 -- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c182760 msgr2=0x7f403c0e7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c182760 0x7f403c0e7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 -- 172.21.15.90:0/3255831875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4034009ae0 con 0x7f403c0c8210 2022-07-05T11:47:51.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f40413a8700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c182760 0x7f403c0e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:51.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f403bfff700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f403c17df90 0x7f403c0e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:47:51.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c0c8210 0x7f403c178120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f403400b770 tx=0x7f403c0ee870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.697+0000 7f4038ff9700 1 -- 172.21.15.90:0/3255831875 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400bb40 con 0x7f403c0c8210 2022-07-05T11:47:51.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.698+0000 7f4038ff9700 1 -- 172.21.15.90:0/3255831875 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400bca0 con 0x7f403c0c8210 2022-07-05T11:47:51.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.698+0000 7f4038ff9700 1 -- 172.21.15.90:0/3255831875 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403401d620 con 0x7f403c0c8210 2022-07-05T11:47:51.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.698+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c0e5420 con 0x7f403c0c8210 2022-07-05T11:47:51.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.698+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c0e59e0 con 0x7f403c0c8210 2022-07-05T11:47:51.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.699+0000 7f4038ff9700 1 -- 172.21.15.90:0/3255831875 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f403401b040 con 0x7f403c0c8210 2022-07-05T11:47:51.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.700+0000 7f4038ff9700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f402008ba40 0x7f402008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.700+0000 7f4038ff9700 1 -- 172.21.15.90:0/3255831875 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f40340b23e0 con 0x7f403c0c8210 2022-07-05T11:47:51.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.700+0000 7f403bfff700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f402008ba40 0x7f402008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.700+0000 7f403bfff700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f402008ba40 0x7f402008df00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f403c0c7900 tx=0x7f402c007ba0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.703+0000 7f4054797b80 1 Processor -- start 2022-07-05T11:47:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.703+0000 7f4054797b80 1 -- start start 2022-07-05T11:47:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f4054797b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c7f0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f4054797b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c83ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f4054797b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c834ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f4054797b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c7ba350 con 0x55713c834820 2022-07-05T11:47:51.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f4054797b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c731b20 con 0x55713c834440 2022-07-05T11:47:51.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f4054797b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c7469d0 con 0x55713c7f0d30 2022-07-05T11:47:51.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f40413a8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c834ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f40413a8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c834ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58426/0 (socket says 172.21.15.90:58426) 2022-07-05T11:47:51.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f40413a8700 1 -- 172.21.15.90:0/729484977 learned_addr learned my addr 172.21.15.90:0/729484977 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f403bfff700 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c83ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.705+0000 7f4040ba7700 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c7f0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f40413a8700 1 -- 172.21.15.90:0/729484977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 msgr2=0x55713c83ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f40413a8700 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c83ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f40413a8700 1 -- 172.21.15.90:0/729484977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 msgr2=0x55713c7f0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f40413a8700 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c7f0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f40413a8700 1 -- 172.21.15.90:0/729484977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55713c578a60 con 0x55713c834820 2022-07-05T11:47:51.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f40413a8700 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c834ca0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f40240015c0 tx=0x7f4024009040).ready entity=mon.0 client_cookie=f990e2dec7fd8397 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f4031ffb700 1 -- 172.21.15.90:0/729484977 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024010520 con 0x55713c834820 2022-07-05T11:47:51.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f4031ffb700 1 -- 172.21.15.90:0/729484977 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024010680 con 0x55713c834820 2022-07-05T11:47:51.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.706+0000 7f4031ffb700 1 -- 172.21.15.90:0/729484977 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024010a20 con 0x55713c834820 2022-07-05T11:47:51.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 -- 172.21.15.90:0/729484977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 msgr2=0x55713c834ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c834ca0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f40240015c0 tx=0x7f4024009040).stop 2022-07-05T11:47:51.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 -- 172.21.15.90:0/729484977 shutdown_connections 2022-07-05T11:47:51.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c834ca0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c7f0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 --2- 172.21.15.90:0/729484977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c83ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 -- 172.21.15.90:0/729484977 >> 172.21.15.90:0/729484977 conn(0x55713c65f240 msgr2=0x55713c7f3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 -- 172.21.15.90:0/729484977 shutdown_connections 2022-07-05T11:47:51.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.707+0000 7f4054797b80 1 -- 172.21.15.90:0/729484977 wait complete. 2022-07-05T11:47:51.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.708+0000 7f4054797b80 1 -- start start 2022-07-05T11:47:51.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.708+0000 7f4054797b80 1 Processor -- start 2022-07-05T11:47:51.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4054797b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c7f0d30 0x55713c826fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4054797b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834440 0x55713c861c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4054797b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834820 0x55713c7faef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4054797b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c70e1a0 con 0x55713c834440 2022-07-05T11:47:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4054797b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c8628a0 con 0x55713c7f0d30 2022-07-05T11:47:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4054797b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c862160 con 0x55713c834820 2022-07-05T11:47:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4054797b80 10 client.0 ll_register_callbacks cb 0x55713c7b4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834440 0x55713c861c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834440 0x55713c861c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58428/0 (socket says 172.21.15.90:58428) 2022-07-05T11:47:51.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 -- 172.21.15.90:0/3326214819 learned_addr learned my addr 172.21.15.90:0/3326214819 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f40413a8700 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834820 0x55713c7faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c7f0d30 0x55713c826fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 -- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834820 msgr2=0x55713c7faef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834820 0x55713c7faef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 -- 172.21.15.90:0/3326214819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c7f0d30 msgr2=0x55713c826fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c7f0d30 0x55713c826fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.709+0000 7f403bfff700 1 -- 172.21.15.90:0/3326214819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402400f040 con 0x55713c834440 2022-07-05T11:47:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f403bfff700 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834440 0x55713c861c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f402c018590 tx=0x7f402c01a040).ready entity=mon.0 client_cookie=b5b4d83f90f1c86e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4012ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4012ffd700 1 -- 172.21.15.90:0/3326214819 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c01d040 con 0x55713c834440 2022-07-05T11:47:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55713c7ee4c0 con 0x55713c834440 2022-07-05T11:47:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4012ffd700 1 -- 172.21.15.90:0/3326214819 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f402c016600 con 0x55713c834440 2022-07-05T11:47:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4012ffd700 1 -- 172.21.15.90:0/3326214819 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f402c016a20 con 0x55713c834440 2022-07-05T11:47:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 10 client.5274 fetch_fsmap learned FSMap version 15 2022-07-05T11:47:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55713c5e7d50 con 0x55713c834440 2022-07-05T11:47:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4012ffd700 1 -- 172.21.15.90:0/3326214819 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55713c7ee4c0 con 0x55713c834440 2022-07-05T11:47:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4012ffd700 1 -- 172.21.15.90:0/3326214819 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 15) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f402c016b80 con 0x55713c834440 2022-07-05T11:47:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 10 client.5274 fetch_fsmap finished waiting for FSMap version 15 2022-07-05T11:47:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 10 client.5274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:51.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 20 client.5274 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:51.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c872ad0 0x55713c872f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 4 client.5274 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:47:51.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55713c73c870 con 0x55713c872ad0 2022-07-05T11:47:51.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.710+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c872ad0 0x55713c872f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4012ffd700 10 client.5274 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:51.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c872ad0 0x55713c872f00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=970db5cb2e0015d0 server_cookie=a79988de836e24ec in_seq=0 out_seq=0 2022-07-05T11:47:51.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4012ffd700 1 -- 172.21.15.90:0/3326214819 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55713c73c870 con 0x55713c872ad0 2022-07-05T11:47:51.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4012ffd700 10 client.5274 handle_command_reply: tid=0 2022-07-05T11:47:51.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 client.5274 shutdown 2022-07-05T11:47:51.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834440 msgr2=0x55713c861c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834440 0x55713c861c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f402c018590 tx=0x7f402c01a040).stop 2022-07-05T11:47:51.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 shutdown_connections 2022-07-05T11:47:51.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c872ad0 0x55713c872f00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834820 0x55713c7faef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4012ffd700 0 client.5274 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:51.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c7f0d30 0x55713c826fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 --2- 172.21.15.90:0/3326214819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834440 0x55713c861c70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.711+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 >> 172.21.15.90:0/3326214819 conn(0x55713c65f240 msgr2=0x55713c8612b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.712+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 shutdown_connections 2022-07-05T11:47:51.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.712+0000 7f4054797b80 1 -- 172.21.15.90:0/3326214819 wait complete. 2022-07-05T11:47:51.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.712+0000 7f4054797b80 20 client.5274 trim_cache size 0 max 16384 2022-07-05T11:47:51.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.729+0000 7f4054797b80 1 Processor -- start 2022-07-05T11:47:51.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.729+0000 7f4054797b80 1 -- start start 2022-07-05T11:47:51.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.730+0000 7f4054797b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.730+0000 7f4054797b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834440 0x55713c83cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.730+0000 7f4054797b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834820 0x55713c826de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.730+0000 7f4054797b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c8267c0 con 0x55713c7f0d30 2022-07-05T11:47:51.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4054797b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c861ff0 con 0x55713c834820 2022-07-05T11:47:51.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4054797b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c83d440 con 0x55713c834440 2022-07-05T11:47:51.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58434/0 (socket says 172.21.15.90:58434) 2022-07-05T11:47:51.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 -- 172.21.15.90:0/3626521328 learned_addr learned my addr 172.21.15.90:0/3626521328 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f403bfff700 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834440 0x55713c83cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f40413a8700 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834820 0x55713c826de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 -- 172.21.15.90:0/3626521328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834440 msgr2=0x55713c83cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834440 0x55713c83cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 -- 172.21.15.90:0/3626521328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834820 msgr2=0x55713c826de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834820 0x55713c826de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 -- 172.21.15.90:0/3626521328 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55713c5b6050 con 0x55713c7f0d30 2022-07-05T11:47:51.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f403bfff700 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834440 0x55713c83cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:51.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.731+0000 7f4040ba7700 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f403401c040 tx=0x7f4034029040).ready entity=mon.0 client_cookie=b775664c1b4b3f57 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f40327fc700 1 -- 172.21.15.90:0/3626521328 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034007320 con 0x55713c7f0d30 2022-07-05T11:47:51.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f40327fc700 1 -- 172.21.15.90:0/3626521328 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4034086600 con 0x55713c7f0d30 2022-07-05T11:47:51.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f40327fc700 1 -- 172.21.15.90:0/3626521328 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034082fe0 con 0x55713c7f0d30 2022-07-05T11:47:51.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 -- 172.21.15.90:0/3626521328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c7f0d30 msgr2=0x55713c8611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f403401c040 tx=0x7f4034029040).stop 2022-07-05T11:47:51.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 -- 172.21.15.90:0/3626521328 shutdown_connections 2022-07-05T11:47:51.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834820 0x55713c826de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 --2- 172.21.15.90:0/3626521328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c834440 0x55713c83cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 -- 172.21.15.90:0/3626521328 >> 172.21.15.90:0/3626521328 conn(0x55713c65f240 msgr2=0x55713c863520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 -- 172.21.15.90:0/3626521328 shutdown_connections 2022-07-05T11:47:51.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.732+0000 7f4054797b80 1 -- 172.21.15.90:0/3626521328 wait complete. 2022-07-05T11:47:51.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.733+0000 7f4054797b80 1 -- start start 2022-07-05T11:47:51.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.733+0000 7f4054797b80 1 Processor -- start 2022-07-05T11:47:51.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.734+0000 7f4054797b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.734+0000 7f4054797b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c85cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.734+0000 7f4054797b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c826bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.734+0000 7f4054797b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c8270c0 con 0x55713c834820 2022-07-05T11:47:51.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.734+0000 7f4054797b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c7f9f90 con 0x55713c834440 2022-07-05T11:47:51.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.734+0000 7f4054797b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713c7f1bc0 con 0x55713c7f0d30 2022-07-05T11:47:51.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.734+0000 7f4054797b80 10 client.0 ll_register_callbacks cb 0x55713c7b4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:51.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f4040ba7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f4040ba7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39836/0 (socket says 172.21.15.90:39836) 2022-07-05T11:47:51.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f4040ba7700 1 -- 172.21.15.90:0/4106257738 learned_addr learned my addr 172.21.15.90:0/4106257738 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f403bfff700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c85cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f40413a8700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c826bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f403bfff700 1 -- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 msgr2=0x55713c8611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f403bfff700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f403bfff700 1 -- 172.21.15.90:0/4106257738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 msgr2=0x55713c826bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f403bfff700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c826bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f403bfff700 1 -- 172.21.15.90:0/4106257738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55713c5e7d50 con 0x55713c834440 2022-07-05T11:47:51.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.735+0000 7f4040ba7700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:47:51.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f403bfff700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c85cd30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f402c007760 tx=0x7f402c012000).ready entity=mon.1 client_cookie=328a37e1568d42d3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4012ffd700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2022-07-05T11:47:51.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4012ffd700 1 -- 172.21.15.90:0/4106257738 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c01d040 con 0x55713c834440 2022-07-05T11:47:51.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4012ffd700 1 -- 172.21.15.90:0/4106257738 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f402c001bf0 con 0x55713c834440 2022-07-05T11:47:51.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4024010680 con 0x55713c834440 2022-07-05T11:47:51.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4012ffd700 1 -- 172.21.15.90:0/4106257738 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f402c016c30 con 0x55713c834440 2022-07-05T11:47:51.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4054797b80 10 client.5044 fetch_fsmap learned FSMap version 15 2022-07-05T11:47:51.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x7f403c0e59e0 con 0x55713c834440 2022-07-05T11:47:51.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.739+0000 7f4012ffd700 1 -- 172.21.15.90:0/4106257738 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024010680 con 0x55713c834440 2022-07-05T11:47:51.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4012ffd700 1 -- 172.21.15.90:0/4106257738 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 15) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f402c0234c0 con 0x55713c834440 2022-07-05T11:47:51.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4054797b80 10 client.5044 fetch_fsmap finished waiting for FSMap version 15 2022-07-05T11:47:51.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4054797b80 10 client.5044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:51.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4054797b80 20 client.5044 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:51.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4054797b80 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c826460 0x55713c872200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4054797b80 4 client.5044 mds_command: new command op to 4371 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2022-07-05T11:47:51.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55713c733710 con 0x55713c826460 2022-07-05T11:47:51.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4040ba7700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c826460 0x55713c872200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4012ffd700 10 client.5044 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:51.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.740+0000 7f4040ba7700 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c826460 0x55713c872200 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5ae38ff23872176d server_cookie=537696494f3069f5 in_seq=0 out_seq=0 2022-07-05T11:47:51.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.799+0000 7f4012ffd700 1 -- 172.21.15.90:0/4106257738 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55713c733710 con 0x55713c826460 2022-07-05T11:47:51.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.799+0000 7f4012ffd700 10 client.5044 handle_command_reply: tid=0 2022-07-05T11:47:51.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.802+0000 7f4054797b80 1 client.5044 shutdown 2022-07-05T11:47:51.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.803+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 msgr2=0x55713c85cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.803+0000 7f4054797b80 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c85cd30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f402c007760 tx=0x7f402c012000).stop 2022-07-05T11:47:51.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.810+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 shutdown_connections 2022-07-05T11:47:51.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.810+0000 7f4054797b80 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55713c826460 0x55713c872200 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.810+0000 7f4054797b80 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55713c834820 0x55713c826bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.810+0000 7f4054797b80 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55713c7f0d30 0x55713c8611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.810+0000 7f4054797b80 1 --2- 172.21.15.90:0/4106257738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55713c834440 0x55713c85cd30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.810+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 >> 172.21.15.90:0/4106257738 conn(0x55713c65f240 msgr2=0x55713c830440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.814+0000 7f4012ffd700 0 client.5044 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:51.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.814+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 shutdown_connections 2022-07-05T11:47:51.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.814+0000 7f4054797b80 1 -- 172.21.15.90:0/4106257738 wait complete. 2022-07-05T11:47:51.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.814+0000 7f4054797b80 20 client.5044 trim_cache size 0 max 16384 2022-07-05T11:47:51.816 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:47:51.816 INFO:teuthology.orchestra.run.smithi090.stdout: "return_code": 0, 2022-07-05T11:47:51.816 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_tag": "caf11fce-9bdc-4b43-bad7-bbeff0381058", 2022-07-05T11:47:51.817 INFO:teuthology.orchestra.run.smithi090.stdout: "mode": "asynchronous" 2022-07-05T11:47:51.817 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:47:51.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f402008ba40 msgr2=0x7f402008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f402008ba40 0x7f402008df00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f403c0c7900 tx=0x7f402c007ba0).stop 2022-07-05T11:47:51.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c0c8210 msgr2=0x7f403c178120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c0c8210 0x7f403c178120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f403400b770 tx=0x7f403c0ee870).stop 2022-07-05T11:47:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 shutdown_connections 2022-07-05T11:47:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f402008ba40 0x7f402008df00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f403c182760 0x7f403c0e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f403c0c8210 0x7f403c178120 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 --2- 172.21.15.90:0/3255831875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f403c17df90 0x7f403c0e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 >> 172.21.15.90:0/3255831875 conn(0x7f403c0edaa0 msgr2=0x7f403c17fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 shutdown_connections 2022-07-05T11:47:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.815+0000 7f4042e0b700 1 -- 172.21.15.90:0/3255831875 wait complete. 2022-07-05T11:47:51.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:47:51.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.950+0000 7f3df9406700 1 Processor -- start 2022-07-05T11:47:51.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.950+0000 7f3df9406700 1 -- start start 2022-07-05T11:47:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.951+0000 7f3df9406700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3df4178610 0x7f3df41789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.951+0000 7f3df9406700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df417d560 con 0x7f3df417f3b0 2022-07-05T11:47:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.951+0000 7f3df9406700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df417f830 con 0x7f3df417e100 2022-07-05T11:47:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.951+0000 7f3df9406700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df417c670 con 0x7f3df4178610 2022-07-05T11:47:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.951+0000 7f3dea7fc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3df417f3b0 0x7f3df417d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51392/0 (socket says 172.21.15.90:51392) 2022-07-05T11:47:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.951+0000 7f3dea7fc700 1 -- 172.21.15.90:0/2992932497 learned_addr learned my addr 172.21.15.90:0/2992932497 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:47:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.951+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/2992932497 >> v2:172.21.15.149:3300/0 conn(0x7f3df4178610 0x7f3df41789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df27fc700 1 -- 172.21.15.90:0/2992932497 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469049335 0 0) 0x7f3df417d560 con 0x7f3df417f3b0 2022-07-05T11:47:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df27fc700 1 -- 172.21.15.90:0/2992932497 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd40033f0 con 0x7f3df417f3b0 2022-07-05T11:47:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df2ffd700 1 -- 172.21.15.90:0/2992932497 >> v1:172.21.15.110:6789/0 conn(0x7f3df417e100 legacy=0x7f3df4063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df2ffd700 1 -- 172.21.15.90:0/2992932497 >> v1:172.21.15.90:6789/0 conn(0x7f3df417f3b0 legacy=0x7f3df417d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df2ffd700 1 -- 172.21.15.90:0/2992932497 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df417c950 con 0x7f3df4178610 2022-07-05T11:47:51.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/2992932497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 0x7f3df41789f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3de4009760 tx=0x7f3de4009060).ready entity=mon.2 client_cookie=2075e3e1b5b0e847 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df27fc700 1 -- 172.21.15.90:0/2992932497 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40090d0 con 0x7f3df4178610 2022-07-05T11:47:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df27fc700 1 -- 172.21.15.90:0/2992932497 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400f510 con 0x7f3df4178610 2022-07-05T11:47:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.952+0000 7f3df27fc700 1 -- 172.21.15.90:0/2992932497 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400f890 con 0x7f3df4178610 2022-07-05T11:47:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.953+0000 7f3df9406700 1 -- 172.21.15.90:0/2992932497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 msgr2=0x7f3df41789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.953+0000 7f3df9406700 1 --2- 172.21.15.90:0/2992932497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 0x7f3df41789f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3de4009760 tx=0x7f3de4009060).stop 2022-07-05T11:47:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.953+0000 7f3df9406700 1 -- 172.21.15.90:0/2992932497 shutdown_connections 2022-07-05T11:47:51.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.953+0000 7f3df9406700 1 --2- 172.21.15.90:0/2992932497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 0x7f3df41789f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.953+0000 7f3df9406700 1 -- 172.21.15.90:0/2992932497 >> 172.21.15.90:0/2992932497 conn(0x7f3df40f2210 msgr2=0x7f3df4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.953+0000 7f3df9406700 1 -- 172.21.15.90:0/2992932497 shutdown_connections 2022-07-05T11:47:51.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.953+0000 7f3df9406700 1 -- 172.21.15.90:0/2992932497 wait complete. 2022-07-05T11:47:51.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.954+0000 7f3df9406700 1 Processor -- start 2022-07-05T11:47:51.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.954+0000 7f3df9406700 1 -- start start 2022-07-05T11:47:51.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df9406700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 0x7f3df40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df9406700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df417e100 0x7f3df40c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df9406700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df417f3b0 0x7f3df4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df9406700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40c8bc0 con 0x7f3df417e100 2022-07-05T11:47:51.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df9406700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40c7cd0 con 0x7f3df417f3b0 2022-07-05T11:47:51.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df9406700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40c7fb0 con 0x7f3df4178610 2022-07-05T11:47:51.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df417e100 0x7f3df40c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df2ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 0x7f3df40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df417e100 0x7f3df40c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58458/0 (socket says 172.21.15.90:58458) 2022-07-05T11:47:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3dea7fc700 1 -- 172.21.15.90:0/3994583885 learned_addr learned my addr 172.21.15.90:0/3994583885 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.955+0000 7f3df37fe700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df417f3b0 0x7f3df4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3dea7fc700 1 -- 172.21.15.90:0/3994583885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 msgr2=0x7f3df40c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 0x7f3df40c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3dea7fc700 1 -- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df417f3b0 msgr2=0x7f3df4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df417f3b0 0x7f3df4159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3dea7fc700 1 -- 172.21.15.90:0/3994583885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40092a0 con 0x7f3df417e100 2022-07-05T11:47:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df417e100 0x7f3df40c7640 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f3ddc00c420 tx=0x7f3ddc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3deb7fe700 1 -- 172.21.15.90:0/3994583885 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0070d0 con 0x7f3df417e100 2022-07-05T11:47:51.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3deb7fe700 1 -- 172.21.15.90:0/3994583885 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc007230 con 0x7f3df417e100 2022-07-05T11:47:51.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df40c8290 con 0x7f3df417e100 2022-07-05T11:47:51.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3deb7fe700 1 -- 172.21.15.90:0/3994583885 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0075b0 con 0x7f3df417e100 2022-07-05T11:47:51.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.956+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df40c8850 con 0x7f3df417e100 2022-07-05T11:47:51.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.958+0000 7f3deb7fe700 1 -- 172.21.15.90:0/3994583885 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3ddc01a060 con 0x7f3df417e100 2022-07-05T11:47:51.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.958+0000 7f3deb7fe700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3dd808ba40 0x7f3dd808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.958+0000 7f3deb7fe700 1 -- 172.21.15.90:0/3994583885 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f3ddc0aff00 con 0x7f3df417e100 2022-07-05T11:47:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.959+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3dd808ba40 0x7f3dd808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.959+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3dd808ba40 0x7f3dd808df00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3de4009760 tx=0x7f3de4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.960+0000 7f3e0ad92b80 1 Processor -- start 2022-07-05T11:47:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.960+0000 7f3e0ad92b80 1 -- start start 2022-07-05T11:47:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0af93c0 0x5596e0ab57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b03990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0a7f2d0 con 0x5596e0ab5cb0 2022-07-05T11:47:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e09f6aa0 con 0x5596e0af93c0 2022-07-05T11:47:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0a0b950 con 0x5596e0af97a0 2022-07-05T11:47:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3df2ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0af93c0 0x5596e0ab57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b03990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b03990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58464/0 (socket says 172.21.15.90:58464) 2022-07-05T11:47:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 -- 172.21.15.90:0/894367508 learned_addr learned my addr 172.21.15.90:0/894367508 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3df2ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0af93c0 0x5596e0ab57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:34782/0 (socket says 172.21.15.90:34782) 2022-07-05T11:47:51.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3df37fe700 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 -- 172.21.15.90:0/894367508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 msgr2=0x5596e0af9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 -- 172.21.15.90:0/894367508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0af93c0 msgr2=0x5596e0ab57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0af93c0 0x5596e0ab57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.961+0000 7f3dea7fc700 1 -- 172.21.15.90:0/894367508 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596e083d9e0 con 0x5596e0ab5cb0 2022-07-05T11:47:51.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b03990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f3ddc084460 tx=0x7f3ddc007e90).ready entity=mon.0 client_cookie=e6c7e424ff8aa08e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3dd3fff700 1 -- 172.21.15.90:0/894367508 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc084840 con 0x5596e0ab5cb0 2022-07-05T11:47:51.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3dd3fff700 1 -- 172.21.15.90:0/894367508 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc08a120 con 0x5596e0ab5cb0 2022-07-05T11:47:51.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3dd3fff700 1 -- 172.21.15.90:0/894367508 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc080f50 con 0x5596e0ab5cb0 2022-07-05T11:47:51.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/894367508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 msgr2=0x5596e0b03990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b03990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f3ddc084460 tx=0x7f3ddc007e90).stop 2022-07-05T11:47:51.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/894367508 shutdown_connections 2022-07-05T11:47:51.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0af93c0 0x5596e0ab57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/894367508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b03990 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.962+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/894367508 >> 172.21.15.90:0/894367508 conn(0x5596e09241c0 msgr2=0x5596e0ab8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.963+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/894367508 shutdown_connections 2022-07-05T11:47:51.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.963+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/894367508 wait complete. 2022-07-05T11:47:51.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.963+0000 7f3e0ad92b80 1 -- start start 2022-07-05T11:47:51.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.963+0000 7f3e0ad92b80 1 Processor -- start 2022-07-05T11:47:51.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.964+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b37830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.964+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.964+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.964+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e09d3120 con 0x5596e0af93c0 2022-07-05T11:47:51.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.964+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0b2ad10 con 0x5596e0ab5cb0 2022-07-05T11:47:51.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.964+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0b29bb0 con 0x5596e0af97a0 2022-07-05T11:47:51.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3e0ad92b80 10 client.0 ll_register_callbacks cb 0x5596e0a791b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:51.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58470/0 (socket says 172.21.15.90:58470) 2022-07-05T11:47:51.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 -- 172.21.15.90:0/617409357 learned_addr learned my addr 172.21.15.90:0/617409357 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:51.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3df37fe700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b37830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 -- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 msgr2=0x5596e0af8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 -- 172.21.15.90:0/617409357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 msgr2=0x5596e0b37830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:51.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b37830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 -- 172.21.15.90:0/617409357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df40c8850 con 0x5596e0af93c0 2022-07-05T11:47:51.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b37830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:47:51.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2a040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f3ddc084540 tx=0x7f3ddc087000).ready entity=mon.0 client_cookie=35fd87efd7d9d60e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:51.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:51.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dd17fa700 1 -- 172.21.15.90:0/617409357 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc093070 con 0x5596e0af93c0 2022-07-05T11:47:51.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dd17fa700 1 -- 172.21.15.90:0/617409357 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f3ddc089ea0 con 0x5596e0af93c0 2022-07-05T11:47:51.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596e0ab3440 con 0x5596e0af93c0 2022-07-05T11:47:51.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dd17fa700 1 -- 172.21.15.90:0/617409357 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ddc080840 con 0x5596e0af93c0 2022-07-05T11:47:51.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3e0ad92b80 10 client.5292 fetch_fsmap learned FSMap version 15 2022-07-05T11:47:51.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5596e08accd0 con 0x5596e0af93c0 2022-07-05T11:47:51.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dd17fa700 1 -- 172.21.15.90:0/617409357 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596e0ab3440 con 0x5596e0af93c0 2022-07-05T11:47:51.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.965+0000 7f3dd17fa700 1 -- 172.21.15.90:0/617409357 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 15) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f3ddc096030 con 0x5596e0af93c0 2022-07-05T11:47:51.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3e0ad92b80 10 client.5292 fetch_fsmap finished waiting for FSMap version 15 2022-07-05T11:47:51.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3e0ad92b80 10 client.5292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:51.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3e0ad92b80 20 client.5292 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:51.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0aedf20 0x5596e0b3ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:51.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3e0ad92b80 4 client.5292 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:47:51.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596e0a017f0 con 0x5596e0aedf20 2022-07-05T11:47:51.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0aedf20 0x5596e0b3ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:51.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3dd17fa700 10 client.5292 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:51.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.966+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0aedf20 0x5596e0b3ade0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a49370ca8558f00a server_cookie=6b8954f4dc2da45f in_seq=0 out_seq=0 2022-07-05T11:47:51.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3dd17fa700 1 -- 172.21.15.90:0/617409357 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5596e0a017f0 con 0x5596e0aedf20 2022-07-05T11:47:51.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3dd17fa700 10 client.5292 handle_command_reply: tid=0 2022-07-05T11:47:51.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 client.5292 shutdown 2022-07-05T11:47:51.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 msgr2=0x5596e0b2a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:51.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2a040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f3ddc084540 tx=0x7f3ddc087000).stop 2022-07-05T11:47:51.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 shutdown_connections 2022-07-05T11:47:51.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0aedf20 0x5596e0b3ade0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af97a0 0x5596e0af8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3dd17fa700 0 client.5292 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:51.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b37830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/617409357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2a040 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:51.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 >> 172.21.15.90:0/617409357 conn(0x5596e09241c0 msgr2=0x5596e0b262a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:51.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 shutdown_connections 2022-07-05T11:47:51.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/617409357 wait complete. 2022-07-05T11:47:51.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.967+0000 7f3e0ad92b80 20 client.5292 trim_cache size 0 max 16384 2022-07-05T11:47:52.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.983+0000 7f3e0ad92b80 1 Processor -- start 2022-07-05T11:47:52.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.983+0000 7f3e0ad92b80 1 -- start start 2022-07-05T11:47:52.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b01c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:52.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0aedf20 0x5596e0abfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:52.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:52.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0b2c9a0 con 0x5596e0af93c0 2022-07-05T11:47:52.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0af68a0 con 0x5596e0ab5cb0 2022-07-05T11:47:52.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0af9f20 con 0x5596e0aedf20 2022-07-05T11:47:52.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3df37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:52.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3df37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58480/0 (socket says 172.21.15.90:58480) 2022-07-05T11:47:52.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0aedf20 0x5596e0abfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:52.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3df37fe700 1 -- 172.21.15.90:0/3459601852 learned_addr learned my addr 172.21.15.90:0/3459601852 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:52.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.984+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b01c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:52.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3df37fe700 1 -- 172.21.15.90:0/3459601852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0aedf20 msgr2=0x5596e0abfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:52.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3df37fe700 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0aedf20 0x5596e0abfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3df37fe700 1 -- 172.21.15.90:0/3459601852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 msgr2=0x5596e0b01c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3df37fe700 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b01c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3df37fe700 1 -- 172.21.15.90:0/3459601852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596e087afd0 con 0x5596e0af93c0 2022-07-05T11:47:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3df37fe700 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2b490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f3dec007cd0 tx=0x7f3dec001480).ready entity=mon.0 client_cookie=fd449d59d25e5ff1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3de8ff9700 1 -- 172.21.15.90:0/3459601852 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec002890 con 0x5596e0af93c0 2022-07-05T11:47:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3de8ff9700 1 -- 172.21.15.90:0/3459601852 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec002240 con 0x5596e0af93c0 2022-07-05T11:47:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3de8ff9700 1 -- 172.21.15.90:0/3459601852 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec002600 con 0x5596e0af93c0 2022-07-05T11:47:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/3459601852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 msgr2=0x5596e0b2b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2b490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f3dec007cd0 tx=0x7f3dec001480).stop 2022-07-05T11:47:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/3459601852 shutdown_connections 2022-07-05T11:47:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0af93c0 0x5596e0b2b490 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0ab5cb0 0x5596e0b01c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/3459601852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0aedf20 0x5596e0abfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/3459601852 >> 172.21.15.90:0/3459601852 conn(0x5596e09241c0 msgr2=0x5596e0af6040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/3459601852 shutdown_connections 2022-07-05T11:47:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.985+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/3459601852 wait complete. 2022-07-05T11:47:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.986+0000 7f3e0ad92b80 1 -- start start 2022-07-05T11:47:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.986+0000 7f3e0ad92b80 1 Processor -- start 2022-07-05T11:47:52.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.987+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b00d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:52.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.987+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0aedf20 0x5596e0b25370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:52.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.987+0000 7f3e0ad92b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af93c0 0x5596e0aee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:52.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.987+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0abf730 con 0x5596e0ab5cb0 2022-07-05T11:47:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.987+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0af2560 con 0x5596e0aedf20 2022-07-05T11:47:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.987+0000 7f3e0ad92b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596e0abf580 con 0x5596e0af93c0 2022-07-05T11:47:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.987+0000 7f3e0ad92b80 10 client.0 ll_register_callbacks cb 0x5596e0a791b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:47:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b00d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b00d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58484/0 (socket says 172.21.15.90:58484) 2022-07-05T11:47:52.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3dea7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0aedf20 0x5596e0b25370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:52.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 -- 172.21.15.90:0/4619412 learned_addr learned my addr 172.21.15.90:0/4619412 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:47:52.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df37fe700 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af93c0 0x5596e0aee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:52.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 -- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af93c0 msgr2=0x5596e0aee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af93c0 0x5596e0aee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 -- 172.21.15.90:0/4619412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0aedf20 msgr2=0x5596e0b25370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:47:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0aedf20 0x5596e0b25370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 -- 172.21.15.90:0/4619412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec00f040 con 0x5596e0ab5cb0 2022-07-05T11:47:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3df2ffd700 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b00d30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f3de4009e00 tx=0x7f3de402e280).ready entity=mon.0 client_cookie=c71babfd37058adb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:47:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3dd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:47:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3dd17fa700 1 -- 172.21.15.90:0/4619412 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de401cac0 con 0x5596e0ab5cb0 2022-07-05T11:47:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3dd17fa700 1 -- 172.21.15.90:0/4619412 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f3de401cc20 con 0x5596e0ab5cb0 2022-07-05T11:47:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ddc08a120 con 0x5596e0ab5cb0 2022-07-05T11:47:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3dd17fa700 1 -- 172.21.15.90:0/4619412 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3de4036430 con 0x5596e0ab5cb0 2022-07-05T11:47:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3e0ad92b80 10 client.5298 fetch_fsmap learned FSMap version 15 2022-07-05T11:47:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5596e0b2b970 con 0x5596e0ab5cb0 2022-07-05T11:47:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3dd17fa700 1 -- 172.21.15.90:0/4619412 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de403a020 con 0x5596e0ab5cb0 2022-07-05T11:47:52.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.988+0000 7f3dd17fa700 1 -- 172.21.15.90:0/4619412 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 15) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f3de4036590 con 0x5596e0ab5cb0 2022-07-05T11:47:52.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 10 client.5298 fetch_fsmap finished waiting for FSMap version 15 2022-07-05T11:47:52.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 10 client.5298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:47:52.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 20 client.5298 populate_metadata read hostname 'smithi090' 2022-07-05T11:47:52.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0af97a0 0x5596e0b82d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:47:52.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 4 client.5298 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:47:52.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5596e09f8690 con 0x5596e0af97a0 2022-07-05T11:47:52.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0af97a0 0x5596e0b82d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:47:52.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3dd17fa700 10 client.5298 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:52.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3dea7fc700 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0af97a0 0x5596e0b82d80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f39f80600ad007c8 server_cookie=caad1f0dacf242c9 in_seq=0 out_seq=0 2022-07-05T11:47:52.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3dd17fa700 1 -- 172.21.15.90:0/4619412 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5596e09f8690 con 0x5596e0af97a0 2022-07-05T11:47:52.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3dd17fa700 10 client.5298 handle_command_reply: tid=0 2022-07-05T11:47:52.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 client.5298 shutdown 2022-07-05T11:47:52.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 msgr2=0x5596e0b00d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:52.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b00d30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f3de4009e00 tx=0x7f3de402e280).stop 2022-07-05T11:47:52.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 shutdown_connections 2022-07-05T11:47:52.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5596e0af97a0 0x5596e0b82d80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596e0af93c0 0x5596e0aee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3dd17fa700 0 client.5298 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:47:52.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5596e0ab5cb0 0x5596e0b00d30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 --2- 172.21.15.90:0/4619412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596e0aedf20 0x5596e0b25370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.989+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 >> 172.21.15.90:0/4619412 conn(0x5596e09241c0 msgr2=0x5596e0b2bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:52.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 shutdown_connections 2022-07-05T11:47:52.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3e0ad92b80 1 -- 172.21.15.90:0/4619412 wait complete. 2022-07-05T11:47:52.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3e0ad92b80 20 client.5298 trim_cache size 0 max 16384 2022-07-05T11:47:52.026 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:47:52.026 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:47:52.026 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:47:52.026 INFO:teuthology.orchestra.run.smithi090.stdout: "caf11fce-9bdc-4b43-bad7-bbeff0381058": { 2022-07-05T11:47:52.027 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:47:52.027 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "caf11fce-9bdc-4b43-bad7-bbeff0381058", 2022-07-05T11:47:52.027 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:47:52.027 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:47:52.027 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:47:52.028 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:47:52.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3dd808ba40 msgr2=0x7f3dd808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:52.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3dd808ba40 0x7f3dd808df00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3de4009760 tx=0x7f3de4017000).stop 2022-07-05T11:47:52.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df417e100 msgr2=0x7f3df40c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:47:52.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df417e100 0x7f3df40c7640 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f3ddc00c420 tx=0x7f3ddc007c80).stop 2022-07-05T11:47:52.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 shutdown_connections 2022-07-05T11:47:52.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3dd808ba40 0x7f3dd808df00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df417f3b0 0x7f3df4159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3df4178610 0x7f3df40c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 --2- 172.21.15.90:0/3994583885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3df417e100 0x7f3df40c7640 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:47:52.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 >> 172.21.15.90:0/3994583885 conn(0x7f3df40f2210 msgr2=0x7f3df417d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:47:52.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 shutdown_connections 2022-07-05T11:47:52.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:47:51.990+0000 7f3df9406700 1 -- 172.21.15.90:0/3994583885 wait complete. 2022-07-05T11:47:52.033 INFO:tasks.cephfs.filesystem:scrub status for tag:caf11fce-9bdc-4b43-bad7-bbeff0381058 - {'path': '/', 'tag': 'caf11fce-9bdc-4b43-bad7-bbeff0381058', 'options': 'recursive,force'} 2022-07-05T11:47:53.387 INFO:tasks.workunit.client.0.smithi090.stdout: 13 159825 756 117592 670 49373 914 2022-07-05T11:48:03.389 INFO:tasks.workunit.client.0.smithi090.stdout: 24 653809 677 429767 487 314072 1601 2022-07-05T11:48:13.389 INFO:tasks.workunit.client.0.smithi090.stdout: 37 344776 792 216335 635 158090 884 2022-07-05T11:48:18.917 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:48:18.921 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:48:18.923 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:48:22.038 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:48:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.181+0000 7f500cb33700 1 Processor -- start 2022-07-05T11:48:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.181+0000 7f500cb33700 1 -- start start 2022-07-05T11:48:22.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500cb33700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5008178610 0x7f50081789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500cb33700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f500817e100 0x7f5008063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500cb33700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500817d560 con 0x7f500817f3b0 2022-07-05T11:48:22.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500cb33700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500817f830 con 0x7f5008178610 2022-07-05T11:48:22.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500cb33700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500817c670 con 0x7f500817e100 2022-07-05T11:48:22.197 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5008178610 0x7f50081789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.197 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5008178610 0x7f50081789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58492/0 (socket says 172.21.15.90:58492) 2022-07-05T11:48:22.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 -- 172.21.15.90:0/2780822204 learned_addr learned my addr 172.21.15.90:0/2780822204 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:22.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f5006d9d700 1 --2- 172.21.15.90:0/2780822204 >> v2:172.21.15.149:3300/0 conn(0x7f500817e100 0x7f5008063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 -- 172.21.15.90:0/2780822204 >> v2:172.21.15.149:3300/0 conn(0x7f500817e100 msgr2=0x7f5008063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 --2- 172.21.15.90:0/2780822204 >> v2:172.21.15.149:3300/0 conn(0x7f500817e100 0x7f5008063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 -- 172.21.15.90:0/2780822204 >> v1:172.21.15.149:6789/0 conn(0x7f500817f3b0 legacy=0x7f500817d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 -- 172.21.15.90:0/2780822204 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500817c950 con 0x7f5008178610 2022-07-05T11:48:22.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.182+0000 7f500659c700 1 --2- 172.21.15.90:0/2780822204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f50081789f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f500817c480 tx=0x7f4ff80090f0).ready entity=mon.0 client_cookie=f211154236d4b583 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:22.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f5005d9b700 1 -- 172.21.15.90:0/2780822204 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800b520 con 0x7f5008178610 2022-07-05T11:48:22.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f5005d9b700 1 -- 172.21.15.90:0/2780822204 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800b680 con 0x7f5008178610 2022-07-05T11:48:22.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f5005d9b700 1 -- 172.21.15.90:0/2780822204 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800ba20 con 0x7f5008178610 2022-07-05T11:48:22.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f500cb33700 1 -- 172.21.15.90:0/2780822204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 msgr2=0x7f50081789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f500cb33700 1 --2- 172.21.15.90:0/2780822204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f50081789f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f500817c480 tx=0x7f4ff80090f0).stop 2022-07-05T11:48:22.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f500cb33700 1 -- 172.21.15.90:0/2780822204 shutdown_connections 2022-07-05T11:48:22.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f500cb33700 1 --2- 172.21.15.90:0/2780822204 >> v2:172.21.15.149:3300/0 conn(0x7f500817e100 0x7f5008063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f500cb33700 1 --2- 172.21.15.90:0/2780822204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f50081789f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.183+0000 7f500cb33700 1 -- 172.21.15.90:0/2780822204 >> 172.21.15.90:0/2780822204 conn(0x7f50080f2210 msgr2=0x7f5008069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:22.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.184+0000 7f500cb33700 1 -- 172.21.15.90:0/2780822204 shutdown_connections 2022-07-05T11:48:22.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.184+0000 7f500cb33700 1 -- 172.21.15.90:0/2780822204 wait complete. 2022-07-05T11:48:22.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.186+0000 7f500cb33700 1 Processor -- start 2022-07-05T11:48:22.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.186+0000 7f500cb33700 1 -- start start 2022-07-05T11:48:22.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500cb33700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f500816eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500cb33700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500817e100 0x7f500816f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500cb33700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f500817f3b0 0x7f50080cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500cb33700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500816f950 con 0x7f5008178610 2022-07-05T11:48:22.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500cb33700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008170a90 con 0x7f500817f3b0 2022-07-05T11:48:22.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500cb33700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500816fba0 con 0x7f500817e100 2022-07-05T11:48:22.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f500816eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500817e100 0x7f500816f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f500816eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58498/0 (socket says 172.21.15.90:58498) 2022-07-05T11:48:22.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f500659c700 1 -- 172.21.15.90:0/233783399 learned_addr learned my addr 172.21.15.90:0/233783399 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:22.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500817e100 0x7f500816f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39896/0 (socket says 172.21.15.90:39896) 2022-07-05T11:48:22.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.187+0000 7f5006d9d700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f500817f3b0 0x7f50080cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500659c700 1 -- 172.21.15.90:0/233783399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500817e100 msgr2=0x7f500816f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500659c700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500817e100 0x7f500816f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500659c700 1 -- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f500817f3b0 msgr2=0x7f50080cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500659c700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f500817f3b0 0x7f50080cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500659c700 1 -- 172.21.15.90:0/233783399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009370 con 0x7f5008178610 2022-07-05T11:48:22.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f4ffffff700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500817e100 0x7f500816f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:48:22.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500659c700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f500816eec0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f4ff8006fd0 tx=0x7f4ff8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:22.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f4ffe7fc700 1 -- 172.21.15.90:0/233783399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8006d90 con 0x7f5008178610 2022-07-05T11:48:22.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f4ffe7fc700 1 -- 172.21.15.90:0/233783399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8006990 con 0x7f5008178610 2022-07-05T11:48:22.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500816fe80 con 0x7f5008178610 2022-07-05T11:48:22.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f4ffe7fc700 1 -- 172.21.15.90:0/233783399 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800b7f0 con 0x7f5008178610 2022-07-05T11:48:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.188+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5008170440 con 0x7f5008178610 2022-07-05T11:48:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.190+0000 7f4ffe7fc700 1 -- 172.21.15.90:0/233783399 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4ff802c070 con 0x7f5008178610 2022-07-05T11:48:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.190+0000 7f4ffe7fc700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4fec08ba40 0x7f4fec08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.191+0000 7f4ffe7fc700 1 -- 172.21.15.90:0/233783399 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f4ff80b2110 con 0x7f5008178610 2022-07-05T11:48:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.191+0000 7f4ffffff700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4fec08ba40 0x7f4fec08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.191+0000 7f4ffffff700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4fec08ba40 0x7f4fec08df00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f5008182df0 tx=0x7f4ff0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:22.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.192+0000 7f501e4bfb80 1 Processor -- start 2022-07-05T11:48:22.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.192+0000 7f501e4bfb80 1 -- start start 2022-07-05T11:48:22.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.193+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74923c0 0x5580d744e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.193+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.193+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d7492c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.193+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d74182d0 con 0x5580d744ecb0 2022-07-05T11:48:22.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.193+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d738faa0 con 0x5580d74923c0 2022-07-05T11:48:22.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.193+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d73a4950 con 0x5580d74927a0 2022-07-05T11:48:22.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74923c0 0x5580d744e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58508/0 (socket says 172.21.15.90:58508) 2022-07-05T11:48:22.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74923c0 0x5580d744e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:34826/0 (socket says 172.21.15.90:34826) 2022-07-05T11:48:22.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f4ffffff700 1 -- 172.21.15.90:0/2037159640 learned_addr learned my addr 172.21.15.90:0/2037159640 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:22.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 -- 172.21.15.90:0/2037159640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 msgr2=0x5580d7492c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:48:22.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d7492c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:22.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 -- 172.21.15.90:0/2037159640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 msgr2=0x5580d749c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 -- 172.21.15.90:0/2037159640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d71d69e0 con 0x5580d74923c0 2022-07-05T11:48:22.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f4ffffff700 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:48:22.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f500659c700 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74923c0 0x5580d744e7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4ff8000e50 tx=0x7f4ff8082d90).ready entity=mon.1 client_cookie=7f415c19bb07b84b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:22.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f4fe77fe700 1 -- 172.21.15.90:0/2037159640 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8086a50 con 0x5580d74923c0 2022-07-05T11:48:22.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f4fe77fe700 1 -- 172.21.15.90:0/2037159640 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff80afe90 con 0x5580d74923c0 2022-07-05T11:48:22.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.194+0000 7f4fe77fe700 1 -- 172.21.15.90:0/2037159640 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff808c330 con 0x5580d74923c0 2022-07-05T11:48:22.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 -- 172.21.15.90:0/2037159640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74923c0 msgr2=0x5580d744e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74923c0 0x5580d744e7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4ff8000e50 tx=0x7f4ff8082d90).stop 2022-07-05T11:48:22.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 -- 172.21.15.90:0/2037159640 shutdown_connections 2022-07-05T11:48:22.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d7492c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:22.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74923c0 0x5580d744e7c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/2037159640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 -- 172.21.15.90:0/2037159640 >> 172.21.15.90:0/2037159640 conn(0x5580d72bd1c0 msgr2=0x5580d7451ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:22.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 -- 172.21.15.90:0/2037159640 shutdown_connections 2022-07-05T11:48:22.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.195+0000 7f501e4bfb80 1 -- 172.21.15.90:0/2037159640 wait complete. 2022-07-05T11:48:22.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.196+0000 7f501e4bfb80 1 -- start start 2022-07-05T11:48:22.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.196+0000 7f501e4bfb80 1 Processor -- start 2022-07-05T11:48:22.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74923c0 0x5580d74882b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74927a0 0x5580d748c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d736c120 con 0x5580d744ecb0 2022-07-05T11:48:22.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d749c260 con 0x5580d74927a0 2022-07-05T11:48:22.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d748d710 con 0x5580d74923c0 2022-07-05T11:48:22.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f501e4bfb80 10 client.0 ll_register_callbacks cb 0x5580d74121b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:22.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58512/0 (socket says 172.21.15.90:58512) 2022-07-05T11:48:22.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 -- 172.21.15.90:0/3460210273 learned_addr learned my addr 172.21.15.90:0/3460210273 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:22.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f5006d9d700 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74927a0 0x5580d748c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 -- 172.21.15.90:0/3460210273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74923c0 msgr2=0x5580d74882b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74923c0 0x5580d74882b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:22.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 -- 172.21.15.90:0/3460210273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74927a0 msgr2=0x5580d748c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74927a0 0x5580d748c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f500659c700 1 -- 172.21.15.90:0/3460210273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500817d560 con 0x5580d744ecb0 2022-07-05T11:48:22.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.197+0000 7f5006d9d700 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74927a0 0x5580d748c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:48:22.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f500659c700 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749b590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4ff80b1010 tx=0x7f4ff8055000).ready entity=mon.0 client_cookie=9df88383d524fdbd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:22.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f4fe4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:48:22.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3460210273 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8090070 con 0x5580d744ecb0 2022-07-05T11:48:22.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3460210273 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f4ff8083160 con 0x5580d744ecb0 2022-07-05T11:48:22.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580d744c440 con 0x5580d744ecb0 2022-07-05T11:48:22.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3460210273 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ff8083320 con 0x5580d744ecb0 2022-07-05T11:48:22.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 10 client.5310 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:22.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f5008170440 con 0x5580d744ecb0 2022-07-05T11:48:22.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3460210273 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5580d744c440 con 0x5580d744ecb0 2022-07-05T11:48:22.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3460210273 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f4ff8093020 con 0x5580d744ecb0 2022-07-05T11:48:22.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 10 client.5310 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:22.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 10 client.5310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:22.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 20 client.5310 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:22.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74953f0 0x5580d7495800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 4 client.5310 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:48:22.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580d739a7f0 con 0x5580d74953f0 2022-07-05T11:48:22.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.198+0000 7f4ffffff700 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74953f0 0x5580d7495800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.199+0000 7f4fe4ff9700 10 client.5310 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:22.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.199+0000 7f4ffffff700 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74953f0 0x5580d7495800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ab93781f0f1b5325 server_cookie=1cfdf12f53d3659f in_seq=0 out_seq=0 2022-07-05T11:48:22.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3460210273 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5580d739a7f0 con 0x5580d74953f0 2022-07-05T11:48:22.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f4fe4ff9700 10 client.5310 handle_command_reply: tid=0 2022-07-05T11:48:22.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 client.5310 shutdown 2022-07-05T11:48:22.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 msgr2=0x5580d749b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749b590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4ff80b1010 tx=0x7f4ff8055000).stop 2022-07-05T11:48:22.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 shutdown_connections 2022-07-05T11:48:22.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74953f0 0x5580d7495800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d74927a0 0x5580d748c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d744ecb0 0x5580d749b590 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f4fe4ff9700 0 client.5310 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:22.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3460210273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74923c0 0x5580d74882b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:22.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 >> 172.21.15.90:0/3460210273 conn(0x5580d72bd1c0 msgr2=0x5580d74bf150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:22.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 shutdown_connections 2022-07-05T11:48:22.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3460210273 wait complete. 2022-07-05T11:48:22.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.200+0000 7f501e4bfb80 20 client.5310 trim_cache size 0 max 16384 2022-07-05T11:48:22.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.217+0000 7f501e4bfb80 1 Processor -- start 2022-07-05T11:48:22.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.217+0000 7f501e4bfb80 1 -- start start 2022-07-05T11:48:22.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.218+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d749bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.218+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d74c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.218+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d7448ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.218+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d751ccf0 con 0x5580d74923c0 2022-07-05T11:48:22.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.218+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d74490f0 con 0x5580d744ecb0 2022-07-05T11:48:22.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.218+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d7450bf0 con 0x5580d74927a0 2022-07-05T11:48:22.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d74c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d74c1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58522/0 (socket says 172.21.15.90:58522) 2022-07-05T11:48:22.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 -- 172.21.15.90:0/4039567798 learned_addr learned my addr 172.21.15.90:0/4039567798 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:22.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f5006d9d700 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d7448ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f500659c700 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d749bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 -- 172.21.15.90:0/4039567798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 msgr2=0x5580d7448ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d7448ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 -- 172.21.15.90:0/4039567798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 msgr2=0x5580d749bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d749bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 -- 172.21.15.90:0/4039567798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d7495b60 con 0x5580d74923c0 2022-07-05T11:48:22.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4ffffff700 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d74c1ad0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x5580d7459d10 tx=0x7f4ff0013000).ready entity=mon.0 client_cookie=e9e71bc56007d9a7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:22.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4fe7fff700 1 -- 172.21.15.90:0/4039567798 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00076d0 con 0x5580d74923c0 2022-07-05T11:48:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4fe7fff700 1 -- 172.21.15.90:0/4039567798 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff00225c0 con 0x5580d74923c0 2022-07-05T11:48:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.219+0000 7f4fe7fff700 1 -- 172.21.15.90:0/4039567798 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0022960 con 0x5580d74923c0 2022-07-05T11:48:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 -- 172.21.15.90:0/4039567798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 msgr2=0x5580d74c1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d74c1ad0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x5580d7459d10 tx=0x7f4ff0013000).stop 2022-07-05T11:48:22.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 -- 172.21.15.90:0/4039567798 shutdown_connections 2022-07-05T11:48:22.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d7448ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d749bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/4039567798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d74c1ad0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 -- 172.21.15.90:0/4039567798 >> 172.21.15.90:0/4039567798 conn(0x5580d72bd1c0 msgr2=0x5580d749b570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 -- 172.21.15.90:0/4039567798 shutdown_connections 2022-07-05T11:48:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 -- 172.21.15.90:0/4039567798 wait complete. 2022-07-05T11:48:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.220+0000 7f501e4bfb80 1 -- start start 2022-07-05T11:48:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.221+0000 7f501e4bfb80 1 Processor -- start 2022-07-05T11:48:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d74bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d751c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d748afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d74be8f0 con 0x5580d74923c0 2022-07-05T11:48:22.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d748bc70 con 0x5580d744ecb0 2022-07-05T11:48:22.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d74be610 con 0x5580d74927a0 2022-07-05T11:48:22.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 10 client.0 ll_register_callbacks cb 0x5580d74121b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:22.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d751c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d751c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58528/0 (socket says 172.21.15.90:58528) 2022-07-05T11:48:22.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 -- 172.21.15.90:0/3203247445 learned_addr learned my addr 172.21.15.90:0/3203247445 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:22.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f5006d9d700 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d748afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f500659c700 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d74bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 -- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 msgr2=0x5580d748afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d748afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 -- 172.21.15.90:0/3203247445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 msgr2=0x5580d74bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:22.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d74bdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 -- 172.21.15.90:0/3203247445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff001c040 con 0x5580d74923c0 2022-07-05T11:48:22.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4ffffff700 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d751c110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f4ff0000c00 tx=0x7f4ff0019000).ready entity=mon.0 client_cookie=a0a886ccadb44e99 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:22.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4fe4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:48:22.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3203247445 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00138d0 con 0x5580d74923c0 2022-07-05T11:48:22.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3203247445 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f4ff0013a30 con 0x5580d74923c0 2022-07-05T11:48:22.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ff80afe90 con 0x5580d74923c0 2022-07-05T11:48:22.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3203247445 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ff0013bf0 con 0x5580d74923c0 2022-07-05T11:48:22.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.222+0000 7f501e4bfb80 10 client.5316 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:22.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f50080c8f90 con 0x5580d74923c0 2022-07-05T11:48:22.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3203247445 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0040020 con 0x5580d74923c0 2022-07-05T11:48:22.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3203247445 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f4ff0029070 con 0x5580d74923c0 2022-07-05T11:48:22.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f501e4bfb80 10 client.5316 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:22.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f501e4bfb80 10 client.5316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:22.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f501e4bfb80 20 client.5316 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:22.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74c1b90 0x5580d749bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:22.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f501e4bfb80 4 client.5316 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:48:22.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5580d7391690 con 0x5580d74c1b90 2022-07-05T11:48:22.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f500659c700 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74c1b90 0x5580d749bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:22.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f4fe4ff9700 10 client.5316 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:22.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.223+0000 7f500659c700 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74c1b90 0x5580d749bb40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2d40191e61629008 server_cookie=b9fff542be80fa59 in_seq=0 out_seq=0 2022-07-05T11:48:22.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f4fe4ff9700 1 -- 172.21.15.90:0/3203247445 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5580d7391690 con 0x5580d74c1b90 2022-07-05T11:48:22.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f4fe4ff9700 10 client.5316 handle_command_reply: tid=0 2022-07-05T11:48:22.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 client.5316 shutdown 2022-07-05T11:48:22.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 msgr2=0x5580d751c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d751c110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f4ff0000c00 tx=0x7f4ff0019000).stop 2022-07-05T11:48:22.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 shutdown_connections 2022-07-05T11:48:22.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5580d74c1b90 0x5580d749bb40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5580d74927a0 0x5580d748afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f4fe4ff9700 0 client.5316 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:22.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5580d744ecb0 0x5580d74bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 --2- 172.21.15.90:0/3203247445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5580d74923c0 0x5580d751c110 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 >> 172.21.15.90:0/3203247445 conn(0x5580d72bd1c0 msgr2=0x5580d7496390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:22.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 shutdown_connections 2022-07-05T11:48:22.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 1 -- 172.21.15.90:0/3203247445 wait complete. 2022-07-05T11:48:22.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.226+0000 7f501e4bfb80 20 client.5316 trim_cache size 0 max 16384 2022-07-05T11:48:22.304 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:48:22.304 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "no active scrubs running", 2022-07-05T11:48:22.304 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": {} 2022-07-05T11:48:22.304 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:48:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4fec08ba40 msgr2=0x7f4fec08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4fec08ba40 0x7f4fec08df00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f5008182df0 tx=0x7f4ff0009040).stop 2022-07-05T11:48:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 msgr2=0x7f500816eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f500816eec0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f4ff8006fd0 tx=0x7f4ff8017000).stop 2022-07-05T11:48:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 shutdown_connections 2022-07-05T11:48:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4fec08ba40 0x7f4fec08df00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f500817f3b0 0x7f50080cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5008178610 0x7f500816eec0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 --2- 172.21.15.90:0/233783399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500817e100 0x7f500816f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 >> 172.21.15.90:0/233783399 conn(0x7f50080f2210 msgr2=0x7f500817d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 shutdown_connections 2022-07-05T11:48:22.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:22.227+0000 7f500cb33700 1 -- 172.21.15.90:0/233783399 wait complete. 2022-07-05T11:48:22.309 INFO:tasks.cephfs.filesystem:all active scrubs completed 2022-07-05T11:48:23.312 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2022-07-05T11:48:23.313 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2022-07-05T11:48:23.389 INFO:tasks.workunit.client.0.smithi090.stdout: 49 222285 535 146559 644 93728 594 2022-07-05T11:48:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.463+0000 7fc0f0864700 1 Processor -- start 2022-07-05T11:48:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.463+0000 7fc0f0864700 1 -- start start 2022-07-05T11:48:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.464+0000 7fc0f0864700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc0ec082660 0x7fc0ec18baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.464+0000 7fc0f0864700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ec18dce0 con 0x7fc0ec0c0520 2022-07-05T11:48:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.464+0000 7fc0f0864700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ec18dfc0 con 0x7fc0ec18e750 2022-07-05T11:48:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.464+0000 7fc0f0864700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ec18e2a0 con 0x7fc0ec082660 2022-07-05T11:48:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.464+0000 7fc0e9d9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc0ec0c0520 0x7fc0ec0c0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51476/0 (socket says 172.21.15.90:51476) 2022-07-05T11:48:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.464+0000 7fc0e9d9b700 1 -- 172.21.15.90:0/855950615 learned_addr learned my addr 172.21.15.90:0/855950615 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:48:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156434982 0 0) 0x7fc0ec18dce0 con 0x7fc0ec0c0520 2022-07-05T11:48:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d80033f0 con 0x7fc0ec0c0520 2022-07-05T11:48:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958475477 0 0) 0x7fc0d80033f0 con 0x7fc0ec0c0520 2022-07-05T11:48:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 >> v2:172.21.15.149:3300/0 conn(0x7fc0ec082660 msgr2=0x7fc0ec18baa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:48:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 --2- 172.21.15.90:0/855950615 >> v2:172.21.15.149:3300/0 conn(0x7fc0ec082660 0x7fc0ec18baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 >> v1:172.21.15.149:6789/0 conn(0x7fc0ec18e750 legacy=0x7fc0ec18eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec0bfd20 con 0x7fc0ec0c0520 2022-07-05T11:48:23.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fc0d4001470 con 0x7fc0ec0c0520 2022-07-05T11:48:23.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 >> v1:172.21.15.90:6789/0 conn(0x7fc0ec0c0520 legacy=0x7fc0ec0c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.465+0000 7fc0e959a700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0d8003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.466+0000 7fc0e959a700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0d8004690 0x7fc0d8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.466+0000 7fc0e959a700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0d8005120 0x7fc0d80098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.466+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec18e2a0 con 0x7fc0d80038e0 2022-07-05T11:48:23.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.466+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8009ff0 con 0x7fc0d8004690 2022-07-05T11:48:23.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.466+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d800a1b0 con 0x7fc0d8005120 2022-07-05T11:48:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.466+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0d8003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.466+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0d8004690 0x7fc0d8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0ea59c700 1 -- 172.21.15.90:0/855950615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0d8005120 msgr2=0x7fc0d80098d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:48:23.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0d8005120 0x7fc0d80098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:23.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0ea59c700 1 -- 172.21.15.90:0/855950615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0d8004690 msgr2=0x7fc0d8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0d8004690 0x7fc0d8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0ead9d700 1 -- 172.21.15.90:0/855950615 reap_dead start 2022-07-05T11:48:23.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0ea59c700 1 -- 172.21.15.90:0/855950615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec0bfd20 con 0x7fc0d80038e0 2022-07-05T11:48:23.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0d8003ce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fc0dc00b7a0 tx=0x7fc0dc006d70).ready entity=mon.0 client_cookie=7a6ab9357fa1afc7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc013460 con 0x7fc0d80038e0 2022-07-05T11:48:23.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc0135e0 con 0x7fc0d80038e0 2022-07-05T11:48:23.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.467+0000 7fc0e959a700 1 -- 172.21.15.90:0/855950615 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0139a0 con 0x7fc0d80038e0 2022-07-05T11:48:23.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.468+0000 7fc0f0864700 1 -- 172.21.15.90:0/855950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 msgr2=0x7fc0d8003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.468+0000 7fc0f0864700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0d8003ce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fc0dc00b7a0 tx=0x7fc0dc006d70).stop 2022-07-05T11:48:23.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.468+0000 7fc0f0864700 1 -- 172.21.15.90:0/855950615 shutdown_connections 2022-07-05T11:48:23.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.468+0000 7fc0f0864700 1 --2- 172.21.15.90:0/855950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0d8003ce0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.468+0000 7fc0f0864700 1 -- 172.21.15.90:0/855950615 >> 172.21.15.90:0/855950615 conn(0x7fc0ec0f0750 msgr2=0x7fc0ec0f0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.468+0000 7fc0f0864700 1 -- 172.21.15.90:0/855950615 shutdown_connections 2022-07-05T11:48:23.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.468+0000 7fc0f0864700 1 -- 172.21.15.90:0/855950615 wait complete. 2022-07-05T11:48:23.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.470+0000 7fc0f0864700 1 Processor -- start 2022-07-05T11:48:23.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.470+0000 7fc0f0864700 1 -- start start 2022-07-05T11:48:23.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0f0864700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0ec1807f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0f0864700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0ec0f1080 0x7fc0ec0e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0f0864700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec0ea070 0x7fc0ec0c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0f0864700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19b600 con 0x7fc0d80038e0 2022-07-05T11:48:23.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0f0864700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec0e9660 con 0x7fc0ec0f1080 2022-07-05T11:48:23.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0f0864700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19b850 con 0x7fc0ec0ea070 2022-07-05T11:48:23.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ea59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0ec1807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0e9d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0ec0f1080 0x7fc0ec0e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0e9d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0ec0f1080 0x7fc0ec0e9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:34866/0 (socket says 172.21.15.90:34866) 2022-07-05T11:48:23.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ea59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0ec1807f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58546/0 (socket says 172.21.15.90:58546) 2022-07-05T11:48:23.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0e9d9b700 1 -- 172.21.15.90:0/1543828569 learned_addr learned my addr 172.21.15.90:0/1543828569 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec0ea070 0x7fc0ec0c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ea59c700 1 -- 172.21.15.90:0/1543828569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec0ea070 msgr2=0x7fc0ec0c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec0ea070 0x7fc0ec0c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ea59c700 1 -- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0ec0f1080 msgr2=0x7fc0ec0e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0ec0f1080 0x7fc0ec0e9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0ea59c700 1 -- 172.21.15.90:0/1543828569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec19bb30 con 0x7fc0d80038e0 2022-07-05T11:48:23.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.471+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0ec0f1080 0x7fc0ec0e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:48:23.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.472+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0ec1807f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fc0dc012000 tx=0x7fc0dc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.472+0000 7fc0e27fc700 1 -- 172.21.15.90:0/1543828569 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc013460 con 0x7fc0d80038e0 2022-07-05T11:48:23.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.472+0000 7fc0e27fc700 1 -- 172.21.15.90:0/1543828569 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc013960 con 0x7fc0d80038e0 2022-07-05T11:48:23.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.472+0000 7fc0e27fc700 1 -- 172.21.15.90:0/1543828569 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc020690 con 0x7fc0d80038e0 2022-07-05T11:48:23.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.472+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec19be10 con 0x7fc0d80038e0 2022-07-05T11:48:23.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.472+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec19c3d0 con 0x7fc0d80038e0 2022-07-05T11:48:23.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.474+0000 7fc0e27fc700 1 -- 172.21.15.90:0/1543828569 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc0dc00f070 con 0x7fc0d80038e0 2022-07-05T11:48:23.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.475+0000 7fc0e27fc700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc0d008ba40 0x7fc0d008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.475+0000 7fc0e27fc700 1 -- 172.21.15.90:0/1543828569 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc0dc0b1920 con 0x7fc0d80038e0 2022-07-05T11:48:23.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.475+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc0d008ba40 0x7fc0d008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.477+0000 7fc1021f0b80 1 Processor -- start 2022-07-05T11:48:23.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.477+0000 7fc1021f0b80 1 -- start start 2022-07-05T11:48:23.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc0d008ba40 0x7fc0d008df00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fc0d40010e0 tx=0x7fc0d4007040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 0x5614bb7a1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb76b350 con 0x5614bb7e5820 2022-07-05T11:48:23.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb6e2b20 con 0x5614bb7e5440 2022-07-05T11:48:23.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb6f79d0 con 0x5614bb7a1d30 2022-07-05T11:48:23.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0e9d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7e5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58556/0 (socket says 172.21.15.90:58556) 2022-07-05T11:48:23.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3099786363 learned_addr learned my addr 172.21.15.90:0/3099786363 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3099786363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 msgr2=0x5614bb7efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/3099786363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3099786363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 msgr2=0x5614bb7a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/3099786363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 0x5614bb7a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:23.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3099786363 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614bb529a60 con 0x5614bb7e5820 2022-07-05T11:48:23.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.478+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/3099786363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7e5ca0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc0e4007140 tx=0x7fc0e4007f70).ready entity=mon.0 client_cookie=e590054e0e5c3028 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.479+0000 7fc0cb7fe700 1 -- 172.21.15.90:0/3099786363 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4006b70 con 0x5614bb7e5820 2022-07-05T11:48:23.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.479+0000 7fc0cb7fe700 1 -- 172.21.15.90:0/3099786363 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e4005c20 con 0x5614bb7e5820 2022-07-05T11:48:23.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.479+0000 7fc0cb7fe700 1 -- 172.21.15.90:0/3099786363 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4006030 con 0x5614bb7e5820 2022-07-05T11:48:23.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3099786363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 msgr2=0x5614bb7e5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3099786363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7e5ca0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc0e4007140 tx=0x7fc0e4007f70).stop 2022-07-05T11:48:23.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3099786363 shutdown_connections 2022-07-05T11:48:23.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3099786363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7e5ca0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3099786363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 0x5614bb7a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:48:23.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3099786363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3099786363 >> 172.21.15.90:0/3099786363 conn(0x5614bb610240 msgr2=0x5614bb7a4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3099786363 shutdown_connections 2022-07-05T11:48:23.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.480+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3099786363 wait complete. 2022-07-05T11:48:23.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.481+0000 7fc1021f0b80 1 -- start start 2022-07-05T11:48:23.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.481+0000 7fc1021f0b80 1 Processor -- start 2022-07-05T11:48:23.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7a1d30 0x5614bb7df290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb818560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb8102f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb6bf1a0 con 0x5614bb7e5820 2022-07-05T11:48:23.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb810fc0 con 0x5614bb7a1d30 2022-07-05T11:48:23.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb818a50 con 0x5614bb7e5440 2022-07-05T11:48:23.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc1021f0b80 10 client.0 ll_register_callbacks cb 0x5614bb765230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:23.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb8102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb8102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58560/0 (socket says 172.21.15.90:58560) 2022-07-05T11:48:23.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 -- 172.21.15.90:0/1037495229 learned_addr learned my addr 172.21.15.90:0/1037495229 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7a1d30 0x5614bb7df290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb818560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 -- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 msgr2=0x5614bb818560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb818560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 -- 172.21.15.90:0/1037495229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7a1d30 msgr2=0x5614bb7df290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7a1d30 0x5614bb7df290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ead9d700 1 -- 172.21.15.90:0/1037495229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e4006d60 con 0x5614bb7e5820 2022-07-05T11:48:23.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.482+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7a1d30 0x5614bb7df290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:48:23.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb8102f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fc0e4008000 tx=0x5614bb7f08c0).ready entity=mon.0 client_cookie=c19e417d73453c39 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:48:23.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/1037495229 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e40068f0 con 0x5614bb7e5820 2022-07-05T11:48:23.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/1037495229 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc0e4014400 con 0x5614bb7e5820 2022-07-05T11:48:23.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614bb79f4c0 con 0x5614bb7e5820 2022-07-05T11:48:23.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/1037495229 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e4014810 con 0x5614bb7e5820 2022-07-05T11:48:23.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 10 client.5328 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:23.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5614bb598d50 con 0x5614bb7e5820 2022-07-05T11:48:23.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/1037495229 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e402a020 con 0x5614bb7e5820 2022-07-05T11:48:23.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/1037495229 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7fc0e4012070 con 0x5614bb7e5820 2022-07-05T11:48:23.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 10 client.5328 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:23.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 10 client.5328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:23.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 20 client.5328 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:23.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb8107e0 0x5614bb823c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 4 client.5328 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:48:23.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614bb6ed870 con 0x5614bb8107e0 2022-07-05T11:48:23.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.483+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb8107e0 0x5614bb823c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.484+0000 7fc0c8ff9700 10 client.5328 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.484+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb8107e0 0x5614bb823c10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=154009e869952e28 server_cookie=e50e7c3a1fc553db in_seq=0 out_seq=0 2022-07-05T11:48:23.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/1037495229 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5614bb6ed870 con 0x5614bb8107e0 2022-07-05T11:48:23.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc0c8ff9700 10 client.5328 handle_command_reply: tid=0 2022-07-05T11:48:23.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 client.5328 shutdown 2022-07-05T11:48:23.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 msgr2=0x5614bb8102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb8102f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fc0e4008000 tx=0x5614bb7f08c0).stop 2022-07-05T11:48:23.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 shutdown_connections 2022-07-05T11:48:23.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb8107e0 0x5614bb823c10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb8102f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7a1d30 0x5614bb7df290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc0c8ff9700 0 client.5328 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/1037495229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb818560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 >> 172.21.15.90:0/1037495229 conn(0x5614bb610240 msgr2=0x5614bb7a1590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 shutdown_connections 2022-07-05T11:48:23.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.485+0000 7fc1021f0b80 1 -- 172.21.15.90:0/1037495229 wait complete. 2022-07-05T11:48:23.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.486+0000 7fc1021f0b80 20 client.5328 trim_cache size 0 max 16384 2022-07-05T11:48:23.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.504+0000 7fc1021f0b80 1 Processor -- start 2022-07-05T11:48:23.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.504+0000 7fc1021f0b80 1 -- start start 2022-07-05T11:48:23.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 0x5614bb7eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7a3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb8172e0 con 0x5614bb7e5820 2022-07-05T11:48:23.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb7ecf40 con 0x5614bb7e5440 2022-07-05T11:48:23.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb7df8f0 con 0x5614bb7a1d30 2022-07-05T11:48:23.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7a3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58570/0 (socket says 172.21.15.90:58570) 2022-07-05T11:48:23.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3272538640 learned_addr learned my addr 172.21.15.90:0/3272538640 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 0x5614bb7eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3272538640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 msgr2=0x5614bb7efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3272538640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 msgr2=0x5614bb7eca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 0x5614bb7eca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 -- 172.21.15.90:0/3272538640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614bb7a6260 con 0x5614bb7e5820 2022-07-05T11:48:23.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.505+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7a3650 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fc0e4007010 tx=0x7fc0e401f000).ready entity=mon.0 client_cookie=f2dcde383992f116 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.507+0000 7fc0cbfff700 1 -- 172.21.15.90:0/3272538640 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4014400 con 0x5614bb7e5820 2022-07-05T11:48:23.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.507+0000 7fc0cbfff700 1 -- 172.21.15.90:0/3272538640 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614bb79f4c0 con 0x5614bb7e5820 2022-07-05T11:48:23.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.507+0000 7fc0cbfff700 1 -- 172.21.15.90:0/3272538640 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4000f40 con 0x5614bb7e5820 2022-07-05T11:48:23.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3272538640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 msgr2=0x5614bb7a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7a3650 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fc0e4007010 tx=0x7fc0e401f000).stop 2022-07-05T11:48:23.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3272538640 shutdown_connections 2022-07-05T11:48:23.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7e5820 0x5614bb7a3650 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7a1d30 0x5614bb7efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/3272538640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5440 0x5614bb7eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3272538640 >> 172.21.15.90:0/3272538640 conn(0x5614bb610240 msgr2=0x5614bb7edbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3272538640 shutdown_connections 2022-07-05T11:48:23.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 -- 172.21.15.90:0/3272538640 wait complete. 2022-07-05T11:48:23.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.508+0000 7fc1021f0b80 1 -- start start 2022-07-05T11:48:23.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.509+0000 7fc1021f0b80 1 Processor -- start 2022-07-05T11:48:23.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7a1d30 0x5614bb8178a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb80e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc1021f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5820 0x5614bb7da620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb7e39b0 con 0x5614bb7a1d30 2022-07-05T11:48:23.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb7a1110 con 0x5614bb7e5820 2022-07-05T11:48:23.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc1021f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bb7e4210 con 0x5614bb7e5440 2022-07-05T11:48:23.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc1021f0b80 10 client.0 ll_register_callbacks cb 0x5614bb765230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:23.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7a1d30 0x5614bb8178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7a1d30 0x5614bb8178a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58572/0 (socket says 172.21.15.90:58572) 2022-07-05T11:48:23.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 -- 172.21.15.90:0/822938711 learned_addr learned my addr 172.21.15.90:0/822938711 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb80e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ead9d700 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5820 0x5614bb7da620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 -- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 msgr2=0x5614bb80e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb80e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 -- 172.21.15.90:0/822938711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5820 msgr2=0x5614bb7da620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5820 0x5614bb7da620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 -- 172.21.15.90:0/822938711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614bb598d50 con 0x5614bb7a1d30 2022-07-05T11:48:23.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0ea59c700 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7a1d30 0x5614bb8178a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fc0dc00bfd0 tx=0x7fc0dc055040).ready entity=mon.0 client_cookie=e2ec50e885bb1e4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.510+0000 7fc0c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:48:23.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/822938711 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc086030 con 0x5614bb7a1d30 2022-07-05T11:48:23.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/822938711 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc0dc086260 con 0x5614bb7a1d30 2022-07-05T11:48:23.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614bb7ed620 con 0x5614bb7a1d30 2022-07-05T11:48:23.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/822938711 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0dc08bb40 con 0x5614bb7a1d30 2022-07-05T11:48:23.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 10 client.5334 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:23.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5614bb567050 con 0x5614bb7a1d30 2022-07-05T11:48:23.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/822938711 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614bb7ed620 con 0x5614bb7a1d30 2022-07-05T11:48:23.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/822938711 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7fc0dc08b6b0 con 0x5614bb7a1d30 2022-07-05T11:48:23.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 10 client.5334 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:23.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 10 client.5334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:23.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 20 client.5334 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:23.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb7e0f20 0x5614bb870000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 4 client.5334 mds_command: new command op to 4371 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2022-07-05T11:48:23.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7fc0e4005c20 con 0x5614bb7e0f20 2022-07-05T11:48:23.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.511+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb7e0f20 0x5614bb870000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.512+0000 7fc0c8ff9700 10 client.5334 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.512+0000 7fc0e9d9b700 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb7e0f20 0x5614bb870000 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c8cda350c606c53b server_cookie=b33a09048166add5 in_seq=0 out_seq=0 2022-07-05T11:48:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc0c8ff9700 1 -- 172.21.15.90:0/822938711 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fc0e4005c20 con 0x5614bb7e0f20 2022-07-05T11:48:23.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc0c8ff9700 10 client.5334 handle_command_reply: tid=0 2022-07-05T11:48:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 client.5334 shutdown 2022-07-05T11:48:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7a1d30 msgr2=0x5614bb8178a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7a1d30 0x5614bb8178a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fc0dc00bfd0 tx=0x7fc0dc055040).stop 2022-07-05T11:48:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 shutdown_connections 2022-07-05T11:48:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5614bb7e0f20 0x5614bb870000 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5614bb7e5820 0x5614bb7da620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc0c8ff9700 0 client.5334 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614bb7a1d30 0x5614bb8178a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 --2- 172.21.15.90:0/822938711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614bb7e5440 0x5614bb80e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 >> 172.21.15.90:0/822938711 conn(0x5614bb610240 msgr2=0x5614bb7d9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 shutdown_connections 2022-07-05T11:48:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 1 -- 172.21.15.90:0/822938711 wait complete. 2022-07-05T11:48:23.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.515+0000 7fc1021f0b80 20 client.5334 trim_cache size 0 max 16384 2022-07-05T11:48:23.632 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:48:23.633 INFO:teuthology.orchestra.run.smithi090.stdout: "return_code": 0, 2022-07-05T11:48:23.633 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:48:23.633 INFO:teuthology.orchestra.run.smithi090.stdout: "mode": "asynchronous" 2022-07-05T11:48:23.633 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:48:23.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc0d008ba40 msgr2=0x7fc0d008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc0d008ba40 0x7fc0d008df00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fc0d40010e0 tx=0x7fc0d4007040).stop 2022-07-05T11:48:23.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 msgr2=0x7fc0ec1807f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0ec1807f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fc0dc012000 tx=0x7fc0dc015000).stop 2022-07-05T11:48:23.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 shutdown_connections 2022-07-05T11:48:23.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc0d008ba40 0x7fc0d008df00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec0ea070 0x7fc0ec0c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0d80038e0 0x7fc0ec1807f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 --2- 172.21.15.90:0/1543828569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0ec0f1080 0x7fc0ec0e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 >> 172.21.15.90:0/1543828569 conn(0x7fc0ec0f0750 msgr2=0x7fc0ec18d500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 shutdown_connections 2022-07-05T11:48:23.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.516+0000 7fc0f0864700 1 -- 172.21.15.90:0/1543828569 wait complete. 2022-07-05T11:48:23.639 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:48:23.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.765+0000 7f56a1a64700 1 Processor -- start 2022-07-05T11:48:23.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.765+0000 7f56a1a64700 1 -- start start 2022-07-05T11:48:23.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.766+0000 7f56a1a64700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c17a2b0 con 0x7f569c0c98a0 2022-07-05T11:48:23.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.766+0000 7f56a1a64700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c17a590 con 0x7f569c176670 2022-07-05T11:48:23.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.766+0000 7f56a1a64700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c17a870 con 0x7f569c176290 2022-07-05T11:48:23.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.766+0000 7f569affd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f569c0c98a0 0x7f569c17b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51524/0 (socket says 172.21.15.90:51524) 2022-07-05T11:48:23.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.766+0000 7f569affd700 1 -- 172.21.15.90:0/1059009629 learned_addr learned my addr 172.21.15.90:0/1059009629 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:48:23.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889545925 0 0) 0x7f569c17a2b0 con 0x7f569c0c98a0 2022-07-05T11:48:23.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56880033f0 con 0x7f569c0c98a0 2022-07-05T11:48:23.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403506160 0 0) 0x7f569c17a870 con 0x7f569c176290 2022-07-05T11:48:23.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f569c17a2b0 con 0x7f569c176290 2022-07-05T11:48:23.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977880656 0 0) 0x7f569c17a590 con 0x7f569c176670 2022-07-05T11:48:23.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f569c17a870 con 0x7f569c176670 2022-07-05T11:48:23.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4172180038 0 0) 0x7f56880033f0 con 0x7f569c0c98a0 2022-07-05T11:48:23.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 >> v1:172.21.15.149:6789/0 conn(0x7f569c176290 legacy=0x7f569c0c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 >> v1:172.21.15.110:6789/0 conn(0x7f569c176670 legacy=0x7f569c17bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c17ab50 con 0x7f569c0c98a0 2022-07-05T11:48:23.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f5690001470 con 0x7f569c0c98a0 2022-07-05T11:48:23.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 >> v1:172.21.15.90:6789/0 conn(0x7f569c0c98a0 legacy=0x7f569c17b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5688003c80 0x7f5688004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56880046e0 0x7f5688004b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688005180 0x7f568800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568800c030 con 0x7f5688003c80 2022-07-05T11:48:23.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568800c1a0 con 0x7f5688005180 2022-07-05T11:48:23.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568800c360 con 0x7f56880046e0 2022-07-05T11:48:23.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569b7fe700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5688003c80 0x7f5688004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569affd700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56880046e0 0x7f5688004b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569bfff700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688005180 0x7f568800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569b7fe700 1 -- 172.21.15.90:0/1059009629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56880046e0 msgr2=0x7f5688004b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569b7fe700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56880046e0 0x7f5688004b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569b7fe700 1 -- 172.21.15.90:0/1059009629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688005180 msgr2=0x7f568800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569b7fe700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688005180 0x7f568800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569b7fe700 1 -- 172.21.15.90:0/1059009629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880033f0 con 0x7f5688003c80 2022-07-05T11:48:23.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569bfff700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688005180 0x7f568800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:48:23.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569bfff700 1 -- 172.21.15.90:0/1059009629 reap_dead start 2022-07-05T11:48:23.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.767+0000 7f569b7fe700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5688003c80 0x7f5688004060 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f568c001870 tx=0x7f568c007b90).ready entity=mon.0 client_cookie=9451723a0d011672 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c007ea0 con 0x7f5688003c80 2022-07-05T11:48:23.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c012400 con 0x7f5688003c80 2022-07-05T11:48:23.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f569a7fc700 1 -- 172.21.15.90:0/1059009629 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c0127a0 con 0x7f5688003c80 2022-07-05T11:48:23.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f56a1a64700 1 -- 172.21.15.90:0/1059009629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5688003c80 msgr2=0x7f5688004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f56a1a64700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5688003c80 0x7f5688004060 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f568c001870 tx=0x7f568c007b90).stop 2022-07-05T11:48:23.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f56a1a64700 1 -- 172.21.15.90:0/1059009629 shutdown_connections 2022-07-05T11:48:23.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f56a1a64700 1 --2- 172.21.15.90:0/1059009629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5688003c80 0x7f5688004060 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f56a1a64700 1 -- 172.21.15.90:0/1059009629 >> 172.21.15.90:0/1059009629 conn(0x7f569c083570 msgr2=0x7f569c083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f56a1a64700 1 -- 172.21.15.90:0/1059009629 shutdown_connections 2022-07-05T11:48:23.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.768+0000 7f56a1a64700 1 -- 172.21.15.90:0/1059009629 wait complete. 2022-07-05T11:48:23.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.770+0000 7f56a1a64700 1 Processor -- start 2022-07-05T11:48:23.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.770+0000 7f56a1a64700 1 -- start start 2022-07-05T11:48:23.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f56a1a64700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5688003c80 0x7f569c168040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f56a1a64700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f569c168530 0x7f569c174960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f56a1a64700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f569c1689b0 0x7f569c174e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f56a1a64700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1967f0 con 0x7f569c1689b0 2022-07-05T11:48:23.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f56a1a64700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1978d0 con 0x7f569c168530 2022-07-05T11:48:23.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f56a1a64700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c173970 con 0x7f5688003c80 2022-07-05T11:48:23.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f569c1689b0 0x7f569c174e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f569c1689b0 0x7f569c174e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58596/0 (socket says 172.21.15.90:58596) 2022-07-05T11:48:23.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 -- 172.21.15.90:0/3423320380 learned_addr learned my addr 172.21.15.90:0/3423320380 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569b7fe700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5688003c80 0x7f569c168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569affd700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f569c168530 0x7f569c174960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 -- 172.21.15.90:0/3423320380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5688003c80 msgr2=0x7f569c168040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5688003c80 0x7f569c168040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 -- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f569c168530 msgr2=0x7f569c174960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f569c168530 0x7f569c174960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 -- 172.21.15.90:0/3423320380 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c1744d0 con 0x7f569c1689b0 2022-07-05T11:48:23.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.771+0000 7f569bfff700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f569c1689b0 0x7f569c174e50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f569c0eb050 tx=0x7f5694009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.772+0000 7f56837fe700 1 -- 172.21.15.90:0/3423320380 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940018c0 con 0x7f569c1689b0 2022-07-05T11:48:23.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.772+0000 7f56837fe700 1 -- 172.21.15.90:0/3423320380 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694001a20 con 0x7f569c1689b0 2022-07-05T11:48:23.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.772+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c196510 con 0x7f569c1689b0 2022-07-05T11:48:23.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.772+0000 7f56837fe700 1 -- 172.21.15.90:0/3423320380 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694001dc0 con 0x7f569c1689b0 2022-07-05T11:48:23.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.772+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c173e80 con 0x7f569c1689b0 2022-07-05T11:48:23.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.773+0000 7f56837fe700 1 -- 172.21.15.90:0/3423320380 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f569401c060 con 0x7f569c1689b0 2022-07-05T11:48:23.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.774+0000 7f56837fe700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f567c08ba10 0x7f567c08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.774+0000 7f56837fe700 1 -- 172.21.15.90:0/3423320380 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f56940afcd0 con 0x7f569c1689b0 2022-07-05T11:48:23.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.774+0000 7f569b7fe700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f567c08ba10 0x7f567c08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.775+0000 7f569b7fe700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f567c08ba10 0x7f567c08ded0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f568c001120 tx=0x7f568c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.775+0000 7f56b33f0b80 1 Processor -- start 2022-07-05T11:48:23.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.776+0000 7f56b33f0b80 1 -- start start 2022-07-05T11:48:23.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e08689a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e086890c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0868162d0 con 0x55e0868907a0 2022-07-05T11:48:23.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08678daa0 con 0x55e08684ccb0 2022-07-05T11:48:23.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0867a2950 con 0x55e0868903c0 2022-07-05T11:48:23.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e086890c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e08689a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39996/0 (socket says 172.21.15.90:39996) 2022-07-05T11:48:23.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e086890c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58604/0 (socket says 172.21.15.90:58604) 2022-07-05T11:48:23.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569b7fe700 1 -- 172.21.15.90:0/208960889 learned_addr learned my addr 172.21.15.90:0/208960889 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 -- 172.21.15.90:0/208960889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 msgr2=0x55e08684c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 --2- 172.21.15.90:0/208960889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 -- 172.21.15.90:0/208960889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 msgr2=0x55e08689a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 --2- 172.21.15.90:0/208960889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e08689a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 -- 172.21.15.90:0/208960889 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0865d49e0 con 0x55e0868907a0 2022-07-05T11:48:23.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f569bfff700 1 --2- 172.21.15.90:0/208960889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e086890c20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f5694084150 tx=0x7f569400ef00).ready entity=mon.0 client_cookie=550455a8cb179ba8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.777+0000 7f5680ff9700 1 -- 172.21.15.90:0/208960889 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694089ef0 con 0x55e0868907a0 2022-07-05T11:48:23.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f5680ff9700 1 -- 172.21.15.90:0/208960889 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56940829b0 con 0x55e0868907a0 2022-07-05T11:48:23.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f5680ff9700 1 -- 172.21.15.90:0/208960889 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694083b00 con 0x55e0868907a0 2022-07-05T11:48:23.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 -- 172.21.15.90:0/208960889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 msgr2=0x55e086890c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/208960889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e086890c20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f5694084150 tx=0x7f569400ef00).stop 2022-07-05T11:48:23.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 -- 172.21.15.90:0/208960889 shutdown_connections 2022-07-05T11:48:23.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/208960889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e086890c20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/208960889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/208960889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e08689a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 -- 172.21.15.90:0/208960889 >> 172.21.15.90:0/208960889 conn(0x55e0866bb1c0 msgr2=0x55e08684fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 -- 172.21.15.90:0/208960889 shutdown_connections 2022-07-05T11:48:23.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.778+0000 7f56b33f0b80 1 -- 172.21.15.90:0/208960889 wait complete. 2022-07-05T11:48:23.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.779+0000 7f56b33f0b80 1 -- start start 2022-07-05T11:48:23.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.779+0000 7f56b33f0b80 1 Processor -- start 2022-07-05T11:48:23.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e08684ccb0 0x55e0868c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e0868c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08676a120 con 0x55e0868907a0 2022-07-05T11:48:23.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0868c1970 con 0x55e0868903c0 2022-07-05T11:48:23.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0868c07a0 con 0x55e08684ccb0 2022-07-05T11:48:23.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f56b33f0b80 10 client.0 ll_register_callbacks cb 0x55e0868101b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:23.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e08684ccb0 0x55e0868c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f569affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e0868c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58610/0 (socket says 172.21.15.90:58610) 2022-07-05T11:48:23.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e08684ccb0 0x55e0868c0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40002/0 (socket says 172.21.15.90:40002) 2022-07-05T11:48:23.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.780+0000 7f569bfff700 1 -- 172.21.15.90:0/698734588 learned_addr learned my addr 172.21.15.90:0/698734588 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f569bfff700 1 -- 172.21.15.90:0/698734588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e08684ccb0 msgr2=0x55e0868c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f569bfff700 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e08684ccb0 0x55e0868c0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f569bfff700 1 -- 172.21.15.90:0/698734588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 msgr2=0x55e0868c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f569bfff700 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e0868c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f569bfff700 1 -- 172.21.15.90:0/698734588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c173e80 con 0x55e0868907a0 2022-07-05T11:48:23.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f569affd700 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e0868c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:48:23.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f569bfff700 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868d1af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f5694084150 tx=0x7f5694086000).ready entity=mon.0 client_cookie=24f60bd8972fdf4b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f5675ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:48:23.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f5675ffb700 1 -- 172.21.15.90:0/698734588 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694089ef0 con 0x55e0868907a0 2022-07-05T11:48:23.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f5675ffb700 1 -- 172.21.15.90:0/698734588 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5694080d20 con 0x55e0868907a0 2022-07-05T11:48:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e08684a440 con 0x55e0868907a0 2022-07-05T11:48:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f5675ffb700 1 -- 172.21.15.90:0/698734588 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5694080ee0 con 0x55e0868907a0 2022-07-05T11:48:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 10 client.5346 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e086643cd0 con 0x55e0868907a0 2022-07-05T11:48:23.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f5675ffb700 1 -- 172.21.15.90:0/698734588 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e08684a440 con 0x55e0868907a0 2022-07-05T11:48:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f5675ffb700 1 -- 172.21.15.90:0/698734588 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f5694089a60 con 0x55e0868907a0 2022-07-05T11:48:23.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 10 client.5346 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:23.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 10 client.5346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:23.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 20 client.5346 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:23.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d2790 0x55e086885530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 4 client.5346 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:48:23.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.781+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0867987f0 con 0x55e0868d2790 2022-07-05T11:48:23.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.782+0000 7f569b7fe700 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d2790 0x55e086885530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.782+0000 7f5675ffb700 10 client.5346 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.782+0000 7f569b7fe700 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d2790 0x55e086885530 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9b425ddfd73d7c7 server_cookie=16c393f9a9420d45 in_seq=0 out_seq=0 2022-07-05T11:48:23.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f5675ffb700 1 -- 172.21.15.90:0/698734588 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55e0867987f0 con 0x55e0868d2790 2022-07-05T11:48:23.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f5675ffb700 10 client.5346 handle_command_reply: tid=0 2022-07-05T11:48:23.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 client.5346 shutdown 2022-07-05T11:48:23.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 msgr2=0x55e0868d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868d1af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f5694084150 tx=0x7f5694086000).stop 2022-07-05T11:48:23.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 shutdown_connections 2022-07-05T11:48:23.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d2790 0x55e086885530 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868d1af0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f5675ffb700 0 client.5346 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e08684ccb0 0x55e0868c0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/698734588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e0868c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 >> 172.21.15.90:0/698734588 conn(0x55e0866bb1c0 msgr2=0x55e0868bd150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 shutdown_connections 2022-07-05T11:48:23.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.783+0000 7f56b33f0b80 1 -- 172.21.15.90:0/698734588 wait complete. 2022-07-05T11:48:23.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.784+0000 7f56b33f0b80 20 client.5346 trim_cache size 0 max 16384 2022-07-05T11:48:23.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.801+0000 7f56b33f0b80 1 Processor -- start 2022-07-05T11:48:23.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.801+0000 7f56b33f0b80 1 -- start start 2022-07-05T11:48:23.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e0868c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0868c3a80 con 0x55e0868907a0 2022-07-05T11:48:23.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0868d2560 con 0x55e08684ccb0 2022-07-05T11:48:23.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08688fd30 con 0x55e0868903c0 2022-07-05T11:48:23.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f569bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868c1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58618/0 (socket says 172.21.15.90:58618) 2022-07-05T11:48:23.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f569bfff700 1 -- 172.21.15.90:0/4114748939 learned_addr learned my addr 172.21.15.90:0/4114748939 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f569b7fe700 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e0868c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.802+0000 7f569affd700 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f569bfff700 1 -- 172.21.15.90:0/4114748939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 msgr2=0x55e08684e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f569bfff700 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f569bfff700 1 -- 172.21.15.90:0/4114748939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 msgr2=0x55e0868c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f569bfff700 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e0868c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f569bfff700 1 -- 172.21.15.90:0/4114748939 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e086611fd0 con 0x55e0868907a0 2022-07-05T11:48:23.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f569bfff700 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868c1a60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f56940845a0 tx=0x7f5694091000).ready entity=mon.0 client_cookie=3f814637024d76fc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56817fa700 1 -- 172.21.15.90:0/4114748939 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694080950 con 0x55e0868907a0 2022-07-05T11:48:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56817fa700 1 -- 172.21.15.90:0/4114748939 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569408b070 con 0x55e0868907a0 2022-07-05T11:48:23.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56817fa700 1 -- 172.21.15.90:0/4114748939 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694083b00 con 0x55e0868907a0 2022-07-05T11:48:23.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56b33f0b80 1 -- 172.21.15.90:0/4114748939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 msgr2=0x55e0868c1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868c1a60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f56940845a0 tx=0x7f5694091000).stop 2022-07-05T11:48:23.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56b33f0b80 1 -- 172.21.15.90:0/4114748939 shutdown_connections 2022-07-05T11:48:23.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e0868907a0 0x55e0868c1a60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e08684ccb0 0x55e0868c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/4114748939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868903c0 0x55e08684e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.803+0000 7f56b33f0b80 1 -- 172.21.15.90:0/4114748939 >> 172.21.15.90:0/4114748939 conn(0x55e0866bb1c0 msgr2=0x55e0868bfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.804+0000 7f56b33f0b80 1 -- 172.21.15.90:0/4114748939 shutdown_connections 2022-07-05T11:48:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.804+0000 7f56b33f0b80 1 -- 172.21.15.90:0/4114748939 wait complete. 2022-07-05T11:48:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.805+0000 7f56b33f0b80 1 -- start start 2022-07-05T11:48:23.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.805+0000 7f56b33f0b80 1 Processor -- start 2022-07-05T11:48:23.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.806+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e08684ccb0 0x55e08688c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.806+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e086846be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.806+0000 7f56b33f0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868907a0 0x55e0868c2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.806+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0868bc1c0 con 0x55e08684ccb0 2022-07-05T11:48:23.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.806+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0868cdd20 con 0x55e0868903c0 2022-07-05T11:48:23.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.806+0000 7f56b33f0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08684fe20 con 0x55e0868907a0 2022-07-05T11:48:23.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f56b33f0b80 10 client.0 ll_register_callbacks cb 0x55e0868101b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:23.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e08684ccb0 0x55e08688c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e08684ccb0 0x55e08688c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58620/0 (socket says 172.21.15.90:58620) 2022-07-05T11:48:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e086846be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569b7fe700 1 -- 172.21.15.90:0/3827556388 learned_addr learned my addr 172.21.15.90:0/3827556388 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:23.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569bfff700 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868907a0 0x55e0868c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569affd700 1 -- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868907a0 msgr2=0x55e0868c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569affd700 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868907a0 0x55e0868c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569affd700 1 -- 172.21.15.90:0/3827556388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e08684ccb0 msgr2=0x55e08688c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569affd700 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e08684ccb0 0x55e08688c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569affd700 1 -- 172.21.15.90:0/3827556388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c173e80 con 0x55e0868903c0 2022-07-05T11:48:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f569affd700 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e086846be0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x55e086850440 tx=0x7f5690018040).ready entity=mon.1 client_cookie=211935b5f7c60c36 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f5675ffb700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2022-07-05T11:48:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f5675ffb700 1 -- 172.21.15.90:0/3827556388 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569001b070 con 0x55e0868903c0 2022-07-05T11:48:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f5675ffb700 1 -- 172.21.15.90:0/3827556388 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f56900168c0 con 0x55e0868903c0 2022-07-05T11:48:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.807+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f56940829b0 con 0x55e0868903c0 2022-07-05T11:48:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f5675ffb700 1 -- 172.21.15.90:0/3827556388 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5690016c90 con 0x55e0868903c0 2022-07-05T11:48:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 10 client.5101 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:23.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e08684b5f0 con 0x55e0868903c0 2022-07-05T11:48:23.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f5675ffb700 1 -- 172.21.15.90:0/3827556388 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569002c020 con 0x55e0868903c0 2022-07-05T11:48:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f5675ffb700 1 -- 172.21.15.90:0/3827556388 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f5690012030 con 0x55e0868903c0 2022-07-05T11:48:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 10 client.5101 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 10 client.5101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 20 client.5101 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:23.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d1a00 0x55e08684d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:23.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 4 client.5101 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:48:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e08678f690 con 0x55e0868d1a00 2022-07-05T11:48:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.808+0000 7f569b7fe700 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d1a00 0x55e08684d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.809+0000 7f5675ffb700 10 client.5101 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.809+0000 7f569b7fe700 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d1a00 0x55e08684d710 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=94e4bbbd9632a18c server_cookie=bc7996a7b3405315 in_seq=0 out_seq=0 2022-07-05T11:48:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f5675ffb700 1 -- 172.21.15.90:0/3827556388 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e08678f690 con 0x55e0868d1a00 2022-07-05T11:48:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f5675ffb700 10 client.5101 handle_command_reply: tid=0 2022-07-05T11:48:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 client.5101 shutdown 2022-07-05T11:48:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 msgr2=0x55e086846be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e086846be0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x55e086850440 tx=0x7f5690018040).stop 2022-07-05T11:48:23.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 shutdown_connections 2022-07-05T11:48:23.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55e0868d1a00 0x55e08684d710 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0868907a0 0x55e0868c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f5675ffb700 0 client.5101 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e08684ccb0 0x55e08688c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 --2- 172.21.15.90:0/3827556388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0868903c0 0x55e086846be0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.810+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 >> 172.21.15.90:0/3827556388 conn(0x55e0866bb1c0 msgr2=0x55e0868844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 shutdown_connections 2022-07-05T11:48:23.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56b33f0b80 1 -- 172.21.15.90:0/3827556388 wait complete. 2022-07-05T11:48:23.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56b33f0b80 20 client.5101 trim_cache size 0 max 16384 2022-07-05T11:48:23.901 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:48:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:48:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:48:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:48:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:48:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:48:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:48:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:48:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:48:23.905 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:48:23.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f567c08ba10 msgr2=0x7f567c08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f567c08ba10 0x7f567c08ded0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f568c001120 tx=0x7f568c017000).stop 2022-07-05T11:48:23.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f569c1689b0 msgr2=0x7f569c174e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f569c1689b0 0x7f569c174e50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f569c0eb050 tx=0x7f5694009040).stop 2022-07-05T11:48:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 shutdown_connections 2022-07-05T11:48:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f567c08ba10 0x7f567c08ded0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f569c1689b0 0x7f569c174e50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5688003c80 0x7f569c168040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 --2- 172.21.15.90:0/3423320380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f569c168530 0x7f569c174960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:23.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 >> 172.21.15.90:0/3423320380 conn(0x7f569c083570 msgr2=0x7f569c17f240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.811+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 shutdown_connections 2022-07-05T11:48:23.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:23.812+0000 7f56a1a64700 1 -- 172.21.15.90:0/3423320380 wait complete. 2022-07-05T11:48:23.915 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:48:33.389 INFO:tasks.workunit.client.0.smithi090.stdout: 60 975160 414 653093 856 386612 900 2022-07-05T11:48:43.389 INFO:tasks.workunit.client.0.smithi090.stdout: 72 1303963 630 896961 631 521481 541 2022-07-05T11:48:49.334 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:48:49.338 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:48:49.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:48:53.389 INFO:tasks.workunit.client.0.smithi090.stdout: 80 492386 605 334112 426 181735 729 2022-07-05T11:48:53.916 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:48:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.155+0000 7f5f3851d700 1 Processor -- start 2022-07-05T11:48:54.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.155+0000 7f5f3851d700 1 -- start start 2022-07-05T11:48:54.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.156+0000 7f5f3851d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5f300c79b0 0x7f5f300eca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.156+0000 7f5f3851d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f300c0ce0 con 0x7f5f3017e360 2022-07-05T11:48:54.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.156+0000 7f5f3851d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f300c0110 con 0x7f5f300c1880 2022-07-05T11:48:54.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.156+0000 7f5f3851d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f300c03b0 con 0x7f5f300c79b0 2022-07-05T11:48:54.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.156+0000 7f5f362b9700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5f3017e360 0x7f5f300c1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51568/0 (socket says 172.21.15.90:51568) 2022-07-05T11:48:54.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.156+0000 7f5f362b9700 1 -- 172.21.15.90:0/926160418 learned_addr learned my addr 172.21.15.90:0/926160418 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:48:54.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.156+0000 7f5f36aba700 1 --2- 172.21.15.90:0/926160418 >> v2:172.21.15.149:3300/0 conn(0x7f5f300c79b0 0x7f5f300eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f352b7700 1 -- 172.21.15.90:0/926160418 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028670317 0 0) 0x7f5f300c0ce0 con 0x7f5f3017e360 2022-07-05T11:48:54.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f352b7700 1 -- 172.21.15.90:0/926160418 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f180033f0 con 0x7f5f3017e360 2022-07-05T11:48:54.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f36aba700 1 -- 172.21.15.90:0/926160418 >> v1:172.21.15.149:6789/0 conn(0x7f5f300c1880 legacy=0x7f5f300c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f36aba700 1 -- 172.21.15.90:0/926160418 >> v1:172.21.15.90:6789/0 conn(0x7f5f3017e360 legacy=0x7f5f300c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f36aba700 1 -- 172.21.15.90:0/926160418 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f300c0690 con 0x7f5f300c79b0 2022-07-05T11:48:54.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f36aba700 1 --2- 172.21.15.90:0/926160418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f300c79b0 0x7f5f300eca20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f5f28009e60 tx=0x7f5f28009780).ready entity=mon.2 client_cookie=8d9746b556eb2a8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:54.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f352b7700 1 -- 172.21.15.90:0/926160418 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800e070 con 0x7f5f300c79b0 2022-07-05T11:48:54.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f352b7700 1 -- 172.21.15.90:0/926160418 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2800bb60 con 0x7f5f300c79b0 2022-07-05T11:48:54.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.157+0000 7f5f352b7700 1 -- 172.21.15.90:0/926160418 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28012410 con 0x7f5f300c79b0 2022-07-05T11:48:54.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.158+0000 7f5f3851d700 1 -- 172.21.15.90:0/926160418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f300c79b0 msgr2=0x7f5f300eca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.158+0000 7f5f3851d700 1 --2- 172.21.15.90:0/926160418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f300c79b0 0x7f5f300eca20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f5f28009e60 tx=0x7f5f28009780).stop 2022-07-05T11:48:54.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.158+0000 7f5f3851d700 1 -- 172.21.15.90:0/926160418 shutdown_connections 2022-07-05T11:48:54.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.158+0000 7f5f3851d700 1 --2- 172.21.15.90:0/926160418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f300c79b0 0x7f5f300eca20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.158+0000 7f5f3851d700 1 -- 172.21.15.90:0/926160418 >> 172.21.15.90:0/926160418 conn(0x7f5f300edb10 msgr2=0x7f5f300edf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:54.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.158+0000 7f5f3851d700 1 -- 172.21.15.90:0/926160418 shutdown_connections 2022-07-05T11:48:54.197 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.158+0000 7f5f3851d700 1 -- 172.21.15.90:0/926160418 wait complete. 2022-07-05T11:48:54.197 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.160+0000 7f5f3851d700 1 Processor -- start 2022-07-05T11:48:54.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.160+0000 7f5f3851d700 1 -- start start 2022-07-05T11:48:54.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f3851d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300c1880 0x7f5f30061f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f3851d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f300c79b0 0x7f5f3017d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f3851d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3017e360 0x7f5f30175900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f3851d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3018ff50 con 0x7f5f300c79b0 2022-07-05T11:48:54.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f3851d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301907f0 con 0x7f5f300c1880 2022-07-05T11:48:54.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f3851d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f30064950 con 0x7f5f3017e360 2022-07-05T11:48:54.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f300c79b0 0x7f5f3017d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f300c79b0 0x7f5f3017d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58634/0 (socket says 172.21.15.90:58634) 2022-07-05T11:48:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f36aba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3017e360 0x7f5f30175900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f35ab8700 1 -- 172.21.15.90:0/3298461889 learned_addr learned my addr 172.21.15.90:0/3298461889 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:54.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f362b9700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300c1880 0x7f5f30061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f36aba700 1 -- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300c1880 msgr2=0x7f5f30061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f36aba700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300c1880 0x7f5f30061f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f36aba700 1 -- 172.21.15.90:0/3298461889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f300c79b0 msgr2=0x7f5f3017d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f36aba700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f300c79b0 0x7f5f3017d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.161+0000 7f5f36aba700 1 -- 172.21.15.90:0/3298461889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009a20 con 0x7f5f3017e360 2022-07-05T11:48:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.162+0000 7f5f36aba700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3017e360 0x7f5f30175900 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5f28014000 tx=0x7f5f28009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:54.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.162+0000 7f5f1e7fc700 1 -- 172.21.15.90:0/3298461889 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28012410 con 0x7f5f3017e360 2022-07-05T11:48:54.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.162+0000 7f5f1e7fc700 1 -- 172.21.15.90:0/3298461889 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2801d630 con 0x7f5f3017e360 2022-07-05T11:48:54.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.162+0000 7f5f1e7fc700 1 -- 172.21.15.90:0/3298461889 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2801d9d0 con 0x7f5f3017e360 2022-07-05T11:48:54.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.162+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f30064c30 con 0x7f5f3017e360 2022-07-05T11:48:54.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.162+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f30190480 con 0x7f5f3017e360 2022-07-05T11:48:54.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.164+0000 7f5f1e7fc700 1 -- 172.21.15.90:0/3298461889 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f5f28026410 con 0x7f5f3017e360 2022-07-05T11:48:54.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.165+0000 7f5f1e7fc700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f1008ba40 0x7f5f1008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.165+0000 7f5f1e7fc700 1 -- 172.21.15.90:0/3298461889 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5f280b2740 con 0x7f5f3017e360 2022-07-05T11:48:54.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.165+0000 7f5f362b9700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f1008ba40 0x7f5f1008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.166+0000 7f5f362b9700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f1008ba40 0x7f5f1008df00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5f2c005750 tx=0x7f5f2c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:54.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.166+0000 7f5f49ea9b80 1 Processor -- start 2022-07-05T11:48:54.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.167+0000 7f5f49ea9b80 1 -- start start 2022-07-05T11:48:54.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.167+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08463c0 0x55aea08027c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.167+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea0802cb0 0x55aea0850990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.167+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0846c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.167+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea07cc2d0 con 0x55aea0802cb0 2022-07-05T11:48:54.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.167+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea0743aa0 con 0x55aea08467a0 2022-07-05T11:48:54.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.167+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea0758950 con 0x55aea08463c0 2022-07-05T11:48:54.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea0802cb0 0x55aea0850990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f362b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08463c0 0x55aea08027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea0802cb0 0x55aea0850990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58642/0 (socket says 172.21.15.90:58642) 2022-07-05T11:48:54.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 -- 172.21.15.90:0/2155303638 learned_addr learned my addr 172.21.15.90:0/2155303638 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:54.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f362b9700 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08463c0 0x55aea08027c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40036/0 (socket says 172.21.15.90:40036) 2022-07-05T11:48:54.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f36aba700 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0846c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 -- 172.21.15.90:0/2155303638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08463c0 msgr2=0x55aea08027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08463c0 0x55aea08027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 -- 172.21.15.90:0/2155303638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 msgr2=0x55aea0846c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0846c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 -- 172.21.15.90:0/2155303638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aea058a9e0 con 0x55aea0802cb0 2022-07-05T11:48:54.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f362b9700 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08463c0 0x55aea08027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:48:54.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f36aba700 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0846c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:48:54.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea0802cb0 0x55aea0850990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f5f20003710 tx=0x7f5f20007e00).ready entity=mon.0 client_cookie=a365c5d0cfa79490 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:54.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f0f7fe700 1 -- 172.21.15.90:0/2155303638 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200032d0 con 0x55aea0802cb0 2022-07-05T11:48:54.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f0f7fe700 1 -- 172.21.15.90:0/2155303638 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20002030 con 0x55aea0802cb0 2022-07-05T11:48:54.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.168+0000 7f5f0f7fe700 1 -- 172.21.15.90:0/2155303638 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200117a0 con 0x55aea0802cb0 2022-07-05T11:48:54.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/2155303638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea0802cb0 msgr2=0x55aea0850990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea0802cb0 0x55aea0850990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f5f20003710 tx=0x7f5f20007e00).stop 2022-07-05T11:48:54.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/2155303638 shutdown_connections 2022-07-05T11:48:54.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0846c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08463c0 0x55aea08027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/2155303638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea0802cb0 0x55aea0850990 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/2155303638 >> 172.21.15.90:0/2155303638 conn(0x55aea06711c0 msgr2=0x55aea0805ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:54.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/2155303638 shutdown_connections 2022-07-05T11:48:54.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.169+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/2155303638 wait complete. 2022-07-05T11:48:54.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.170+0000 7f5f49ea9b80 1 -- start start 2022-07-05T11:48:54.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.170+0000 7f5f49ea9b80 1 Processor -- start 2022-07-05T11:48:54.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.172+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea0801680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.172+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0885810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.172+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea0800c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.172+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea0720120 con 0x55aea08463c0 2022-07-05T11:48:54.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.172+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea0801b70 con 0x55aea0802cb0 2022-07-05T11:48:54.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.172+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea0886440 con 0x55aea08467a0 2022-07-05T11:48:54.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.172+0000 7f5f49ea9b80 10 client.0 ll_register_callbacks cb 0x55aea07c61b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:54.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea0800c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea0800c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40044/0 (socket says 172.21.15.90:40044) 2022-07-05T11:48:54.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 -- 172.21.15.90:0/1186057998 learned_addr learned my addr 172.21.15.90:0/1186057998 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:54.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f362b9700 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea0801680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0885810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 -- 172.21.15.90:0/1186057998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 msgr2=0x55aea0801680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea0801680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 -- 172.21.15.90:0/1186057998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 msgr2=0x55aea0885810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0885810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 -- 172.21.15.90:0/1186057998 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f180033f0 con 0x55aea08467a0 2022-07-05T11:48:54.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f36aba700 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea0800c40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5f28009ec0 tx=0x7f5f280b2040).ready entity=mon.2 client_cookie=b65ec24c34d417df server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:54.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2022-07-05T11:48:54.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f0cff9700 1 -- 172.21.15.90:0/1186057998 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28083340 con 0x55aea08467a0 2022-07-05T11:48:54.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f0cff9700 1 -- 172.21.15.90:0/1186057998 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5f28086700 con 0x55aea08467a0 2022-07-05T11:48:54.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aea0800440 con 0x55aea08467a0 2022-07-05T11:48:54.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f0cff9700 1 -- 172.21.15.90:0/1186057998 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f2808c660 con 0x55aea08467a0 2022-07-05T11:48:54.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f49ea9b80 10 client.5069 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:54.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.173+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f5f300c0110 con 0x55aea08467a0 2022-07-05T11:48:54.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f0cff9700 1 -- 172.21.15.90:0/1186057998 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aea0800440 con 0x55aea08467a0 2022-07-05T11:48:54.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f0cff9700 1 -- 172.21.15.90:0/1186057998 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f5f2808cb30 con 0x55aea08467a0 2022-07-05T11:48:54.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f49ea9b80 10 client.5069 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:54.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f49ea9b80 10 client.5069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:54.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f49ea9b80 20 client.5069 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:54.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea086f3b0 0x55aea0840e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f49ea9b80 4 client.5069 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:48:54.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aea074e7f0 con 0x55aea086f3b0 2022-07-05T11:48:54.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f362b9700 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea086f3b0 0x55aea0840e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f0cff9700 10 client.5069 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:54.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.174+0000 7f5f362b9700 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea086f3b0 0x55aea0840e50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8bb5282595eb2630 server_cookie=37a9ed250b793817 in_seq=0 out_seq=0 2022-07-05T11:48:54.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f0cff9700 1 -- 172.21.15.90:0/1186057998 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55aea074e7f0 con 0x55aea086f3b0 2022-07-05T11:48:54.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f0cff9700 10 client.5069 handle_command_reply: tid=0 2022-07-05T11:48:54.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 client.5069 shutdown 2022-07-05T11:48:54.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 msgr2=0x55aea0800c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea0800c40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5f28009ec0 tx=0x7f5f280b2040).stop 2022-07-05T11:48:54.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 shutdown_connections 2022-07-05T11:48:54.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea086f3b0 0x55aea0840e50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea0800c40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea0801680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f0cff9700 0 client.5069 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:54.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/1186057998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0885810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 >> 172.21.15.90:0/1186057998 conn(0x55aea06711c0 msgr2=0x55aea0873230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:54.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 shutdown_connections 2022-07-05T11:48:54.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/1186057998 wait complete. 2022-07-05T11:48:54.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.175+0000 7f5f49ea9b80 20 client.5069 trim_cache size 0 max 16384 2022-07-05T11:48:54.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.191+0000 7f5f49ea9b80 1 Processor -- start 2022-07-05T11:48:54.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.191+0000 7f5f49ea9b80 1 -- start start 2022-07-05T11:48:54.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea0802cb0 0x55aea0842a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea08d5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0871ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea0806ce0 con 0x55aea08463c0 2022-07-05T11:48:54.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea08736f0 con 0x55aea08467a0 2022-07-05T11:48:54.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea08d5660 con 0x55aea0802cb0 2022-07-05T11:48:54.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea08d5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea08d5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58656/0 (socket says 172.21.15.90:58656) 2022-07-05T11:48:54.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f35ab8700 1 -- 172.21.15.90:0/450059824 learned_addr learned my addr 172.21.15.90:0/450059824 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:54.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.192+0000 7f5f362b9700 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea0802cb0 0x55aea0842a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f35ab8700 1 -- 172.21.15.90:0/450059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea0802cb0 msgr2=0x55aea0842a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea0802cb0 0x55aea0842a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f35ab8700 1 -- 172.21.15.90:0/450059824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 msgr2=0x55aea0871ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f36aba700 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0871ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0871ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f35ab8700 1 -- 172.21.15.90:0/450059824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aea05f9cd0 con 0x55aea08463c0 2022-07-05T11:48:54.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f36aba700 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0871ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:48:54.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea08d5170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f5f2000a000 tx=0x7f5f20018000).ready entity=mon.0 client_cookie=5d50702da2a95d9d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:54.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f0ffff700 1 -- 172.21.15.90:0/450059824 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20007b30 con 0x55aea08463c0 2022-07-05T11:48:54.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f0ffff700 1 -- 172.21.15.90:0/450059824 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20024070 con 0x55aea08463c0 2022-07-05T11:48:54.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f0ffff700 1 -- 172.21.15.90:0/450059824 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200032d0 con 0x55aea08463c0 2022-07-05T11:48:54.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/450059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 msgr2=0x55aea08d5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea08d5170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f5f2000a000 tx=0x7f5f20018000).stop 2022-07-05T11:48:54.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/450059824 shutdown_connections 2022-07-05T11:48:54.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea08467a0 0x55aea0871ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea0802cb0 0x55aea0842a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/450059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea08d5170 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.193+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/450059824 >> 172.21.15.90:0/450059824 conn(0x55aea06711c0 msgr2=0x55aea0878200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:54.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.194+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/450059824 shutdown_connections 2022-07-05T11:48:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.194+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/450059824 wait complete. 2022-07-05T11:48:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.194+0000 7f5f49ea9b80 1 -- start start 2022-07-05T11:48:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.194+0000 7f5f49ea9b80 1 Processor -- start 2022-07-05T11:48:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.195+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea084e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.195+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0801e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.195+0000 7f5f49ea9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea07fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.195+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea08de1f0 con 0x55aea08463c0 2022-07-05T11:48:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.195+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea08de650 con 0x55aea0802cb0 2022-07-05T11:48:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.195+0000 7f5f49ea9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea0846cb0 con 0x55aea08467a0 2022-07-05T11:48:54.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.195+0000 7f5f49ea9b80 10 client.0 ll_register_callbacks cb 0x55aea07c61b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:48:54.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0801e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0801e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58662/0 (socket says 172.21.15.90:58662) 2022-07-05T11:48:54.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 -- 172.21.15.90:0/3741100003 learned_addr learned my addr 172.21.15.90:0/3741100003 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:48:54.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f36aba700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea07fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f362b9700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea084e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 -- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 msgr2=0x55aea07fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea07fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 -- 172.21.15.90:0/3741100003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 msgr2=0x55aea084e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:48:54.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea084e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 -- 172.21.15.90:0/3741100003 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aea058a9e0 con 0x55aea08463c0 2022-07-05T11:48:54.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f362b9700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea084e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:48:54.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f35ab8700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0801e10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x55aea0878c70 tx=0x7f5f20022070).ready entity=mon.0 client_cookie=5bef1d4bef1dc0de server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:48:54.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:48:54.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f0cff9700 1 -- 172.21.15.90:0/3741100003 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200119b0 con 0x55aea08463c0 2022-07-05T11:48:54.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f0cff9700 1 -- 172.21.15.90:0/3741100003 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5f20011b10 con 0x55aea08463c0 2022-07-05T11:48:54.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f20002030 con 0x55aea08463c0 2022-07-05T11:48:54.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f0cff9700 1 -- 172.21.15.90:0/3741100003 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f200066a0 con 0x55aea08463c0 2022-07-05T11:48:54.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f49ea9b80 10 client.5370 fetch_fsmap learned FSMap version 17 2022-07-05T11:48:54.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55aea05c7fd0 con 0x55aea08463c0 2022-07-05T11:48:54.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.196+0000 7f5f0cff9700 1 -- 172.21.15.90:0/3741100003 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20002030 con 0x55aea08463c0 2022-07-05T11:48:54.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f0cff9700 1 -- 172.21.15.90:0/3741100003 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f5f2001a070 con 0x55aea08463c0 2022-07-05T11:48:54.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 10 client.5370 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:48:54.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 10 client.5370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:48:54.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 20 client.5370 populate_metadata read hostname 'smithi090' 2022-07-05T11:48:54.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea080c930 0x55aea080be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:48:54.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 4 client.5370 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:48:54.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aea0745690 con 0x55aea080c930 2022-07-05T11:48:54.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f362b9700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea080c930 0x55aea080be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:48:54.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f362b9700 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea080c930 0x55aea080be90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=754766166fe2c68c server_cookie=a98df2e4a6559d1 in_seq=0 out_seq=0 2022-07-05T11:48:54.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f0cff9700 10 client.5370 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:54.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f0cff9700 1 -- 172.21.15.90:0/3741100003 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55aea0745690 con 0x55aea080c930 2022-07-05T11:48:54.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f0cff9700 10 client.5370 handle_command_reply: tid=0 2022-07-05T11:48:54.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 client.5370 shutdown 2022-07-05T11:48:54.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 msgr2=0x55aea0801e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0801e10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x55aea0878c70 tx=0x7f5f20022070).stop 2022-07-05T11:48:54.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 shutdown_connections 2022-07-05T11:48:54.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55aea080c930 0x55aea080be90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aea08467a0 0x55aea07fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f0cff9700 0 client.5370 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:48:54.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aea0802cb0 0x55aea084e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 --2- 172.21.15.90:0/3741100003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aea08463c0 0x55aea0801e10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 >> 172.21.15.90:0/3741100003 conn(0x55aea06711c0 msgr2=0x55aea0803f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:54.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.197+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 shutdown_connections 2022-07-05T11:48:54.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f49ea9b80 1 -- 172.21.15.90:0/3741100003 wait complete. 2022-07-05T11:48:54.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f49ea9b80 20 client.5370 trim_cache size 0 max 16384 2022-07-05T11:48:54.318 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:48:54.318 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:48:54.319 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:48:54.319 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:48:54.319 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:48:54.320 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:48:54.320 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:48:54.320 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:48:54.320 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:48:54.321 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:48:54.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f1008ba40 msgr2=0x7f5f1008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f1008ba40 0x7f5f1008df00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5f2c005750 tx=0x7f5f2c009040).stop 2022-07-05T11:48:54.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3017e360 msgr2=0x7f5f30175900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:48:54.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3017e360 0x7f5f30175900 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5f28014000 tx=0x7f5f28009780).stop 2022-07-05T11:48:54.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 shutdown_connections 2022-07-05T11:48:54.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f5f1008ba40 0x7f5f1008df00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3017e360 0x7f5f30175900 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300c1880 0x7f5f30061f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 --2- 172.21.15.90:0/3298461889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f300c79b0 0x7f5f3017d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:48:54.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 >> 172.21.15.90:0/3298461889 conn(0x7f5f300edb10 msgr2=0x7f5f30179e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:48:54.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 shutdown_connections 2022-07-05T11:48:54.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:48:54.198+0000 7f5f3851d700 1 -- 172.21.15.90:0/3298461889 wait complete. 2022-07-05T11:48:54.329 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:49:03.389 INFO:tasks.workunit.client.0.smithi090.stdout: 91 1076347 658 708885 510 393656 913 2022-07-05T11:49:13.389 INFO:tasks.workunit.client.0.smithi090.stdout: 100 1551866 523 1037092 547 563513 860 2022-07-05T11:49:19.647 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:49:19.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:49:19.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:49:23.390 INFO:tasks.workunit.client.0.smithi090.stdout: 112 926054 561 627249 576 328334 566 2022-07-05T11:49:24.331 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:49:24.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.476+0000 7fc83b2b8700 1 Processor -- start 2022-07-05T11:49:24.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.476+0000 7fc83b2b8700 1 -- start start 2022-07-05T11:49:24.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.477+0000 7fc83b2b8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8341720c0 0x7fc8340edd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.492 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.477+0000 7fc83b2b8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83417cac0 con 0x7fc83417d660 2022-07-05T11:49:24.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.477+0000 7fc83b2b8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340c8610 con 0x7fc8340c7330 2022-07-05T11:49:24.493 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.477+0000 7fc83b2b8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340c7a90 con 0x7fc8341720c0 2022-07-05T11:49:24.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc839054700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8341720c0 0x7fc8340edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.494 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc838853700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc8340c7330 0x7fc83417cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:47850/0 (socket says 172.21.15.90:47850) 2022-07-05T11:49:24.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc838853700 1 -- 172.21.15.90:0/2402282890 learned_addr learned my addr 172.21.15.90:0/2402282890 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:49:24.495 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc839054700 1 --2- 172.21.15.90:0/2402282890 >> v2:172.21.15.149:3300/0 conn(0x7fc8341720c0 0x7fc8340edd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40064/0 (socket says 172.21.15.90:40064) 2022-07-05T11:49:24.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc839054700 1 -- 172.21.15.90:0/2402282890 >> v1:172.21.15.149:6789/0 conn(0x7fc8340c7330 legacy=0x7fc83417cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.496 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc839054700 1 -- 172.21.15.90:0/2402282890 >> v1:172.21.15.110:6789/0 conn(0x7fc83417d660 legacy=0x7fc834083570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc839054700 1 -- 172.21.15.90:0/2402282890 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340c7d70 con 0x7fc8341720c0 2022-07-05T11:49:24.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc839054700 1 --2- 172.21.15.90:0/2402282890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 0x7fc8340edd60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc830009760 tx=0x7fc830009060).ready entity=mon.2 client_cookie=e0df71555798fa5e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc823fff700 1 -- 172.21.15.90:0/2402282890 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000b580 con 0x7fc8341720c0 2022-07-05T11:49:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc823fff700 1 -- 172.21.15.90:0/2402282890 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000b6e0 con 0x7fc8341720c0 2022-07-05T11:49:24.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.478+0000 7fc823fff700 1 -- 172.21.15.90:0/2402282890 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000ba60 con 0x7fc8341720c0 2022-07-05T11:49:24.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.479+0000 7fc83b2b8700 1 -- 172.21.15.90:0/2402282890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 msgr2=0x7fc8340edd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.479+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/2402282890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 0x7fc8340edd60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc830009760 tx=0x7fc830009060).stop 2022-07-05T11:49:24.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.479+0000 7fc83b2b8700 1 -- 172.21.15.90:0/2402282890 shutdown_connections 2022-07-05T11:49:24.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.479+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/2402282890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 0x7fc8340edd60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.479+0000 7fc83b2b8700 1 -- 172.21.15.90:0/2402282890 >> 172.21.15.90:0/2402282890 conn(0x7fc83405d9a0 msgr2=0x7fc83405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:24.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.479+0000 7fc83b2b8700 1 -- 172.21.15.90:0/2402282890 shutdown_connections 2022-07-05T11:49:24.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.479+0000 7fc83b2b8700 1 -- 172.21.15.90:0/2402282890 wait complete. 2022-07-05T11:49:24.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.480+0000 7fc83b2b8700 1 Processor -- start 2022-07-05T11:49:24.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.480+0000 7fc83b2b8700 1 -- start start 2022-07-05T11:49:24.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc83b2b8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8340c7330 0x7fc83416a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc83b2b8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 0x7fc834067150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc83b2b8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc83417d660 0x7fc834067640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc83b2b8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834068330 con 0x7fc83417d660 2022-07-05T11:49:24.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc83b2b8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834176680 con 0x7fc8340c7330 2022-07-05T11:49:24.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc83b2b8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834067b30 con 0x7fc8341720c0 2022-07-05T11:49:24.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc83417d660 0x7fc834067640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc83417d660 0x7fc834067640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58676/0 (socket says 172.21.15.90:58676) 2022-07-05T11:49:24.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc838853700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 0x7fc834067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 -- 172.21.15.90:0/706695369 learned_addr learned my addr 172.21.15.90:0/706695369 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:24.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839054700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8340c7330 0x7fc83416a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 -- 172.21.15.90:0/706695369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 msgr2=0x7fc834067150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 0x7fc834067150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 -- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8340c7330 msgr2=0x7fc83416a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8340c7330 0x7fc83416a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 -- 172.21.15.90:0/706695369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300092a0 con 0x7fc83417d660 2022-07-05T11:49:24.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc839855700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc83417d660 0x7fc834067640 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc82c00c7f0 tx=0x7fc82c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:24.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc8217fa700 1 -- 172.21.15.90:0/706695369 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00e4a0 con 0x7fc83417d660 2022-07-05T11:49:24.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.482+0000 7fc8217fa700 1 -- 172.21.15.90:0/706695369 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00e600 con 0x7fc83417d660 2022-07-05T11:49:24.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.483+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc834176fb0 con 0x7fc83417d660 2022-07-05T11:49:24.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.483+0000 7fc8217fa700 1 -- 172.21.15.90:0/706695369 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00e9a0 con 0x7fc83417d660 2022-07-05T11:49:24.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.483+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc834068050 con 0x7fc83417d660 2022-07-05T11:49:24.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.484+0000 7fc8217fa700 1 -- 172.21.15.90:0/706695369 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc82c010070 con 0x7fc83417d660 2022-07-05T11:49:24.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.485+0000 7fc8217fa700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc81408ba40 0x7fc81408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.485+0000 7fc8217fa700 1 -- 172.21.15.90:0/706695369 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc82c0afec0 con 0x7fc83417d660 2022-07-05T11:49:24.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.485+0000 7fc839054700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc81408ba40 0x7fc81408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.486+0000 7fc839054700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc81408ba40 0x7fc81408df00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fc83000b340 tx=0x7fc830017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:24.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.487+0000 7fc84cc44b80 1 Processor -- start 2022-07-05T11:49:24.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.487+0000 7fc84cc44b80 1 -- start start 2022-07-05T11:49:24.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56898f0 0x5595e56b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e56b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e568aff0 0x5595e5689cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e560f2d0 con 0x5595e56898f0 2022-07-05T11:49:24.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e5586aa0 con 0x5595e568aff0 2022-07-05T11:49:24.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e559b950 con 0x5595e568ab70 2022-07-05T11:49:24.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56898f0 0x5595e56b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56898f0 0x5595e56b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58680/0 (socket says 172.21.15.90:58680) 2022-07-05T11:49:24.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 -- 172.21.15.90:0/382690335 learned_addr learned my addr 172.21.15.90:0/382690335 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:24.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc838853700 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e56b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839855700 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e568aff0 0x5595e5689cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 -- 172.21.15.90:0/382690335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 msgr2=0x5595e56b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e56b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 -- 172.21.15.90:0/382690335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e568aff0 msgr2=0x5595e5689cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e568aff0 0x5595e5689cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 -- 172.21.15.90:0/382690335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595e53cd9e0 con 0x5595e56898f0 2022-07-05T11:49:24.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc839054700 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56898f0 0x5595e56b7f60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc834085e50 tx=0x7fc83001e040).ready entity=mon.0 client_cookie=b8f3238ce17c38a9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:24.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc81a7fc700 1 -- 172.21.15.90:0/382690335 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000ba70 con 0x5595e56898f0 2022-07-05T11:49:24.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc81a7fc700 1 -- 172.21.15.90:0/382690335 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83001c880 con 0x5595e56898f0 2022-07-05T11:49:24.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.488+0000 7fc81a7fc700 1 -- 172.21.15.90:0/382690335 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83001c9f0 con 0x5595e56898f0 2022-07-05T11:49:24.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 -- 172.21.15.90:0/382690335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56898f0 msgr2=0x5595e56b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56898f0 0x5595e56b7f60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc834085e50 tx=0x7fc83001e040).stop 2022-07-05T11:49:24.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 -- 172.21.15.90:0/382690335 shutdown_connections 2022-07-05T11:49:24.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e568aff0 0x5595e5689cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56898f0 0x5595e56b7f60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/382690335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e56b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 -- 172.21.15.90:0/382690335 >> 172.21.15.90:0/382690335 conn(0x5595e54b41c0 msgr2=0x5595e5648ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:24.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 -- 172.21.15.90:0/382690335 shutdown_connections 2022-07-05T11:49:24.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.489+0000 7fc84cc44b80 1 -- 172.21.15.90:0/382690335 wait complete. 2022-07-05T11:49:24.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.490+0000 7fc84cc44b80 1 -- start start 2022-07-05T11:49:24.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.490+0000 7fc84cc44b80 1 Processor -- start 2022-07-05T11:49:24.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56898f0 0x5595e56cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e56b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56bac50 0x5595e5684e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e5563120 con 0x5595e568ab70 2022-07-05T11:49:24.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e56bb920 con 0x5595e56bac50 2022-07-05T11:49:24.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e56ba7c0 con 0x5595e56898f0 2022-07-05T11:49:24.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc84cc44b80 10 client.0 ll_register_callbacks cb 0x5595e56091b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:49:24.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e56b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e56b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58688/0 (socket says 172.21.15.90:58688) 2022-07-05T11:49:24.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 -- 172.21.15.90:0/644515022 learned_addr learned my addr 172.21.15.90:0/644515022 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:24.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc839054700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56898f0 0x5595e56cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc839855700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56bac50 0x5595e5684e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 -- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56898f0 msgr2=0x5595e56cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56898f0 0x5595e56cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 -- 172.21.15.90:0/644515022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56bac50 msgr2=0x5595e5684e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56bac50 0x5595e5684e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 -- 172.21.15.90:0/644515022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8340c7d70 con 0x5595e568ab70 2022-07-05T11:49:24.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc839855700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56bac50 0x5595e5684e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:49:24.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc838853700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e56b8400 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc824004f90 tx=0x7fc824009040).ready entity=mon.0 client_cookie=d36e4f6f108c2c73 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:24.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.491+0000 7fc80f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:49:24.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc80f7fe700 1 -- 172.21.15.90:0/644515022 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82401a070 con 0x5595e568ab70 2022-07-05T11:49:24.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc80f7fe700 1 -- 172.21.15.90:0/644515022 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc824012e80 con 0x5595e568ab70 2022-07-05T11:49:24.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595e5643440 con 0x5595e568ab70 2022-07-05T11:49:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc80f7fe700 1 -- 172.21.15.90:0/644515022 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8240072f0 con 0x5595e568ab70 2022-07-05T11:49:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 10 client.5379 fetch_fsmap learned FSMap version 17 2022-07-05T11:49:24.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5595e543ccd0 con 0x5595e568ab70 2022-07-05T11:49:24.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc80f7fe700 1 -- 172.21.15.90:0/644515022 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595e5643440 con 0x5595e568ab70 2022-07-05T11:49:24.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc80f7fe700 1 -- 172.21.15.90:0/644515022 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7fc82401d020 con 0x5595e568ab70 2022-07-05T11:49:24.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 10 client.5379 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:49:24.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 10 client.5379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:49:24.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 20 client.5379 populate_metadata read hostname 'smithi090' 2022-07-05T11:49:24.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5648a70 0x5595e5648e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 4 client.5379 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:49:24.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595e55917f0 con 0x5595e5648a70 2022-07-05T11:49:24.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.492+0000 7fc839054700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5648a70 0x5595e5648e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc80f7fe700 10 client.5379 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:24.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc839054700 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5648a70 0x5595e5648e80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e4225a8d8648518c server_cookie=73c7c8a8336ff937 in_seq=0 out_seq=0 2022-07-05T11:49:24.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc80f7fe700 1 -- 172.21.15.90:0/644515022 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5595e55917f0 con 0x5595e5648a70 2022-07-05T11:49:24.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc80f7fe700 10 client.5379 handle_command_reply: tid=0 2022-07-05T11:49:24.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 client.5379 shutdown 2022-07-05T11:49:24.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 msgr2=0x5595e56b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e56b8400 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc824004f90 tx=0x7fc824009040).stop 2022-07-05T11:49:24.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 shutdown_connections 2022-07-05T11:49:24.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5648a70 0x5595e5648e80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56bac50 0x5595e5684e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc80f7fe700 0 client.5379 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:24.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56898f0 0x5595e56cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/644515022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e56b8400 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 >> 172.21.15.90:0/644515022 conn(0x5595e54b41c0 msgr2=0x5595e5650580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:24.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 shutdown_connections 2022-07-05T11:49:24.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.493+0000 7fc84cc44b80 1 -- 172.21.15.90:0/644515022 wait complete. 2022-07-05T11:49:24.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.494+0000 7fc84cc44b80 20 client.5379 trim_cache size 0 max 16384 2022-07-05T11:49:24.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.524+0000 7fc84cc44b80 1 Processor -- start 2022-07-05T11:49:24.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.524+0000 7fc84cc44b80 1 -- start start 2022-07-05T11:49:24.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e568db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e568a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56bac50 0x5595e5646d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e56b91b0 con 0x5595e56bac50 2022-07-05T11:49:24.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e5649640 con 0x5595e56898f0 2022-07-05T11:49:24.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e5689ff0 con 0x5595e568ab70 2022-07-05T11:49:24.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56bac50 0x5595e5646d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56bac50 0x5595e5646d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58698/0 (socket says 172.21.15.90:58698) 2022-07-05T11:49:24.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 -- 172.21.15.90:0/2795585002 learned_addr learned my addr 172.21.15.90:0/2795585002 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:24.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc838853700 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e568a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839054700 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e568db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 -- 172.21.15.90:0/2795585002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 msgr2=0x5595e568a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e568a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 -- 172.21.15.90:0/2795585002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 msgr2=0x5595e568db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e568db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 -- 172.21.15.90:0/2795585002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595e540afd0 con 0x5595e56bac50 2022-07-05T11:49:24.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839054700 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e568db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:49:24.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc839855700 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56bac50 0x5595e5646d00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fc82c004290 tx=0x7fc82c086040).ready entity=mon.0 client_cookie=8468e147f19d991 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:24.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.525+0000 7fc81affd700 1 -- 172.21.15.90:0/2795585002 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c084340 con 0x5595e56bac50 2022-07-05T11:49:24.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc81affd700 1 -- 172.21.15.90:0/2795585002 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c082940 con 0x5595e56bac50 2022-07-05T11:49:24.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc81affd700 1 -- 172.21.15.90:0/2795585002 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c082ba0 con 0x5595e56bac50 2022-07-05T11:49:24.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 -- 172.21.15.90:0/2795585002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56bac50 msgr2=0x5595e5646d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56bac50 0x5595e5646d00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fc82c004290 tx=0x7fc82c086040).stop 2022-07-05T11:49:24.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 -- 172.21.15.90:0/2795585002 shutdown_connections 2022-07-05T11:49:24.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e56bac50 0x5595e5646d00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e568db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/2795585002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e568ab70 0x5595e568a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 -- 172.21.15.90:0/2795585002 >> 172.21.15.90:0/2795585002 conn(0x5595e54b41c0 msgr2=0x5595e5684e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:24.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 -- 172.21.15.90:0/2795585002 shutdown_connections 2022-07-05T11:49:24.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.526+0000 7fc84cc44b80 1 -- 172.21.15.90:0/2795585002 wait complete. 2022-07-05T11:49:24.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.527+0000 7fc84cc44b80 1 -- start start 2022-07-05T11:49:24.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.527+0000 7fc84cc44b80 1 Processor -- start 2022-07-05T11:49:24.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e5717160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e564f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc84cc44b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56bac50 0x5595e5710600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e57223c0 con 0x5595e568ab70 2022-07-05T11:49:24.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e56db760 con 0x5595e56898f0 2022-07-05T11:49:24.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc84cc44b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e56da600 con 0x5595e56bac50 2022-07-05T11:49:24.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc84cc44b80 10 client.0 ll_register_callbacks cb 0x5595e5645e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:49:24.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc838853700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e564f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.528+0000 7fc838853700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e564f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58702/0 (socket says 172.21.15.90:58702) 2022-07-05T11:49:24.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc838853700 1 -- 172.21.15.90:0/1296563415 learned_addr learned my addr 172.21.15.90:0/1296563415 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:24.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc839855700 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56bac50 0x5595e5710600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc839054700 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e5717160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc838853700 1 -- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56bac50 msgr2=0x5595e5710600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc838853700 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56bac50 0x5595e5710600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc838853700 1 -- 172.21.15.90:0/1296563415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 msgr2=0x5595e5717160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:24.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc838853700 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e5717160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc838853700 1 -- 172.21.15.90:0/1296563415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595e53cd9e0 con 0x5595e568ab70 2022-07-05T11:49:24.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc838853700 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e564f030 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x5595e56dc6c0 tx=0x7fc82401a000).ready entity=mon.0 client_cookie=930e63aadf2c77d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:24.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc80f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:49:24.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc80f7fe700 1 -- 172.21.15.90:0/1296563415 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824015a40 con 0x5595e568ab70 2022-07-05T11:49:24.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc80f7fe700 1 -- 172.21.15.90:0/1296563415 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc824015ba0 con 0x5595e568ab70 2022-07-05T11:49:24.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc83001c880 con 0x5595e568ab70 2022-07-05T11:49:24.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc80f7fe700 1 -- 172.21.15.90:0/1296563415 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc824015da0 con 0x5595e568ab70 2022-07-05T11:49:24.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc84cc44b80 10 client.5385 fetch_fsmap learned FSMap version 17 2022-07-05T11:49:24.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7fc834068050 con 0x5595e568ab70 2022-07-05T11:49:24.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.529+0000 7fc80f7fe700 1 -- 172.21.15.90:0/1296563415 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83001c880 con 0x5595e568ab70 2022-07-05T11:49:24.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc80f7fe700 1 -- 172.21.15.90:0/1296563415 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7fc82401d070 con 0x5595e568ab70 2022-07-05T11:49:24.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc84cc44b80 10 client.5385 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:49:24.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc84cc44b80 10 client.5385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:49:24.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc84cc44b80 20 client.5385 populate_metadata read hostname 'smithi090' 2022-07-05T11:49:24.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5688720 0x5595e56daa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:24.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc84cc44b80 4 client.5385 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:49:24.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5595e5588690 con 0x5595e5688720 2022-07-05T11:49:24.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc839054700 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5688720 0x5595e56daa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:24.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc80f7fe700 10 client.5385 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:24.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.530+0000 7fc839054700 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5688720 0x5595e56daa90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7a2033c547cecd1b server_cookie=8e4f76d3ccc9748 in_seq=0 out_seq=0 2022-07-05T11:49:24.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc80f7fe700 1 -- 172.21.15.90:0/1296563415 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5595e5588690 con 0x5595e5688720 2022-07-05T11:49:24.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc80f7fe700 10 client.5385 handle_command_reply: tid=0 2022-07-05T11:49:24.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 client.5385 shutdown 2022-07-05T11:49:24.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 msgr2=0x5595e564f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e564f030 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x5595e56dc6c0 tx=0x7fc82401a000).stop 2022-07-05T11:49:24.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 shutdown_connections 2022-07-05T11:49:24.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5595e5688720 0x5595e56daa90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595e56bac50 0x5595e5710600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595e56898f0 0x5595e5717160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 --2- 172.21.15.90:0/1296563415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595e568ab70 0x5595e564f030 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 >> 172.21.15.90:0/1296563415 conn(0x5595e54b41c0 msgr2=0x5595e56450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:24.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc80f7fe700 0 client.5385 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:24.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 shutdown_connections 2022-07-05T11:49:24.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 1 -- 172.21.15.90:0/1296563415 wait complete. 2022-07-05T11:49:24.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.531+0000 7fc84cc44b80 20 client.5385 trim_cache size 0 max 16384 2022-07-05T11:49:24.644 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:49:24.645 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:49:24.646 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:49:24.646 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:49:24.647 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:49:24.647 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:49:24.648 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:49:24.648 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:49:24.648 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:49:24.649 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:49:24.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.532+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc81408ba40 msgr2=0x7fc81408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.532+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc81408ba40 0x7fc81408df00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fc83000b340 tx=0x7fc830017000).stop 2022-07-05T11:49:24.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.532+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc83417d660 msgr2=0x7fc834067640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:24.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.532+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc83417d660 0x7fc834067640 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc82c00c7f0 tx=0x7fc82c001510).stop 2022-07-05T11:49:24.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 shutdown_connections 2022-07-05T11:49:24.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc81408ba40 0x7fc81408df00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc83417d660 0x7fc834067640 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8340c7330 0x7fc83416a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 --2- 172.21.15.90:0/706695369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8341720c0 0x7fc834067150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:24.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 >> 172.21.15.90:0/706695369 conn(0x7fc83405d9a0 msgr2=0x7fc83417ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:24.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 shutdown_connections 2022-07-05T11:49:24.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:24.533+0000 7fc83b2b8700 1 -- 172.21.15.90:0/706695369 wait complete. 2022-07-05T11:49:24.659 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:49:33.390 INFO:tasks.workunit.client.0.smithi090.stdout: 120 814471 418 560191 382 297062 561 2022-07-05T11:49:43.389 INFO:tasks.workunit.client.0.smithi090.stdout: 127 1688183 553 1187187 366 577452 566 2022-07-05T11:49:50.163 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:49:50.230 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:49:50.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:49:53.391 INFO:tasks.workunit.client.0.smithi090.stdout: 146 1628094 983 1113136 907 552147 705 2022-07-05T11:49:54.661 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:49:55.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.160+0000 7f2a0c82d700 1 Processor -- start 2022-07-05T11:49:55.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.160+0000 7f2a0c82d700 1 -- start start 2022-07-05T11:49:55.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.162+0000 7f2a0c82d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a08188910 0x7f2a08189000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.162+0000 7f2a0c82d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a080f0160 con 0x7f2a081894f0 2022-07-05T11:49:55.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.162+0000 7f2a0c82d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a08188dc0 con 0x7f2a08188530 2022-07-05T11:49:55.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.162+0000 7f2a0c82d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a080f05f0 con 0x7f2a08188910 2022-07-05T11:49:55.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.162+0000 7f2a06d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2a081894f0 0x7f2a08191ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51650/0 (socket says 172.21.15.90:51650) 2022-07-05T11:49:55.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.162+0000 7f2a06d9d700 1 -- 172.21.15.90:0/3682489571 learned_addr learned my addr 172.21.15.90:0/3682489571 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:49:55.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.172+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/3682489571 >> v2:172.21.15.110:3300/0 conn(0x7f2a08188910 0x7f2a08189000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.223+0000 7f2a05d9b700 1 -- 172.21.15.90:0/3682489571 >> v1:172.21.15.110:6789/0 conn(0x7f2a08188530 legacy=0x7f2a080ee6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.223+0000 7f2a05d9b700 1 -- 172.21.15.90:0/3682489571 >> v1:172.21.15.90:6789/0 conn(0x7f2a081894f0 legacy=0x7f2a08191ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.223+0000 7f2a05d9b700 1 -- 172.21.15.90:0/3682489571 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080ef270 con 0x7f2a08188910 2022-07-05T11:49:55.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.190+0000 7f2a0559a700 1 -- 172.21.15.90:0/3682489571 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561240801 0 0) 0x7f2a080f0160 con 0x7f2a081894f0 2022-07-05T11:49:55.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.223+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/3682489571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 0x7f2a08189000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f2a00009360 tx=0x7f2a00009780).ready entity=mon.1 client_cookie=e694f9b362da8565 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:55.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.223+0000 7f2a0559a700 1 -- 172.21.15.90:0/3682489571 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000bae0 con 0x7f2a08188910 2022-07-05T11:49:55.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.223+0000 7f2a0559a700 1 -- 172.21.15.90:0/3682489571 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0000bc40 con 0x7f2a08188910 2022-07-05T11:49:55.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.223+0000 7f2a0559a700 1 -- 172.21.15.90:0/3682489571 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00010480 con 0x7f2a08188910 2022-07-05T11:49:55.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.224+0000 7f2a0c82d700 1 -- 172.21.15.90:0/3682489571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 msgr2=0x7f2a08189000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.224+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/3682489571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 0x7f2a08189000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f2a00009360 tx=0x7f2a00009780).stop 2022-07-05T11:49:55.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.227+0000 7f2a0c82d700 1 -- 172.21.15.90:0/3682489571 shutdown_connections 2022-07-05T11:49:55.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.227+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/3682489571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 0x7f2a08189000 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.227+0000 7f2a0c82d700 1 -- 172.21.15.90:0/3682489571 >> 172.21.15.90:0/3682489571 conn(0x7f2a080edd60 msgr2=0x7f2a0805d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:55.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.227+0000 7f2a0c82d700 1 -- 172.21.15.90:0/3682489571 shutdown_connections 2022-07-05T11:49:55.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.227+0000 7f2a0c82d700 1 -- 172.21.15.90:0/3682489571 wait complete. 2022-07-05T11:49:55.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.230+0000 7f2a0c82d700 1 Processor -- start 2022-07-05T11:49:55.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.230+0000 7f2a0c82d700 1 -- start start 2022-07-05T11:49:55.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0c82d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a08188530 0x7f2a08183f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0c82d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 0x7f2a080eb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0c82d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a081894f0 0x7f2a081b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0c82d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08193ad0 con 0x7f2a08188530 2022-07-05T11:49:55.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0c82d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0819f600 con 0x7f2a08188910 2022-07-05T11:49:55.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0c82d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08192ec0 con 0x7f2a081894f0 2022-07-05T11:49:55.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a08188530 0x7f2a08183f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a08188530 0x7f2a08183f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58714/0 (socket says 172.21.15.90:58714) 2022-07-05T11:49:55.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.232+0000 7f2a0659c700 1 -- 172.21.15.90:0/1043821870 learned_addr learned my addr 172.21.15.90:0/1043821870 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:55.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.233+0000 7f2a0659c700 1 -- 172.21.15.90:0/1043821870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a081894f0 msgr2=0x7f2a081b0100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-07-05T11:49:55.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.233+0000 7f2a0659c700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a081894f0 0x7f2a081b0100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.233+0000 7f2a0659c700 1 -- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 msgr2=0x7f2a080eb450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-07-05T11:49:55.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.233+0000 7f2a0659c700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 0x7f2a080eb450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.233+0000 7f2a0659c700 1 -- 172.21.15.90:0/1043821870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00009a20 con 0x7f2a08188530 2022-07-05T11:49:55.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.233+0000 7f2a0659c700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a08188530 0x7f2a08183f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f29fc00c490 tx=0x7f29fc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:55.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.259+0000 7f29f67fc700 1 -- 172.21.15.90:0/1043821870 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00f470 con 0x7f2a08188530 2022-07-05T11:49:55.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.259+0000 7f29f67fc700 1 -- 172.21.15.90:0/1043821870 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc00f5d0 con 0x7f2a08188530 2022-07-05T11:49:55.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.259+0000 7f29f67fc700 1 -- 172.21.15.90:0/1043821870 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00f990 con 0x7f2a08188530 2022-07-05T11:49:55.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.259+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a081931a0 con 0x7f2a08188530 2022-07-05T11:49:55.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.259+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a08193760 con 0x7f2a08188530 2022-07-05T11:49:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.265+0000 7f2a1e1b9b80 1 Processor -- start 2022-07-05T11:49:55.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.265+0000 7f2a1e1b9b80 1 -- start start 2022-07-05T11:49:55.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.266+0000 7f29f67fc700 1 -- 172.21.15.90:0/1043821870 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f29fc019030 con 0x7f2a08188530 2022-07-05T11:49:55.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.266+0000 7f29f67fc700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f29ec08bb10 0x7f29ec08dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.267+0000 7f29f67fc700 1 -- 172.21.15.90:0/1043821870 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f29fc0afe80 con 0x7f2a08188530 2022-07-05T11:49:55.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.267+0000 7f2a06d9d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f29ec08bb10 0x7f29ec08dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.270+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.270+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe33cb0 0x55794fe81990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.270+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 0x55794fe77c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.270+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fdfd2d0 con 0x55794fe773c0 2022-07-05T11:49:55.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.270+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fd74aa0 con 0x55794fe33cb0 2022-07-05T11:49:55.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.270+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fd89950 con 0x55794fe777a0 2022-07-05T11:49:55.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe33cb0 0x55794fe81990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe33cb0 0x55794fe81990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35042/0 (socket says 172.21.15.90:35042) 2022-07-05T11:49:55.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 -- 172.21.15.90:0/348301041 learned_addr learned my addr 172.21.15.90:0/348301041 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:55.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a06d9d700 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 0x55794fe77c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a06d9d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f29ec08bb10 0x7f29ec08dfd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f29f8005750 tx=0x7f29f8007850).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:55.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 -- 172.21.15.90:0/348301041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 msgr2=0x55794fe77c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:55.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 0x55794fe77c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 -- 172.21.15.90:0/348301041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 msgr2=0x55794fe337c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:49:55.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe337c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.271+0000 7f2a05d9b700 1 -- 172.21.15.90:0/348301041 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55794fbbb9e0 con 0x55794fe33cb0 2022-07-05T11:49:55.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.272+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe33cb0 0x55794fe81990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2a080844f0 tx=0x7f2a080f00d0).ready entity=mon.1 client_cookie=fe2a71d7308a05a4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:55.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.321+0000 7f29e77fe700 1 -- 172.21.15.90:0/348301041 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000bae0 con 0x55794fe33cb0 2022-07-05T11:49:55.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.321+0000 7f29e77fe700 1 -- 172.21.15.90:0/348301041 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a00007080 con 0x55794fe33cb0 2022-07-05T11:49:55.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.321+0000 7f29e77fe700 1 -- 172.21.15.90:0/348301041 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000bdb0 con 0x55794fe33cb0 2022-07-05T11:49:55.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.322+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/348301041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe33cb0 msgr2=0x55794fe81990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.322+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe33cb0 0x55794fe81990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f2a080844f0 tx=0x7f2a080f00d0).stop 2022-07-05T11:49:55.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.327+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/348301041 shutdown_connections 2022-07-05T11:49:55.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.327+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 0x55794fe77c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.327+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.327+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/348301041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe33cb0 0x55794fe81990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.327+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/348301041 >> 172.21.15.90:0/348301041 conn(0x55794fca21c0 msgr2=0x55794fe36ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:55.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.348+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/348301041 shutdown_connections 2022-07-05T11:49:55.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.348+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/348301041 wait complete. 2022-07-05T11:49:55.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.350+0000 7f2a1e1b9b80 1 -- start start 2022-07-05T11:49:55.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.350+0000 7f2a1e1b9b80 1 Processor -- start 2022-07-05T11:49:55.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe33cb0 0x55794fe6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 0x55794fe724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 0x55794fe7a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fd51120 con 0x55794fe33cb0 2022-07-05T11:49:55.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fe7b970 con 0x55794fe773c0 2022-07-05T11:49:55.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fe731a0 con 0x55794fe777a0 2022-07-05T11:49:55.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a1e1b9b80 10 client.0 ll_register_callbacks cb 0x55794fdf71b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:49:55.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.352+0000 7f2a0659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe33cb0 0x55794fe6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe33cb0 0x55794fe6d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58726/0 (socket says 172.21.15.90:58726) 2022-07-05T11:49:55.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 -- 172.21.15.90:0/4171726144 learned_addr learned my addr 172.21.15.90:0/4171726144 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:55.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 -- 172.21.15.90:0/4171726144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 msgr2=0x55794fe7a560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:49:55.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 0x55794fe7a560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 -- 172.21.15.90:0/4171726144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 msgr2=0x55794fe724d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:49:55.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 0x55794fe724d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 -- 172.21.15.90:0/4171726144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a080ef270 con 0x55794fe33cb0 2022-07-05T11:49:55.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.353+0000 7f2a0659c700 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe33cb0 0x55794fe6d670 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f29fc082d10 tx=0x7f29fc001100).ready entity=mon.0 client_cookie=cd7bca783e6751f3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:55.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.370+0000 7f29e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:49:55.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.370+0000 7f29e4ff9700 1 -- 172.21.15.90:0/4171726144 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc083c30 con 0x55794fe33cb0 2022-07-05T11:49:55.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.371+0000 7f29e4ff9700 1 -- 172.21.15.90:0/4171726144 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f29fc083d90 con 0x55794fe33cb0 2022-07-05T11:49:55.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.371+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55794fd7f7f0 con 0x55794fe33cb0 2022-07-05T11:49:55.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.371+0000 7f29e4ff9700 1 -- 172.21.15.90:0/4171726144 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29fc089da0 con 0x55794fe33cb0 2022-07-05T11:49:55.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.379+0000 7f2a1e1b9b80 10 client.5394 fetch_fsmap learned FSMap version 17 2022-07-05T11:49:55.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.379+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55794fc2acd0 con 0x55794fe33cb0 2022-07-05T11:49:55.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f29e4ff9700 1 -- 172.21.15.90:0/4171726144 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55794fd7f7f0 con 0x55794fe33cb0 2022-07-05T11:49:55.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f29e4ff9700 1 -- 172.21.15.90:0/4171726144 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f29fc0adb80 con 0x55794fe33cb0 2022-07-05T11:49:55.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f2a1e1b9b80 10 client.5394 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:49:55.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f2a1e1b9b80 10 client.5394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:49:55.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f2a1e1b9b80 20 client.5394 populate_metadata read hostname 'smithi090' 2022-07-05T11:49:55.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794feb8d90 0x55794feb91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f2a1e1b9b80 4 client.5394 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:49:55.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.382+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55794fd76690 con 0x55794feb8d90 2022-07-05T11:49:55.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.442+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794feb8d90 0x55794feb91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.446+0000 7f29e4ff9700 10 client.5394 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:55.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.446+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794feb8d90 0x55794feb91a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3b828da182375586 server_cookie=d6524ab99009f273 in_seq=0 out_seq=0 2022-07-05T11:49:55.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.455+0000 7f29e4ff9700 1 -- 172.21.15.90:0/4171726144 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55794fd76690 con 0x55794feb8d90 2022-07-05T11:49:55.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.455+0000 7f29e4ff9700 10 client.5394 handle_command_reply: tid=0 2022-07-05T11:49:55.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.455+0000 7f2a1e1b9b80 1 client.5394 shutdown 2022-07-05T11:49:55.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.473+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe33cb0 msgr2=0x55794fe6d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.477 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.473+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe33cb0 0x55794fe6d670 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f29fc082d10 tx=0x7f29fc001100).stop 2022-07-05T11:49:55.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.479+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 shutdown_connections 2022-07-05T11:49:55.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.479+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794feb8d90 0x55794feb91a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.479+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe777a0 0x55794fe7a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.479+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe33cb0 0x55794fe6d670 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.479+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/4171726144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 0x55794fe724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.479+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 >> 172.21.15.90:0/4171726144 conn(0x55794fca21c0 msgr2=0x55794fea4230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:55.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.479+0000 7f29e4ff9700 0 client.5394 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:55.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.480+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 shutdown_connections 2022-07-05T11:49:55.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.480+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/4171726144 wait complete. 2022-07-05T11:49:55.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.480+0000 7f2a1e1b9b80 20 client.5394 trim_cache size 0 max 16384 2022-07-05T11:49:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.516+0000 7f2a1e1b9b80 1 Processor -- start 2022-07-05T11:49:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.517+0000 7f2a1e1b9b80 1 -- start start 2022-07-05T11:49:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.518+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe78470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.518+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.518+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe777a0 0x55794feb8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.518+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fe2e0c0 con 0x55794fe777a0 2022-07-05T11:49:55.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.518+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794feb6080 con 0x55794fe773c0 2022-07-05T11:49:55.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.518+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fe72880 con 0x55794fe33cb0 2022-07-05T11:49:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe78470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe78470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40130/0 (socket says 172.21.15.90:40130) 2022-07-05T11:49:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 -- 172.21.15.90:0/2317778489 learned_addr learned my addr 172.21.15.90:0/2317778489 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a06d9d700 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe777a0 0x55794feb8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 -- 172.21.15.90:0/2317778489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 msgr2=0x55794fe2dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:55.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 -- 172.21.15.90:0/2317778489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe777a0 msgr2=0x55794feb8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:49:55.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe777a0 0x55794feb8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 -- 172.21.15.90:0/2317778489 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55794fbf8fd0 con 0x55794fe33cb0 2022-07-05T11:49:55.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a06d9d700 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe777a0 0x55794feb8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:49:55.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.519+0000 7f2a0659c700 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe78470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f29fc00ffd0 tx=0x7f29fc08d000).ready entity=mon.2 client_cookie=b6d6ccab44d5b4d0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:55.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.521+0000 7f29e7fff700 1 -- 172.21.15.90:0/2317778489 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc08a020 con 0x55794fe33cb0 2022-07-05T11:49:55.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.521+0000 7f29e7fff700 1 -- 172.21.15.90:0/2317778489 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc089da0 con 0x55794fe33cb0 2022-07-05T11:49:55.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.521+0000 7f29e7fff700 1 -- 172.21.15.90:0/2317778489 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00fb50 con 0x55794fe33cb0 2022-07-05T11:49:55.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.522+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/2317778489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 msgr2=0x55794fe78470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.522+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe78470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f29fc00ffd0 tx=0x7f29fc08d000).stop 2022-07-05T11:49:55.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.529+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/2317778489 shutdown_connections 2022-07-05T11:49:55.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.529+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe777a0 0x55794feb8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.529+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe78470 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.529+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/2317778489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.529+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/2317778489 >> 172.21.15.90:0/2317778489 conn(0x55794fca21c0 msgr2=0x55794fe77b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:55.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.541+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/2317778489 shutdown_connections 2022-07-05T11:49:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.541+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/2317778489 wait complete. 2022-07-05T11:49:55.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.542+0000 7f2a1e1b9b80 1 -- start start 2022-07-05T11:49:55.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.542+0000 7f2a1e1b9b80 1 Processor -- start 2022-07-05T11:49:55.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.544+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe70020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.544+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.544+0000 7f2a1e1b9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe777a0 0x55794fe35110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.544+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fe2e0c0 con 0x55794fe773c0 2022-07-05T11:49:55.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.544+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fe763e0 con 0x55794fe777a0 2022-07-05T11:49:55.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.544+0000 7f2a1e1b9b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794fea5010 con 0x55794fe33cb0 2022-07-05T11:49:55.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.544+0000 7f2a1e1b9b80 10 client.0 ll_register_callbacks cb 0x55794fdf71b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:49:55.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58742/0 (socket says 172.21.15.90:58742) 2022-07-05T11:49:55.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 -- 172.21.15.90:0/958532846 learned_addr learned my addr 172.21.15.90:0/958532846 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:49:55.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 -- 172.21.15.90:0/958532846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 msgr2=0x55794fe70020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:49:55.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe70020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 -- 172.21.15.90:0/958532846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe777a0 msgr2=0x55794fe35110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:49:55.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe777a0 0x55794fe35110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 -- 172.21.15.90:0/958532846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55794fc2acd0 con 0x55794fe773c0 2022-07-05T11:49:55.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.545+0000 7f2a05d9b700 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f2a0001a000 tx=0x7f2a0002b280).ready entity=mon.0 client_cookie=7bd82dff6c08d1a2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:49:55.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.549+0000 7f29e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:49:55.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.549+0000 7f29e4ff9700 1 -- 172.21.15.90:0/958532846 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00010d00 con 0x55794fe773c0 2022-07-05T11:49:55.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.549+0000 7f29e4ff9700 1 -- 172.21.15.90:0/958532846 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f2a00019450 con 0x55794fe773c0 2022-07-05T11:49:55.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.549+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55794fe31440 con 0x55794fe773c0 2022-07-05T11:49:55.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.549+0000 7f29e4ff9700 1 -- 172.21.15.90:0/958532846 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a00010e60 con 0x55794fe773c0 2022-07-05T11:49:55.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.550+0000 7f2a1e1b9b80 10 client.5397 fetch_fsmap learned FSMap version 17 2022-07-05T11:49:55.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.550+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55794fea46e0 con 0x55794fe773c0 2022-07-05T11:49:55.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.550+0000 7f29e4ff9700 1 -- 172.21.15.90:0/958532846 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a00059020 con 0x55794fe773c0 2022-07-05T11:49:55.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.550+0000 7f29e4ff9700 1 -- 172.21.15.90:0/958532846 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f2a00019820 con 0x55794fe773c0 2022-07-05T11:49:55.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a1e1b9b80 10 client.5397 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:49:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a1e1b9b80 10 client.5397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:49:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a1e1b9b80 20 client.5397 populate_metadata read hostname 'smithi090' 2022-07-05T11:49:55.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794fe758b0 0x55794fe705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:49:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a1e1b9b80 4 client.5397 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:49:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55794fbdd3e0 con 0x55794fe758b0 2022-07-05T11:49:55.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a0659c700 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794fe758b0 0x55794fe705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:49:55.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f29e4ff9700 10 client.5397 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:55.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.551+0000 7f2a0659c700 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794fe758b0 0x55794fe705a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=926606b386ee2c19 server_cookie=f6181c93f99bcd59 in_seq=0 out_seq=0 2022-07-05T11:49:55.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.553+0000 7f29e4ff9700 1 -- 172.21.15.90:0/958532846 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55794fbdd3e0 con 0x55794fe758b0 2022-07-05T11:49:55.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.553+0000 7f29e4ff9700 10 client.5397 handle_command_reply: tid=0 2022-07-05T11:49:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.553+0000 7f2a1e1b9b80 1 client.5397 shutdown 2022-07-05T11:49:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.553+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 msgr2=0x55794fe2dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.553+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f2a0001a000 tx=0x7f2a0002b280).stop 2022-07-05T11:49:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 shutdown_connections 2022-07-05T11:49:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55794fe758b0 0x55794fe705a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55794fe777a0 0x55794fe35110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55794fe33cb0 0x55794fe70020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 --2- 172.21.15.90:0/958532846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55794fe773c0 0x55794fe2dbd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 >> 172.21.15.90:0/958532846 conn(0x55794fca21c0 msgr2=0x55794fea94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f29e4ff9700 0 client.5397 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:49:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 shutdown_connections 2022-07-05T11:49:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 1 -- 172.21.15.90:0/958532846 wait complete. 2022-07-05T11:49:55.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.554+0000 7f2a1e1b9b80 20 client.5397 trim_cache size 0 max 16384 2022-07-05T11:49:55.577 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:49:55.577 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:49:55.578 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:49:55.578 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:49:55.578 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:49:55.579 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:49:55.579 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:49:55.580 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:49:55.580 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:49:55.580 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:49:55.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.555+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f29ec08bb10 msgr2=0x7f29ec08dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.555+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f29ec08bb10 0x7f29ec08dfd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f29f8005750 tx=0x7f29f8007850).stop 2022-07-05T11:49:55.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.555+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a08188530 msgr2=0x7f2a08183f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:49:55.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.555+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a08188530 0x7f2a08183f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f29fc00c490 tx=0x7f29fc007de0).stop 2022-07-05T11:49:55.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 shutdown_connections 2022-07-05T11:49:55.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f29ec08bb10 0x7f29ec08dfd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a081894f0 0x7f2a081b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a08188530 0x7f2a08183f30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:49:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 --2- 172.21.15.90:0/1043821870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a08188910 0x7f2a080eb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:49:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 >> 172.21.15.90:0/1043821870 conn(0x7f2a080edd60 msgr2=0x7f2a08064d30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:49:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 shutdown_connections 2022-07-05T11:49:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:49:55.556+0000 7f2a0c82d700 1 -- 172.21.15.90:0/1043821870 wait complete. 2022-07-05T11:49:55.587 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:50:03.389 INFO:tasks.workunit.client.0.smithi090.stdout: 158 2294593 724 1560302 706 757602 512 2022-07-05T11:50:13.389 INFO:tasks.workunit.client.0.smithi090.stdout: 175 1168587 994 795449 920 393708 917 2022-07-05T11:50:21.701 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:50:21.745 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:50:21.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:50:23.389 INFO:tasks.workunit.client.0.smithi090.stdout: 191 1032576 961 713687 1027 365727 1694 2022-07-05T11:50:25.589 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:50:26.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.971+0000 7f97d236c700 1 Processor -- start 2022-07-05T11:50:26.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.971+0000 7f97d236c700 1 -- start start 2022-07-05T11:50:26.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.972+0000 7f97d236c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97cc17a560 0x7f97cc0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:26.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.972+0000 7f97d236c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc0eb520 con 0x7f97cc17a180 2022-07-05T11:50:26.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.972+0000 7f97d236c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc17a9e0 con 0x7f97cc05d9a0 2022-07-05T11:50:26.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.972+0000 7f97d236c700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97cc0c8d20 con 0x7f97cc17a560 2022-07-05T11:50:26.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.972+0000 7f97cbfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f97cc17a180 0x7f97cc0c3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51688/0 (socket says 172.21.15.90:51688) 2022-07-05T11:50:26.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.972+0000 7f97cbfff700 1 -- 172.21.15.90:0/4059360897 learned_addr learned my addr 172.21.15.90:0/4059360897 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:50:26.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.981+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/4059360897 >> v2:172.21.15.110:3300/0 conn(0x7f97cc17a560 0x7f97cc0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:26.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.981+0000 7f97caffd700 1 -- 172.21.15.90:0/4059360897 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292322572 0 0) 0x7f97cc0eb520 con 0x7f97cc17a180 2022-07-05T11:50:26.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.981+0000 7f97caffd700 1 -- 172.21.15.90:0/4059360897 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97ac0033f0 con 0x7f97cc17a180 2022-07-05T11:50:26.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97caffd700 1 -- 172.21.15.90:0/4059360897 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032547012 0 0) 0x7f97cc17a9e0 con 0x7f97cc05d9a0 2022-07-05T11:50:26.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97caffd700 1 -- 172.21.15.90:0/4059360897 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97cc0eb520 con 0x7f97cc05d9a0 2022-07-05T11:50:26.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97cb7fe700 1 -- 172.21.15.90:0/4059360897 >> v1:172.21.15.149:6789/0 conn(0x7f97cc05d9a0 legacy=0x7f97cc0e9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:26.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97cb7fe700 1 -- 172.21.15.90:0/4059360897 >> v1:172.21.15.90:6789/0 conn(0x7f97cc17a180 legacy=0x7f97cc0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:26.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97cb7fe700 1 -- 172.21.15.90:0/4059360897 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc0c9000 con 0x7f97cc17a560 2022-07-05T11:50:26.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/4059360897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc17a560 0x7f97cc0c3f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f97b4009760 tx=0x7f97b4009060).ready entity=mon.1 client_cookie=847039d2b609c1bd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:26.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97caffd700 1 -- 172.21.15.90:0/4059360897 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400d4a0 con 0x7f97cc17a560 2022-07-05T11:50:26.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97caffd700 1 -- 172.21.15.90:0/4059360897 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400d600 con 0x7f97cc17a560 2022-07-05T11:50:26.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.982+0000 7f97caffd700 1 -- 172.21.15.90:0/4059360897 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400d980 con 0x7f97cc17a560 2022-07-05T11:50:26.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.983+0000 7f97d236c700 1 -- 172.21.15.90:0/4059360897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc17a560 msgr2=0x7f97cc0c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:26.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.983+0000 7f97d236c700 1 --2- 172.21.15.90:0/4059360897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc17a560 0x7f97cc0c3f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f97b4009760 tx=0x7f97b4009060).stop 2022-07-05T11:50:26.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.983+0000 7f97d236c700 1 -- 172.21.15.90:0/4059360897 shutdown_connections 2022-07-05T11:50:26.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.983+0000 7f97d236c700 1 --2- 172.21.15.90:0/4059360897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc17a560 0x7f97cc0c3f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:26.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.983+0000 7f97d236c700 1 -- 172.21.15.90:0/4059360897 >> 172.21.15.90:0/4059360897 conn(0x7f97cc083570 msgr2=0x7f97cc083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:26.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.983+0000 7f97d236c700 1 -- 172.21.15.90:0/4059360897 shutdown_connections 2022-07-05T11:50:26.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.983+0000 7f97d236c700 1 -- 172.21.15.90:0/4059360897 wait complete. 2022-07-05T11:50:26.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.986+0000 7f97d236c700 1 Processor -- start 2022-07-05T11:50:26.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.986+0000 7f97d236c700 1 -- start start 2022-07-05T11:50:26.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.987+0000 7f97d236c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc05d9a0 0x7f97cc163f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:26.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.987+0000 7f97d236c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97cc17a180 0x7f97cc0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:26.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.987+0000 7f97d236c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97cc17a560 0x7f97cc0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:26.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.987+0000 7f97d236c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0c4290 con 0x7f97cc17a180 2022-07-05T11:50:26.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.987+0000 7f97d236c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0c36a0 con 0x7f97cc05d9a0 2022-07-05T11:50:26.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.987+0000 7f97d236c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0696e0 con 0x7f97cc17a560 2022-07-05T11:50:26.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97cc17a560 0x7f97cc0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:26.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97cc17a560 0x7f97cc0c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40154/0 (socket says 172.21.15.90:40154) 2022-07-05T11:50:26.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 -- 172.21.15.90:0/942233183 learned_addr learned my addr 172.21.15.90:0/942233183 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:26.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 -- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc05d9a0 msgr2=0x7f97cc163f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-07-05T11:50:26.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc05d9a0 0x7f97cc163f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:26.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 -- 172.21.15.90:0/942233183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97cc17a180 msgr2=0x7f97cc0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:26.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97cc17a180 0x7f97cc0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:26.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 -- 172.21.15.90:0/942233183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40092a0 con 0x7f97cc17a560 2022-07-05T11:50:26.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d0909700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97cc17a560 0x7f97cc0c8330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f97c400c740 tx=0x7f97c40025e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:26.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97c3fff700 1 -- 172.21.15.90:0/942233183 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4010510 con 0x7f97cc17a560 2022-07-05T11:50:26.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97c3fff700 1 -- 172.21.15.90:0/942233183 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4010670 con 0x7f97cc17a560 2022-07-05T11:50:26.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97c3fff700 1 -- 172.21.15.90:0/942233183 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4010a30 con 0x7f97cc17a560 2022-07-05T11:50:26.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.988+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc0c3960 con 0x7f97cc17a560 2022-07-05T11:50:26.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.989+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc0c3f20 con 0x7f97cc17a560 2022-07-05T11:50:26.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.991+0000 7f97c3fff700 1 -- 172.21.15.90:0/942233183 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f97c4010070 con 0x7f97cc17a560 2022-07-05T11:50:27.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.992+0000 7f97c3fff700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f97b008ba40 0x7f97b008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.992+0000 7f97c3fff700 1 -- 172.21.15.90:0/942233183 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f97c40b0740 con 0x7f97cc17a560 2022-07-05T11:50:27.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.993+0000 7f97cbfff700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f97b008ba40 0x7f97b008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.993+0000 7f97e3cf8b80 1 Processor -- start 2022-07-05T11:50:27.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.993+0000 7f97e3cf8b80 1 -- start start 2022-07-05T11:50:27.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.993+0000 7f97cbfff700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f97b008ba40 0x7f97b008df00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f97bc005750 tx=0x7f97bc0077c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:27.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b283c0 0x555a00ae47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b32990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b287a0 0x555a00b28c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00aae2d0 con 0x555a00b283c0 2022-07-05T11:50:27.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00a25aa0 con 0x555a00ae4cb0 2022-07-05T11:50:27.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00a3a950 con 0x555a00b287a0 2022-07-05T11:50:27.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b32990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b32990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35084/0 (socket says 172.21.15.90:35084) 2022-07-05T11:50:27.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 -- 172.21.15.90:0/4054970598 learned_addr learned my addr 172.21.15.90:0/4054970598 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:27.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 -- 172.21.15.90:0/4054970598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b287a0 msgr2=0x555a00b28c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/4054970598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b287a0 0x555a00b28c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 -- 172.21.15.90:0/4054970598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b283c0 msgr2=0x555a00ae47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/4054970598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b283c0 0x555a00ae47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 -- 172.21.15.90:0/4054970598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a0086c9e0 con 0x555a00ae4cb0 2022-07-05T11:50:27.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:26.995+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/4054970598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b32990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f97b4010000 tx=0x7f97b4016000).ready entity=mon.1 client_cookie=e8f10f70b098c918 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:27.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.004+0000 7f97c17fa700 1 -- 172.21.15.90:0/4054970598 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4000c90 con 0x555a00ae4cb0 2022-07-05T11:50:27.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.004+0000 7f97c17fa700 1 -- 172.21.15.90:0/4054970598 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400dcf0 con 0x555a00ae4cb0 2022-07-05T11:50:27.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.004+0000 7f97c17fa700 1 -- 172.21.15.90:0/4054970598 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400de60 con 0x555a00ae4cb0 2022-07-05T11:50:27.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/4054970598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 msgr2=0x555a00b32990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:27.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/4054970598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b32990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f97b4010000 tx=0x7f97b4016000).stop 2022-07-05T11:50:27.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/4054970598 shutdown_connections 2022-07-05T11:50:27.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/4054970598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b287a0 0x555a00b28c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/4054970598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b283c0 0x555a00ae47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/4054970598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b32990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/4054970598 >> 172.21.15.90:0/4054970598 conn(0x555a009531c0 msgr2=0x555a00ae7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:27.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/4054970598 shutdown_connections 2022-07-05T11:50:27.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.005+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/4054970598 wait complete. 2022-07-05T11:50:27.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.006+0000 7f97e3cf8b80 1 -- start start 2022-07-05T11:50:27.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.006+0000 7f97e3cf8b80 1 Processor -- start 2022-07-05T11:50:27.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b1e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b30ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00b22650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00a02120 con 0x555a00b287a0 2022-07-05T11:50:27.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00b31ba0 con 0x555a00ae4cb0 2022-07-05T11:50:27.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00b224a0 con 0x555a00b283c0 2022-07-05T11:50:27.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97e3cf8b80 10 client.0 ll_register_callbacks cb 0x555a00aa81b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:50:27.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b30ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b30ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40164/0 (socket says 172.21.15.90:40164) 2022-07-05T11:50:27.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97d0909700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00b22650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97cb7fe700 1 -- 172.21.15.90:0/1893045533 learned_addr learned my addr 172.21.15.90:0/1893045533 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:27.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97d0909700 1 -- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 msgr2=0x555a00b30ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97d0909700 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b30ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97d0909700 1 -- 172.21.15.90:0/1893045533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 msgr2=0x555a00b1e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97d0909700 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b1e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97d0909700 1 -- 172.21.15.90:0/1893045533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc0c9000 con 0x555a00b287a0 2022-07-05T11:50:27.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.007+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b30ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:50:27.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97d0909700 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00b22650 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f97c4084960 tx=0x7f97c40ae260).ready entity=mon.0 client_cookie=194116931b5e5cb2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:27.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:50:27.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1893045533 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4081710 con 0x555a00b287a0 2022-07-05T11:50:27.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a00ae2440 con 0x555a00b287a0 2022-07-05T11:50:27.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1893045533 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f97c4081870 con 0x555a00b287a0 2022-07-05T11:50:27.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1893045533 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97c400a500 con 0x555a00b287a0 2022-07-05T11:50:27.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 10 client.5403 fetch_fsmap learned FSMap version 17 2022-07-05T11:50:27.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555a008dbcd0 con 0x555a00b287a0 2022-07-05T11:50:27.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1893045533 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4094020 con 0x555a00b287a0 2022-07-05T11:50:27.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1893045533 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f97c40844f0 con 0x555a00b287a0 2022-07-05T11:50:27.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 10 client.5403 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:50:27.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 10 client.5403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:50:27.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 20 client.5403 populate_metadata read hostname 'smithi090' 2022-07-05T11:50:27.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00b31620 0x555a00b66ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 4 client.5403 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:50:27.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.008+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a00a307f0 con 0x555a00b31620 2022-07-05T11:50:27.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.009+0000 7f97cbfff700 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00b31620 0x555a00b66ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.009+0000 7f97aa7fc700 10 client.5403 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:50:27.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.009+0000 7f97cbfff700 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00b31620 0x555a00b66ad0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e0c9b25db097203d server_cookie=955185c3e1069d1 in_seq=0 out_seq=0 2022-07-05T11:50:27.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1893045533 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x555a00a307f0 con 0x555a00b31620 2022-07-05T11:50:27.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97aa7fc700 10 client.5403 handle_command_reply: tid=0 2022-07-05T11:50:27.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 client.5403 shutdown 2022-07-05T11:50:27.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 msgr2=0x555a00b22650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:27.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00b22650 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f97c4084960 tx=0x7f97c40ae260).stop 2022-07-05T11:50:27.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 shutdown_connections 2022-07-05T11:50:27.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00b31620 0x555a00b66ad0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00b22650 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00ae4cb0 0x555a00b1e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1893045533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b30ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 >> 172.21.15.90:0/1893045533 conn(0x555a009531c0 msgr2=0x555a00b55b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:27.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97aa7fc700 0 client.5403 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:50:27.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 shutdown_connections 2022-07-05T11:50:27.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1893045533 wait complete. 2022-07-05T11:50:27.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.010+0000 7f97e3cf8b80 20 client.5403 trim_cache size 0 max 16384 2022-07-05T11:50:27.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.030+0000 7f97e3cf8b80 1 Processor -- start 2022-07-05T11:50:27.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.030+0000 7f97e3cf8b80 1 -- start start 2022-07-05T11:50:27.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00ae4cb0 0x555a00b25020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b283c0 0x555a00b66bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00bb2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00bb2f60 con 0x555a00b287a0 2022-07-05T11:50:27.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00adf050 con 0x555a00b283c0 2022-07-05T11:50:27.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00ae7db0 con 0x555a00ae4cb0 2022-07-05T11:50:27.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97d0909700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00bb2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97d0909700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00bb2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58776/0 (socket says 172.21.15.90:58776) 2022-07-05T11:50:27.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00ae4cb0 0x555a00b25020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.031+0000 7f97d0909700 1 -- 172.21.15.90:0/674006854 learned_addr learned my addr 172.21.15.90:0/674006854 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:27.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b283c0 0x555a00b66bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97d0909700 1 -- 172.21.15.90:0/674006854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00ae4cb0 msgr2=0x555a00b25020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97d0909700 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00ae4cb0 0x555a00b25020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97d0909700 1 -- 172.21.15.90:0/674006854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b283c0 msgr2=0x555a00b66bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97d0909700 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b283c0 0x555a00b66bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97d0909700 1 -- 172.21.15.90:0/674006854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a008a9fd0 con 0x555a00b287a0 2022-07-05T11:50:27.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97d0909700 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00bb2a70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f97c4084d00 tx=0x7f97c40835b0).ready entity=mon.0 client_cookie=251342c692bd8a35 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:27.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97c1ffb700 1 -- 172.21.15.90:0/674006854 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c408a8e0 con 0x555a00b287a0 2022-07-05T11:50:27.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97c1ffb700 1 -- 172.21.15.90:0/674006854 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4094040 con 0x555a00b287a0 2022-07-05T11:50:27.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.032+0000 7f97c1ffb700 1 -- 172.21.15.90:0/674006854 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400a500 con 0x555a00b287a0 2022-07-05T11:50:27.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/674006854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 msgr2=0x555a00bb2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:27.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00bb2a70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f97c4084d00 tx=0x7f97c40835b0).stop 2022-07-05T11:50:27.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/674006854 shutdown_connections 2022-07-05T11:50:27.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00b287a0 0x555a00bb2a70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00ae4cb0 0x555a00b25020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/674006854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b283c0 0x555a00b66bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/674006854 >> 172.21.15.90:0/674006854 conn(0x555a009531c0 msgr2=0x555a00b25680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:27.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/674006854 shutdown_connections 2022-07-05T11:50:27.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.033+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/674006854 wait complete. 2022-07-05T11:50:27.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.034+0000 7f97e3cf8b80 1 -- start start 2022-07-05T11:50:27.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.034+0000 7f97e3cf8b80 1 Processor -- start 2022-07-05T11:50:27.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00ae4cb0 0x555a00ba62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b65f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97e3cf8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b287a0 0x555a00bae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00b32520 con 0x555a00ae4cb0 2022-07-05T11:50:27.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00b21640 con 0x555a00b287a0 2022-07-05T11:50:27.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97e3cf8b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a00bae720 con 0x555a00b283c0 2022-07-05T11:50:27.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97e3cf8b80 10 client.0 ll_register_callbacks cb 0x555a00aa81b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:50:27.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00ae4cb0 0x555a00ba62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00ae4cb0 0x555a00ba62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58778/0 (socket says 172.21.15.90:58778) 2022-07-05T11:50:27.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b65f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 -- 172.21.15.90:0/1121582392 learned_addr learned my addr 172.21.15.90:0/1121582392 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:27.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97d0909700 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b287a0 0x555a00bae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 -- 172.21.15.90:0/1121582392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 msgr2=0x555a00b65f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b65f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 -- 172.21.15.90:0/1121582392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b287a0 msgr2=0x555a00bae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:27.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b287a0 0x555a00bae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.035+0000 7f97cbfff700 1 -- 172.21.15.90:0/1121582392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a008dbcd0 con 0x555a00ae4cb0 2022-07-05T11:50:27.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97cbfff700 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00ae4cb0 0x555a00ba62f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x555a00b23c00 tx=0x7f97bc019040).ready entity=mon.0 client_cookie=976397b2b96cd993 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:27.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:50:27.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1121582392 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc026070 con 0x555a00ae4cb0 2022-07-05T11:50:27.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1121582392 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f97bc005280 con 0x555a00ae4cb0 2022-07-05T11:50:27.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97b400dcf0 con 0x555a00ae4cb0 2022-07-05T11:50:27.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1121582392 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97bc005e90 con 0x555a00ae4cb0 2022-07-05T11:50:27.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 10 client.5409 fetch_fsmap learned FSMap version 17 2022-07-05T11:50:27.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555a00b20ff0 con 0x555a00ae4cb0 2022-07-05T11:50:27.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1121582392 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400dcf0 con 0x555a00ae4cb0 2022-07-05T11:50:27.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1121582392 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 17) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f97bc029030 con 0x555a00ae4cb0 2022-07-05T11:50:27.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 10 client.5409 fetch_fsmap finished waiting for FSMap version 17 2022-07-05T11:50:27.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 10 client.5409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:50:27.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 20 client.5409 populate_metadata read hostname 'smithi090' 2022-07-05T11:50:27.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00aef900 0x555a00ba6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:27.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 4 client.5409 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:50:27.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555a00a27690 con 0x555a00aef900 2022-07-05T11:50:27.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.036+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00aef900 0x555a00ba6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:27.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97aa7fc700 10 client.5409 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:50:27.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97cb7fe700 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00aef900 0x555a00ba6850 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=42df3c32105647a5 server_cookie=89e2c30d655ea362 in_seq=0 out_seq=0 2022-07-05T11:50:27.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97aa7fc700 1 -- 172.21.15.90:0/1121582392 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555a00a27690 con 0x555a00aef900 2022-07-05T11:50:27.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97aa7fc700 10 client.5409 handle_command_reply: tid=0 2022-07-05T11:50:27.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 client.5409 shutdown 2022-07-05T11:50:27.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00ae4cb0 msgr2=0x555a00ba62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:27.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00ae4cb0 0x555a00ba62f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x555a00b23c00 tx=0x7f97bc019040).stop 2022-07-05T11:50:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 shutdown_connections 2022-07-05T11:50:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555a00aef900 0x555a00ba6850 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555a00b287a0 0x555a00bae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97aa7fc700 0 client.5409 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:50:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a00ae4cb0 0x555a00ba62f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 --2- 172.21.15.90:0/1121582392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a00b283c0 0x555a00b65f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 >> 172.21.15.90:0/1121582392 conn(0x555a009531c0 msgr2=0x555a00ae41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:27.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 shutdown_connections 2022-07-05T11:50:27.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 1 -- 172.21.15.90:0/1121582392 wait complete. 2022-07-05T11:50:27.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.037+0000 7f97e3cf8b80 20 client.5409 trim_cache size 0 max 16384 2022-07-05T11:50:27.096 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:50:27.097 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:50:27.097 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:50:27.098 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:50:27.101 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:50:27.103 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:50:27.103 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:50:27.104 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:50:27.104 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:50:27.104 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:50:27.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f97b008ba40 msgr2=0x7f97b008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:27.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f97b008ba40 0x7f97b008df00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f97bc005750 tx=0x7f97bc0077c0).stop 2022-07-05T11:50:27.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97cc17a560 msgr2=0x7f97cc0c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:27.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97cc17a560 0x7f97cc0c8330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f97c400c740 tx=0x7f97c40025e0).stop 2022-07-05T11:50:27.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 shutdown_connections 2022-07-05T11:50:27.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f97b008ba40 0x7f97b008df00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97cc17a560 0x7f97cc0c8330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:27.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97cc05d9a0 0x7f97cc163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 --2- 172.21.15.90:0/942233183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97cc17a180 0x7f97cc0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:27.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 >> 172.21.15.90:0/942233183 conn(0x7f97cc083570 msgr2=0x7f97cc0f0670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:27.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 shutdown_connections 2022-07-05T11:50:27.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:27.038+0000 7f97d236c700 1 -- 172.21.15.90:0/942233183 wait complete. 2022-07-05T11:50:27.110 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:50:33.390 INFO:tasks.workunit.client.0.smithi090.stdout: 201 2117990 560 1468143 545 758763 780 2022-07-05T11:50:43.390 INFO:tasks.workunit.client.0.smithi090.stdout: 213 2077141 656 1445188 704 776515 1227 2022-07-05T11:50:52.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:50:52.300 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:50:52.302 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:50:53.396 INFO:tasks.workunit.client.0.smithi090.stdout: 222 2538827 690 1763800 516 973920 1000 2022-07-05T11:50:57.112 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:50:59.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.693+0000 7fdc4b59e700 1 Processor -- start 2022-07-05T11:50:59.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.704+0000 7fdc4b59e700 1 -- start start 2022-07-05T11:50:59.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.706+0000 7fdc4b59e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdc4c179cd0 0x7fdc4c17a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.706+0000 7fdc4b59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdc4c0bfb90 0x7fdc4c0c0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.706+0000 7fdc4b59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c17ba20 con 0x7fdc4c0c3660 2022-07-05T11:50:59.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.706+0000 7fdc4b59e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c17b400 con 0x7fdc4c179cd0 2022-07-05T11:50:59.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.706+0000 7fdc4b59e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c17bc70 con 0x7fdc4c0bfb90 2022-07-05T11:50:59.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.710+0000 7fdc4a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdc4c179cd0 0x7fdc4c17a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:59.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.710+0000 7fdc4a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdc4c179cd0 0x7fdc4c17a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58786/0 (socket says 172.21.15.90:58786) 2022-07-05T11:50:59.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.710+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1030577680 learned_addr learned my addr 172.21.15.90:0/1030577680 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:59.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.711+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1030577680 >> v2:172.21.15.110:3300/0 conn(0x7fdc4c0bfb90 msgr2=0x7fdc4c0c0040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:50:59.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.711+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/1030577680 >> v2:172.21.15.110:3300/0 conn(0x7fdc4c0bfb90 0x7fdc4c0c0040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.711+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1030577680 >> v1:172.21.15.90:6789/0 conn(0x7fdc4c0c3660 legacy=0x7fdc4c17cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:59.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.711+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1030577680 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c17bf50 con 0x7fdc4c179cd0 2022-07-05T11:50:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.711+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/1030577680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c179cd0 0x7fdc4c17a0b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fdc4c0c8a30 tx=0x7fdc3c009980).ready entity=mon.0 client_cookie=239b7d02dbeb120b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.712+0000 7fdc4959a700 1 -- 172.21.15.90:0/1030577680 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c013a90 con 0x7fdc4c179cd0 2022-07-05T11:50:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.712+0000 7fdc4959a700 1 -- 172.21.15.90:0/1030577680 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c013bf0 con 0x7fdc4c179cd0 2022-07-05T11:50:59.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.712+0000 7fdc4959a700 1 -- 172.21.15.90:0/1030577680 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c00c400 con 0x7fdc4c179cd0 2022-07-05T11:50:59.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.713+0000 7fdc4b59e700 1 -- 172.21.15.90:0/1030577680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c179cd0 msgr2=0x7fdc4c17a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:59.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.713+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/1030577680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c179cd0 0x7fdc4c17a0b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fdc4c0c8a30 tx=0x7fdc3c009980).stop 2022-07-05T11:50:59.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.717+0000 7fdc4b59e700 1 -- 172.21.15.90:0/1030577680 shutdown_connections 2022-07-05T11:50:59.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.717+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/1030577680 >> v2:172.21.15.110:3300/0 conn(0x7fdc4c0bfb90 0x7fdc4c0c0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.717+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/1030577680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c179cd0 0x7fdc4c17a0b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:59.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.717+0000 7fdc4b59e700 1 -- 172.21.15.90:0/1030577680 >> 172.21.15.90:0/1030577680 conn(0x7fdc4c0f10a0 msgr2=0x7fdc4c0ed070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:59.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.720+0000 7fdc4b59e700 1 -- 172.21.15.90:0/1030577680 shutdown_connections 2022-07-05T11:50:59.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.723+0000 7fdc4b59e700 1 -- 172.21.15.90:0/1030577680 wait complete. 2022-07-05T11:50:59.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.725+0000 7fdc4b59e700 1 Processor -- start 2022-07-05T11:50:59.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.725+0000 7fdc4b59e700 1 -- start start 2022-07-05T11:50:59.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.727+0000 7fdc4b59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c0bfb90 0x7fdc4c0c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.727+0000 7fdc4b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c0c3660 0x7fdc4c064930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.727+0000 7fdc4b59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc4c179cd0 0x7fdc4c064e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.727+0000 7fdc4b59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0eb1f0 con 0x7fdc4c0c3660 2022-07-05T11:50:59.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.727+0000 7fdc4b59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0c44a0 con 0x7fdc4c179cd0 2022-07-05T11:50:59.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.727+0000 7fdc4b59e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0c4780 con 0x7fdc4c0bfb90 2022-07-05T11:50:59.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.728+0000 7fdc49d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c0c3660 0x7fdc4c064930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:59.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.728+0000 7fdc49d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c0c3660 0x7fdc4c064930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58794/0 (socket says 172.21.15.90:58794) 2022-07-05T11:50:59.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.728+0000 7fdc49d9b700 1 -- 172.21.15.90:0/783692677 learned_addr learned my addr 172.21.15.90:0/783692677 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:59.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.729+0000 7fdc49d9b700 1 -- 172.21.15.90:0/783692677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c0bfb90 msgr2=0x7fdc4c0c3a60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-07-05T11:50:59.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.729+0000 7fdc49d9b700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c0bfb90 0x7fdc4c0c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.729+0000 7fdc49d9b700 1 -- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc4c179cd0 msgr2=0x7fdc4c064e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-07-05T11:50:59.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.729+0000 7fdc49d9b700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc4c179cd0 0x7fdc4c064e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.729+0000 7fdc49d9b700 1 -- 172.21.15.90:0/783692677 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c009c00 con 0x7fdc4c0c3660 2022-07-05T11:50:59.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.729+0000 7fdc49d9b700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c0c3660 0x7fdc4c064930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fdc4400bb80 tx=0x7fdc44009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:59.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.730+0000 7fdc3a7fc700 1 -- 172.21.15.90:0/783692677 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400c970 con 0x7fdc4c0c3660 2022-07-05T11:50:59.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.730+0000 7fdc3a7fc700 1 -- 172.21.15.90:0/783692677 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400cad0 con 0x7fdc4c0c3660 2022-07-05T11:50:59.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.730+0000 7fdc3a7fc700 1 -- 172.21.15.90:0/783692677 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400cc80 con 0x7fdc4c0c3660 2022-07-05T11:50:59.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.730+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c0c4a60 con 0x7fdc4c0c3660 2022-07-05T11:50:59.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.730+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c0c5020 con 0x7fdc4c0c3660 2022-07-05T11:50:59.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.738+0000 7fdc3a7fc700 1 -- 172.21.15.90:0/783692677 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fdc44015630 con 0x7fdc4c0c3660 2022-07-05T11:50:59.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.739+0000 7fdc3a7fc700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdc3008bbf0 0x7fdc3008e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.740+0000 7fdc3a7fc700 1 -- 172.21.15.90:0/783692677 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdc440b0d20 con 0x7fdc4c0c3660 2022-07-05T11:50:59.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.741+0000 7fdc623a3b80 1 Processor -- start 2022-07-05T11:50:59.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.745+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdc3008bbf0 0x7fdc3008e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:59.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.745+0000 7fdc623a3b80 1 -- start start 2022-07-05T11:50:59.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.746+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d94b0 0x5611b29958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.746+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b29e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.746+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29d9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.746+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b295f2d0 con 0x5611b29d9890 2022-07-05T11:50:59.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.746+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b28d6aa0 con 0x5611b2995da0 2022-07-05T11:50:59.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.746+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b28eb950 con 0x5611b29d94b0 2022-07-05T11:50:59.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29d9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:59.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29d9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58798/0 (socket says 172.21.15.90:58798) 2022-07-05T11:50:59.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/2091842393 learned_addr learned my addr 172.21.15.90:0/2091842393 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:59.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/2091842393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d94b0 msgr2=0x5611b29958b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:50:59.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 --2- 172.21.15.90:0/2091842393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d94b0 0x5611b29958b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/2091842393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 msgr2=0x5611b29e3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:59.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 --2- 172.21.15.90:0/2091842393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b29e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/2091842393 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b271d9e0 con 0x5611b29d9890 2022-07-05T11:50:59.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.747+0000 7fdc4ad9d700 1 --2- 172.21.15.90:0/2091842393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29d9d10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fdc4000b690 tx=0x7fdc40006ea0).ready entity=mon.0 client_cookie=cec4ed510a6070ff server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:59.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.748+0000 7fdc2f7fe700 1 -- 172.21.15.90:0/2091842393 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000d4a0 con 0x5611b29d9890 2022-07-05T11:50:59.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.748+0000 7fdc2f7fe700 1 -- 172.21.15.90:0/2091842393 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000d640 con 0x5611b29d9890 2022-07-05T11:50:59.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.748+0000 7fdc2f7fe700 1 -- 172.21.15.90:0/2091842393 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000da00 con 0x5611b29d9890 2022-07-05T11:50:59.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.749+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2091842393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 msgr2=0x5611b29d9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:59.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.749+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2091842393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29d9d10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fdc4000b690 tx=0x7fdc40006ea0).stop 2022-07-05T11:50:59.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.749+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2091842393 shutdown_connections 2022-07-05T11:50:59.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.749+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2091842393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29d9d10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:59.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.749+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2091842393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d94b0 0x5611b29958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.749+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2091842393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b29e3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.749+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2091842393 >> 172.21.15.90:0/2091842393 conn(0x5611b28041c0 msgr2=0x5611b2998ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:59.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.757+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdc3008bbf0 0x7fdc3008e0b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fdc4c0c8a30 tx=0x7fdc3c01b000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:59.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.758+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2091842393 shutdown_connections 2022-07-05T11:50:59.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.758+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2091842393 wait complete. 2022-07-05T11:50:59.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.759+0000 7fdc623a3b80 1 -- start start 2022-07-05T11:50:59.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.759+0000 7fdc623a3b80 1 Processor -- start 2022-07-05T11:50:59.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a18ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d9890 0x5611b29cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d3670 0x5611b29a0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b28b3120 con 0x5611b29d3670 2022-07-05T11:50:59.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2a18a70 con 0x5611b2995da0 2022-07-05T11:50:59.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b29d2790 con 0x5611b29d9890 2022-07-05T11:50:59.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc623a3b80 10 client.0 ll_register_callbacks cb 0x5611b2959380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:50:59.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.761+0000 7fdc4a59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a18ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:59.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a18ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35122/0 (socket says 172.21.15.90:35122) 2022-07-05T11:50:59.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 -- 172.21.15.90:0/2313222903 learned_addr learned my addr 172.21.15.90:0/2313222903 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:50:59.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4ad9d700 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d3670 0x5611b29a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:59.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 -- 172.21.15.90:0/2313222903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d9890 msgr2=0x5611b29cf580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:50:59.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d9890 0x5611b29cf580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 -- 172.21.15.90:0/2313222903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d3670 msgr2=0x5611b29a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:50:59.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d3670 0x5611b29a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:59.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 -- 172.21.15.90:0/2313222903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4000b1e0 con 0x5611b2995da0 2022-07-05T11:50:59.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.762+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a18ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fdc3c006fd0 tx=0x7fdc3c01e070).ready entity=mon.1 client_cookie=64f8d7e9866c95d0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:50:59.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.784+0000 7fdc2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2022-07-05T11:50:59.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.784+0000 7fdc2cff9700 1 -- 172.21.15.90:0/2313222903 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c011640 con 0x5611b2995da0 2022-07-05T11:50:59.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.784+0000 7fdc2cff9700 1 -- 172.21.15.90:0/2313222903 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdc3c0117a0 con 0x5611b2995da0 2022-07-05T11:50:59.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.790+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611b2993690 con 0x5611b2995da0 2022-07-05T11:50:59.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.801+0000 7fdc2cff9700 1 -- 172.21.15.90:0/2313222903 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc3c011b70 con 0x5611b2995da0 2022-07-05T11:50:59.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.802+0000 7fdc623a3b80 10 client.5155 fetch_fsmap learned FSMap version 20 2022-07-05T11:50:59.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.802+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5611b278ccd0 con 0x5611b2995da0 2022-07-05T11:50:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.812+0000 7fdc2cff9700 1 -- 172.21.15.90:0/2313222903 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611b2993690 con 0x5611b2995da0 2022-07-05T11:50:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.812+0000 7fdc2cff9700 1 -- 172.21.15.90:0/2313222903 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 20) v1 ==== 7472+0+0 (secure 0 0 0) 0x7fdc3c011cd0 con 0x5611b2995da0 2022-07-05T11:50:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.813+0000 7fdc623a3b80 10 client.5155 fetch_fsmap finished waiting for FSMap version 20 2022-07-05T11:50:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.813+0000 7fdc623a3b80 10 client.5155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:50:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.813+0000 7fdc623a3b80 20 client.5155 populate_metadata read hostname 'smithi090' 2022-07-05T11:50:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.813+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29a09f0 0x5611b29d8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:50:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.813+0000 7fdc623a3b80 4 client.5155 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:50:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.813+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611b28e17f0 con 0x5611b29a09f0 2022-07-05T11:50:59.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.818+0000 7fdc49d9b700 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29a09f0 0x5611b29d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:50:59.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.819+0000 7fdc49d9b700 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29a09f0 0x5611b29d8670 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8aea74f1219f7ab3 server_cookie=b59db41632c0597d in_seq=0 out_seq=0 2022-07-05T11:50:59.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.819+0000 7fdc2cff9700 10 client.5155 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:50:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.822+0000 7fdc2cff9700 1 -- 172.21.15.90:0/2313222903 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5611b28e17f0 con 0x5611b29a09f0 2022-07-05T11:50:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.822+0000 7fdc2cff9700 10 client.5155 handle_command_reply: tid=0 2022-07-05T11:50:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.822+0000 7fdc623a3b80 1 client.5155 shutdown 2022-07-05T11:50:59.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.829+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 msgr2=0x5611b2a18ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:50:59.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.829+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a18ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fdc3c006fd0 tx=0x7fdc3c01e070).stop 2022-07-05T11:50:59.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.856+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 shutdown_connections 2022-07-05T11:50:59.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.856+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29a09f0 0x5611b29d8670 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:59.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.856+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d3670 0x5611b29a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:59.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.856+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a18ec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:50:59.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.856+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/2313222903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d9890 0x5611b29cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:50:59.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.856+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 >> 172.21.15.90:0/2313222903 conn(0x5611b28041c0 msgr2=0x5611b29d9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:50:59.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.859+0000 7fdc2cff9700 0 client.5155 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:50:59.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.859+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 shutdown_connections 2022-07-05T11:50:59.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.859+0000 7fdc623a3b80 1 -- 172.21.15.90:0/2313222903 wait complete. 2022-07-05T11:50:59.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:50:59.894+0000 7fdc623a3b80 20 client.5155 trim_cache size 0 max 16384 2022-07-05T11:51:00.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.004+0000 7fdc623a3b80 1 Processor -- start 2022-07-05T11:51:00.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.005+0000 7fdc623a3b80 1 -- start start 2022-07-05T11:51:00.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.006+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b2995da0 0x5611b2a1b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:00.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 0x5611b2a04bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:00.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b29d9890 0x5611b2a67b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:00.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b29e2270 con 0x5611b2995da0 2022-07-05T11:51:00.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b29d4020 con 0x5611b29d9890 2022-07-05T11:51:00.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b29d2fc0 con 0x5611b29d3670 2022-07-05T11:51:00.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b2995da0 0x5611b2a1b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:00.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b2995da0 0x5611b2a1b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58808/0 (socket says 172.21.15.90:58808) 2022-07-05T11:51:00.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1762005248 learned_addr learned my addr 172.21.15.90:0/1762005248 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:00.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4ad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b29d9890 0x5611b2a67b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:00.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1762005248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 msgr2=0x5611b2a04bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:51:00.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/1762005248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 0x5611b2a04bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1762005248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b29d9890 msgr2=0x5611b2a67b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/1762005248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b29d9890 0x5611b2a67b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.007+0000 7fdc4a59c700 1 -- 172.21.15.90:0/1762005248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b275afd0 con 0x5611b2995da0 2022-07-05T11:51:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.008+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/1762005248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b2995da0 0x5611b2a1b060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fdc3c009ad0 tx=0x7fdc3c027000).ready entity=mon.0 client_cookie=a7c95cee0ac56018 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:00.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.058+0000 7fdc2ffff700 1 -- 172.21.15.90:0/1762005248 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c013d60 con 0x5611b2995da0 2022-07-05T11:51:00.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.058+0000 7fdc2ffff700 1 -- 172.21.15.90:0/1762005248 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c011640 con 0x5611b2995da0 2022-07-05T11:51:00.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.058+0000 7fdc2ffff700 1 -- 172.21.15.90:0/1762005248 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c00c610 con 0x5611b2995da0 2022-07-05T11:51:00.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.061+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1762005248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b2995da0 msgr2=0x5611b2a1b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:00.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.061+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1762005248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b2995da0 0x5611b2a1b060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fdc3c009ad0 tx=0x7fdc3c027000).stop 2022-07-05T11:51:00.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.062+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1762005248 shutdown_connections 2022-07-05T11:51:00.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.062+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1762005248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b29d9890 0x5611b2a67b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:00.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.062+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1762005248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b2995da0 0x5611b2a1b060 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:00.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.062+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1762005248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 0x5611b2a04bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.062+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1762005248 >> 172.21.15.90:0/1762005248 conn(0x5611b28041c0 msgr2=0x5611b29dd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:00.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.073+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1762005248 shutdown_connections 2022-07-05T11:51:00.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.073+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1762005248 wait complete. 2022-07-05T11:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.074+0000 7fdc623a3b80 1 -- start start 2022-07-05T11:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.074+0000 7fdc623a3b80 1 Processor -- start 2022-07-05T11:51:00.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.078+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a1b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:00.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.078+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 0x5611b29dd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:00.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.078+0000 7fdc623a3b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:00.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.078+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b29dcc10 con 0x5611b29d9890 2022-07-05T11:51:00.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.078+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2a6d0c0 con 0x5611b2995da0 2022-07-05T11:51:00.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.078+0000 7fdc623a3b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2a70660 con 0x5611b29d3670 2022-07-05T11:51:00.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.078+0000 7fdc623a3b80 10 client.0 ll_register_callbacks cb 0x5611b2959380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:51:00.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:00.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29e0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58818/0 (socket says 172.21.15.90:58818) 2022-07-05T11:51:00.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/1329008749 learned_addr learned my addr 172.21.15.90:0/1329008749 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:00.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/1329008749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 msgr2=0x5611b29dd6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:51:00.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 0x5611b29dd6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/1329008749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 msgr2=0x5611b2a1b6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:51:00.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a1b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.079+0000 7fdc4ad9d700 1 -- 172.21.15.90:0/1329008749 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611b278ccd0 con 0x5611b29d9890 2022-07-05T11:51:00.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.080+0000 7fdc4ad9d700 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29e0d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fdc40000fd0 tx=0x7fdc40013000).ready entity=mon.0 client_cookie=1c87de42c602e749 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.091+0000 7fdc2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.091+0000 7fdc2cff9700 1 -- 172.21.15.90:0/1329008749 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40017070 con 0x5611b29d9890 2022-07-05T11:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.091+0000 7fdc2cff9700 1 -- 172.21.15.90:0/1329008749 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdc40014750 con 0x5611b29d9890 2022-07-05T11:51:00.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.091+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc4000d640 con 0x5611b29d9890 2022-07-05T11:51:00.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.092+0000 7fdc2cff9700 1 -- 172.21.15.90:0/1329008749 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc40014b20 con 0x5611b29d9890 2022-07-05T11:51:00.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.092+0000 7fdc623a3b80 10 client.5427 fetch_fsmap learned FSMap version 20 2022-07-05T11:51:00.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.092+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5611b29dc930 con 0x5611b29d9890 2022-07-05T11:51:00.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.092+0000 7fdc2cff9700 1 -- 172.21.15.90:0/1329008749 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000d640 con 0x5611b29d9890 2022-07-05T11:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.092+0000 7fdc2cff9700 1 -- 172.21.15.90:0/1329008749 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 20) v1 ==== 7472+0+0 (secure 0 0 0) 0x7fdc40014c80 con 0x5611b29d9890 2022-07-05T11:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.093+0000 7fdc623a3b80 10 client.5427 fetch_fsmap finished waiting for FSMap version 20 2022-07-05T11:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.093+0000 7fdc623a3b80 10 client.5427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.093+0000 7fdc623a3b80 20 client.5427 populate_metadata read hostname 'smithi090' 2022-07-05T11:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.093+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29cea80 0x5611b2a70d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.093+0000 7fdc623a3b80 4 client.5427 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.093+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5611b28d8690 con 0x5611b29cea80 2022-07-05T11:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.095+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29cea80 0x5611b2a70d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:00.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.097+0000 7fdc4a59c700 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29cea80 0x5611b2a70d90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=516855e46c1e1ba7 server_cookie=1fdbdc41b743d369 in_seq=0 out_seq=0 2022-07-05T11:51:00.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.106+0000 7fdc2cff9700 10 client.5427 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:51:00.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.106+0000 7fdc2cff9700 1 -- 172.21.15.90:0/1329008749 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5611b28d8690 con 0x5611b29cea80 2022-07-05T11:51:00.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.106+0000 7fdc2cff9700 10 client.5427 handle_command_reply: tid=0 2022-07-05T11:51:00.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.106+0000 7fdc623a3b80 1 client.5427 shutdown 2022-07-05T11:51:00.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.182+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 msgr2=0x5611b29e0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:00.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.182+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29e0d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fdc40000fd0 tx=0x7fdc40013000).stop 2022-07-05T11:51:00.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.189+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 shutdown_connections 2022-07-05T11:51:00.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.189+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5611b29cea80 0x5611b2a70d90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:00.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.189+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5611b29d9890 0x5611b29e0d90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:00.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.189+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611b2995da0 0x5611b2a1b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.190 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.189+0000 7fdc623a3b80 1 --2- 172.21.15.90:0/1329008749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5611b29d3670 0x5611b29dd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.189+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 >> 172.21.15.90:0/1329008749 conn(0x5611b28041c0 msgr2=0x5611b2a05180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:00.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.189+0000 7fdc2cff9700 0 client.5427 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:51:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.198+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 shutdown_connections 2022-07-05T11:51:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.198+0000 7fdc623a3b80 1 -- 172.21.15.90:0/1329008749 wait complete. 2022-07-05T11:51:00.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.215+0000 7fdc623a3b80 20 client.5427 trim_cache size 0 max 16384 2022-07-05T11:51:00.216 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:51:00.216 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:51:00.216 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:51:00.217 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:51:00.217 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:51:00.218 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:51:00.218 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:51:00.218 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:51:00.219 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:51:00.219 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:51:00.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.255+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdc3008bbf0 msgr2=0x7fdc3008e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:00.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.255+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdc3008bbf0 0x7fdc3008e0b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fdc4c0c8a30 tx=0x7fdc3c01b000).stop 2022-07-05T11:51:00.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.255+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c0c3660 msgr2=0x7fdc4c064930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:00.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.255+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c0c3660 0x7fdc4c064930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fdc4400bb80 tx=0x7fdc44009810).stop 2022-07-05T11:51:00.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 shutdown_connections 2022-07-05T11:51:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fdc3008bbf0 0x7fdc3008e0b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc4c179cd0 0x7fdc4c064e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c0bfb90 0x7fdc4c0c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 --2- 172.21.15.90:0/783692677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc4c0c3660 0x7fdc4c064930 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 >> 172.21.15.90:0/783692677 conn(0x7fdc4c0f10a0 msgr2=0x7fdc4c062fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 shutdown_connections 2022-07-05T11:51:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:00.256+0000 7fdc4b59e700 1 -- 172.21.15.90:0/783692677 wait complete. 2022-07-05T11:51:00.337 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:51:03.396 INFO:tasks.workunit.client.0.smithi090.stdout: 231 1765700 443 1231274 591 687687 1374 2022-07-05T11:51:13.396 INFO:tasks.workunit.client.0.smithi090.stdout: 239 1444322 333 1011369 309 597750 898 2022-07-05T11:51:22.851 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:51:22.906 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:51:22.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:51:23.403 INFO:tasks.workunit.client.0.smithi090.stdout: 249 2502842 529 1744440 639 1056727 1217 2022-07-05T11:51:30.340 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:51:30.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.505+0000 7fc63bfff700 1 Processor -- start 2022-07-05T11:51:30.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.505+0000 7fc63bfff700 1 -- start start 2022-07-05T11:51:30.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63bfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc63c17a710 0x7fc63c0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc63c17aaf0 0x7fc63c0c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc63c0c4030 0x7fc63c17e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63bfff700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0c9a30 con 0x7fc63c17a710 2022-07-05T11:51:30.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63bfff700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0c8b40 con 0x7fc63c0c4030 2022-07-05T11:51:30.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63bfff700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0c8e20 con 0x7fc63c17aaf0 2022-07-05T11:51:30.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63affd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc63c17a710 0x7fc63c0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63affd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc63c17a710 0x7fc63c0c3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58822/0 (socket says 172.21.15.90:58822) 2022-07-05T11:51:30.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63affd700 1 -- 172.21.15.90:0/1688926679 learned_addr learned my addr 172.21.15.90:0/1688926679 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:30.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/1688926679 >> v2:172.21.15.149:3300/0 conn(0x7fc63c17aaf0 0x7fc63c0c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.506+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/1688926679 >> v2:172.21.15.110:3300/0 conn(0x7fc63c0c4030 0x7fc63c17e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc63affd700 1 -- 172.21.15.90:0/1688926679 >> v2:172.21.15.149:3300/0 conn(0x7fc63c17aaf0 msgr2=0x7fc63c0c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc63affd700 1 --2- 172.21.15.90:0/1688926679 >> v2:172.21.15.149:3300/0 conn(0x7fc63c17aaf0 0x7fc63c0c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc63affd700 1 -- 172.21.15.90:0/1688926679 >> v2:172.21.15.110:3300/0 conn(0x7fc63c0c4030 msgr2=0x7fc63c17e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc63affd700 1 --2- 172.21.15.90:0/1688926679 >> v2:172.21.15.110:3300/0 conn(0x7fc63c0c4030 0x7fc63c17e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc63affd700 1 -- 172.21.15.90:0/1688926679 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0c9100 con 0x7fc63c17a710 2022-07-05T11:51:30.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/1688926679 >> v2:172.21.15.110:3300/0 conn(0x7fc63c0c4030 0x7fc63c17e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:51:30.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc63affd700 1 --2- 172.21.15.90:0/1688926679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c0c3650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fc63c0ee940 tx=0x7fc62c00b3b0).ready entity=mon.0 client_cookie=28ed98fd69f965 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:30.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc639ffb700 1 -- 172.21.15.90:0/1688926679 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00da40 con 0x7fc63c17a710 2022-07-05T11:51:30.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc639ffb700 1 -- 172.21.15.90:0/1688926679 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c00dba0 con 0x7fc63c17a710 2022-07-05T11:51:30.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.507+0000 7fc639ffb700 1 -- 172.21.15.90:0/1688926679 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c010470 con 0x7fc63c17a710 2022-07-05T11:51:30.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 -- 172.21.15.90:0/1688926679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 msgr2=0x7fc63c0c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 --2- 172.21.15.90:0/1688926679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c0c3650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fc63c0ee940 tx=0x7fc62c00b3b0).stop 2022-07-05T11:51:30.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 -- 172.21.15.90:0/1688926679 shutdown_connections 2022-07-05T11:51:30.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 --2- 172.21.15.90:0/1688926679 >> v2:172.21.15.110:3300/0 conn(0x7fc63c0c4030 0x7fc63c17e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 --2- 172.21.15.90:0/1688926679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c0c3650 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 --2- 172.21.15.90:0/1688926679 >> v2:172.21.15.149:3300/0 conn(0x7fc63c17aaf0 0x7fc63c0c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 -- 172.21.15.90:0/1688926679 >> 172.21.15.90:0/1688926679 conn(0x7fc63c0ed8d0 msgr2=0x7fc63c0edce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:30.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 -- 172.21.15.90:0/1688926679 shutdown_connections 2022-07-05T11:51:30.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.508+0000 7fc63bfff700 1 -- 172.21.15.90:0/1688926679 wait complete. 2022-07-05T11:51:30.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.509+0000 7fc63bfff700 1 Processor -- start 2022-07-05T11:51:30.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.509+0000 7fc63bfff700 1 -- start start 2022-07-05T11:51:30.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.510+0000 7fc63bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c0c4030 0x7fc63c18ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c17ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc63c17aaf0 0x7fc63c0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63bfff700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c17e7a0 con 0x7fc63c17a710 2022-07-05T11:51:30.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63bfff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c17d5d0 con 0x7fc63c17aaf0 2022-07-05T11:51:30.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63bfff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c17d8b0 con 0x7fc63c0c4030 2022-07-05T11:51:30.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c17ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c17ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58830/0 (socket says 172.21.15.90:58830) 2022-07-05T11:51:30.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 -- 172.21.15.90:0/2539971703 learned_addr learned my addr 172.21.15.90:0/2539971703 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:30.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63affd700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c0c4030 0x7fc63c18ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc63c17aaf0 0x7fc63c0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 -- 172.21.15.90:0/2539971703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c0c4030 msgr2=0x7fc63c18ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c0c4030 0x7fc63c18ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 -- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc63c17aaf0 msgr2=0x7fc63c0c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc63c17aaf0 0x7fc63c0c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 -- 172.21.15.90:0/2539971703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c00b610 con 0x7fc63c17a710 2022-07-05T11:51:30.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc63c17aaf0 0x7fc63c0c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:51:30.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.511+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c17ec30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc63000e950 tx=0x7fc630009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:30.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.512+0000 7fc622ffd700 1 -- 172.21.15.90:0/2539971703 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630012600 con 0x7fc63c17a710 2022-07-05T11:51:30.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.512+0000 7fc622ffd700 1 -- 172.21.15.90:0/2539971703 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630012760 con 0x7fc63c17a710 2022-07-05T11:51:30.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.512+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c17db90 con 0x7fc63c17a710 2022-07-05T11:51:30.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.512+0000 7fc622ffd700 1 -- 172.21.15.90:0/2539971703 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630012ae0 con 0x7fc63c17a710 2022-07-05T11:51:30.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.512+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c17e150 con 0x7fc63c17a710 2022-07-05T11:51:30.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.514+0000 7fc622ffd700 1 -- 172.21.15.90:0/2539971703 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc630022070 con 0x7fc63c17a710 2022-07-05T11:51:30.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.514+0000 7fc622ffd700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc61c08ba10 0x7fc61c08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.515+0000 7fc622ffd700 1 -- 172.21.15.90:0/2539971703 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc6300b0dc0 con 0x7fc63c17a710 2022-07-05T11:51:30.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.515+0000 7fc63affd700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc61c08ba10 0x7fc61c08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.515+0000 7fc63affd700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc61c08ba10 0x7fc61c08ded0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fc63c0ee940 tx=0x7fc63c0c99a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:30.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.516+0000 7fc652c34b80 1 Processor -- start 2022-07-05T11:51:30.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.516+0000 7fc652c34b80 1 -- start start 2022-07-05T11:51:30.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca478b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414ca95a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc652c34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414ca112d0 con 0x56414ca8b4b0 2022-07-05T11:51:30.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc652c34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414c988aa0 con 0x56414ca47da0 2022-07-05T11:51:30.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc652c34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414c99d950 con 0x56414ca8b890 2022-07-05T11:51:30.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc63affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc63affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58836/0 (socket says 172.21.15.90:58836) 2022-07-05T11:51:30.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc63affd700 1 -- 172.21.15.90:0/79761671 learned_addr learned my addr 172.21.15.90:0/79761671 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:30.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414ca95a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.517+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc63affd700 1 -- 172.21.15.90:0/79761671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 msgr2=0x56414ca8bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc63affd700 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc63affd700 1 -- 172.21.15.90:0/79761671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 msgr2=0x56414ca95a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc63affd700 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414ca95a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc63affd700 1 -- 172.21.15.90:0/79761671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56414c7cf9e0 con 0x56414ca8b4b0 2022-07-05T11:51:30.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414ca95a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:51:30.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc63affd700 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca478b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc62c006fd0 tx=0x7fc62c01f000).ready entity=mon.0 client_cookie=19959d0574998ffc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:30.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc617fff700 1 -- 172.21.15.90:0/79761671 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c01f070 con 0x56414ca8b4b0 2022-07-05T11:51:30.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc617fff700 1 -- 172.21.15.90:0/79761671 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c02a070 con 0x56414ca8b4b0 2022-07-05T11:51:30.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc617fff700 1 -- 172.21.15.90:0/79761671 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c010c40 con 0x56414ca8b4b0 2022-07-05T11:51:30.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc652c34b80 1 -- 172.21.15.90:0/79761671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 msgr2=0x56414ca478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.518+0000 7fc652c34b80 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca478b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc62c006fd0 tx=0x7fc62c01f000).stop 2022-07-05T11:51:30.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 -- 172.21.15.90:0/79761671 shutdown_connections 2022-07-05T11:51:30.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca478b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 --2- 172.21.15.90:0/79761671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414ca95a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 -- 172.21.15.90:0/79761671 >> 172.21.15.90:0/79761671 conn(0x56414c8b61c0 msgr2=0x56414ca4aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:30.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 -- 172.21.15.90:0/79761671 shutdown_connections 2022-07-05T11:51:30.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 -- 172.21.15.90:0/79761671 wait complete. 2022-07-05T11:51:30.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 -- start start 2022-07-05T11:51:30.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.519+0000 7fc652c34b80 1 Processor -- start 2022-07-05T11:51:30.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b4b0 0x56414ca81850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b890 0x56414cabbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414c965120 con 0x56414ca8b890 2022-07-05T11:51:30.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414caca400 con 0x56414ca47da0 2022-07-05T11:51:30.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414cabc860 con 0x56414ca8b4b0 2022-07-05T11:51:30.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 10 client.0 ll_register_callbacks cb 0x56414ca0b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:51:30.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b890 0x56414cabbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b890 0x56414cabbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58842/0 (socket says 172.21.15.90:58842) 2022-07-05T11:51:30.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 -- 172.21.15.90:0/3443615868 learned_addr learned my addr 172.21.15.90:0/3443615868 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:30.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b4b0 0x56414ca81850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 -- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b4b0 msgr2=0x56414ca81850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b4b0 0x56414ca81850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 -- 172.21.15.90:0/3443615868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 msgr2=0x56414cac9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:30.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 -- 172.21.15.90:0/3443615868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c17e150 con 0x56414ca8b890 2022-07-05T11:51:30.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b890 0x56414cabbb90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc6340025e0 tx=0x7fc6340098f0).ready entity=mon.0 client_cookie=f3ca5d5a864817dd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:30.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc6157fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:51:30.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc6157fa700 1 -- 172.21.15.90:0/3443615868 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634007560 con 0x56414ca8b890 2022-07-05T11:51:30.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc6157fa700 1 -- 172.21.15.90:0/3443615868 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc634002e30 con 0x56414ca8b890 2022-07-05T11:51:30.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56414ca45690 con 0x56414ca8b890 2022-07-05T11:51:30.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc6157fa700 1 -- 172.21.15.90:0/3443615868 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc634014740 con 0x56414ca8b890 2022-07-05T11:51:30.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 10 client.5439 fetch_fsmap learned FSMap version 22 2022-07-05T11:51:30.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.521+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7fc63c0c9100 con 0x56414ca8b890 2022-07-05T11:51:30.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc6157fa700 1 -- 172.21.15.90:0/3443615868 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56414ca45690 con 0x56414ca8b890 2022-07-05T11:51:30.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc6157fa700 1 -- 172.21.15.90:0/3443615868 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fc634014040 con 0x56414ca8b890 2022-07-05T11:51:30.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc652c34b80 10 client.5439 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:51:30.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc652c34b80 10 client.5439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:51:30.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc652c34b80 20 client.5439 populate_metadata read hostname 'smithi090' 2022-07-05T11:51:30.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc652c34b80 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414cab7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc652c34b80 4 client.5439 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:51:30.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56414c9937f0 con 0x56414cabc2e0 2022-07-05T11:51:30.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.522+0000 7fc63affd700 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414cab7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.523+0000 7fc6157fa700 10 client.5439 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:51:30.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.523+0000 7fc63affd700 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414cab7270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=87f10e4925ffd316 server_cookie=b4f67ee57232e5a7 in_seq=0 out_seq=0 2022-07-05T11:51:30.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.530+0000 7fc6157fa700 1 -- 172.21.15.90:0/3443615868 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x56414c9937f0 con 0x56414cabc2e0 2022-07-05T11:51:30.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.530+0000 7fc6157fa700 10 client.5439 handle_command_reply: tid=0 2022-07-05T11:51:30.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 client.5439 shutdown 2022-07-05T11:51:30.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b890 msgr2=0x56414cabbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b890 0x56414cabbb90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc6340025e0 tx=0x7fc6340098f0).stop 2022-07-05T11:51:30.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 shutdown_connections 2022-07-05T11:51:30.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414cab7270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b890 0x56414cabbb90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:51:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc6157fa700 0 client.5439 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:51:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 --2- 172.21.15.90:0/3443615868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b4b0 0x56414ca81850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 >> 172.21.15.90:0/3443615868 conn(0x56414c8b61c0 msgr2=0x56414ca487f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 shutdown_connections 2022-07-05T11:51:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.531+0000 7fc652c34b80 1 -- 172.21.15.90:0/3443615868 wait complete. 2022-07-05T11:51:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.532+0000 7fc652c34b80 20 client.5439 trim_cache size 0 max 16384 2022-07-05T11:51:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.550+0000 7fc652c34b80 1 Processor -- start 2022-07-05T11:51:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.550+0000 7fc652c34b80 1 -- start start 2022-07-05T11:51:30.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca8bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca89e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc652c34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414ca92cb0 con 0x56414ca8b4b0 2022-07-05T11:51:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc652c34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414ca93ba0 con 0x56414ca47da0 2022-07-05T11:51:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc652c34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414cab7ec0 con 0x56414ca8b890 2022-07-05T11:51:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca8bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca8bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58852/0 (socket says 172.21.15.90:58852) 2022-07-05T11:51:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 -- 172.21.15.90:0/310119124 learned_addr learned my addr 172.21.15.90:0/310119124 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63affd700 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca89e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 -- 172.21.15.90:0/310119124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 msgr2=0x56414ca89e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca89e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 -- 172.21.15.90:0/310119124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 msgr2=0x56414cac9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 -- 172.21.15.90:0/310119124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56414c83ecd0 con 0x56414ca8b4b0 2022-07-05T11:51:30.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63affd700 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:51:30.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca8bce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fc6300855c0 tx=0x7fc630088040).ready entity=mon.0 client_cookie=a20bf7f4f75a7d95 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:30.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc620ff9700 1 -- 172.21.15.90:0/310119124 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63008afe0 con 0x56414ca8b4b0 2022-07-05T11:51:30.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc620ff9700 1 -- 172.21.15.90:0/310119124 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630083aa0 con 0x56414ca8b4b0 2022-07-05T11:51:30.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.551+0000 7fc620ff9700 1 -- 172.21.15.90:0/310119124 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630081e10 con 0x56414ca8b4b0 2022-07-05T11:51:30.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 -- 172.21.15.90:0/310119124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 msgr2=0x56414ca8bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca8bce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fc6300855c0 tx=0x7fc630088040).stop 2022-07-05T11:51:30.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 -- 172.21.15.90:0/310119124 shutdown_connections 2022-07-05T11:51:30.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca89e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca47da0 0x56414cac9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 --2- 172.21.15.90:0/310119124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca8b4b0 0x56414ca8bce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 -- 172.21.15.90:0/310119124 >> 172.21.15.90:0/310119124 conn(0x56414c8b61c0 msgr2=0x56414cabdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:30.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 -- 172.21.15.90:0/310119124 shutdown_connections 2022-07-05T11:51:30.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.552+0000 7fc652c34b80 1 -- 172.21.15.90:0/310119124 wait complete. 2022-07-05T11:51:30.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.553+0000 7fc652c34b80 1 -- start start 2022-07-05T11:51:30.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.553+0000 7fc652c34b80 1 Processor -- start 2022-07-05T11:51:30.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.554+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca47da0 0x56414cb203d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.554+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca8b4b0 0x56414cb14b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.554+0000 7fc652c34b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.554+0000 7fc652c34b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414cb15040 con 0x56414ca47da0 2022-07-05T11:51:30.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.554+0000 7fc652c34b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414cb10180 con 0x56414ca8b4b0 2022-07-05T11:51:30.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.554+0000 7fc652c34b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414ca8c5e0 con 0x56414ca8b890 2022-07-05T11:51:30.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.554+0000 7fc652c34b80 10 client.0 ll_register_callbacks cb 0x56414ca0b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:51:30.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca47da0 0x56414cb203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca47da0 0x56414cb203d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58856/0 (socket says 172.21.15.90:58856) 2022-07-05T11:51:30.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 -- 172.21.15.90:0/2309037840 learned_addr learned my addr 172.21.15.90:0/2309037840 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:51:30.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca8b4b0 0x56414cb14b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63b7fe700 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 -- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 msgr2=0x56414ca8c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 -- 172.21.15.90:0/2309037840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca8b4b0 msgr2=0x56414cb14b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:51:30.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca8b4b0 0x56414cb14b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 -- 172.21.15.90:0/2309037840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56414c7cf9e0 con 0x56414ca47da0 2022-07-05T11:51:30.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc63affd700 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca47da0 0x56414cb203d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fc62c029000 tx=0x7fc62c036280).ready entity=mon.0 client_cookie=aad3305e72cf133b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:51:30.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc6157fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:51:30.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc6157fa700 1 -- 172.21.15.90:0/2309037840 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c036070 con 0x56414ca47da0 2022-07-05T11:51:30.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc6157fa700 1 -- 172.21.15.90:0/2309037840 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc62c010c40 con 0x56414ca47da0 2022-07-05T11:51:30.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc62c02a070 con 0x56414ca47da0 2022-07-05T11:51:30.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc6157fa700 1 -- 172.21.15.90:0/2309037840 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc62c01f040 con 0x56414ca47da0 2022-07-05T11:51:30.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc652c34b80 10 client.5445 fetch_fsmap learned FSMap version 22 2022-07-05T11:51:30.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7fc63c17db90 con 0x56414ca47da0 2022-07-05T11:51:30.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.555+0000 7fc6157fa700 1 -- 172.21.15.90:0/2309037840 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c02a070 con 0x56414ca47da0 2022-07-05T11:51:30.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc6157fa700 1 -- 172.21.15.90:0/2309037840 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fc62c005a90 con 0x56414ca47da0 2022-07-05T11:51:30.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc652c34b80 10 client.5445 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:51:30.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc652c34b80 10 client.5445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:51:30.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc652c34b80 20 client.5445 populate_metadata read hostname 'smithi090' 2022-07-05T11:51:30.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc652c34b80 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414ca487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:51:30.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc652c34b80 4 client.5445 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:51:30.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56414c98a690 con 0x56414cabc2e0 2022-07-05T11:51:30.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414ca487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:51:30.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc6157fa700 10 client.5445 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:51:30.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.556+0000 7fc63a7fc700 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414ca487f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ebd1a2e470f7c794 server_cookie=c16201a20d2db5ae in_seq=0 out_seq=0 2022-07-05T11:51:30.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.560+0000 7fc6157fa700 1 -- 172.21.15.90:0/2309037840 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56414c98a690 con 0x56414cabc2e0 2022-07-05T11:51:30.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.560+0000 7fc6157fa700 10 client.5445 handle_command_reply: tid=0 2022-07-05T11:51:30.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.560+0000 7fc652c34b80 1 client.5445 shutdown 2022-07-05T11:51:30.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.560+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca47da0 msgr2=0x56414cb203d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.560+0000 7fc652c34b80 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca47da0 0x56414cb203d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fc62c029000 tx=0x7fc62c036280).stop 2022-07-05T11:51:30.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.560+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 shutdown_connections 2022-07-05T11:51:30.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.560+0000 7fc652c34b80 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56414cabc2e0 0x56414ca487f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc652c34b80 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56414ca8b890 0x56414ca8c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc6157fa700 0 client.5445 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:51:30.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc652c34b80 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56414ca47da0 0x56414cb203d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc652c34b80 1 --2- 172.21.15.90:0/2309037840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56414ca8b4b0 0x56414cb14b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 >> 172.21.15.90:0/2309037840 conn(0x56414c8b61c0 msgr2=0x56414cb11fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:30.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 shutdown_connections 2022-07-05T11:51:30.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc652c34b80 1 -- 172.21.15.90:0/2309037840 wait complete. 2022-07-05T11:51:30.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc652c34b80 20 client.5445 trim_cache size 0 max 16384 2022-07-05T11:51:30.629 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:51:30.630 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:51:30.630 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:51:30.630 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:51:30.631 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:51:30.631 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:51:30.631 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:51:30.631 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:51:30.632 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:51:30.632 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:51:30.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc61c08ba10 msgr2=0x7fc61c08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc61c08ba10 0x7fc61c08ded0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fc63c0ee940 tx=0x7fc63c0c99a0).stop 2022-07-05T11:51:30.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 msgr2=0x7fc63c17ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:51:30.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c17ec30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc63000e950 tx=0x7fc630009060).stop 2022-07-05T11:51:30.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 shutdown_connections 2022-07-05T11:51:30.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc61c08ba10 0x7fc61c08ded0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc63c17aaf0 0x7fc63c0c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc63c0c4030 0x7fc63c18ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 --2- 172.21.15.90:0/2539971703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc63c17a710 0x7fc63c17ec30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:51:30.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 >> 172.21.15.90:0/2539971703 conn(0x7fc63c0ed8d0 msgr2=0x7fc63c0c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:51:30.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 shutdown_connections 2022-07-05T11:51:30.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:51:30.561+0000 7fc63bfff700 1 -- 172.21.15.90:0/2539971703 wait complete. 2022-07-05T11:51:30.637 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:51:33.403 INFO:tasks.workunit.client.0.smithi090.stdout: 256 1933051 495 1356543 557 826328 973 2022-07-05T11:51:43.403 INFO:tasks.workunit.client.0.smithi090.stdout: 259 564111 64 396777 143 243867 129 2022-07-05T11:51:53.199 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:51:53.359 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:51:53.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:51:53.406 INFO:tasks.workunit.client.0.smithi090.stdout: 260 892733 262 629330 111 382260 286 2022-07-05T11:51:53.448 INFO:tasks.ceph.mds.i.smithi149.stderr:2022-07-05T11:51:53.447+0000 7fc6abc1d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41921) UID: 0 2022-07-05T11:51:53.449 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T11:51:53.447+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41921) UID: 0 2022-07-05T11:51:53.449 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T11:51:53.447+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41921) UID: 0 2022-07-05T11:51:53.450 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T11:51:53.447+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41921) UID: 0 2022-07-05T11:52:00.639 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:52:00.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.767+0000 7fd3fae5b700 1 Processor -- start 2022-07-05T11:52:00.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.767+0000 7fd3fae5b700 1 -- start start 2022-07-05T11:52:00.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.768+0000 7fd3fae5b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd3f4178610 0x7fd3f41789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.768+0000 7fd3fae5b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f417d560 con 0x7fd3f417e100 2022-07-05T11:52:00.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.768+0000 7fd3fae5b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f417f830 con 0x7fd3f417f3b0 2022-07-05T11:52:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.768+0000 7fd3fae5b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f417c670 con 0x7fd3f4178610 2022-07-05T11:52:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f93f8700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd3f417e100 0x7fd3f4063bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51808/0 (socket says 172.21.15.90:51808) 2022-07-05T11:52:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f93f8700 1 -- 172.21.15.90:0/3211792951 learned_addr learned my addr 172.21.15.90:0/3211792951 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:52:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/3211792951 >> v2:172.21.15.149:3300/0 conn(0x7fd3f4178610 0x7fd3f41789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647464768 0 0) 0x7fd3f417d560 con 0x7fd3f417e100 2022-07-05T11:52:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e00033f0 con 0x7fd3f417e100 2022-07-05T11:52:00.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874473460 0 0) 0x7fd3f417f830 con 0x7fd3f417f3b0 2022-07-05T11:52:00.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f417d560 con 0x7fd3f417f3b0 2022-07-05T11:52:00.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f8bf7700 1 -- 172.21.15.90:0/3211792951 >> v1:172.21.15.149:6789/0 conn(0x7fd3f417f3b0 legacy=0x7fd3f417d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 28756666 0 0) 0x7fd3e00033f0 con 0x7fd3f417e100 2022-07-05T11:52:00.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f8bf7700 1 -- 172.21.15.90:0/3211792951 >> v1:172.21.15.90:6789/0 conn(0x7fd3f417e100 legacy=0x7fd3f4063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f8bf7700 1 -- 172.21.15.90:0/3211792951 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f417c950 con 0x7fd3f4178610 2022-07-05T11:52:00.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/3211792951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 0x7fd3f41789f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd3ec009e60 tx=0x7fd3ec009780).ready entity=mon.2 client_cookie=db331d9c04f0d46d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:00.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.769+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00e070 con 0x7fd3f4178610 2022-07-05T11:52:00.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec00b7a0 con 0x7fd3f4178610 2022-07-05T11:52:00.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3f37fe700 1 -- 172.21.15.90:0/3211792951 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40014c0 con 0x7fd3f4178610 2022-07-05T11:52:00.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3fae5b700 1 -- 172.21.15.90:0/3211792951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 msgr2=0x7fd3f41789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/3211792951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 0x7fd3f41789f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd3ec009e60 tx=0x7fd3ec009780).stop 2022-07-05T11:52:00.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3fae5b700 1 -- 172.21.15.90:0/3211792951 shutdown_connections 2022-07-05T11:52:00.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/3211792951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 0x7fd3f41789f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3fae5b700 1 -- 172.21.15.90:0/3211792951 >> 172.21.15.90:0/3211792951 conn(0x7fd3f40f2210 msgr2=0x7fd3f4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:00.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3fae5b700 1 -- 172.21.15.90:0/3211792951 shutdown_connections 2022-07-05T11:52:00.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.770+0000 7fd3fae5b700 1 -- 172.21.15.90:0/3211792951 wait complete. 2022-07-05T11:52:00.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.771+0000 7fd3fae5b700 1 Processor -- start 2022-07-05T11:52:00.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.772+0000 7fd3fae5b700 1 -- start start 2022-07-05T11:52:00.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 0x7fd3f418f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f417e100 0x7fd3f415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3f417f3b0 0x7fd3f415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f417fe00 con 0x7fd3f417f3b0 2022-07-05T11:52:00.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4192360 con 0x7fd3f417e100 2022-07-05T11:52:00.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f41917e0 con 0x7fd3f4178610 2022-07-05T11:52:00.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3f417f3b0 0x7fd3f415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f8bf7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 0x7fd3f418f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3f417f3b0 0x7fd3f415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58874/0 (socket says 172.21.15.90:58874) 2022-07-05T11:52:00.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2261044578 learned_addr learned my addr 172.21.15.90:0/2261044578 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:00.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f417e100 0x7fd3f415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2261044578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 msgr2=0x7fd3f418f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 0x7fd3f418f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f417e100 msgr2=0x7fd3f415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f417e100 0x7fd3f415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2261044578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec009a20 con 0x7fd3f417f3b0 2022-07-05T11:52:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f417e100 0x7fd3f415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:52:00.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3f417f3b0 0x7fd3f415a9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fd3e400c840 tx=0x7fd3e4001940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:00.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f0ff9700 1 -- 172.21.15.90:0/2261044578 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4007170 con 0x7fd3f417f3b0 2022-07-05T11:52:00.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f0ff9700 1 -- 172.21.15.90:0/2261044578 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e40072f0 con 0x7fd3f417f3b0 2022-07-05T11:52:00.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f4191ac0 con 0x7fd3f417f3b0 2022-07-05T11:52:00.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3f0ff9700 1 -- 172.21.15.90:0/2261044578 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4004910 con 0x7fd3f417f3b0 2022-07-05T11:52:00.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.773+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f4192080 con 0x7fd3f417f3b0 2022-07-05T11:52:00.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.775+0000 7fd3f0ff9700 1 -- 172.21.15.90:0/2261044578 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd3e401b070 con 0x7fd3f417f3b0 2022-07-05T11:52:00.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.776+0000 7fd3f0ff9700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd3d408ba40 0x7fd3d408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.776+0000 7fd3f0ff9700 1 -- 172.21.15.90:0/2261044578 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd3e40b0090 con 0x7fd3f417f3b0 2022-07-05T11:52:00.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.776+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd3d408ba40 0x7fd3d408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.777+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd3d408ba40 0x7fd3d408df00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fd3ec00baf0 tx=0x7fd3f417d4d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:00.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.777+0000 7fd40c7e7b80 1 Processor -- start 2022-07-05T11:52:00.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.777+0000 7fd40c7e7b80 1 -- start start 2022-07-05T11:52:00.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.778+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x5604246f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.778+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.778+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424738c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.778+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604246be2d0 con 0x5604247387a0 2022-07-05T11:52:00.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.778+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424635aa0 con 0x5604247383c0 2022-07-05T11:52:00.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.778+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56042464a950 con 0x5604246f4cb0 2022-07-05T11:52:00.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424738c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424738c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58882/0 (socket says 172.21.15.90:58882) 2022-07-05T11:52:00.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40276/0 (socket says 172.21.15.90:40276) 2022-07-05T11:52:00.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2376775947 learned_addr learned my addr 172.21.15.90:0/2376775947 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:00.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x5604246f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2376775947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 msgr2=0x560424742990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2376775947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 msgr2=0x5604246f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x5604246f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 -- 172.21.15.90:0/2376775947 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56042447c9e0 con 0x5604247387a0 2022-07-05T11:52:00.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x5604246f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:52:00.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424738c20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fd3e4084460 tx=0x7fd3e40847a0).ready entity=mon.0 client_cookie=97c0338db7f2f840 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:00.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3d9ffb700 1 -- 172.21.15.90:0/2376775947 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40019d0 con 0x5604247387a0 2022-07-05T11:52:00.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3d9ffb700 1 -- 172.21.15.90:0/2376775947 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4082d70 con 0x5604247387a0 2022-07-05T11:52:00.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.779+0000 7fd3d9ffb700 1 -- 172.21.15.90:0/2376775947 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40810e0 con 0x5604247387a0 2022-07-05T11:52:00.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2376775947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 msgr2=0x560424738c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424738c20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fd3e4084460 tx=0x7fd3e40847a0).stop 2022-07-05T11:52:00.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2376775947 shutdown_connections 2022-07-05T11:52:00.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424738c20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x5604246f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2376775947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2376775947 >> 172.21.15.90:0/2376775947 conn(0x5604245631c0 msgr2=0x5604246f7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:00.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2376775947 shutdown_connections 2022-07-05T11:52:00.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.780+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2376775947 wait complete. 2022-07-05T11:52:00.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.781+0000 7fd40c7e7b80 1 -- start start 2022-07-05T11:52:00.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.781+0000 7fd40c7e7b80 1 Processor -- start 2022-07-05T11:52:00.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604246f4cb0 0x560424778020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247383c0 0x560424732440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424760fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424612120 con 0x5604247387a0 2022-07-05T11:52:00.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424778cf0 con 0x5604246f4cb0 2022-07-05T11:52:00.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424777b40 con 0x5604247383c0 2022-07-05T11:52:00.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd40c7e7b80 10 client.0 ll_register_callbacks cb 0x5604246b81b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:52:00.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd3f93f8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424760fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd3f93f8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424760fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58888/0 (socket says 172.21.15.90:58888) 2022-07-05T11:52:00.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd3f93f8700 1 -- 172.21.15.90:0/1470399850 learned_addr learned my addr 172.21.15.90:0/1470399850 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:00.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247383c0 0x560424732440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.782+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604246f4cb0 0x560424778020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3f93f8700 1 -- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247383c0 msgr2=0x560424732440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247383c0 0x560424732440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3f93f8700 1 -- 172.21.15.90:0/1470399850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604246f4cb0 msgr2=0x560424778020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604246f4cb0 0x560424778020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3f93f8700 1 -- 172.21.15.90:0/1470399850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f4192080 con 0x5604247387a0 2022-07-05T11:52:00.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424760fb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd3e4080ed0 tx=0x7fd3e408c000).ready entity=mon.0 client_cookie=3ab55c5546ad30bc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:00.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:52:00.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3ceffd700 1 -- 172.21.15.90:0/1470399850 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40810e0 con 0x5604247387a0 2022-07-05T11:52:00.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3ceffd700 1 -- 172.21.15.90:0/1470399850 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd3e4090070 con 0x5604247387a0 2022-07-05T11:52:00.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604246f2440 con 0x5604247387a0 2022-07-05T11:52:00.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3ceffd700 1 -- 172.21.15.90:0/1470399850 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3e4081240 con 0x5604247387a0 2022-07-05T11:52:00.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 10 client.5457 fetch_fsmap learned FSMap version 22 2022-07-05T11:52:00.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5604244ebcd0 con 0x5604247387a0 2022-07-05T11:52:00.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3ceffd700 1 -- 172.21.15.90:0/1470399850 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604246f2440 con 0x5604247387a0 2022-07-05T11:52:00.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd3ceffd700 1 -- 172.21.15.90:0/1470399850 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fd3e40807c0 con 0x5604247387a0 2022-07-05T11:52:00.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 10 client.5457 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:52:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 10 client.5457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:52:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 20 client.5457 populate_metadata read hostname 'smithi090' 2022-07-05T11:52:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5604247614a0 0x560424778510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 4 client.5457 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:52:00.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.783+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604246407f0 con 0x5604247614a0 2022-07-05T11:52:00.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.784+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5604247614a0 0x560424778510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.784+0000 7fd3ceffd700 10 client.5457 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:00.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.784+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5604247614a0 0x560424778510 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b0d77304de259108 server_cookie=e5af9b08411ba60c in_seq=0 out_seq=0 2022-07-05T11:52:00.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.785+0000 7fd3ceffd700 1 -- 172.21.15.90:0/1470399850 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5604246407f0 con 0x5604247614a0 2022-07-05T11:52:00.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.785+0000 7fd3ceffd700 10 client.5457 handle_command_reply: tid=0 2022-07-05T11:52:00.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.785+0000 7fd40c7e7b80 1 client.5457 shutdown 2022-07-05T11:52:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 msgr2=0x560424760fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424760fb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd3e4080ed0 tx=0x7fd3e408c000).stop 2022-07-05T11:52:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 shutdown_connections 2022-07-05T11:52:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5604247614a0 0x560424778510 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247387a0 0x560424760fb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd3ceffd700 0 client.5457 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604246f4cb0 0x560424778020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/1470399850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247383c0 0x560424732440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 >> 172.21.15.90:0/1470399850 conn(0x5604245631c0 msgr2=0x5604246f7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:00.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 shutdown_connections 2022-07-05T11:52:00.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/1470399850 wait complete. 2022-07-05T11:52:00.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.786+0000 7fd40c7e7b80 20 client.5457 trim_cache size 0 max 16384 2022-07-05T11:52:00.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.803+0000 7fd40c7e7b80 1 Processor -- start 2022-07-05T11:52:00.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.803+0000 7fd40c7e7b80 1 -- start start 2022-07-05T11:52:00.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247383c0 0x5604246f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247387a0 0x560424737c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424733c60 con 0x5604247383c0 2022-07-05T11:52:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424777db0 con 0x5604247387a0 2022-07-05T11:52:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604247655d0 con 0x5604246f4cb0 2022-07-05T11:52:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247383c0 0x5604246f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247383c0 0x5604246f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58894/0 (socket says 172.21.15.90:58894) 2022-07-05T11:52:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 -- 172.21.15.90:0/269597836 learned_addr learned my addr 172.21.15.90:0/269597836 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:00.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247387a0 0x560424737c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 -- 172.21.15.90:0/269597836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 msgr2=0x560424742fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 -- 172.21.15.90:0/269597836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247387a0 msgr2=0x560424737c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247387a0 0x560424737c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 -- 172.21.15.90:0/269597836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604244b9fd0 con 0x5604247383c0 2022-07-05T11:52:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247387a0 0x560424737c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:52:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247383c0 0x5604246f5090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fd3f417bf40 tx=0x7fd3e8009040).ready entity=mon.0 client_cookie=5dd1b9517075ace4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3da7fc700 1 -- 172.21.15.90:0/269597836 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e801a070 con 0x5604247383c0 2022-07-05T11:52:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3da7fc700 1 -- 172.21.15.90:0/269597836 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e800d040 con 0x5604247383c0 2022-07-05T11:52:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.804+0000 7fd3da7fc700 1 -- 172.21.15.90:0/269597836 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8015830 con 0x5604247383c0 2022-07-05T11:52:00.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/269597836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247383c0 msgr2=0x5604246f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247383c0 0x5604246f5090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fd3f417bf40 tx=0x7fd3e8009040).stop 2022-07-05T11:52:00.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/269597836 shutdown_connections 2022-07-05T11:52:00.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247387a0 0x560424737c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604246f4cb0 0x560424742fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/269597836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604247383c0 0x5604246f5090 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/269597836 >> 172.21.15.90:0/269597836 conn(0x5604245631c0 msgr2=0x560424738b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:00.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/269597836 shutdown_connections 2022-07-05T11:52:00.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.805+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/269597836 wait complete. 2022-07-05T11:52:00.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.806+0000 7fd40c7e7b80 1 -- start start 2022-07-05T11:52:00.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.806+0000 7fd40c7e7b80 1 Processor -- start 2022-07-05T11:52:00.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604246f4cb0 0x560424742010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x560424742a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd40c7e7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247387a0 0x560424775b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424764ec0 con 0x5604246f4cb0 2022-07-05T11:52:00.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560424742520 con 0x5604247383c0 2022-07-05T11:52:00.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd40c7e7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604247341d0 con 0x5604247387a0 2022-07-05T11:52:00.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd40c7e7b80 10 client.0 ll_register_callbacks cb 0x5604246b81b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:52:00.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604246f4cb0 0x560424742010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604246f4cb0 0x560424742010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58898/0 (socket says 172.21.15.90:58898) 2022-07-05T11:52:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 -- 172.21.15.90:0/2577478160 learned_addr learned my addr 172.21.15.90:0/2577478160 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f93f8700 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247387a0 0x560424775b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x560424742a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 -- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247387a0 msgr2=0x560424775b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247387a0 0x560424775b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 -- 172.21.15.90:0/2577478160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 msgr2=0x560424742a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x560424742a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 -- 172.21.15.90:0/2577478160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f417d560 con 0x5604246f4cb0 2022-07-05T11:52:00.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3f8bf7700 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604246f4cb0 0x560424742010 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd3ec00b610 tx=0x7fd3ec032280).ready entity=mon.0 client_cookie=c62d7def909b5180 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:00.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.807+0000 7fd3ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:52:00.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd3ceffd700 1 -- 172.21.15.90:0/2577478160 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec030070 con 0x5604246f4cb0 2022-07-05T11:52:00.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3e4082d70 con 0x5604246f4cb0 2022-07-05T11:52:00.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd3ceffd700 1 -- 172.21.15.90:0/2577478160 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd3ec0124e0 con 0x5604246f4cb0 2022-07-05T11:52:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd3ceffd700 1 -- 172.21.15.90:0/2577478160 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3ec0128b0 con 0x5604246f4cb0 2022-07-05T11:52:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 10 client.5463 fetch_fsmap learned FSMap version 22 2022-07-05T11:52:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x560424734fa0 con 0x5604246f4cb0 2022-07-05T11:52:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd3ceffd700 1 -- 172.21.15.90:0/2577478160 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4082d70 con 0x5604246f4cb0 2022-07-05T11:52:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd3ceffd700 1 -- 172.21.15.90:0/2577478160 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fd3ec012a10 con 0x5604246f4cb0 2022-07-05T11:52:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 10 client.5463 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:52:00.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 10 client.5463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:52:00.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 20 client.5463 populate_metadata read hostname 'smithi090' 2022-07-05T11:52:00.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560424778120 0x5604246f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:00.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 4 client.5463 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:52:00.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560424637690 con 0x560424778120 2022-07-05T11:52:00.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.808+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560424778120 0x5604246f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:00.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.809+0000 7fd3ceffd700 10 client.5463 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:00.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.809+0000 7fd3f3fff700 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560424778120 0x5604246f65c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f229caef62f10244 server_cookie=423b4bf37d02d96c in_seq=0 out_seq=0 2022-07-05T11:52:00.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd3ceffd700 1 -- 172.21.15.90:0/2577478160 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560424637690 con 0x560424778120 2022-07-05T11:52:00.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd3ceffd700 10 client.5463 handle_command_reply: tid=0 2022-07-05T11:52:00.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 client.5463 shutdown 2022-07-05T11:52:00.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604246f4cb0 msgr2=0x560424742010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604246f4cb0 0x560424742010 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd3ec00b610 tx=0x7fd3ec032280).stop 2022-07-05T11:52:00.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 shutdown_connections 2022-07-05T11:52:00.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560424778120 0x5604246f65c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5604247387a0 0x560424775b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604246f4cb0 0x560424742010 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd3ceffd700 0 client.5463 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:00.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 --2- 172.21.15.90:0/2577478160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604247383c0 0x560424742a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 >> 172.21.15.90:0/2577478160 conn(0x5604245631c0 msgr2=0x5604246f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:00.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 shutdown_connections 2022-07-05T11:52:00.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 1 -- 172.21.15.90:0/2577478160 wait complete. 2022-07-05T11:52:00.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.810+0000 7fd40c7e7b80 20 client.5463 trim_cache size 0 max 16384 2022-07-05T11:52:00.907 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:52:00.908 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:52:00.908 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:52:00.909 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:52:00.909 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:52:00.909 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:52:00.910 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:52:00.910 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:52:00.911 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:52:00.911 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:52:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd3d408ba40 msgr2=0x7fd3d408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd3d408ba40 0x7fd3d408df00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fd3ec00baf0 tx=0x7fd3f417d4d0).stop 2022-07-05T11:52:00.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3f417f3b0 msgr2=0x7fd3f415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:00.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3f417f3b0 0x7fd3f415a9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fd3e400c840 tx=0x7fd3e4001940).stop 2022-07-05T11:52:00.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 shutdown_connections 2022-07-05T11:52:00.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd3d408ba40 0x7fd3d408df00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3f417f3b0 0x7fd3f415a9a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4178610 0x7fd3f418f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 --2- 172.21.15.90:0/2261044578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f417e100 0x7fd3f415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:00.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 >> 172.21.15.90:0/2261044578 conn(0x7fd3f40f2210 msgr2=0x7fd3f417d710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:00.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 shutdown_connections 2022-07-05T11:52:00.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:00.811+0000 7fd3fae5b700 1 -- 172.21.15.90:0/2261044578 wait complete. 2022-07-05T11:52:00.921 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:52:03.410 INFO:tasks.workunit.client.0.smithi090.stdout: 271 558008 509 388172 694 242017 597 2022-07-05T11:52:13.404 INFO:tasks.workunit.client.0.smithi090.stdout: 277 736307 265 513516 221 310188 570 2022-07-05T11:52:23.407 INFO:tasks.workunit.client.0.smithi090.stdout: 283 2352848 476 1640356 400 1007032 1125 2022-07-05T11:52:30.922 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:52:31.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.947+0000 7fe183424700 1 Processor -- start 2022-07-05T11:52:31.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.953+0000 7fe183424700 1 -- start start 2022-07-05T11:52:31.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.955+0000 7fe183424700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe17c1814e0 0x7fe17c0eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:31.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.955+0000 7fe183424700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c180940 con 0x7fe17c0ef330 2022-07-05T11:52:31.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.955+0000 7fe183424700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0c4fa0 con 0x7fe17c17e0e0 2022-07-05T11:52:31.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.955+0000 7fe183424700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c17fd30 con 0x7fe17c1814e0 2022-07-05T11:52:31.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.955+0000 7fe1811c0700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe17c17e0e0 0x7fe17c180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:48088/0 (socket says 172.21.15.90:48088) 2022-07-05T11:52:31.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.956+0000 7fe1811c0700 1 -- 172.21.15.90:0/1056620694 learned_addr learned my addr 172.21.15.90:0/1056620694 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:52:31.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.959+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1056620694 >> v2:172.21.15.90:3300/0 conn(0x7fe17c1814e0 0x7fe17c0eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:31.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.963+0000 7fe16bfff700 1 -- 172.21.15.90:0/1056620694 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973266873 0 0) 0x7fe17c0c4fa0 con 0x7fe17c17e0e0 2022-07-05T11:52:31.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.963+0000 7fe16bfff700 1 -- 172.21.15.90:0/1056620694 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1640033f0 con 0x7fe17c17e0e0 2022-07-05T11:52:31.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.963+0000 7fe1809bf700 1 -- 172.21.15.90:0/1056620694 >> v1:172.21.15.149:6789/0 conn(0x7fe17c17e0e0 legacy=0x7fe17c180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:31.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.963+0000 7fe16bfff700 1 -- 172.21.15.90:0/1056620694 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094222608 0 0) 0x7fe17c180940 con 0x7fe17c0ef330 2022-07-05T11:52:31.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.963+0000 7fe1809bf700 1 -- 172.21.15.90:0/1056620694 >> v1:172.21.15.90:6789/0 conn(0x7fe17c0ef330 legacy=0x7fe17c0ef740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:31.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.963+0000 7fe1809bf700 1 -- 172.21.15.90:0/1056620694 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c180010 con 0x7fe17c1814e0 2022-07-05T11:52:31.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.963+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1056620694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 0x7fe17c0eee40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe16c009760 tx=0x7fe16c009060).ready entity=mon.0 client_cookie=a099e01caa2c0faa server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:31.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.972+0000 7fe16bfff700 1 -- 172.21.15.90:0/1056620694 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00f510 con 0x7fe17c1814e0 2022-07-05T11:52:31.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.972+0000 7fe16bfff700 1 -- 172.21.15.90:0/1056620694 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c00f670 con 0x7fe17c1814e0 2022-07-05T11:52:31.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.972+0000 7fe16bfff700 1 -- 172.21.15.90:0/1056620694 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00f9f0 con 0x7fe17c1814e0 2022-07-05T11:52:31.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.973+0000 7fe183424700 1 -- 172.21.15.90:0/1056620694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 msgr2=0x7fe17c0eee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:31.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.973+0000 7fe183424700 1 --2- 172.21.15.90:0/1056620694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 0x7fe17c0eee40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe16c009760 tx=0x7fe16c009060).stop 2022-07-05T11:52:31.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.981+0000 7fe183424700 1 -- 172.21.15.90:0/1056620694 shutdown_connections 2022-07-05T11:52:31.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.981+0000 7fe183424700 1 --2- 172.21.15.90:0/1056620694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 0x7fe17c0eee40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:31.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.981+0000 7fe183424700 1 -- 172.21.15.90:0/1056620694 >> 172.21.15.90:0/1056620694 conn(0x7fe17c0edd60 msgr2=0x7fe17c05d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:31.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.988+0000 7fe183424700 1 -- 172.21.15.90:0/1056620694 shutdown_connections 2022-07-05T11:52:31.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.988+0000 7fe183424700 1 -- 172.21.15.90:0/1056620694 wait complete. 2022-07-05T11:52:31.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.992+0000 7fe183424700 1 Processor -- start 2022-07-05T11:52:32.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.996+0000 7fe183424700 1 -- start start 2022-07-05T11:52:32.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe183424700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe17c0ef330 0x7fe17c1789b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe183424700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c17e0e0 0x7fe17c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe183424700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 0x7fe17c17c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe183424700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c17bc90 con 0x7fe17c1814e0 2022-07-05T11:52:32.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe183424700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c17ada0 con 0x7fe17c17e0e0 2022-07-05T11:52:32.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe183424700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c17b080 con 0x7fe17c0ef330 2022-07-05T11:52:32.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe1811c0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe17c0ef330 0x7fe17c1789b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe1811c0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe17c0ef330 0x7fe17c1789b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40308/0 (socket says 172.21.15.90:40308) 2022-07-05T11:52:32.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe1811c0700 1 -- 172.21.15.90:0/148980681 learned_addr learned my addr 172.21.15.90:0/148980681 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:32.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:31.998+0000 7fe1819c1700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 0x7fe17c17c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.003+0000 7fe1809bf700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c17e0e0 0x7fe17c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.003+0000 7fe1809bf700 1 -- 172.21.15.90:0/148980681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe17c0ef330 msgr2=0x7fe17c1789b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.003+0000 7fe1809bf700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe17c0ef330 0x7fe17c1789b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.003+0000 7fe1809bf700 1 -- 172.21.15.90:0/148980681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 msgr2=0x7fe17c17c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.003+0000 7fe1809bf700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 0x7fe17c17c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.003+0000 7fe1809bf700 1 -- 172.21.15.90:0/148980681 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0092a0 con 0x7fe17c17e0e0 2022-07-05T11:52:32.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.005+0000 7fe1809bf700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c17e0e0 0x7fe17c15b7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe16c014000 tx=0x7fe16c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:32.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.008+0000 7fe1697fa700 1 -- 172.21.15.90:0/148980681 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00f7e0 con 0x7fe17c17e0e0 2022-07-05T11:52:32.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.008+0000 7fe1697fa700 1 -- 172.21.15.90:0/148980681 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c00f940 con 0x7fe17c17e0e0 2022-07-05T11:52:32.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.008+0000 7fe1697fa700 1 -- 172.21.15.90:0/148980681 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c01b650 con 0x7fe17c17e0e0 2022-07-05T11:52:32.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.008+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c17b360 con 0x7fe17c17e0e0 2022-07-05T11:52:32.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.008+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c17b920 con 0x7fe17c17e0e0 2022-07-05T11:52:32.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.015+0000 7fe194db0b80 1 Processor -- start 2022-07-05T11:52:32.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.016+0000 7fe1697fa700 1 -- 172.21.15.90:0/148980681 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe16c00f070 con 0x7fe17c17e0e0 2022-07-05T11:52:32.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.016+0000 7fe1697fa700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe15c08ba60 0x7fe15c08df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.017+0000 7fe1697fa700 1 -- 172.21.15.90:0/148980681 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe16c0b1d40 con 0x7fe17c17e0e0 2022-07-05T11:52:32.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.019+0000 7fe1819c1700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe15c08ba60 0x7fe15c08df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.020+0000 7fe1819c1700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe15c08ba60 0x7fe15c08df20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fe17c0e75d0 tx=0x7fe178007ae0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:32.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.020+0000 7fe194db0b80 1 -- start start 2022-07-05T11:52:32.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.022+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8ac97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.022+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8ac9cb0 0x561fb8b17990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.022+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8b0d7a0 0x561fb8b0dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.022+0000 7fe194db0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8a932d0 con 0x561fb8b0d3c0 2022-07-05T11:52:32.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.022+0000 7fe194db0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8a0aaa0 con 0x561fb8ac9cb0 2022-07-05T11:52:32.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.022+0000 7fe194db0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8a1f950 con 0x561fb8b0d7a0 2022-07-05T11:52:32.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8ac9cb0 0x561fb8b17990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8ac9cb0 0x561fb8b17990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35242/0 (socket says 172.21.15.90:35242) 2022-07-05T11:52:32.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 -- 172.21.15.90:0/1624196102 learned_addr learned my addr 172.21.15.90:0/1624196102 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:32.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1819c1700 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8b0d7a0 0x561fb8b0dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 -- 172.21.15.90:0/1624196102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8b0d7a0 msgr2=0x561fb8b0dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:32.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8b0d7a0 0x561fb8b0dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 -- 172.21.15.90:0/1624196102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 msgr2=0x561fb8ac97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:32.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8ac97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 -- 172.21.15.90:0/1624196102 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fb88519e0 con 0x561fb8ac9cb0 2022-07-05T11:52:32.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8ac9cb0 0x561fb8b17990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe16c0af8a0 tx=0x7fe16c0829c0).ready entity=mon.1 client_cookie=5f5da2017af9015a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:32.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1627fc700 1 -- 172.21.15.90:0/1624196102 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c08bf60 con 0x561fb8ac9cb0 2022-07-05T11:52:32.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1627fc700 1 -- 172.21.15.90:0/1624196102 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c084a20 con 0x561fb8ac9cb0 2022-07-05T11:52:32.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.028+0000 7fe1627fc700 1 -- 172.21.15.90:0/1624196102 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c082d90 con 0x561fb8ac9cb0 2022-07-05T11:52:32.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.029+0000 7fe194db0b80 1 -- 172.21.15.90:0/1624196102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8ac9cb0 msgr2=0x561fb8b17990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.029+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8ac9cb0 0x561fb8b17990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe16c0af8a0 tx=0x7fe16c0829c0).stop 2022-07-05T11:52:32.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.029+0000 7fe194db0b80 1 -- 172.21.15.90:0/1624196102 shutdown_connections 2022-07-05T11:52:32.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.029+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8b0d7a0 0x561fb8b0dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.029+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8ac97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.029+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1624196102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8ac9cb0 0x561fb8b17990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.029+0000 7fe194db0b80 1 -- 172.21.15.90:0/1624196102 >> 172.21.15.90:0/1624196102 conn(0x561fb89381c0 msgr2=0x561fb8accab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:32.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.030+0000 7fe194db0b80 1 -- 172.21.15.90:0/1624196102 shutdown_connections 2022-07-05T11:52:32.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.030+0000 7fe194db0b80 1 -- 172.21.15.90:0/1624196102 wait complete. 2022-07-05T11:52:32.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.031+0000 7fe194db0b80 1 -- start start 2022-07-05T11:52:32.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.032+0000 7fe194db0b80 1 Processor -- start 2022-07-05T11:52:32.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.034+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8b36be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.034+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b08a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.034+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8ad4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.034+0000 7fe194db0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb89e7120 con 0x561fb8b0d3c0 2022-07-05T11:52:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.034+0000 7fe194db0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8b378b0 con 0x561fb8b0d7a0 2022-07-05T11:52:32.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.034+0000 7fe194db0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8b0bc40 con 0x561fb8ac9cb0 2022-07-05T11:52:32.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.034+0000 7fe194db0b80 10 client.0 ll_register_callbacks cb 0x561fb8a8d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:52:32.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b08a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b08a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58926/0 (socket says 172.21.15.90:58926) 2022-07-05T11:52:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 -- 172.21.15.90:0/2966002505 learned_addr learned my addr 172.21.15.90:0/2966002505 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1811c0700 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8b36be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 -- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 msgr2=0x561fb8b36be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:32.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8b36be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 -- 172.21.15.90:0/2966002505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 msgr2=0x561fb8ad4260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:52:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8ad4260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 -- 172.21.15.90:0/2966002505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c17b920 con 0x561fb8b0d3c0 2022-07-05T11:52:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1809bf700 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b08a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fe16c086330 tx=0x7fe16c088000).ready entity=mon.0 client_cookie=c477ecc328d59362 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.035+0000 7fe1577fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:52:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.036+0000 7fe1577fe700 1 -- 172.21.15.90:0/2966002505 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c096030 con 0x561fb8b0d3c0 2022-07-05T11:52:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.036+0000 7fe1577fe700 1 -- 172.21.15.90:0/2966002505 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe16c097070 con 0x561fb8b0d3c0 2022-07-05T11:52:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.036+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fb8ac7440 con 0x561fb8b0d3c0 2022-07-05T11:52:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.036+0000 7fe1577fe700 1 -- 172.21.15.90:0/2966002505 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe16c082ee0 con 0x561fb8b0d3c0 2022-07-05T11:52:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 10 client.5475 fetch_fsmap learned FSMap version 22 2022-07-05T11:52:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561fb88c0cd0 con 0x561fb8b0d3c0 2022-07-05T11:52:32.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe1577fe700 1 -- 172.21.15.90:0/2966002505 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fb8ac7440 con 0x561fb8b0d3c0 2022-07-05T11:52:32.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe1577fe700 1 -- 172.21.15.90:0/2966002505 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fe16c082470 con 0x561fb8b0d3c0 2022-07-05T11:52:32.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 10 client.5475 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:52:32.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 10 client.5475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:52:32.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 20 client.5475 populate_metadata read hostname 'smithi090' 2022-07-05T11:52:32.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b0abd0 0x561fb8b5f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 4 client.5475 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:52:32.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.039+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fb8a157f0 con 0x561fb8b0abd0 2022-07-05T11:52:32.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.040+0000 7fe1811c0700 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b0abd0 0x561fb8b5f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.041+0000 7fe1577fe700 10 client.5475 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:32.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.042+0000 7fe1811c0700 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b0abd0 0x561fb8b5f9c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=47a12fc4b00aac5f server_cookie=c9d658420722a89a in_seq=0 out_seq=0 2022-07-05T11:52:32.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.043+0000 7fe1577fe700 1 -- 172.21.15.90:0/2966002505 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x561fb8a157f0 con 0x561fb8b0abd0 2022-07-05T11:52:32.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.043+0000 7fe1577fe700 10 client.5475 handle_command_reply: tid=0 2022-07-05T11:52:32.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.043+0000 7fe194db0b80 1 client.5475 shutdown 2022-07-05T11:52:32.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 msgr2=0x561fb8b08a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b08a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fe16c086330 tx=0x7fe16c088000).stop 2022-07-05T11:52:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 shutdown_connections 2022-07-05T11:52:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b0abd0 0x561fb8b5f9c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8ad4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8b36be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2966002505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b08a60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 >> 172.21.15.90:0/2966002505 conn(0x561fb89381c0 msgr2=0x561fb8b3a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:32.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe1577fe700 0 client.5475 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:32.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 shutdown_connections 2022-07-05T11:52:32.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 1 -- 172.21.15.90:0/2966002505 wait complete. 2022-07-05T11:52:32.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.057+0000 7fe194db0b80 20 client.5475 trim_cache size 0 max 16384 2022-07-05T11:52:32.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.077+0000 7fe194db0b80 1 Processor -- start 2022-07-05T11:52:32.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.077+0000 7fe194db0b80 1 -- start start 2022-07-05T11:52:32.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.078+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8b07b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.078+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b14be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.078+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8b371f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.078+0000 7fe194db0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8b08050 con 0x561fb8b0d3c0 2022-07-05T11:52:32.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.078+0000 7fe194db0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8b20e00 con 0x561fb8b0d7a0 2022-07-05T11:52:32.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.078+0000 7fe194db0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8b3e210 con 0x561fb8ac9cb0 2022-07-05T11:52:32.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b14be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b14be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58934/0 (socket says 172.21.15.90:58934) 2022-07-05T11:52:32.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 -- 172.21.15.90:0/1859178446 learned_addr learned my addr 172.21.15.90:0/1859178446 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:32.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 -- 172.21.15.90:0/1859178446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 msgr2=0x561fb8b07b60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:52:32.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1859178446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8b07b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 -- 172.21.15.90:0/1859178446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 msgr2=0x561fb8b371f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:52:32.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1859178446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8b371f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 -- 172.21.15.90:0/1859178446 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fb888efd0 con 0x561fb8b0d3c0 2022-07-05T11:52:32.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe1809bf700 1 --2- 172.21.15.90:0/1859178446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b14be0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe16c0861e0 tx=0x7fe16c094070).ready entity=mon.0 client_cookie=b5080d74f33989b4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:32.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.079+0000 7fe162ffd700 1 -- 172.21.15.90:0/1859178446 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c096070 con 0x561fb8b0d3c0 2022-07-05T11:52:32.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.080+0000 7fe162ffd700 1 -- 172.21.15.90:0/1859178446 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c0847c0 con 0x561fb8b0d3c0 2022-07-05T11:52:32.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.080+0000 7fe162ffd700 1 -- 172.21.15.90:0/1859178446 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c082d90 con 0x561fb8b0d3c0 2022-07-05T11:52:32.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.080+0000 7fe194db0b80 1 -- 172.21.15.90:0/1859178446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 msgr2=0x561fb8b14be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.080+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1859178446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b14be0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe16c0861e0 tx=0x7fe16c094070).stop 2022-07-05T11:52:32.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.082+0000 7fe194db0b80 1 -- 172.21.15.90:0/1859178446 shutdown_connections 2022-07-05T11:52:32.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.082+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1859178446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8b371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.082+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1859178446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8b07b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.082+0000 7fe194db0b80 1 --2- 172.21.15.90:0/1859178446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b14be0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.082+0000 7fe194db0b80 1 -- 172.21.15.90:0/1859178446 >> 172.21.15.90:0/1859178446 conn(0x561fb89381c0 msgr2=0x561fb8acae50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:32.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.083+0000 7fe194db0b80 1 -- 172.21.15.90:0/1859178446 shutdown_connections 2022-07-05T11:52:32.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.083+0000 7fe194db0b80 1 -- 172.21.15.90:0/1859178446 wait complete. 2022-07-05T11:52:32.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.084+0000 7fe194db0b80 1 -- start start 2022-07-05T11:52:32.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.084+0000 7fe194db0b80 1 Processor -- start 2022-07-05T11:52:32.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8aca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b083b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe194db0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8bb49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe194db0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8acb9d0 con 0x561fb8b0d3c0 2022-07-05T11:52:32.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe194db0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8b088a0 con 0x561fb8b0d7a0 2022-07-05T11:52:32.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe194db0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb8acb6f0 con 0x561fb8ac9cb0 2022-07-05T11:52:32.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe194db0b80 10 client.0 ll_register_callbacks cb 0x561fb8a8d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:52:32.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe1809bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b083b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58940/0 (socket says 172.21.15.90:58940) 2022-07-05T11:52:32.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe1809bf700 1 -- 172.21.15.90:0/2045018322 learned_addr learned my addr 172.21.15.90:0/2045018322 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:52:32.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.089+0000 7fe1819c1700 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8bb49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1819c1700 1 -- 172.21.15.90:0/2045018322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 msgr2=0x561fb8aca710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:52:32.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1819c1700 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8aca710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1819c1700 1 -- 172.21.15.90:0/2045018322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 msgr2=0x561fb8b083b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:52:32.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1819c1700 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b083b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1819c1700 1 -- 172.21.15.90:0/2045018322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fb88c0cd0 con 0x561fb8b0d7a0 2022-07-05T11:52:32.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1809bf700 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:52:32.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1819c1700 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8bb49b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x561fb8acc080 tx=0x7fe178013000).ready entity=mon.1 client_cookie=f20857e9bb69f20b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:52:32.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1577fe700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2022-07-05T11:52:32.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1577fe700 1 -- 172.21.15.90:0/2045018322 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178014bf0 con 0x561fb8b0d7a0 2022-07-05T11:52:32.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe16c084a20 con 0x561fb8b0d7a0 2022-07-05T11:52:32.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1577fe700 1 -- 172.21.15.90:0/2045018322 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe178014d50 con 0x561fb8b0d7a0 2022-07-05T11:52:32.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe1577fe700 1 -- 172.21.15.90:0/2045018322 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe178021660 con 0x561fb8b0d7a0 2022-07-05T11:52:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe194db0b80 10 client.5191 fetch_fsmap learned FSMap version 22 2022-07-05T11:52:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.090+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561fb8b17fb0 con 0x561fb8b0d7a0 2022-07-05T11:52:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe1577fe700 1 -- 172.21.15.90:0/2045018322 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c084a20 con 0x561fb8b0d7a0 2022-07-05T11:52:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe1577fe700 1 -- 172.21.15.90:0/2045018322 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fe17801f070 con 0x561fb8b0d7a0 2022-07-05T11:52:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe194db0b80 10 client.5191 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:52:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe194db0b80 10 client.5191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:52:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe194db0b80 20 client.5191 populate_metadata read hostname 'smithi090' 2022-07-05T11:52:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b403d0 0x561fb8b3c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:52:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe194db0b80 4 client.5191 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:52:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561fb8a0c690 con 0x561fb8b403d0 2022-07-05T11:52:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.091+0000 7fe1811c0700 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b403d0 0x561fb8b3c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:52:32.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.092+0000 7fe1577fe700 10 client.5191 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:32.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.092+0000 7fe1811c0700 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b403d0 0x561fb8b3c9b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=50c00a419cc3d4dc server_cookie=ed43eb5e57172a54 in_seq=0 out_seq=0 2022-07-05T11:52:32.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.094+0000 7fe1577fe700 1 -- 172.21.15.90:0/2045018322 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561fb8a0c690 con 0x561fb8b403d0 2022-07-05T11:52:32.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.094+0000 7fe1577fe700 10 client.5191 handle_command_reply: tid=0 2022-07-05T11:52:32.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.094+0000 7fe194db0b80 1 client.5191 shutdown 2022-07-05T11:52:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 msgr2=0x561fb8bb49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8bb49b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x561fb8acc080 tx=0x7fe178013000).stop 2022-07-05T11:52:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 shutdown_connections 2022-07-05T11:52:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561fb8b403d0 0x561fb8b3c9b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561fb8b0d7a0 0x561fb8bb49b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fb8ac9cb0 0x561fb8aca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:52:32.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 --2- 172.21.15.90:0/2045018322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fb8b0d3c0 0x561fb8b083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 >> 172.21.15.90:0/2045018322 conn(0x561fb89381c0 msgr2=0x561fb8b5cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:32.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe1577fe700 0 client.5191 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:52:32.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 shutdown_connections 2022-07-05T11:52:32.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 1 -- 172.21.15.90:0/2045018322 wait complete. 2022-07-05T11:52:32.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.098+0000 7fe194db0b80 20 client.5191 trim_cache size 0 max 16384 2022-07-05T11:52:32.118 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:52:32.118 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:52:32.118 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:52:32.118 INFO:teuthology.orchestra.run.smithi090.stdout: "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348": { 2022-07-05T11:52:32.119 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:52:32.119 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "b87b6869-14ec-4ee1-ac0d-38e2d9d6e348", 2022-07-05T11:52:32.119 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:52:32.120 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:52:32.120 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:52:32.120 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:52:32.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe15c08ba60 msgr2=0x7fe15c08df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe15c08ba60 0x7fe15c08df20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fe17c0e75d0 tx=0x7fe178007ae0).stop 2022-07-05T11:52:32.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c17e0e0 msgr2=0x7fe17c15b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:52:32.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c17e0e0 0x7fe17c15b7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe16c014000 tx=0x7fe16c017000).stop 2022-07-05T11:52:32.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 shutdown_connections 2022-07-05T11:52:32.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe15c08ba60 0x7fe15c08df20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe17c1814e0 0x7fe17c17c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe17c0ef330 0x7fe17c1789b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 --2- 172.21.15.90:0/148980681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c17e0e0 0x7fe17c15b7e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:52:32.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 >> 172.21.15.90:0/148980681 conn(0x7fe17c0edd60 msgr2=0x7fe17c05d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:52:32.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 shutdown_connections 2022-07-05T11:52:32.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:52:32.099+0000 7fe183424700 1 -- 172.21.15.90:0/148980681 wait complete. 2022-07-05T11:52:32.128 INFO:tasks.cephfs.filesystem:scrub status for tag:b87b6869-14ec-4ee1-ac0d-38e2d9d6e348 - {'path': '/', 'tag': 'b87b6869-14ec-4ee1-ac0d-38e2d9d6e348', 'options': 'recursive,force'} 2022-07-05T11:52:33.407 INFO:tasks.workunit.client.0.smithi090.stdout: 293 2099775 628 1448197 436 900495 1220 2022-07-05T11:52:43.418 INFO:tasks.workunit.client.0.smithi090.stdout: 305 2018061 639 1398091 563 899376 1371 2022-07-05T11:52:56.325 INFO:tasks.workunit.client.0.smithi090.stdout: 2022-07-05T11:52:56.326 INFO:tasks.workunit.client.0.smithi090.stdout:Final score for writes: 305 2022-07-05T11:52:56.327 INFO:tasks.workunit.client.0.smithi090.stdout:Final score for reads : 819470 2022-07-05T11:52:56.327 INFO:tasks.workunit.client.0.smithi090.stdout: 2022-07-05T11:52:56.328 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-07-05T11:52:56.328 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-07-05T11:53:02.130 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:53:02.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.314+0000 7f244a10a700 1 Processor -- start 2022-07-05T11:53:02.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.314+0000 7f244a10a700 1 -- start start 2022-07-05T11:53:02.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f244a10a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24441789f0 0x7f244417f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f244a10a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f244417e100 0x7f2444063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f244a10a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244417d560 con 0x7f2444178610 2022-07-05T11:53:02.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f244a10a700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244417f8a0 con 0x7f244417e100 2022-07-05T11:53:02.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f244a10a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244417c670 con 0x7f24441789f0 2022-07-05T11:53:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f24437fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2444178610 0x7f244417d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:33252/0 (socket says 172.21.15.90:33252) 2022-07-05T11:53:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f24437fe700 1 -- 172.21.15.90:0/271947252 learned_addr learned my addr 172.21.15.90:0/271947252 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:53:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f2442ffd700 1 --2- 172.21.15.90:0/271947252 >> v2:172.21.15.110:3300/0 conn(0x7f24441789f0 0x7f244417f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f2443fff700 1 --2- 172.21.15.90:0/271947252 >> v2:172.21.15.90:3300/0 conn(0x7f244417e100 0x7f2444063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f2442ffd700 1 -- 172.21.15.90:0/271947252 >> v2:172.21.15.90:3300/0 conn(0x7f244417e100 msgr2=0x7f2444063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f2442ffd700 1 --2- 172.21.15.90:0/271947252 >> v2:172.21.15.90:3300/0 conn(0x7f244417e100 0x7f2444063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f2442ffd700 1 -- 172.21.15.90:0/271947252 >> v1:172.21.15.110:6789/0 conn(0x7f2444178610 legacy=0x7f244417d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.316+0000 7f2442ffd700 1 -- 172.21.15.90:0/271947252 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244417c950 con 0x7f24441789f0 2022-07-05T11:53:02.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.317+0000 7f2442ffd700 1 --2- 172.21.15.90:0/271947252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24441789f0 0x7f244417f3b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f244405ff10 tx=0x7f2438009060).ready entity=mon.1 client_cookie=f9cc583f463dd339 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:02.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.317+0000 7f24427fc700 1 -- 172.21.15.90:0/271947252 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438014ca0 con 0x7f24441789f0 2022-07-05T11:53:02.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.317+0000 7f24427fc700 1 -- 172.21.15.90:0/271947252 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438014e00 con 0x7f24441789f0 2022-07-05T11:53:02.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.318+0000 7f24427fc700 1 -- 172.21.15.90:0/271947252 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243801d680 con 0x7f24441789f0 2022-07-05T11:53:02.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.319+0000 7f244a10a700 1 -- 172.21.15.90:0/271947252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24441789f0 msgr2=0x7f244417f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.319+0000 7f244a10a700 1 --2- 172.21.15.90:0/271947252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24441789f0 0x7f244417f3b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f244405ff10 tx=0x7f2438009060).stop 2022-07-05T11:53:02.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.319+0000 7f244a10a700 1 -- 172.21.15.90:0/271947252 shutdown_connections 2022-07-05T11:53:02.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.319+0000 7f244a10a700 1 --2- 172.21.15.90:0/271947252 >> v2:172.21.15.90:3300/0 conn(0x7f244417e100 0x7f2444063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.319+0000 7f244a10a700 1 --2- 172.21.15.90:0/271947252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24441789f0 0x7f244417f3b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.319+0000 7f244a10a700 1 -- 172.21.15.90:0/271947252 >> 172.21.15.90:0/271947252 conn(0x7f24440f2210 msgr2=0x7f2444069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:02.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.319+0000 7f244a10a700 1 -- 172.21.15.90:0/271947252 shutdown_connections 2022-07-05T11:53:02.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.321+0000 7f244a10a700 1 -- 172.21.15.90:0/271947252 wait complete. 2022-07-05T11:53:02.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.323+0000 7f244a10a700 1 Processor -- start 2022-07-05T11:53:02.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.323+0000 7f244a10a700 1 -- start start 2022-07-05T11:53:02.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.324+0000 7f244a10a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2444178610 0x7f244418b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.324+0000 7f244a10a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24441789f0 0x7f244416dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f244a10a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244417e100 0x7f244416e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f244a10a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444178e10 con 0x7f244417e100 2022-07-05T11:53:02.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f244a10a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441790f0 con 0x7f2444178610 2022-07-05T11:53:02.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f244a10a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444171130 con 0x7f24441789f0 2022-07-05T11:53:02.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2444178610 0x7f244418b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2444178610 0x7f244418b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35272/0 (socket says 172.21.15.90:35272) 2022-07-05T11:53:02.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 -- 172.21.15.90:0/406920844 learned_addr learned my addr 172.21.15.90:0/406920844 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:02.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f2443fff700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244417e100 0x7f244416e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f2442ffd700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24441789f0 0x7f244416dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 -- 172.21.15.90:0/406920844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24441789f0 msgr2=0x7f244416dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24441789f0 0x7f244416dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 -- 172.21.15.90:0/406920844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244417e100 msgr2=0x7f244416e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244417e100 0x7f244416e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f24437fe700 1 -- 172.21.15.90:0/406920844 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380092a0 con 0x7f2444178610 2022-07-05T11:53:02.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.325+0000 7f2443fff700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244417e100 0x7f244416e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:53:02.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.326+0000 7f24437fe700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2444178610 0x7f244418b080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f243400c410 tx=0x7f2434007e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:02.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.328+0000 7f242b7fe700 1 -- 172.21.15.90:0/406920844 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340072e0 con 0x7f2444178610 2022-07-05T11:53:02.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.328+0000 7f242b7fe700 1 -- 172.21.15.90:0/406920844 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434007440 con 0x7f2444178610 2022-07-05T11:53:02.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.328+0000 7f242b7fe700 1 -- 172.21.15.90:0/406920844 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340057a0 con 0x7f2444178610 2022-07-05T11:53:02.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.328+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2444171410 con 0x7f2444178610 2022-07-05T11:53:02.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.328+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441719d0 con 0x7f2444178610 2022-07-05T11:53:02.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.331+0000 7f242b7fe700 1 -- 172.21.15.90:0/406920844 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2434010070 con 0x7f2444178610 2022-07-05T11:53:02.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.332+0000 7f242b7fe700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f242408ba90 0x7f242408df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.332+0000 7f242b7fe700 1 -- 172.21.15.90:0/406920844 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f24340afd90 con 0x7f2444178610 2022-07-05T11:53:02.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.332+0000 7f2442ffd700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f242408ba90 0x7f242408df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.332+0000 7f2442ffd700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f242408ba90 0x7f242408df50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f2438009fd0 tx=0x7f243801d000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:02.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.333+0000 7f245ba96b80 1 Processor -- start 2022-07-05T11:53:02.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.333+0000 7f245ba96b80 1 -- start start 2022-07-05T11:53:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.334+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac33047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.334+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac3352990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.334+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3348c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.334+0000 7f245ba96b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac32ce2d0 con 0x556ac3304cb0 2022-07-05T11:53:02.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.334+0000 7f245ba96b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac3245aa0 con 0x556ac33483c0 2022-07-05T11:53:02.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.334+0000 7f245ba96b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac325a950 con 0x556ac33487a0 2022-07-05T11:53:02.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.334+0000 7f2442ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac3352990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac3352990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58962/0 (socket says 172.21.15.90:58962) 2022-07-05T11:53:02.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f24437fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac33047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 -- 172.21.15.90:0/145197792 learned_addr learned my addr 172.21.15.90:0/145197792 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:02.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2443fff700 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3348c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 -- 172.21.15.90:0/145197792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 msgr2=0x556ac3348c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3348c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 -- 172.21.15.90:0/145197792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 msgr2=0x556ac33047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac33047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 -- 172.21.15.90:0/145197792 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ac308c9e0 con 0x556ac3304cb0 2022-07-05T11:53:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f24437fe700 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac33047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2442ffd700 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac3352990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f2438000e50 tx=0x7f2438023000).ready entity=mon.0 client_cookie=ff1fcbba04752b3e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2428ff9700 1 -- 172.21.15.90:0/145197792 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438021040 con 0x556ac3304cb0 2022-07-05T11:53:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2428ff9700 1 -- 172.21.15.90:0/145197792 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243802c040 con 0x556ac3304cb0 2022-07-05T11:53:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.335+0000 7f2428ff9700 1 -- 172.21.15.90:0/145197792 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438026450 con 0x556ac3304cb0 2022-07-05T11:53:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.336+0000 7f245ba96b80 1 -- 172.21.15.90:0/145197792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 msgr2=0x556ac3352990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.336+0000 7f245ba96b80 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac3352990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f2438000e50 tx=0x7f2438023000).stop 2022-07-05T11:53:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 -- 172.21.15.90:0/145197792 shutdown_connections 2022-07-05T11:53:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3348c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac33047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 --2- 172.21.15.90:0/145197792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac3352990 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 -- 172.21.15.90:0/145197792 >> 172.21.15.90:0/145197792 conn(0x556ac31731c0 msgr2=0x556ac3307ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:02.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 -- 172.21.15.90:0/145197792 shutdown_connections 2022-07-05T11:53:02.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 -- 172.21.15.90:0/145197792 wait complete. 2022-07-05T11:53:02.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 -- start start 2022-07-05T11:53:02.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.337+0000 7f245ba96b80 1 Processor -- start 2022-07-05T11:53:02.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 0x556ac3337aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac337b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33487a0 0x556ac33865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac3222120 con 0x556ac33487a0 2022-07-05T11:53:02.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac3388300 con 0x556ac33483c0 2022-07-05T11:53:02.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac3379aa0 con 0x556ac3304cb0 2022-07-05T11:53:02.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 10 client.0 ll_register_callbacks cb 0x556ac32c81b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:02.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33487a0 0x556ac33865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33487a0 0x556ac33865d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58970/0 (socket says 172.21.15.90:58970) 2022-07-05T11:53:02.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 -- 172.21.15.90:0/3496405765 learned_addr learned my addr 172.21.15.90:0/3496405765 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:02.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2442ffd700 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac337b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 -- 172.21.15.90:0/3496405765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 msgr2=0x556ac3337aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 0x556ac3337aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:02.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 -- 172.21.15.90:0/3496405765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 msgr2=0x556ac337b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac337b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 -- 172.21.15.90:0/3496405765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441719d0 con 0x556ac33487a0 2022-07-05T11:53:02.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2442ffd700 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac337b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:02.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f2443fff700 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33487a0 0x556ac33865d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f243c007ea0 tx=0x7f243c00b040).ready entity=mon.0 client_cookie=1ba1661a93e7b2cd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:02.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f241dffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:02.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f241dffb700 1 -- 172.21.15.90:0/3496405765 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c009ea0 con 0x556ac33487a0 2022-07-05T11:53:02.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f241dffb700 1 -- 172.21.15.90:0/3496405765 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f243c011a50 con 0x556ac33487a0 2022-07-05T11:53:02.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ac3302440 con 0x556ac33487a0 2022-07-05T11:53:02.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f241dffb700 1 -- 172.21.15.90:0/3496405765 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243c011e20 con 0x556ac33487a0 2022-07-05T11:53:02.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 10 client.5493 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:02.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7f244417c950 con 0x556ac33487a0 2022-07-05T11:53:02.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.339+0000 7f241dffb700 1 -- 172.21.15.90:0/3496405765 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ac3302440 con 0x556ac33487a0 2022-07-05T11:53:02.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f241dffb700 1 -- 172.21.15.90:0/3496405765 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f243c014070 con 0x556ac33487a0 2022-07-05T11:53:02.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f245ba96b80 10 client.5493 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:02.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f245ba96b80 10 client.5493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:02.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f245ba96b80 20 client.5493 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:02.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f245ba96b80 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3389b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f245ba96b80 4 client.5493 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:53:02.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ac32507f0 con 0x556ac33786c0 2022-07-05T11:53:02.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f24437fe700 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3389b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f241dffb700 10 client.5493 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:02.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.340+0000 7f24437fe700 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3389b50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=691c6e79eec21154 server_cookie=b87d1fcadb72dc1c in_seq=0 out_seq=0 2022-07-05T11:53:02.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f241dffb700 1 -- 172.21.15.90:0/3496405765 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x556ac32507f0 con 0x556ac33786c0 2022-07-05T11:53:02.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f241dffb700 10 client.5493 handle_command_reply: tid=0 2022-07-05T11:53:02.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 client.5493 shutdown 2022-07-05T11:53:02.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33487a0 msgr2=0x556ac33865d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33487a0 0x556ac33865d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f243c007ea0 tx=0x7f243c00b040).stop 2022-07-05T11:53:02.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 shutdown_connections 2022-07-05T11:53:02.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3389b50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33487a0 0x556ac33865d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f241dffb700 0 client.5493 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:02.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 0x556ac3337aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:02.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 --2- 172.21.15.90:0/3496405765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac337b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 >> 172.21.15.90:0/3496405765 conn(0x556ac31731c0 msgr2=0x556ac3307a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:02.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 shutdown_connections 2022-07-05T11:53:02.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 1 -- 172.21.15.90:0/3496405765 wait complete. 2022-07-05T11:53:02.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.341+0000 7f245ba96b80 20 client.5493 trim_cache size 0 max 16384 2022-07-05T11:53:02.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.357+0000 7f245ba96b80 1 Processor -- start 2022-07-05T11:53:02.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.357+0000 7f245ba96b80 1 -- start start 2022-07-05T11:53:02.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac33cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac3374320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3350b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f245ba96b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac3377ee0 con 0x556ac3304cb0 2022-07-05T11:53:02.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f245ba96b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac3378e90 con 0x556ac33483c0 2022-07-05T11:53:02.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f245ba96b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac33783f0 con 0x556ac33487a0 2022-07-05T11:53:02.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f24437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac33cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f24437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac33cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58974/0 (socket says 172.21.15.90:58974) 2022-07-05T11:53:02.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f24437fe700 1 -- 172.21.15.90:0/640292387 learned_addr learned my addr 172.21.15.90:0/640292387 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:02.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.358+0000 7f2443fff700 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3350b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f2442ffd700 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac3374320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24437fe700 1 -- 172.21.15.90:0/640292387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 msgr2=0x556ac3350b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24437fe700 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3350b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24437fe700 1 -- 172.21.15.90:0/640292387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 msgr2=0x556ac3374320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24437fe700 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac3374320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24437fe700 1 -- 172.21.15.90:0/640292387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ac30fbcd0 con 0x556ac3304cb0 2022-07-05T11:53:02.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f2442ffd700 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac3374320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:53:02.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24437fe700 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac33cf350 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2434084350 tx=0x7f2434086040).ready entity=mon.0 client_cookie=a03b2f681a609d9c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:02.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24297fa700 1 -- 172.21.15.90:0/640292387 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434082860 con 0x556ac3304cb0 2022-07-05T11:53:02.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24297fa700 1 -- 172.21.15.90:0/640292387 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434097070 con 0x556ac3304cb0 2022-07-05T11:53:02.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f24297fa700 1 -- 172.21.15.90:0/640292387 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340829f0 con 0x556ac3304cb0 2022-07-05T11:53:02.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 -- 172.21.15.90:0/640292387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 msgr2=0x556ac33cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac33cf350 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2434084350 tx=0x7f2434086040).stop 2022-07-05T11:53:02.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 -- 172.21.15.90:0/640292387 shutdown_connections 2022-07-05T11:53:02.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac33487a0 0x556ac3350b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac3304cb0 0x556ac33cf350 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 --2- 172.21.15.90:0/640292387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33483c0 0x556ac3374320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 -- 172.21.15.90:0/640292387 >> 172.21.15.90:0/640292387 conn(0x556ac31731c0 msgr2=0x556ac3305700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:02.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 -- 172.21.15.90:0/640292387 shutdown_connections 2022-07-05T11:53:02.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.359+0000 7f245ba96b80 1 -- 172.21.15.90:0/640292387 wait complete. 2022-07-05T11:53:02.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.360+0000 7f245ba96b80 1 -- start start 2022-07-05T11:53:02.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.360+0000 7f245ba96b80 1 Processor -- start 2022-07-05T11:53:02.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 0x556ac3350c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33483c0 0x556ac33dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f245ba96b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33487a0 0x556ac33cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f245ba96b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac333ce60 con 0x556ac33483c0 2022-07-05T11:53:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f245ba96b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac33512f0 con 0x556ac33487a0 2022-07-05T11:53:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f245ba96b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac333c250 con 0x556ac3304cb0 2022-07-05T11:53:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f245ba96b80 10 client.0 ll_register_callbacks cb 0x556ac32c81b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f2442ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33483c0 0x556ac33dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f2442ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33483c0 0x556ac33dfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58982/0 (socket says 172.21.15.90:58982) 2022-07-05T11:53:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f2442ffd700 1 -- 172.21.15.90:0/1813614314 learned_addr learned my addr 172.21.15.90:0/1813614314 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:02.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f24437fe700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 0x556ac3350c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.361+0000 7f2443fff700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33487a0 0x556ac33cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f2442ffd700 1 -- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 msgr2=0x556ac3350c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f2442ffd700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 0x556ac3350c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f2442ffd700 1 -- 172.21.15.90:0/1813614314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33487a0 msgr2=0x556ac33cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:02.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f2442ffd700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33487a0 0x556ac33cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f2442ffd700 1 -- 172.21.15.90:0/1813614314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2444171410 con 0x556ac33483c0 2022-07-05T11:53:02.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f2443fff700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33487a0 0x556ac33cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:53:02.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f2442ffd700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33483c0 0x556ac33dfa40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f2438014fd0 tx=0x7f243802d000).ready entity=mon.0 client_cookie=f048a4af2148f031 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:02.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f241dffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:02.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f241dffb700 1 -- 172.21.15.90:0/1813614314 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438021040 con 0x556ac33483c0 2022-07-05T11:53:02.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f241dffb700 1 -- 172.21.15.90:0/1813614314 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f2438031650 con 0x556ac33483c0 2022-07-05T11:53:02.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f243802c040 con 0x556ac33483c0 2022-07-05T11:53:02.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f241dffb700 1 -- 172.21.15.90:0/1813614314 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2438031a20 con 0x556ac33483c0 2022-07-05T11:53:02.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 10 client.5499 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:02.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x556ac30c9fd0 con 0x556ac33483c0 2022-07-05T11:53:02.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f241dffb700 1 -- 172.21.15.90:0/1813614314 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438045020 con 0x556ac33483c0 2022-07-05T11:53:02.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f241dffb700 1 -- 172.21.15.90:0/1813614314 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f2438031b80 con 0x556ac33483c0 2022-07-05T11:53:02.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 10 client.5499 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:02.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 10 client.5499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:02.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 20 client.5499 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:02.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3305700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:02.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 4 client.5499 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:53:02.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556ac3247690 con 0x556ac33786c0 2022-07-05T11:53:02.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.362+0000 7f24437fe700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3305700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:02.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f241dffb700 10 client.5499 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:02.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f24437fe700 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3305700 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2fc65368cc038ba8 server_cookie=9bce9e52c4c0a85b in_seq=0 out_seq=0 2022-07-05T11:53:02.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f241dffb700 1 -- 172.21.15.90:0/1813614314 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556ac3247690 con 0x556ac33786c0 2022-07-05T11:53:02.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f241dffb700 10 client.5499 handle_command_reply: tid=0 2022-07-05T11:53:02.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 client.5499 shutdown 2022-07-05T11:53:02.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33483c0 msgr2=0x556ac33dfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33483c0 0x556ac33dfa40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f2438014fd0 tx=0x7f243802d000).stop 2022-07-05T11:53:02.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 shutdown_connections 2022-07-05T11:53:02.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x556ac33786c0 0x556ac3305700 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556ac33487a0 0x556ac33cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f241dffb700 0 client.5499 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:02.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ac3304cb0 0x556ac3350c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 --2- 172.21.15.90:0/1813614314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac33483c0 0x556ac33dfa40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 >> 172.21.15.90:0/1813614314 conn(0x556ac31731c0 msgr2=0x556ac33776c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:02.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 shutdown_connections 2022-07-05T11:53:02.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 1 -- 172.21.15.90:0/1813614314 wait complete. 2022-07-05T11:53:02.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.363+0000 7f245ba96b80 20 client.5499 trim_cache size 0 max 16384 2022-07-05T11:53:02.402 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:53:02.402 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "no active scrubs running", 2022-07-05T11:53:02.402 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": {} 2022-07-05T11:53:02.403 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:53:02.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f242408ba90 msgr2=0x7f242408df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f242408ba90 0x7f242408df50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f2438009fd0 tx=0x7f243801d000).stop 2022-07-05T11:53:02.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2444178610 msgr2=0x7f244418b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:02.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2444178610 0x7f244418b080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f243400c410 tx=0x7f2434007e10).stop 2022-07-05T11:53:02.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 shutdown_connections 2022-07-05T11:53:02.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f242408ba90 0x7f242408df50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244417e100 0x7f244416e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2444178610 0x7f244418b080 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 --2- 172.21.15.90:0/406920844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24441789f0 0x7f244416dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:02.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 >> 172.21.15.90:0/406920844 conn(0x7f24440f2210 msgr2=0x7f24440ece70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:02.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 shutdown_connections 2022-07-05T11:53:02.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:02.364+0000 7f244a10a700 1 -- 172.21.15.90:0/406920844 wait complete. 2022-07-05T11:53:02.411 INFO:tasks.cephfs.filesystem:all active scrubs completed 2022-07-05T11:53:03.413 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2022-07-05T11:53:03.414 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2022-07-05T11:53:03.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.534+0000 7f740a65c700 1 Processor -- start 2022-07-05T11:53:03.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.534+0000 7f740a65c700 1 -- start start 2022-07-05T11:53:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.535+0000 7f740a65c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f740417dfb0 0x7f7404185d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.535+0000 7f740a65c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740417d410 con 0x7f740417c0a0 2022-07-05T11:53:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.535+0000 7f740a65c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7404178900 con 0x7f7404178520 2022-07-05T11:53:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.535+0000 7f740a65c700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740417c520 con 0x7f740417dfb0 2022-07-05T11:53:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.535+0000 7f7409e5b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f740417dfb0 0x7f7404185d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.535+0000 7f7408e59700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f740417c0a0 0x7f740417d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51928/0 (socket says 172.21.15.90:51928) 2022-07-05T11:53:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.535+0000 7f7408e59700 1 -- 172.21.15.90:0/3764307396 learned_addr learned my addr 172.21.15.90:0/3764307396 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:53:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7409e5b700 1 -- 172.21.15.90:0/3764307396 >> v1:172.21.15.149:6789/0 conn(0x7f7404178520 legacy=0x7f74040efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7409e5b700 1 -- 172.21.15.90:0/3764307396 >> v1:172.21.15.90:6789/0 conn(0x7f740417c0a0 legacy=0x7f740417d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7409e5b700 1 -- 172.21.15.90:0/3764307396 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740417c800 con 0x7f740417dfb0 2022-07-05T11:53:03.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7403fff700 1 -- 172.21.15.90:0/3764307396 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609422991 0 0) 0x7f740417d410 con 0x7f740417c0a0 2022-07-05T11:53:03.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7409e5b700 1 --2- 172.21.15.90:0/3764307396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f740417dfb0 0x7f7404185d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f73f4009e60 tx=0x7f73f4009780).ready entity=mon.0 client_cookie=5d185a25df2ce713 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7403fff700 1 -- 172.21.15.90:0/3764307396 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f400e070 con 0x7f740417dfb0 2022-07-05T11:53:03.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7403fff700 1 -- 172.21.15.90:0/3764307396 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f400bc30 con 0x7f740417dfb0 2022-07-05T11:53:03.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f7403fff700 1 -- 172.21.15.90:0/3764307396 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4012410 con 0x7f740417dfb0 2022-07-05T11:53:03.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f740a65c700 1 -- 172.21.15.90:0/3764307396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f740417dfb0 msgr2=0x7f7404185d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f740a65c700 1 --2- 172.21.15.90:0/3764307396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f740417dfb0 0x7f7404185d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f73f4009e60 tx=0x7f73f4009780).stop 2022-07-05T11:53:03.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f740a65c700 1 -- 172.21.15.90:0/3764307396 shutdown_connections 2022-07-05T11:53:03.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f740a65c700 1 --2- 172.21.15.90:0/3764307396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f740417dfb0 0x7f7404185d90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.536+0000 7f740a65c700 1 -- 172.21.15.90:0/3764307396 >> 172.21.15.90:0/3764307396 conn(0x7f74040f13f0 msgr2=0x7f74040f1800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.537+0000 7f740a65c700 1 -- 172.21.15.90:0/3764307396 shutdown_connections 2022-07-05T11:53:03.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.537+0000 7f740a65c700 1 -- 172.21.15.90:0/3764307396 wait complete. 2022-07-05T11:53:03.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.538+0000 7f740a65c700 1 Processor -- start 2022-07-05T11:53:03.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.538+0000 7f740a65c700 1 -- start start 2022-07-05T11:53:03.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740a65c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7404178520 0x7f74040c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740a65c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f740417c0a0 0x7f7404167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740a65c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740417dfb0 0x7f74041683e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740a65c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74040ca360 con 0x7f7404178520 2022-07-05T11:53:03.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740a65c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74040cabc0 con 0x7f740417c0a0 2022-07-05T11:53:03.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740a65c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041823e0 con 0x7f740417dfb0 2022-07-05T11:53:03.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7404178520 0x7f74040c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7404178520 0x7f74040c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58994/0 (socket says 172.21.15.90:58994) 2022-07-05T11:53:03.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 -- 172.21.15.90:0/3745017467 learned_addr learned my addr 172.21.15.90:0/3745017467 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f7409e5b700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740417dfb0 0x7f74041683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f7408e59700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f740417c0a0 0x7f7404167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 -- 172.21.15.90:0/3745017467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740417dfb0 msgr2=0x7f74041683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740417dfb0 0x7f74041683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 -- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f740417c0a0 msgr2=0x7f7404167ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f740417c0a0 0x7f7404167ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.539+0000 7f740965a700 1 -- 172.21.15.90:0/3745017467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4009a20 con 0x7f7404178520 2022-07-05T11:53:03.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.540+0000 7f740965a700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7404178520 0x7f74040c55c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f73fc00c4c0 tx=0x7f73fc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.540+0000 7f74017fa700 1 -- 172.21.15.90:0/3745017467 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc007020 con 0x7f7404178520 2022-07-05T11:53:03.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.540+0000 7f74017fa700 1 -- 172.21.15.90:0/3745017467 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc001e90 con 0x7f7404178520 2022-07-05T11:53:03.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.540+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74041826c0 con 0x7f7404178520 2022-07-05T11:53:03.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.540+0000 7f74017fa700 1 -- 172.21.15.90:0/3745017467 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0073b0 con 0x7f7404178520 2022-07-05T11:53:03.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.540+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74040ca850 con 0x7f7404178520 2022-07-05T11:53:03.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.542+0000 7f74017fa700 1 -- 172.21.15.90:0/3745017467 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f73fc010070 con 0x7f7404178520 2022-07-05T11:53:03.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.542+0000 7f74017fa700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f73e408ba40 0x7f73e408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.542+0000 7f74017fa700 1 -- 172.21.15.90:0/3745017467 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f73fc0b01a0 con 0x7f7404178520 2022-07-05T11:53:03.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.542+0000 7f7408e59700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f73e408ba40 0x7f73e408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.543+0000 7f7408e59700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f73e408ba40 0x7f73e408df00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f74040f0630 tx=0x7f73f8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.544+0000 7f741d24ab80 1 Processor -- start 2022-07-05T11:53:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.544+0000 7f741d24ab80 1 -- start start 2022-07-05T11:53:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b3952c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395311b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307910 0x55b395307d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f741d24ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b39528d350 con 0x55b3952c3e20 2022-07-05T11:53:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f741d24ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395204b20 con 0x55b395307910 2022-07-05T11:53:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f741d24ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3952199d0 con 0x55b395307530 2022-07-05T11:53:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f7408e59700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395311b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f740965a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b3952c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f7408e59700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395311b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59004/0 (socket says 172.21.15.90:59004) 2022-07-05T11:53:03.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f7408e59700 1 -- 172.21.15.90:0/2973046251 learned_addr learned my addr 172.21.15.90:0/2973046251 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f7409e5b700 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307910 0x55b395307d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f740965a700 1 -- 172.21.15.90:0/2973046251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307910 msgr2=0x55b395307d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f740965a700 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307910 0x55b395307d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f740965a700 1 -- 172.21.15.90:0/2973046251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 msgr2=0x55b395311b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f740965a700 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395311b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f740965a700 1 -- 172.21.15.90:0/2973046251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b39504ba60 con 0x55b395307530 2022-07-05T11:53:03.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f7408e59700 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395311b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:03.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f740965a700 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b3952c3930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f73fc00cb60 tx=0x7f73fc0b0050).ready entity=mon.2 client_cookie=6810e75a3b47a101 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f73ea7fc700 1 -- 172.21.15.90:0/2973046251 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc007510 con 0x55b395307530 2022-07-05T11:53:03.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f73ea7fc700 1 -- 172.21.15.90:0/2973046251 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc084ae0 con 0x55b395307530 2022-07-05T11:53:03.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.545+0000 7f73ea7fc700 1 -- 172.21.15.90:0/2973046251 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc08a3c0 con 0x55b395307530 2022-07-05T11:53:03.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 -- 172.21.15.90:0/2973046251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 msgr2=0x55b3952c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b3952c3930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f73fc00cb60 tx=0x7f73fc0b0050).stop 2022-07-05T11:53:03.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 -- 172.21.15.90:0/2973046251 shutdown_connections 2022-07-05T11:53:03.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307910 0x55b395307d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b3952c3930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2973046251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395311b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 -- 172.21.15.90:0/2973046251 >> 172.21.15.90:0/2973046251 conn(0x55b395132240 msgr2=0x55b3952c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 -- 172.21.15.90:0/2973046251 shutdown_connections 2022-07-05T11:53:03.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.546+0000 7f741d24ab80 1 -- 172.21.15.90:0/2973046251 wait complete. 2022-07-05T11:53:03.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.547+0000 7f741d24ab80 1 -- start start 2022-07-05T11:53:03.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.547+0000 7f741d24ab80 1 Processor -- start 2022-07-05T11:53:03.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307530 0x55b3952fd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395347300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f741d24ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3951e11a0 con 0x55b395307530 2022-07-05T11:53:03.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f741d24ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395347fd0 con 0x55b3952c3e20 2022-07-05T11:53:03.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f741d24ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395302ed0 con 0x55b395307910 2022-07-05T11:53:03.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f741d24ab80 10 client.0 ll_register_callbacks cb 0x55b395287400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:03.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307530 0x55b3952fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307530 0x55b3952fd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59010/0 (socket says 172.21.15.90:59010) 2022-07-05T11:53:03.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 -- 172.21.15.90:0/2358695918 learned_addr learned my addr 172.21.15.90:0/2358695918 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7409e5b700 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395347300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f740965a700 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 -- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 msgr2=0x55b395347300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395347300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 -- 172.21.15.90:0/2358695918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 msgr2=0x55b3953014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 -- 172.21.15.90:0/2358695918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f800f040 con 0x55b395307530 2022-07-05T11:53:03.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f7408e59700 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307530 0x55b3952fd740 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f73f8005e50 tx=0x7f73f801a040).ready entity=mon.0 client_cookie=5ef2dab0381cf083 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.548+0000 7f73df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:03.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f73df7fe700 1 -- 172.21.15.90:0/2358695918 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f801d040 con 0x55b395307530 2022-07-05T11:53:03.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f73df7fe700 1 -- 172.21.15.90:0/2358695918 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f73f8013420 con 0x55b395307530 2022-07-05T11:53:03.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3952c1710 con 0x55b395307530 2022-07-05T11:53:03.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f73df7fe700 1 -- 172.21.15.90:0/2358695918 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f8005e80 con 0x55b395307530 2022-07-05T11:53:03.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 10 client.5514 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:03.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7f74040ca850 con 0x55b395307530 2022-07-05T11:53:03.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f73df7fe700 1 -- 172.21.15.90:0/2358695918 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b3952c1710 con 0x55b395307530 2022-07-05T11:53:03.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f73df7fe700 1 -- 172.21.15.90:0/2358695918 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f73f80137f0 con 0x55b395307530 2022-07-05T11:53:03.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 10 client.5514 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:03.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 10 client.5514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:03.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 20 client.5514 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:03.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395332200 0x55b3953325e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 4 client.5514 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:53:03.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b39520f870 con 0x55b395332200 2022-07-05T11:53:03.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.549+0000 7f740965a700 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395332200 0x55b3953325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.550+0000 7f73df7fe700 10 client.5514 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.550+0000 7f740965a700 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395332200 0x55b3953325e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3387c59edf60351e server_cookie=7a165fdcbd87925c in_seq=0 out_seq=0 2022-07-05T11:53:03.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.550+0000 7f73df7fe700 1 -- 172.21.15.90:0/2358695918 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55b39520f870 con 0x55b395332200 2022-07-05T11:53:03.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.550+0000 7f73df7fe700 10 client.5514 handle_command_reply: tid=0 2022-07-05T11:53:03.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.550+0000 7f741d24ab80 1 client.5514 shutdown 2022-07-05T11:53:03.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307530 msgr2=0x55b3952fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307530 0x55b3952fd740 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f73f8005e50 tx=0x7f73f801a040).stop 2022-07-05T11:53:03.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 shutdown_connections 2022-07-05T11:53:03.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395332200 0x55b3953325e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395347300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 --2- 172.21.15.90:0/2358695918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307530 0x55b3952fd740 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f73df7fe700 0 client.5514 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 >> 172.21.15.90:0/2358695918 conn(0x55b395132240 msgr2=0x55b3953342c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 shutdown_connections 2022-07-05T11:53:03.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 1 -- 172.21.15.90:0/2358695918 wait complete. 2022-07-05T11:53:03.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.551+0000 7f741d24ab80 20 client.5514 trim_cache size 0 max 16384 2022-07-05T11:53:03.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.566+0000 7f741d24ab80 1 Processor -- start 2022-07-05T11:53:03.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.567+0000 7f741d24ab80 1 -- start start 2022-07-05T11:53:03.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395348200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307530 0x55b3952bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395331af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f741d24ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395334a30 con 0x55b3952c3e20 2022-07-05T11:53:03.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f741d24ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395303620 con 0x55b395307530 2022-07-05T11:53:03.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f741d24ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3953342c0 con 0x55b395307910 2022-07-05T11:53:03.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395348200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395348200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59016/0 (socket says 172.21.15.90:59016) 2022-07-05T11:53:03.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 -- 172.21.15.90:0/3225574481 learned_addr learned my addr 172.21.15.90:0/3225574481 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f7408e59700 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307530 0x55b3952bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f7409e5b700 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395331af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 -- 172.21.15.90:0/3225574481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 msgr2=0x55b395331af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395331af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 -- 172.21.15.90:0/3225574481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307530 msgr2=0x55b3952bdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307530 0x55b3952bdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 -- 172.21.15.90:0/3225574481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395347bb0 con 0x55b3952c3e20 2022-07-05T11:53:03.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f740965a700 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395348200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f73fc0011b0 tx=0x7f73fc052000).ready entity=mon.0 client_cookie=cd651aa59bdfc783 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f73eaffd700 1 -- 172.21.15.90:0/3225574481 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0b0040 con 0x55b3952c3e20 2022-07-05T11:53:03.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f73eaffd700 1 -- 172.21.15.90:0/3225574481 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc091040 con 0x55b3952c3e20 2022-07-05T11:53:03.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.568+0000 7f73eaffd700 1 -- 172.21.15.90:0/3225574481 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc007510 con 0x55b3952c3e20 2022-07-05T11:53:03.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 -- 172.21.15.90:0/3225574481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 msgr2=0x55b395348200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395348200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f73fc0011b0 tx=0x7f73fc052000).stop 2022-07-05T11:53:03.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 -- 172.21.15.90:0/3225574481 shutdown_connections 2022-07-05T11:53:03.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307910 0x55b395331af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b3952c3e20 0x55b395348200 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 --2- 172.21.15.90:0/3225574481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b395307530 0x55b3952bdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 -- 172.21.15.90:0/3225574481 >> 172.21.15.90:0/3225574481 conn(0x55b395132240 msgr2=0x55b395334c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 -- 172.21.15.90:0/3225574481 shutdown_connections 2022-07-05T11:53:03.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 -- 172.21.15.90:0/3225574481 wait complete. 2022-07-05T11:53:03.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.569+0000 7f741d24ab80 1 -- start start 2022-07-05T11:53:03.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.570+0000 7f741d24ab80 1 Processor -- start 2022-07-05T11:53:03.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953325e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b395336f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307910 0x55b39538d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395337480 con 0x55b395307910 2022-07-05T11:53:03.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3953a0340 con 0x55b3952c3e20 2022-07-05T11:53:03.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b39538d2f0 con 0x55b395307530 2022-07-05T11:53:03.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 10 client.0 ll_register_callbacks cb 0x55b395287400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:03.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307910 0x55b39538d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307910 0x55b39538d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59024/0 (socket says 172.21.15.90:59024) 2022-07-05T11:53:03.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 -- 172.21.15.90:0/101841456 learned_addr learned my addr 172.21.15.90:0/101841456 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f740965a700 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7408e59700 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b395336f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 -- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 msgr2=0x55b395336f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b395336f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 -- 172.21.15.90:0/101841456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 msgr2=0x55b3953325e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953325e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 -- 172.21.15.90:0/101841456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b39504ba60 con 0x55b395307910 2022-07-05T11:53:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f7409e5b700 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307910 0x55b39538d780 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f740405dac0 tx=0x7f73f4009780).ready entity=mon.0 client_cookie=ef4247c493e613db server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f73df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:03.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f73df7fe700 1 -- 172.21.15.90:0/101841456 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f401e6e0 con 0x55b395307910 2022-07-05T11:53:03.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f73df7fe700 1 -- 172.21.15.90:0/101841456 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f73f401e840 con 0x55b395307910 2022-07-05T11:53:03.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73fc084ae0 con 0x55b395307910 2022-07-05T11:53:03.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f73df7fe700 1 -- 172.21.15.90:0/101841456 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f401ec10 con 0x55b395307910 2022-07-05T11:53:03.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 10 client.5520 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:03.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.571+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55b3950bad50 con 0x55b395307910 2022-07-05T11:53:03.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f73df7fe700 1 -- 172.21.15.90:0/101841456 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4034020 con 0x55b395307910 2022-07-05T11:53:03.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f73df7fe700 1 -- 172.21.15.90:0/101841456 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f73f402a440 con 0x55b395307910 2022-07-05T11:53:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f741d24ab80 10 client.5520 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f741d24ab80 10 client.5520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f741d24ab80 20 client.5520 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f741d24ab80 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395335550 0x55b39538e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f741d24ab80 4 client.5520 mds_command: new command op to 4371 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2022-07-05T11:53:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b395206710 con 0x55b395335550 2022-07-05T11:53:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f740965a700 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395335550 0x55b39538e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f73df7fe700 10 client.5520 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.572+0000 7f740965a700 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395335550 0x55b39538e820 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=82aa23d3d585e735 server_cookie=fa65e72e86c571ec in_seq=0 out_seq=0 2022-07-05T11:53:03.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f73df7fe700 1 -- 172.21.15.90:0/101841456 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b395206710 con 0x55b395335550 2022-07-05T11:53:03.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f73df7fe700 10 client.5520 handle_command_reply: tid=0 2022-07-05T11:53:03.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 client.5520 shutdown 2022-07-05T11:53:03.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307910 msgr2=0x55b39538d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307910 0x55b39538d780 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f740405dac0 tx=0x7f73f4009780).stop 2022-07-05T11:53:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 shutdown_connections 2022-07-05T11:53:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55b395335550 0x55b39538e820 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b395307910 0x55b39538d780 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f73df7fe700 0 client.5520 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b3952c3e20 0x55b3953325e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 --2- 172.21.15.90:0/101841456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b395307530 0x55b395336f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 >> 172.21.15.90:0/101841456 conn(0x55b395132240 msgr2=0x55b3952c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 shutdown_connections 2022-07-05T11:53:03.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 1 -- 172.21.15.90:0/101841456 wait complete. 2022-07-05T11:53:03.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.574+0000 7f741d24ab80 20 client.5520 trim_cache size 0 max 16384 2022-07-05T11:53:03.607 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:53:03.608 INFO:teuthology.orchestra.run.smithi090.stdout: "return_code": 0, 2022-07-05T11:53:03.608 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_tag": "1cabf20c-a61b-407b-98c5-acc3eba111fa", 2022-07-05T11:53:03.608 INFO:teuthology.orchestra.run.smithi090.stdout: "mode": "asynchronous" 2022-07-05T11:53:03.609 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:53:03.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f73e408ba40 msgr2=0x7f73e408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f73e408ba40 0x7f73e408df00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f74040f0630 tx=0x7f73f8009040).stop 2022-07-05T11:53:03.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7404178520 msgr2=0x7f74040c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7404178520 0x7f74040c55c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f73fc00c4c0 tx=0x7f73fc007e00).stop 2022-07-05T11:53:03.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 shutdown_connections 2022-07-05T11:53:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f73e408ba40 0x7f73e408df00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740417dfb0 0x7f74041683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7404178520 0x7f74040c55c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 --2- 172.21.15.90:0/3745017467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f740417c0a0 0x7f7404167ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 >> 172.21.15.90:0/3745017467 conn(0x7f74040f13f0 msgr2=0x7f74040c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 shutdown_connections 2022-07-05T11:53:03.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.575+0000 7f740a65c700 1 -- 172.21.15.90:0/3745017467 wait complete. 2022-07-05T11:53:03.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:53:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.734+0000 7fb5b74ae700 1 Processor -- start 2022-07-05T11:53:03.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.734+0000 7fb5b74ae700 1 -- start start 2022-07-05T11:53:03.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.735+0000 7fb5b74ae700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb5b01720c0 0x7fb5b00edd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.735+0000 7fb5b74ae700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b017cac0 con 0x7fb5b017d660 2022-07-05T11:53:03.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.735+0000 7fb5b74ae700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00c8610 con 0x7fb5b00c7330 2022-07-05T11:53:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.735+0000 7fb5b74ae700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b00c7a90 con 0x7fb5b01720c0 2022-07-05T11:53:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b5a4b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb5b017d660 0x7fb5b0083570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51972/0 (socket says 172.21.15.90:51972) 2022-07-05T11:53:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/3949544584 learned_addr learned my addr 172.21.15.90:0/3949544584 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:53:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3949544584 >> v2:172.21.15.149:3300/0 conn(0x7fb5b01720c0 0x7fb5b00edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038038899 0 0) 0x7fb5b017cac0 con 0x7fb5b017d660 2022-07-05T11:53:03.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5980033f0 con 0x7fb5b017d660 2022-07-05T11:53:03.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3427498440 0 0) 0x7fb5980033f0 con 0x7fb5b017d660 2022-07-05T11:53:03.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 >> v2:172.21.15.149:3300/0 conn(0x7fb5b01720c0 msgr2=0x7fb5b00edd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 --2- 172.21.15.90:0/3949544584 >> v2:172.21.15.149:3300/0 conn(0x7fb5b01720c0 0x7fb5b00edd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 >> v1:172.21.15.149:6789/0 conn(0x7fb5b00c7330 legacy=0x7fb5b017cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00c7d70 con 0x7fb5b017d660 2022-07-05T11:53:03.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fb5a80017f0 con 0x7fb5b017d660 2022-07-05T11:53:03.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 >> v1:172.21.15.90:6789/0 conn(0x7fb5b017d660 legacy=0x7fb5b0083570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb598003930 0x7fb598003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598004690 0x7fb598004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb598005120 0x7fb59800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c7a90 con 0x7fb598003930 2022-07-05T11:53:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59800bf90 con 0x7fb598004690 2022-07-05T11:53:03.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59800c150 con 0x7fb598005120 2022-07-05T11:53:03.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb598003930 0x7fb598003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb598005120 0x7fb59800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598004690 0x7fb598004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b524a700 1 -- 172.21.15.90:0/3949544584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb598005120 msgr2=0x7fb59800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb598005120 0x7fb59800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b524a700 1 -- 172.21.15.90:0/3949544584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598004690 msgr2=0x7fb598004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598004690 0x7fb598004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b524a700 1 -- 172.21.15.90:0/3949544584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980033f0 con 0x7fb598003930 2022-07-05T11:53:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.736+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/3949544584 reap_dead start 2022-07-05T11:53:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598004690 0x7fb598004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:53:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb598003930 0x7fb598003d50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fb5ac00b9d0 tx=0x7fb5ac008040).ready entity=mon.0 client_cookie=5b924e14d640b599 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00b340 con 0x7fb598003930 2022-07-05T11:53:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac013480 con 0x7fb598003930 2022-07-05T11:53:03.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb59ffff700 1 -- 172.21.15.90:0/3949544584 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac013800 con 0x7fb598003930 2022-07-05T11:53:03.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b74ae700 1 -- 172.21.15.90:0/3949544584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb598003930 msgr2=0x7fb598003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb598003930 0x7fb598003d50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fb5ac00b9d0 tx=0x7fb5ac008040).stop 2022-07-05T11:53:03.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b74ae700 1 -- 172.21.15.90:0/3949544584 shutdown_connections 2022-07-05T11:53:03.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/3949544584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb598003930 0x7fb598003d50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b74ae700 1 -- 172.21.15.90:0/3949544584 >> 172.21.15.90:0/3949544584 conn(0x7fb5b005d9a0 msgr2=0x7fb5b005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b74ae700 1 -- 172.21.15.90:0/3949544584 shutdown_connections 2022-07-05T11:53:03.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.737+0000 7fb5b74ae700 1 -- 172.21.15.90:0/3949544584 wait complete. 2022-07-05T11:53:03.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.739+0000 7fb5b74ae700 1 Processor -- start 2022-07-05T11:53:03.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.739+0000 7fb5b74ae700 1 -- start start 2022-07-05T11:53:03.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b74ae700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598003930 0x7fb5b0178890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b74ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b015b9f0 0x7fb5b015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b74ae700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b015c360 0x7fb5b00f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b74ae700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00efff0 con 0x7fb5b015c360 2022-07-05T11:53:03.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b74ae700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015f500 con 0x7fb598003930 2022-07-05T11:53:03.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b74ae700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015f7e0 con 0x7fb5b015b9f0 2022-07-05T11:53:03.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b015c360 0x7fb5b00f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b015c360 0x7fb5b00f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59044/0 (socket says 172.21.15.90:59044) 2022-07-05T11:53:03.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/415399607 learned_addr learned my addr 172.21.15.90:0/415399607 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b015b9f0 0x7fb5b015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b524a700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598003930 0x7fb5b0178890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/415399607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b015b9f0 msgr2=0x7fb5b015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b015b9f0 0x7fb5b015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598003930 msgr2=0x7fb5b0178890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598003930 0x7fb5b0178890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/415399607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00ef9a0 con 0x7fb5b015c360 2022-07-05T11:53:03.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.740+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b015c360 0x7fb5b00f0480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fb5b017e9d0 tx=0x7fb5a8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.741+0000 7fb59d7fa700 1 -- 172.21.15.90:0/415399607 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800e830 con 0x7fb5b015c360 2022-07-05T11:53:03.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.741+0000 7fb59d7fa700 1 -- 172.21.15.90:0/415399607 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a800e9b0 con 0x7fb5b015c360 2022-07-05T11:53:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.741+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00efc80 con 0x7fb5b015c360 2022-07-05T11:53:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.741+0000 7fb59d7fa700 1 -- 172.21.15.90:0/415399607 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800ed70 con 0x7fb5b015c360 2022-07-05T11:53:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.741+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b00f0970 con 0x7fb5b015c360 2022-07-05T11:53:03.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.742+0000 7fb59d7fa700 1 -- 172.21.15.90:0/415399607 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb5a8014640 con 0x7fb5b015c360 2022-07-05T11:53:03.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.743+0000 7fb59d7fa700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb59008ba40 0x7fb59008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.743+0000 7fb59d7fa700 1 -- 172.21.15.90:0/415399607 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb5a80b07e0 con 0x7fb5b015c360 2022-07-05T11:53:03.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.743+0000 7fb5b524a700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb59008ba40 0x7fb59008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.743+0000 7fb5b524a700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb59008ba40 0x7fb59008df00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fb5ac007fd0 tx=0x7fb5ac008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.745+0000 7fb5c8e3ab80 1 Processor -- start 2022-07-05T11:53:03.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.745+0000 7fb5c8e3ab80 1 -- start start 2022-07-05T11:53:03.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641901403c0 0x5641900fc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641900fccb0 0x56419014a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901407a0 0x564190140c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641900c62d0 con 0x5641900fccb0 2022-07-05T11:53:03.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419003daa0 con 0x5641901407a0 2022-07-05T11:53:03.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564190052950 con 0x5641901403c0 2022-07-05T11:53:03.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641900fccb0 0x56419014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641900fccb0 0x56419014a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59050/0 (socket says 172.21.15.90:59050) 2022-07-05T11:53:03.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 -- 172.21.15.90:0/1448984736 learned_addr learned my addr 172.21.15.90:0/1448984736 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b524a700 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641901403c0 0x5641900fc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 -- 172.21.15.90:0/1448984736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641901403c0 msgr2=0x5641900fc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641901403c0 0x5641900fc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901407a0 0x564190140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 -- 172.21.15.90:0/1448984736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901407a0 msgr2=0x564190140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901407a0 0x564190140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 -- 172.21.15.90:0/1448984736 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56418fe849e0 con 0x5641900fccb0 2022-07-05T11:53:03.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641900fccb0 0x56419014a990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb5a0003630 tx=0x7fb5a0009040).ready entity=mon.0 client_cookie=e65530fb2cb457f4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5967fc700 1 -- 172.21.15.90:0/1448984736 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0003280 con 0x5641900fccb0 2022-07-05T11:53:03.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5967fc700 1 -- 172.21.15.90:0/1448984736 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a000d070 con 0x5641900fccb0 2022-07-05T11:53:03.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.746+0000 7fb5967fc700 1 -- 172.21.15.90:0/1448984736 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0012850 con 0x5641900fccb0 2022-07-05T11:53:03.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1448984736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641900fccb0 msgr2=0x56419014a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641900fccb0 0x56419014a990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb5a0003630 tx=0x7fb5a0009040).stop 2022-07-05T11:53:03.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1448984736 shutdown_connections 2022-07-05T11:53:03.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901407a0 0x564190140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641901403c0 0x5641900fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1448984736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641900fccb0 0x56419014a990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1448984736 >> 172.21.15.90:0/1448984736 conn(0x56418ff6b1c0 msgr2=0x5641900ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1448984736 shutdown_connections 2022-07-05T11:53:03.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.747+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1448984736 wait complete. 2022-07-05T11:53:03.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.748+0000 7fb5c8e3ab80 1 -- start start 2022-07-05T11:53:03.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.748+0000 7fb5c8e3ab80 1 Processor -- start 2022-07-05T11:53:03.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641901805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190182470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901407a0 0x56419013eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419001a120 con 0x5641901407a0 2022-07-05T11:53:03.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641901812a0 con 0x5641901403c0 2022-07-05T11:53:03.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564190180140 con 0x5641900fccb0 2022-07-05T11:53:03.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5c8e3ab80 10 client.0 ll_register_callbacks cb 0x5641900c01b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901407a0 0x56419013eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901407a0 0x56419013eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59058/0 (socket says 172.21.15.90:59058) 2022-07-05T11:53:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/3268121180 learned_addr learned my addr 172.21.15.90:0/3268121180 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641901805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190182470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 msgr2=0x5641901805d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641901805d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/3268121180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 msgr2=0x564190182470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190182470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/3268121180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b00c8610 con 0x5641901407a0 2022-07-05T11:53:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901407a0 0x56419013eb90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fb5a8084db0 tx=0x7fb5a80b0040).ready entity=mon.0 client_cookie=c8a50801f2d0b4e1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.749+0000 7fb58b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb58b7fe700 1 -- 172.21.15.90:0/3268121180 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8084610 con 0x5641901407a0 2022-07-05T11:53:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb58b7fe700 1 -- 172.21.15.90:0/3268121180 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb5a8084770 con 0x5641901407a0 2022-07-05T11:53:03.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641900fa440 con 0x5641901407a0 2022-07-05T11:53:03.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb58b7fe700 1 -- 172.21.15.90:0/3268121180 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5a808a780 con 0x5641901407a0 2022-07-05T11:53:03.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 10 client.5532 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:03.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56418fef3cd0 con 0x5641901407a0 2022-07-05T11:53:03.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb58b7fe700 1 -- 172.21.15.90:0/3268121180 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641900fa440 con 0x5641901407a0 2022-07-05T11:53:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb58b7fe700 1 -- 172.21.15.90:0/3268121180 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fb5a8080f10 con 0x5641901407a0 2022-07-05T11:53:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 10 client.5532 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 10 client.5532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 20 client.5532 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56419013e330 0x564190134e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 4 client.5532 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:53:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641900487f0 con 0x56419013e330 2022-07-05T11:53:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.750+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56419013e330 0x564190134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.751+0000 7fb58b7fe700 10 client.5532 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.751+0000 7fb5b524a700 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56419013e330 0x564190134e70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=50d5107be507915b server_cookie=5660f93897915308 in_seq=0 out_seq=0 2022-07-05T11:53:03.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.756+0000 7fb58b7fe700 1 -- 172.21.15.90:0/3268121180 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5641900487f0 con 0x56419013e330 2022-07-05T11:53:03.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.756+0000 7fb58b7fe700 10 client.5532 handle_command_reply: tid=0 2022-07-05T11:53:03.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.756+0000 7fb5c8e3ab80 1 client.5532 shutdown 2022-07-05T11:53:03.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901407a0 msgr2=0x56419013eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901407a0 0x56419013eb90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fb5a8084db0 tx=0x7fb5a80b0040).stop 2022-07-05T11:53:03.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 shutdown_connections 2022-07-05T11:53:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56419013e330 0x564190134e70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901407a0 0x56419013eb90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641901805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb58b7fe700 0 client.5532 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/3268121180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190182470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 >> 172.21.15.90:0/3268121180 conn(0x56418ff6b1c0 msgr2=0x56419016d150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 shutdown_connections 2022-07-05T11:53:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/3268121180 wait complete. 2022-07-05T11:53:03.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.757+0000 7fb5c8e3ab80 20 client.5532 trim_cache size 0 max 16384 2022-07-05T11:53:03.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.772+0000 7fb5c8e3ab80 1 Processor -- start 2022-07-05T11:53:03.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.773+0000 7fb5c8e3ab80 1 -- start start 2022-07-05T11:53:03.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.773+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641900fc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56419013e330 0x564190148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419013fde0 con 0x56419013e330 2022-07-05T11:53:03.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564190168bb0 con 0x5641901403c0 2022-07-05T11:53:03.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419013fa90 con 0x5641900fccb0 2022-07-05T11:53:03.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56419013e330 0x564190148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56419013e330 0x564190148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59066/0 (socket says 172.21.15.90:59066) 2022-07-05T11:53:03.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 -- 172.21.15.90:0/255654318 learned_addr learned my addr 172.21.15.90:0/255654318 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b524a700 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641900fc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 -- 172.21.15.90:0/255654318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 msgr2=0x5641900fc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641900fc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 -- 172.21.15.90:0/255654318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 msgr2=0x564190148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 -- 172.21.15.90:0/255654318 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56418fec1fd0 con 0x56419013e330 2022-07-05T11:53:03.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b524a700 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641900fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:53:03.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:03.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56419013e330 0x564190148ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb5a000a000 tx=0x56419014b840).ready entity=mon.0 client_cookie=b73b42504a1325e9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb596ffd700 1 -- 172.21.15.90:0/255654318 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0000c90 con 0x56419013e330 2022-07-05T11:53:03.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb596ffd700 1 -- 172.21.15.90:0/255654318 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0012c80 con 0x56419013e330 2022-07-05T11:53:03.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.774+0000 7fb596ffd700 1 -- 172.21.15.90:0/255654318 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0012df0 con 0x56419013e330 2022-07-05T11:53:03.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/255654318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56419013e330 msgr2=0x564190148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56419013e330 0x564190148ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb5a000a000 tx=0x56419014b840).stop 2022-07-05T11:53:03.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/255654318 shutdown_connections 2022-07-05T11:53:03.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641901403c0 0x564190148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5641900fccb0 0x5641900fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/255654318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56419013e330 0x564190148ab0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/255654318 >> 172.21.15.90:0/255654318 conn(0x56418ff6b1c0 msgr2=0x5641900fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/255654318 shutdown_connections 2022-07-05T11:53:03.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/255654318 wait complete. 2022-07-05T11:53:03.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.775+0000 7fb5c8e3ab80 1 -- start start 2022-07-05T11:53:03.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.776+0000 7fb5c8e3ab80 1 Processor -- start 2022-07-05T11:53:03.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641900fccb0 0x5641900ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56419013e330 0x5641901ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901403c0 0x56419013c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641901480b0 con 0x5641901403c0 2022-07-05T11:53:03.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641901d9680 con 0x5641900fccb0 2022-07-05T11:53:03.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641901dcb00 con 0x56419013e330 2022-07-05T11:53:03.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 10 client.0 ll_register_callbacks cb 0x5641900c01b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:03.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901403c0 0x56419013c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b524a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641900fccb0 0x5641900ffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b524a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641900fccb0 0x5641900ffc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35388/0 (socket says 172.21.15.90:35388) 2022-07-05T11:53:03.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901403c0 0x56419013c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59072/0 (socket says 172.21.15.90:59072) 2022-07-05T11:53:03.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b524a700 1 -- 172.21.15.90:0/1646880014 learned_addr learned my addr 172.21.15.90:0/1646880014 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:03.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b4a49700 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56419013e330 0x5641901ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56419013e330 msgr2=0x5641901ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56419013e330 0x5641901ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/1646880014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641900fccb0 msgr2=0x5641900ffc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:03.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641900fccb0 0x5641900ffc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 -- 172.21.15.90:0/1646880014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56418fef3cd0 con 0x5641901403c0 2022-07-05T11:53:03.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b524a700 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641900fccb0 0x5641900ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:03.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5b5a4b700 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901403c0 0x56419013c240 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fb5a8084e20 tx=0x7fb5a8053000).ready entity=mon.0 client_cookie=d09b7796db263d1e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:03.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb58b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:03.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb58b7fe700 1 -- 172.21.15.90:0/1646880014 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8081460 con 0x5641901403c0 2022-07-05T11:53:03.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5a000d070 con 0x5641901403c0 2022-07-05T11:53:03.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.777+0000 7fb58b7fe700 1 -- 172.21.15.90:0/1646880014 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb5a808aa00 con 0x5641901403c0 2022-07-05T11:53:03.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb58b7fe700 1 -- 172.21.15.90:0/1646880014 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5a8084610 con 0x5641901403c0 2022-07-05T11:53:03.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 10 client.5538 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:03.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56418fe849e0 con 0x5641901403c0 2022-07-05T11:53:03.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb58b7fe700 1 -- 172.21.15.90:0/1646880014 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a000d070 con 0x5641901403c0 2022-07-05T11:53:03.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb58b7fe700 1 -- 172.21.15.90:0/1646880014 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fb5a8097070 con 0x5641901403c0 2022-07-05T11:53:03.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 10 client.5538 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:03.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 10 client.5538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:03.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 20 client.5538 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:03.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5641901407a0 0x5641901c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:03.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 4 client.5538 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:53:03.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56419003f690 con 0x5641901407a0 2022-07-05T11:53:03.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5b524a700 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5641901407a0 0x5641901c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:03.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb58b7fe700 10 client.5538 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.778+0000 7fb5b524a700 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5641901407a0 0x5641901c22c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=93271e2d0dc2227e server_cookie=79bcbec846318493 in_seq=0 out_seq=0 2022-07-05T11:53:03.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb58b7fe700 1 -- 172.21.15.90:0/1646880014 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x56419003f690 con 0x5641901407a0 2022-07-05T11:53:03.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb58b7fe700 10 client.5538 handle_command_reply: tid=0 2022-07-05T11:53:03.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb5c8e3ab80 1 client.5538 shutdown 2022-07-05T11:53:03.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901403c0 msgr2=0x56419013c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901403c0 0x56419013c240 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fb5a8084e20 tx=0x7fb5a8053000).stop 2022-07-05T11:53:03.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 shutdown_connections 2022-07-05T11:53:03.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5641901407a0 0x5641901c22c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.783+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641901403c0 0x56419013c240 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb58b7fe700 0 client.5538 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:03.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641900fccb0 0x5641900ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5c8e3ab80 1 --2- 172.21.15.90:0/1646880014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56419013e330 0x5641901ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 >> 172.21.15.90:0/1646880014 conn(0x56418ff6b1c0 msgr2=0x5641900f6750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 shutdown_connections 2022-07-05T11:53:03.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5c8e3ab80 1 -- 172.21.15.90:0/1646880014 wait complete. 2022-07-05T11:53:03.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5c8e3ab80 20 client.5538 trim_cache size 0 max 16384 2022-07-05T11:53:03.837 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:53:03.838 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "scrub active (8548 inodes in the stack)", 2022-07-05T11:53:03.838 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:53:03.838 INFO:teuthology.orchestra.run.smithi090.stdout: "1cabf20c-a61b-407b-98c5-acc3eba111fa": { 2022-07-05T11:53:03.838 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:53:03.839 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "1cabf20c-a61b-407b-98c5-acc3eba111fa", 2022-07-05T11:53:03.839 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:53:03.839 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:53:03.839 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:53:03.840 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:53:03.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb59008ba40 msgr2=0x7fb59008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb59008ba40 0x7fb59008df00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fb5ac007fd0 tx=0x7fb5ac008040).stop 2022-07-05T11:53:03.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b015c360 msgr2=0x7fb5b00f0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:03.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b015c360 0x7fb5b00f0480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fb5b017e9d0 tx=0x7fb5a8007dd0).stop 2022-07-05T11:53:03.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 shutdown_connections 2022-07-05T11:53:03.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb59008ba40 0x7fb59008df00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b015c360 0x7fb5b00f0480 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb598003930 0x7fb5b0178890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 --2- 172.21.15.90:0/415399607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b015b9f0 0x7fb5b015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:03.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 >> 172.21.15.90:0/415399607 conn(0x7fb5b005d9a0 msgr2=0x7fb5b00ed3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:03.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 shutdown_connections 2022-07-05T11:53:03.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:03.784+0000 7fb5b74ae700 1 -- 172.21.15.90:0/415399607 wait complete. 2022-07-05T11:53:03.845 INFO:tasks.cephfs.filesystem:scrub status for tag:1cabf20c-a61b-407b-98c5-acc3eba111fa - {'path': '/', 'tag': '1cabf20c-a61b-407b-98c5-acc3eba111fa', 'options': 'recursive,force'} 2022-07-05T11:53:33.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:53:33.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.965+0000 7f094596b700 1 Processor -- start 2022-07-05T11:53:33.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.965+0000 7f094596b700 1 -- start start 2022-07-05T11:53:33.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f094596b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f094017a540 0x7f0940083570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:33.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f094596b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0940083a60 0x7f0940083ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:33.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f094596b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0940085390 con 0x7f0940172b80 2022-07-05T11:53:33.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f094596b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0940172f60 con 0x7f0940083a60 2022-07-05T11:53:33.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f094596b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09400844a0 con 0x7f094017a540 2022-07-05T11:53:33.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0940083a60 0x7f0940083ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:33.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0940083a60 0x7f0940083ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59080/0 (socket says 172.21.15.90:59080) 2022-07-05T11:53:33.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 -- 172.21.15.90:0/2490502254 learned_addr learned my addr 172.21.15.90:0/2490502254 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:33.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093e7fc700 1 --2- 172.21.15.90:0/2490502254 >> v2:172.21.15.110:3300/0 conn(0x7f094017a540 0x7f0940083570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 -- 172.21.15.90:0/2490502254 >> v2:172.21.15.110:3300/0 conn(0x7f094017a540 msgr2=0x7f0940083570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 --2- 172.21.15.90:0/2490502254 >> v2:172.21.15.110:3300/0 conn(0x7f094017a540 0x7f0940083570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 -- 172.21.15.90:0/2490502254 >> v1:172.21.15.149:6789/0 conn(0x7f0940172b80 legacy=0x7f0940179e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 -- 172.21.15.90:0/2490502254 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940084780 con 0x7f0940083a60 2022-07-05T11:53:34.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093f7fe700 1 --2- 172.21.15.90:0/2490502254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940083a60 0x7f0940083ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f09400873f0 tx=0x7f0938009840).ready entity=mon.0 client_cookie=6639fe0939c3bab4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:34.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093dffb700 1 -- 172.21.15.90:0/2490502254 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800e070 con 0x7f0940083a60 2022-07-05T11:53:34.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093dffb700 1 -- 172.21.15.90:0/2490502254 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800ba50 con 0x7f0940083a60 2022-07-05T11:53:34.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.966+0000 7f093dffb700 1 -- 172.21.15.90:0/2490502254 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800bdd0 con 0x7f0940083a60 2022-07-05T11:53:34.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 -- 172.21.15.90:0/2490502254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940083a60 msgr2=0x7f0940083ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 --2- 172.21.15.90:0/2490502254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940083a60 0x7f0940083ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f09400873f0 tx=0x7f0938009840).stop 2022-07-05T11:53:34.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 -- 172.21.15.90:0/2490502254 shutdown_connections 2022-07-05T11:53:34.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 --2- 172.21.15.90:0/2490502254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940083a60 0x7f0940083ef0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 --2- 172.21.15.90:0/2490502254 >> v2:172.21.15.110:3300/0 conn(0x7f094017a540 0x7f0940083570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 -- 172.21.15.90:0/2490502254 >> 172.21.15.90:0/2490502254 conn(0x7f09400ef260 msgr2=0x7f09400ef670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:34.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 -- 172.21.15.90:0/2490502254 shutdown_connections 2022-07-05T11:53:34.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.967+0000 7f094596b700 1 -- 172.21.15.90:0/2490502254 wait complete. 2022-07-05T11:53:34.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.969+0000 7f094596b700 1 Processor -- start 2022-07-05T11:53:34.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.969+0000 7f094596b700 1 -- start start 2022-07-05T11:53:34.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f094596b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940083a60 0x7f0940171b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f094596b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940172b80 0x7f09400ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f094596b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f094017a540 0x7f09400ec210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f094596b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400ca850 con 0x7f0940172b80 2022-07-05T11:53:34.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f094596b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940190200 con 0x7f0940083a60 2022-07-05T11:53:34.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f094596b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400ec700 con 0x7f094017a540 2022-07-05T11:53:34.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940172b80 0x7f09400ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940172b80 0x7f09400ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59086/0 (socket says 172.21.15.90:59086) 2022-07-05T11:53:34.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 -- 172.21.15.90:0/4086639725 learned_addr learned my addr 172.21.15.90:0/4086639725 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:34.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093effd700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940083a60 0x7f0940171b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093f7fe700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f094017a540 0x7f09400ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 -- 172.21.15.90:0/4086639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f094017a540 msgr2=0x7f09400ec210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f094017a540 0x7f09400ec210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 -- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940083a60 msgr2=0x7f0940171b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940083a60 0x7f0940171b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 -- 172.21.15.90:0/4086639725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938009ae0 con 0x7f0940172b80 2022-07-05T11:53:34.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.971+0000 7f093e7fc700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940172b80 0x7f09400ca360 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f093400d8c0 tx=0x7f0934008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.972+0000 7f0926ffd700 1 -- 172.21.15.90:0/4086639725 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934011590 con 0x7f0940172b80 2022-07-05T11:53:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.972+0000 7f0926ffd700 1 -- 172.21.15.90:0/4086639725 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09340116f0 con 0x7f0940172b80 2022-07-05T11:53:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.972+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0940190690 con 0x7f0940172b80 2022-07-05T11:53:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.972+0000 7f0926ffd700 1 -- 172.21.15.90:0/4086639725 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934011a70 con 0x7f0940172b80 2022-07-05T11:53:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.972+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09400c7ac0 con 0x7f0940172b80 2022-07-05T11:53:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.973+0000 7f0926ffd700 1 -- 172.21.15.90:0/4086639725 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f093401c460 con 0x7f0940172b80 2022-07-05T11:53:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.974+0000 7f0926ffd700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f092008ba40 0x7f092008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.974+0000 7f0926ffd700 1 -- 172.21.15.90:0/4086639725 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f09340b07c0 con 0x7f0940172b80 2022-07-05T11:53:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.975+0000 7f09572f7b80 1 Processor -- start 2022-07-05T11:53:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.976+0000 7f09572f7b80 1 -- start start 2022-07-05T11:53:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.976+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869c2d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.976+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bffc60 0x558869c2b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c000e0 0x558869bfedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f09572f7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869b842d0 con 0x558869bffc60 2022-07-05T11:53:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f09572f7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869afbaa0 con 0x558869bfe9e0 2022-07-05T11:53:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f09572f7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869b10950 con 0x558869c000e0 2022-07-05T11:53:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bffc60 0x558869c2b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bffc60 0x558869c2b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59092/0 (socket says 172.21.15.90:59092) 2022-07-05T11:53:34.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 -- 172.21.15.90:0/4062198270 learned_addr learned my addr 172.21.15.90:0/4062198270 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:34.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093f7fe700 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c000e0 0x558869bfedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093effd700 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869c2d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 -- 172.21.15.90:0/4062198270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c000e0 msgr2=0x558869bfedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c000e0 0x558869bfedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 -- 172.21.15.90:0/4062198270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 msgr2=0x558869c2d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869c2d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 -- 172.21.15.90:0/4062198270 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588699429e0 con 0x558869bffc60 2022-07-05T11:53:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093f7fe700 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c000e0 0x558869bfedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f093e7fc700 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bffc60 0x558869c2b290 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f0934084d40 tx=0x7f0934084d70).ready entity=mon.0 client_cookie=beb83ded68f53ff9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f091bfff700 1 -- 172.21.15.90:0/4062198270 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934085100 con 0x558869bffc60 2022-07-05T11:53:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f091bfff700 1 -- 172.21.15.90:0/4062198270 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093408a9e0 con 0x558869bffc60 2022-07-05T11:53:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.977+0000 7f091bfff700 1 -- 172.21.15.90:0/4062198270 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340834a0 con 0x558869bffc60 2022-07-05T11:53:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 -- 172.21.15.90:0/4062198270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bffc60 msgr2=0x558869c2b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bffc60 0x558869c2b290 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f0934084d40 tx=0x7f0934084d70).stop 2022-07-05T11:53:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 -- 172.21.15.90:0/4062198270 shutdown_connections 2022-07-05T11:53:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c000e0 0x558869bfedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869c2d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 --2- 172.21.15.90:0/4062198270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bffc60 0x558869c2b290 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 -- 172.21.15.90:0/4062198270 >> 172.21.15.90:0/4062198270 conn(0x558869a291c0 msgr2=0x558869bbdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 -- 172.21.15.90:0/4062198270 shutdown_connections 2022-07-05T11:53:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.978+0000 7f09572f7b80 1 -- 172.21.15.90:0/4062198270 wait complete. 2022-07-05T11:53:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.979+0000 7f09572f7b80 1 -- start start 2022-07-05T11:53:34.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.979+0000 7f09572f7b80 1 Processor -- start 2022-07-05T11:53:34.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869bfd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bffc60 0x558869bfcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bfa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09572f7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869ad8120 con 0x558869c413b0 2022-07-05T11:53:34.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09572f7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869c40cc0 con 0x558869bfe9e0 2022-07-05T11:53:34.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09572f7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869c40f60 con 0x558869bffc60 2022-07-05T11:53:34.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09572f7b80 10 client.0 ll_register_callbacks cb 0x558869b7e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:34.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bfa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bffc60 0x558869bfcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bfa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59100/0 (socket says 172.21.15.90:59100) 2022-07-05T11:53:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093f7fe700 1 -- 172.21.15.90:0/3341898402 learned_addr learned my addr 172.21.15.90:0/3341898402 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093effd700 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869bfd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093e7fc700 1 -- 172.21.15.90:0/3341898402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 msgr2=0x558869bfd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093e7fc700 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869bfd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093e7fc700 1 -- 172.21.15.90:0/3341898402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 msgr2=0x558869bfa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093e7fc700 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bfa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093e7fc700 1 -- 172.21.15.90:0/3341898402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0940084780 con 0x558869bffc60 2022-07-05T11:53:34.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093f7fe700 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bfa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:34.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f093e7fc700 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bffc60 0x558869bfcb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0934085090 tx=0x7f0934084d70).ready entity=mon.2 client_cookie=7b813e56d65811 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:34.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.980+0000 7f09197fa700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2022-07-05T11:53:34.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09197fa700 1 -- 172.21.15.90:0/3341898402 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340834a0 con 0x558869bffc60 2022-07-05T11:53:34.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558869bb8690 con 0x558869bffc60 2022-07-05T11:53:34.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09197fa700 1 -- 172.21.15.90:0/3341898402 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f09340845f0 con 0x558869bffc60 2022-07-05T11:53:34.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09197fa700 1 -- 172.21.15.90:0/3341898402 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f093408a550 con 0x558869bffc60 2022-07-05T11:53:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 10 client.5231 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7f09400c7ac0 con 0x558869bffc60 2022-07-05T11:53:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09197fa700 1 -- 172.21.15.90:0/3341898402 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558869bb8690 con 0x558869bffc60 2022-07-05T11:53:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09197fa700 1 -- 172.21.15.90:0/3341898402 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f0934080ef0 con 0x558869bffc60 2022-07-05T11:53:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 10 client.5231 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 10 client.5231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:34.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 20 client.5231 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:34.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869c2d050 0x558869c2d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 4 client.5231 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:53:34.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558869b067f0 con 0x558869c2d050 2022-07-05T11:53:34.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.981+0000 7f093effd700 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869c2d050 0x558869c2d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09197fa700 10 client.5231 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:34.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f093effd700 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869c2d050 0x558869c2d460 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5c862465e3681cfd server_cookie=a0475d63d96d9adb in_seq=0 out_seq=0 2022-07-05T11:53:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09197fa700 1 -- 172.21.15.90:0/3341898402 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x558869b067f0 con 0x558869c2d050 2022-07-05T11:53:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09197fa700 10 client.5231 handle_command_reply: tid=0 2022-07-05T11:53:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 client.5231 shutdown 2022-07-05T11:53:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bffc60 msgr2=0x558869bfcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bffc60 0x558869bfcb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0934085090 tx=0x7f0934084d70).stop 2022-07-05T11:53:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 shutdown_connections 2022-07-05T11:53:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869c2d050 0x558869c2d460 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bfa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09197fa700 0 client.5231 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:34.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bfe9e0 0x558869bfd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 --2- 172.21.15.90:0/3341898402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bffc60 0x558869bfcb40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 >> 172.21.15.90:0/3341898402 conn(0x558869a291c0 msgr2=0x558869bc5670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:34.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 shutdown_connections 2022-07-05T11:53:34.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.982+0000 7f09572f7b80 1 -- 172.21.15.90:0/3341898402 wait complete. 2022-07-05T11:53:34.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.983+0000 7f09572f7b80 20 client.5231 trim_cache size 0 max 16384 2022-07-05T11:53:34.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.998+0000 7f09572f7b80 1 Processor -- start 2022-07-05T11:53:34.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.998+0000 7f09572f7b80 1 -- start start 2022-07-05T11:53:34.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bfe9e0 0x558869bfb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bc41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f09572f7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869c44d90 con 0x558869c413b0 2022-07-05T11:53:34.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f09572f7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869c2b880 con 0x558869bffc60 2022-07-05T11:53:34.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f09572f7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869c02a50 con 0x558869bfe9e0 2022-07-05T11:53:34.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bc41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bc41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59108/0 (socket says 172.21.15.90:59108) 2022-07-05T11:53:34.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 -- 172.21.15.90:0/590699807 learned_addr learned my addr 172.21.15.90:0/590699807 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:34.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093e7fc700 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093effd700 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bfe9e0 0x558869bfb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 -- 172.21.15.90:0/590699807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bfe9e0 msgr2=0x558869bfb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bfe9e0 0x558869bfb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 -- 172.21.15.90:0/590699807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 msgr2=0x558869bfa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 -- 172.21.15.90:0/590699807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588699b1cd0 con 0x558869c413b0 2022-07-05T11:53:34.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f093f7fe700 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bc41e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f09380137f0 tx=0x7f0938009840).ready entity=mon.0 client_cookie=547e156371657687 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:34.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:33.999+0000 7f0924ff9700 1 -- 172.21.15.90:0/590699807 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938024070 con 0x558869c413b0 2022-07-05T11:53:34.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f0924ff9700 1 -- 172.21.15.90:0/590699807 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09380093c0 con 0x558869c413b0 2022-07-05T11:53:34.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f0924ff9700 1 -- 172.21.15.90:0/590699807 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938013b00 con 0x558869c413b0 2022-07-05T11:53:34.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 -- 172.21.15.90:0/590699807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 msgr2=0x558869bc41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bc41e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f09380137f0 tx=0x7f0938009840).stop 2022-07-05T11:53:34.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 -- 172.21.15.90:0/590699807 shutdown_connections 2022-07-05T11:53:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869c413b0 0x558869bc41e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869bfe9e0 0x558869bfb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 --2- 172.21.15.90:0/590699807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 -- 172.21.15.90:0/590699807 >> 172.21.15.90:0/590699807 conn(0x558869a291c0 msgr2=0x558869bfc900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:34.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 -- 172.21.15.90:0/590699807 shutdown_connections 2022-07-05T11:53:34.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.000+0000 7f09572f7b80 1 -- 172.21.15.90:0/590699807 wait complete. 2022-07-05T11:53:34.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.001+0000 7f09572f7b80 1 -- start start 2022-07-05T11:53:34.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.001+0000 7f09572f7b80 1 Processor -- start 2022-07-05T11:53:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bfe9e0 0x558869c9a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f09572f7b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c413b0 0x558869c30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f09572f7b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869c31650 con 0x558869bfe9e0 2022-07-05T11:53:34.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f09572f7b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869c96d80 con 0x558869bffc60 2022-07-05T11:53:34.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f09572f7b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558869bfc380 con 0x558869c413b0 2022-07-05T11:53:34.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f09572f7b80 10 client.0 ll_register_callbacks cb 0x558869b7e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.002+0000 7f093effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bfe9e0 0x558869c9a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bfe9e0 0x558869c9a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59110/0 (socket says 172.21.15.90:59110) 2022-07-05T11:53:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 -- 172.21.15.90:0/977420771 learned_addr learned my addr 172.21.15.90:0/977420771 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093f7fe700 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c413b0 0x558869c30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093e7fc700 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 -- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c413b0 msgr2=0x558869c30980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c413b0 0x558869c30980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 -- 172.21.15.90:0/977420771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 msgr2=0x558869bfbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:34.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 -- 172.21.15.90:0/977420771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0938013630 con 0x558869bfe9e0 2022-07-05T11:53:34.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f093effd700 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bfe9e0 0x558869c9a310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x558869c445c0 tx=0x7f0930018040).ready entity=mon.0 client_cookie=843776d819db359a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:34.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09197fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:34.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09197fa700 1 -- 172.21.15.90:0/977420771 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930016be0 con 0x558869bfe9e0 2022-07-05T11:53:34.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09197fa700 1 -- 172.21.15.90:0/977420771 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f0930016d40 con 0x558869bfe9e0 2022-07-05T11:53:34.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f093408a9e0 con 0x558869bfe9e0 2022-07-05T11:53:34.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09197fa700 1 -- 172.21.15.90:0/977420771 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f093001f680 con 0x558869bfe9e0 2022-07-05T11:53:34.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09572f7b80 10 client.5556 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:34.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55886997ffd0 con 0x558869bfe9e0 2022-07-05T11:53:34.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09197fa700 1 -- 172.21.15.90:0/977420771 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093408a9e0 con 0x558869bfe9e0 2022-07-05T11:53:34.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.003+0000 7f09197fa700 1 -- 172.21.15.90:0/977420771 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f093001e3d0 con 0x558869bfe9e0 2022-07-05T11:53:34.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 10 client.5556 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:34.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 10 client.5556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:34.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 20 client.5556 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:34.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869bb47e0 0x558869c82ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:34.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 4 client.5556 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:53:34.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558869afd690 con 0x558869bb47e0 2022-07-05T11:53:34.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f093e7fc700 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869bb47e0 0x558869c82ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:34.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09197fa700 10 client.5556 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:34.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f093e7fc700 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869bb47e0 0x558869c82ab0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=aa1e3cb1a5cf1b7f server_cookie=dd57bb3a602e81f1 in_seq=0 out_seq=0 2022-07-05T11:53:34.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09197fa700 1 -- 172.21.15.90:0/977420771 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558869afd690 con 0x558869bb47e0 2022-07-05T11:53:34.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09197fa700 10 client.5556 handle_command_reply: tid=0 2022-07-05T11:53:34.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 client.5556 shutdown 2022-07-05T11:53:34.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bfe9e0 msgr2=0x558869c9a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bfe9e0 0x558869c9a310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x558869c445c0 tx=0x7f0930018040).stop 2022-07-05T11:53:34.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 shutdown_connections 2022-07-05T11:53:34.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558869bb47e0 0x558869c82ab0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558869c413b0 0x558869c30980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09197fa700 0 client.5556 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558869bfe9e0 0x558869c9a310 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 --2- 172.21.15.90:0/977420771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558869bffc60 0x558869bfbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 >> 172.21.15.90:0/977420771 conn(0x558869a291c0 msgr2=0x558869bfb780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:34.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 shutdown_connections 2022-07-05T11:53:34.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.004+0000 7f09572f7b80 1 -- 172.21.15.90:0/977420771 wait complete. 2022-07-05T11:53:34.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f09572f7b80 20 client.5556 trim_cache size 0 max 16384 2022-07-05T11:53:34.112 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:53:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "no active scrubs running", 2022-07-05T11:53:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": {} 2022-07-05T11:53:34.114 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:53:34.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f092008ba40 msgr2=0x7f092008df00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-07-05T11:53:34.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f092008ba40 0x7f092008df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:34.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940172b80 msgr2=0x7f09400ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:34.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940172b80 0x7f09400ca360 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f093400d8c0 tx=0x7f0934008040).stop 2022-07-05T11:53:34.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 shutdown_connections 2022-07-05T11:53:34.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f092008ba40 0x7f092008df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:34.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f094017a540 0x7f09400ec210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940083a60 0x7f0940171b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 --2- 172.21.15.90:0/4086639725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0940172b80 0x7f09400ca360 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:34.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 >> 172.21.15.90:0/4086639725 conn(0x7f09400ef260 msgr2=0x7f0940179d30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:34.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 shutdown_connections 2022-07-05T11:53:34.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:34.005+0000 7f094596b700 1 -- 172.21.15.90:0/4086639725 wait complete. 2022-07-05T11:53:34.125 INFO:tasks.cephfs.filesystem:all active scrubs completed 2022-07-05T11:53:35.125 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2022-07-05T11:53:35.126 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2022-07-05T11:53:35.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.267+0000 7fa301913700 1 Processor -- start 2022-07-05T11:53:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.267+0000 7fa301913700 1 -- start start 2022-07-05T11:53:35.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa301913700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa2fc0c78f0 0x7fa2fc1785c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa301913700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2fc178ab0 0x7fa2fc1812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa301913700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2fc17a160 con 0x7fa2fc1713c0 2022-07-05T11:53:35.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa301913700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2fc179270 con 0x7fa2fc178ab0 2022-07-05T11:53:35.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa301913700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2fc179550 con 0x7fa2fc0c78f0 2022-07-05T11:53:35.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa2fbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa2fc0c78f0 0x7fa2fc1785c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa301112700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2fc178ab0 0x7fa2fc1812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa300911700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa2fc1713c0 0x7fa2fc0c71e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:48300/0 (socket says 172.21.15.90:48300) 2022-07-05T11:53:35.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa301112700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2fc178ab0 0x7fa2fc1812a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35442/0 (socket says 172.21.15.90:35442) 2022-07-05T11:53:35.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa2fbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa2fc0c78f0 0x7fa2fc1785c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40516/0 (socket says 172.21.15.90:40516) 2022-07-05T11:53:35.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.268+0000 7fa300911700 1 -- 172.21.15.90:0/1604397547 learned_addr learned my addr 172.21.15.90:0/1604397547 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:53:35.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa301112700 1 -- 172.21.15.90:0/1604397547 >> v2:172.21.15.149:3300/0 conn(0x7fa2fc0c78f0 msgr2=0x7fa2fc1785c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa301112700 1 --2- 172.21.15.90:0/1604397547 >> v2:172.21.15.149:3300/0 conn(0x7fa2fc0c78f0 0x7fa2fc1785c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa301112700 1 -- 172.21.15.90:0/1604397547 >> v1:172.21.15.149:6789/0 conn(0x7fa2fc1713c0 legacy=0x7fa2fc0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa301112700 1 -- 172.21.15.90:0/1604397547 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc179830 con 0x7fa2fc178ab0 2022-07-05T11:53:35.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa2fbfff700 1 --2- 172.21.15.90:0/1604397547 >> v2:172.21.15.149:3300/0 conn(0x7fa2fc0c78f0 0x7fa2fc1785c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:35.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa301112700 1 --2- 172.21.15.90:0/1604397547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc1812a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fa2fc153710 tx=0x7fa2f4009780).ready entity=mon.1 client_cookie=2b465a7c02a44b88 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa2fb7fe700 1 -- 172.21.15.90:0/1604397547 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400e070 con 0x7fa2fc178ab0 2022-07-05T11:53:35.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa2fb7fe700 1 -- 172.21.15.90:0/1604397547 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f400bb20 con 0x7fa2fc178ab0 2022-07-05T11:53:35.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.269+0000 7fa2fb7fe700 1 -- 172.21.15.90:0/1604397547 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400bea0 con 0x7fa2fc178ab0 2022-07-05T11:53:35.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 -- 172.21.15.90:0/1604397547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc178ab0 msgr2=0x7fa2fc1812a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 --2- 172.21.15.90:0/1604397547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc1812a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fa2fc153710 tx=0x7fa2f4009780).stop 2022-07-05T11:53:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 -- 172.21.15.90:0/1604397547 shutdown_connections 2022-07-05T11:53:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 --2- 172.21.15.90:0/1604397547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc1812a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 --2- 172.21.15.90:0/1604397547 >> v2:172.21.15.149:3300/0 conn(0x7fa2fc0c78f0 0x7fa2fc1785c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 -- 172.21.15.90:0/1604397547 >> 172.21.15.90:0/1604397547 conn(0x7fa2fc0ee320 msgr2=0x7fa2fc083570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 -- 172.21.15.90:0/1604397547 shutdown_connections 2022-07-05T11:53:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.270+0000 7fa301913700 1 -- 172.21.15.90:0/1604397547 wait complete. 2022-07-05T11:53:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.272+0000 7fa301913700 1 Processor -- start 2022-07-05T11:53:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.272+0000 7fa301913700 1 -- start start 2022-07-05T11:53:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.273+0000 7fa301913700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2fc0c78f0 0x7fa2fc0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301913700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc1713c0 0x7fa2fc17d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301913700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301913700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc0c3750 con 0x7fa2fc178ab0 2022-07-05T11:53:35.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301913700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc17cfc0 con 0x7fa2fc1713c0 2022-07-05T11:53:35.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301913700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc17c0d0 con 0x7fa2fc0c78f0 2022-07-05T11:53:35.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa300911700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2fc0c78f0 0x7fa2fc0c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301112700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa300911700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2fc0c78f0 0x7fa2fc0c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40520/0 (socket says 172.21.15.90:40520) 2022-07-05T11:53:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa300911700 1 -- 172.21.15.90:0/2355102942 learned_addr learned my addr 172.21.15.90:0/2355102942 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301112700 1 -- 172.21.15.90:0/2355102942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2fc0c78f0 msgr2=0x7fa2fc0c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301112700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2fc0c78f0 0x7fa2fc0c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301112700 1 -- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc1713c0 msgr2=0x7fa2fc17d450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-07-05T11:53:35.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301112700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc1713c0 0x7fa2fc17d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.274+0000 7fa301112700 1 -- 172.21.15.90:0/2355102942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80092a0 con 0x7fa2fc178ab0 2022-07-05T11:53:35.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.275+0000 7fa301112700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc151380 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fa2fc084760 tx=0x7fa2f4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.275+0000 7fa2f8ff9700 1 -- 172.21.15.90:0/2355102942 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4021070 con 0x7fa2fc178ab0 2022-07-05T11:53:35.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.275+0000 7fa2f8ff9700 1 -- 172.21.15.90:0/2355102942 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f401d630 con 0x7fa2fc178ab0 2022-07-05T11:53:35.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.275+0000 7fa2f8ff9700 1 -- 172.21.15.90:0/2355102942 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f401d9d0 con 0x7fa2fc178ab0 2022-07-05T11:53:35.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.277+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f4009a20 con 0x7fa2fc178ab0 2022-07-05T11:53:35.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.278+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc17c690 con 0x7fa2fc178ab0 2022-07-05T11:53:35.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.282+0000 7fa2f8ff9700 1 -- 172.21.15.90:0/2355102942 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fa2f4026410 con 0x7fa2fc178ab0 2022-07-05T11:53:35.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.283+0000 7fa2f8ff9700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa2e408ba40 0x7fa2e408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.283+0000 7fa2f8ff9700 1 -- 172.21.15.90:0/2355102942 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fa2f40b2760 con 0x7fa2fc178ab0 2022-07-05T11:53:35.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.284+0000 7fa314501b80 1 Processor -- start 2022-07-05T11:53:35.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.284+0000 7fa314501b80 1 -- start start 2022-07-05T11:53:35.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.286+0000 7fa314501b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e9986f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.286+0000 7fa314501b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.286+0000 7fa314501b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.286+0000 7fa314501b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e99839350 con 0x558e998b3910 2022-07-05T11:53:35.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.286+0000 7fa314501b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e997b0b20 con 0x558e9986fe20 2022-07-05T11:53:35.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.286+0000 7fa314501b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e997c59d0 con 0x558e998b3530 2022-07-05T11:53:35.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.287+0000 7fa301112700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.287+0000 7fa301112700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59134/0 (socket says 172.21.15.90:59134) 2022-07-05T11:53:35.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.287+0000 7fa301112700 1 -- 172.21.15.90:0/3963240265 learned_addr learned my addr 172.21.15.90:0/3963240265 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa301112700 1 -- 172.21.15.90:0/3963240265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 msgr2=0x558e9986f930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-07-05T11:53:35.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa2fbfff700 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa301112700 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e9986f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa301112700 1 -- 172.21.15.90:0/3963240265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 msgr2=0x558e998bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa301112700 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa300911700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa2e408ba40 0x7fa2e408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa301112700 1 -- 172.21.15.90:0/3963240265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e995f7a60 con 0x558e998b3910 2022-07-05T11:53:35.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.288+0000 7fa2fbfff700 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:53:35.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.289+0000 7fa301112700 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998b3d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa2f4086ed0 tx=0x7fa2f40b01d0).ready entity=mon.0 client_cookie=7bd6848691d52b4c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.289+0000 7fa300911700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa2e408ba40 0x7fa2e408df00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fa2f0006fd0 tx=0x7fa2f0006f20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.298+0000 7fa2ddffb700 1 -- 172.21.15.90:0/3963240265 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f408c900 con 0x558e998b3910 2022-07-05T11:53:35.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.300+0000 7fa2ddffb700 1 -- 172.21.15.90:0/3963240265 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f40853c0 con 0x558e998b3910 2022-07-05T11:53:35.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.300+0000 7fa2ddffb700 1 -- 172.21.15.90:0/3963240265 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4086510 con 0x558e998b3910 2022-07-05T11:53:35.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.301+0000 7fa314501b80 1 -- 172.21.15.90:0/3963240265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 msgr2=0x558e998b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.301+0000 7fa314501b80 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998b3d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa2f4086ed0 tx=0x7fa2f40b01d0).stop 2022-07-05T11:53:35.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.301+0000 7fa314501b80 1 -- 172.21.15.90:0/3963240265 shutdown_connections 2022-07-05T11:53:35.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.301+0000 7fa314501b80 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998b3d90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.301+0000 7fa314501b80 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e9986f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.301+0000 7fa314501b80 1 --2- 172.21.15.90:0/3963240265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.301+0000 7fa314501b80 1 -- 172.21.15.90:0/3963240265 >> 172.21.15.90:0/3963240265 conn(0x558e996de240 msgr2=0x558e99872c20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.304+0000 7fa314501b80 1 -- 172.21.15.90:0/3963240265 shutdown_connections 2022-07-05T11:53:35.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.304+0000 7fa314501b80 1 -- 172.21.15.90:0/3963240265 wait complete. 2022-07-05T11:53:35.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.305+0000 7fa314501b80 1 -- start start 2022-07-05T11:53:35.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.306+0000 7fa314501b80 1 Processor -- start 2022-07-05T11:53:35.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa314501b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa314501b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa314501b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998e6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa314501b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9978d1a0 con 0x558e998b3910 2022-07-05T11:53:35.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa314501b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e998fd3b0 con 0x558e9986fe20 2022-07-05T11:53:35.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa314501b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e998fd6d0 con 0x558e998b3530 2022-07-05T11:53:35.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa314501b80 10 client.0 ll_register_callbacks cb 0x558e99833400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:35.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa300911700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa2fbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa300911700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35456/0 (socket says 172.21.15.90:35456) 2022-07-05T11:53:35.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa2fbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998fdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40534/0 (socket says 172.21.15.90:40534) 2022-07-05T11:53:35.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa300911700 1 -- 172.21.15.90:0/2849305566 learned_addr learned my addr 172.21.15.90:0/2849305566 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa301112700 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa301112700 1 -- 172.21.15.90:0/2849305566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 msgr2=0x558e998fdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa301112700 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998fdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa301112700 1 -- 172.21.15.90:0/2849305566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 msgr2=0x558e998fcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa301112700 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.308+0000 7fa301112700 1 -- 172.21.15.90:0/2849305566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc17c690 con 0x558e998b3910 2022-07-05T11:53:35.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.309+0000 7fa301112700 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998e6180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fa2f4009560 tx=0x7fa2f401f000).ready entity=mon.0 client_cookie=accb311dece14b1b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.309+0000 7fa2d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:35.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.310+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2849305566 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f408c900 con 0x558e998b3910 2022-07-05T11:53:35.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.310+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2849305566 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fa2f408c680 con 0x558e998b3910 2022-07-05T11:53:35.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.310+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e9986d710 con 0x558e998b3910 2022-07-05T11:53:35.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.311+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2849305566 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f4010df0 con 0x558e998b3910 2022-07-05T11:53:35.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.311+0000 7fa314501b80 10 client.5565 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:35.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.311+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x558e99666d50 con 0x558e998b3910 2022-07-05T11:53:35.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2849305566 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f409b030 con 0x558e998b3910 2022-07-05T11:53:35.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2849305566 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fa2f4088070 con 0x558e998b3910 2022-07-05T11:53:35.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa314501b80 10 client.5565 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:35.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa314501b80 10 client.5565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:35.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa314501b80 20 client.5565 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:35.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa314501b80 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fc670 0x558e998ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa314501b80 4 client.5565 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:53:35.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.313+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e997bb870 con 0x558e998fc670 2022-07-05T11:53:35.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.314+0000 7fa300911700 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fc670 0x558e998ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.314+0000 7fa300911700 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fc670 0x558e998ae4f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=317020f4ab475a2f server_cookie=a2d04d9227ead666 in_seq=0 out_seq=0 2022-07-05T11:53:35.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.315+0000 7fa2d6ffd700 10 client.5565 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.320+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2849305566 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x558e997bb870 con 0x558e998fc670 2022-07-05T11:53:35.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.320+0000 7fa2d6ffd700 10 client.5565 handle_command_reply: tid=0 2022-07-05T11:53:35.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.320+0000 7fa314501b80 1 client.5565 shutdown 2022-07-05T11:53:35.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.320+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 msgr2=0x558e998e6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.320+0000 7fa314501b80 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998e6180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fa2f4009560 tx=0x7fa2f401f000).stop 2022-07-05T11:53:35.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 shutdown_connections 2022-07-05T11:53:35.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fc670 0x558e998ae4f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e998e6180 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 --2- 172.21.15.90:0/2849305566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998fdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 >> 172.21.15.90:0/2849305566 conn(0x558e996de240 msgr2=0x558e998e02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa2d6ffd700 0 client.5565 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 shutdown_connections 2022-07-05T11:53:35.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 1 -- 172.21.15.90:0/2849305566 wait complete. 2022-07-05T11:53:35.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.321+0000 7fa314501b80 20 client.5565 trim_cache size 0 max 16384 2022-07-05T11:53:35.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.347+0000 7fa314501b80 1 Processor -- start 2022-07-05T11:53:35.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.348+0000 7fa314501b80 1 -- start start 2022-07-05T11:53:35.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa314501b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa314501b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3530 0x558e998e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa314501b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3910 0x558e998aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa314501b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e998b3110 con 0x558e998b3530 2022-07-05T11:53:35.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa314501b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e998ae830 con 0x558e9986fe20 2022-07-05T11:53:35.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa314501b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e998b2b50 con 0x558e998b3910 2022-07-05T11:53:35.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa2fbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3530 0x558e998e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa2fbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3530 0x558e998e5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59146/0 (socket says 172.21.15.90:59146) 2022-07-05T11:53:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa2fbfff700 1 -- 172.21.15.90:0/4070451491 learned_addr learned my addr 172.21.15.90:0/4070451491 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.349+0000 7fa300911700 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2fbfff700 1 -- 172.21.15.90:0/4070451491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3910 msgr2=0x558e998aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2fbfff700 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3910 0x558e998aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2fbfff700 1 -- 172.21.15.90:0/4070451491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 msgr2=0x558e998fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2fbfff700 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2fbfff700 1 -- 172.21.15.90:0/4070451491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e99635050 con 0x558e998b3530 2022-07-05T11:53:35.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2fbfff700 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3530 0x558e998e5de0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fa2e8009c20 tx=0x7fa2e8008040).ready entity=mon.0 client_cookie=71190b4c820725de server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2de7fc700 1 -- 172.21.15.90:0/4070451491 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80097b0 con 0x558e998b3530 2022-07-05T11:53:35.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2de7fc700 1 -- 172.21.15.90:0/4070451491 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8013930 con 0x558e998b3530 2022-07-05T11:53:35.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.350+0000 7fa2de7fc700 1 -- 172.21.15.90:0/4070451491 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8013cd0 con 0x558e998b3530 2022-07-05T11:53:35.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 -- 172.21.15.90:0/4070451491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3530 msgr2=0x558e998e5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3530 0x558e998e5de0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fa2e8009c20 tx=0x7fa2e8008040).stop 2022-07-05T11:53:35.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 -- 172.21.15.90:0/4070451491 shutdown_connections 2022-07-05T11:53:35.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3910 0x558e998aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e998fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 --2- 172.21.15.90:0/4070451491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3530 0x558e998e5de0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 -- 172.21.15.90:0/4070451491 >> 172.21.15.90:0/4070451491 conn(0x558e996de240 msgr2=0x558e998bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 -- 172.21.15.90:0/4070451491 shutdown_connections 2022-07-05T11:53:35.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.352+0000 7fa314501b80 1 -- 172.21.15.90:0/4070451491 wait complete. 2022-07-05T11:53:35.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.353+0000 7fa314501b80 1 -- start start 2022-07-05T11:53:35.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.354+0000 7fa314501b80 1 Processor -- start 2022-07-05T11:53:35.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.355+0000 7fa314501b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e9993b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.355+0000 7fa314501b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.355+0000 7fa314501b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e99942080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.355+0000 7fa314501b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e99937e50 con 0x558e998b3910 2022-07-05T11:53:35.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.355+0000 7fa314501b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e998fac80 con 0x558e9986fe20 2022-07-05T11:53:35.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.355+0000 7fa314501b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e998fa100 con 0x558e998b3530 2022-07-05T11:53:35.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.355+0000 7fa314501b80 10 client.0 ll_register_callbacks cb 0x558e99833400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:35.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e99942080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e99942080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59150/0 (socket says 172.21.15.90:59150) 2022-07-05T11:53:35.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 -- 172.21.15.90:0/2248568151 learned_addr learned my addr 172.21.15.90:0/2248568151 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa2fbfff700 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 -- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 msgr2=0x558e998e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 -- 172.21.15.90:0/2248568151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 msgr2=0x558e9993b7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-07-05T11:53:35.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e9993b7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 -- 172.21.15.90:0/2248568151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e8009920 con 0x558e998b3910 2022-07-05T11:53:35.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa301112700 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e99942080 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fa2f40093f0 tx=0x7fa2f408e070).ready entity=mon.0 client_cookie=2b0ca7c16b8131e4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.356+0000 7fa2d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:35.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.357+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2248568151 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f408c900 con 0x558e998b3910 2022-07-05T11:53:35.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.357+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2248568151 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fa2f4085160 con 0x558e998b3910 2022-07-05T11:53:35.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.358+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e99902a20 con 0x558e998b3910 2022-07-05T11:53:35.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.358+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2248568151 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f408cb50 con 0x558e998b3910 2022-07-05T11:53:35.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.359+0000 7fa314501b80 10 client.5571 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:35.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.359+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x558e998dbf80 con 0x558e998b3910 2022-07-05T11:53:35.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.359+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2248568151 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e99902a20 con 0x558e998b3910 2022-07-05T11:53:35.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.359+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2248568151 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fa2f408ccb0 con 0x558e998b3910 2022-07-05T11:53:35.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.359+0000 7fa314501b80 10 client.5571 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:35.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.359+0000 7fa314501b80 10 client.5571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:35.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.360+0000 7fa314501b80 20 client.5571 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:35.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.360+0000 7fa314501b80 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fb110 0x558e998db260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.360+0000 7fa314501b80 4 client.5571 mds_command: new command op to 4371 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2022-07-05T11:53:35.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.360+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7fa2f40853c0 con 0x558e998fb110 2022-07-05T11:53:35.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.360+0000 7fa300911700 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fb110 0x558e998db260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.362+0000 7fa300911700 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fb110 0x558e998db260 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=830a6bdf36389d6b server_cookie=27f26801174b3f90 in_seq=0 out_seq=0 2022-07-05T11:53:35.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.362+0000 7fa2d6ffd700 10 client.5571 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa2d6ffd700 1 -- 172.21.15.90:0/2248568151 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fa2f40853c0 con 0x558e998fb110 2022-07-05T11:53:35.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa2d6ffd700 10 client.5571 handle_command_reply: tid=0 2022-07-05T11:53:35.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 client.5571 shutdown 2022-07-05T11:53:35.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 msgr2=0x558e99942080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e99942080 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fa2f40093f0 tx=0x7fa2f408e070).stop 2022-07-05T11:53:35.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 shutdown_connections 2022-07-05T11:53:35.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x558e998fb110 0x558e998db260 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558e998b3910 0x558e99942080 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e9986fe20 0x558e9993b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 --2- 172.21.15.90:0/2248568151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558e998b3530 0x558e998e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 >> 172.21.15.90:0/2248568151 conn(0x558e996de240 msgr2=0x558e998fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.365+0000 7fa2d6ffd700 0 client.5571 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 shutdown_connections 2022-07-05T11:53:35.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa314501b80 1 -- 172.21.15.90:0/2248568151 wait complete. 2022-07-05T11:53:35.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa314501b80 20 client.5571 trim_cache size 0 max 16384 2022-07-05T11:53:35.420 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:53:35.420 INFO:teuthology.orchestra.run.smithi090.stdout: "return_code": 0, 2022-07-05T11:53:35.420 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:53:35.420 INFO:teuthology.orchestra.run.smithi090.stdout: "mode": "asynchronous" 2022-07-05T11:53:35.421 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:53:35.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa2e408ba40 msgr2=0x7fa2e408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa2e408ba40 0x7fa2e408df00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fa2f0006fd0 tx=0x7fa2f0006f20).stop 2022-07-05T11:53:35.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2fc178ab0 msgr2=0x7fa2fc151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc151380 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fa2fc084760 tx=0x7fa2f4009780).stop 2022-07-05T11:53:35.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 shutdown_connections 2022-07-05T11:53:35.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fa2e408ba40 0x7fa2e408df00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2fc178ab0 0x7fa2fc151380 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2fc0c78f0 0x7fa2fc0c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 --2- 172.21.15.90:0/2355102942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc1713c0 0x7fa2fc17d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 >> 172.21.15.90:0/2355102942 conn(0x7fa2fc0ee320 msgr2=0x7fa2fc0eab10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.367+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 shutdown_connections 2022-07-05T11:53:35.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.368+0000 7fa301913700 1 -- 172.21.15.90:0/2355102942 wait complete. 2022-07-05T11:53:35.426 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:53:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.627+0000 7fef4f7ce700 1 Processor -- start 2022-07-05T11:53:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.627+0000 7fef4f7ce700 1 -- start start 2022-07-05T11:53:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4f7ce700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fef480ed530 0x7fef4817eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4f7ce700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fef48174ed0 0x7fef481801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4f7ce700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef480edb50 con 0x7fef48174af0 2022-07-05T11:53:35.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4f7ce700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480ede30 con 0x7fef480ed530 2022-07-05T11:53:35.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4f7ce700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480ee110 con 0x7fef48174ed0 2022-07-05T11:53:35.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4cd69700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fef480ed530 0x7fef4817eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4d56a700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fef48174af0 0x7fef4817faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52098/0 (socket says 172.21.15.90:52098) 2022-07-05T11:53:35.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4cd69700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fef480ed530 0x7fef4817eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59158/0 (socket says 172.21.15.90:59158) 2022-07-05T11:53:35.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.628+0000 7fef4d56a700 1 -- 172.21.15.90:0/3096867260 learned_addr learned my addr 172.21.15.90:0/3096867260 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:53:35.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/3096867260 >> v2:172.21.15.149:3300/0 conn(0x7fef48174ed0 0x7fef481801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945882386 0 0) 0x7fef480edb50 con 0x7fef48174af0 2022-07-05T11:53:35.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef300033f0 con 0x7fef48174af0 2022-07-05T11:53:35.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3105829950 0 0) 0x7fef300033f0 con 0x7fef48174af0 2022-07-05T11:53:35.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 >> v2:172.21.15.149:3300/0 conn(0x7fef48174ed0 msgr2=0x7fef481801b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 --2- 172.21.15.90:0/3096867260 >> v2:172.21.15.149:3300/0 conn(0x7fef48174ed0 0x7fef481801b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 >> v2:172.21.15.90:3300/0 conn(0x7fef480ed530 msgr2=0x7fef4817eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 --2- 172.21.15.90:0/3096867260 >> v2:172.21.15.90:3300/0 conn(0x7fef480ed530 0x7fef4817eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480ee3f0 con 0x7fef48174af0 2022-07-05T11:53:35.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7fef44001470 con 0x7fef48174af0 2022-07-05T11:53:35.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 >> v1:172.21.15.90:6789/0 conn(0x7fef48174af0 legacy=0x7fef4817faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef30003930 0x7fef30003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef30004690 0x7fef30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef30005000 0x7fef3000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef480ede30 con 0x7fef30003930 2022-07-05T11:53:35.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef480ee110 con 0x7fef30004690 2022-07-05T11:53:35.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.629+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3000be80 con 0x7fef30005000 2022-07-05T11:53:35.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef30003930 0x7fef30003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef30004690 0x7fef30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4d56a700 1 -- 172.21.15.90:0/3096867260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef30005000 msgr2=0x7fef3000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef30005000 0x7fef3000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:53:35.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4d56a700 1 -- 172.21.15.90:0/3096867260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef30004690 msgr2=0x7fef30004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef30004690 0x7fef30004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4dd6b700 1 -- 172.21.15.90:0/3096867260 reap_dead start 2022-07-05T11:53:35.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4d56a700 1 -- 172.21.15.90:0/3096867260 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300033f0 con 0x7fef30003930 2022-07-05T11:53:35.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef30004690 0x7fef30004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:53:35.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.630+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef30003930 0x7fef30003d50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fef4400c210 tx=0x7fef44001e90).ready entity=mon.0 client_cookie=8a671fab470601f0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44007a60 con 0x7fef30003930 2022-07-05T11:53:35.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400cae0 con 0x7fef30003930 2022-07-05T11:53:35.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef37fff700 1 -- 172.21.15.90:0/3096867260 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400ce60 con 0x7fef30003930 2022-07-05T11:53:35.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3096867260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef30003930 msgr2=0x7fef30003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef30003930 0x7fef30003d50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fef4400c210 tx=0x7fef44001e90).stop 2022-07-05T11:53:35.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3096867260 shutdown_connections 2022-07-05T11:53:35.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3096867260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef30003930 0x7fef30003d50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3096867260 >> 172.21.15.90:0/3096867260 conn(0x7fef4805d9a0 msgr2=0x7fef4805ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3096867260 shutdown_connections 2022-07-05T11:53:35.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.631+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3096867260 wait complete. 2022-07-05T11:53:35.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.633+0000 7fef4f7ce700 1 Processor -- start 2022-07-05T11:53:35.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.633+0000 7fef4f7ce700 1 -- start start 2022-07-05T11:53:35.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.634+0000 7fef4f7ce700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef48167fd0 0x7fef4818fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.634+0000 7fef4f7ce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480e7000 0x7fef481769e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.634+0000 7fef4f7ce700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef480e7480 0x7fef48191eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.634+0000 7fef4f7ce700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48176550 con 0x7fef480e7480 2022-07-05T11:53:35.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.634+0000 7fef4f7ce700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef481683b0 con 0x7fef48167fd0 2022-07-05T11:53:35.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.634+0000 7fef4f7ce700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48175660 con 0x7fef480e7000 2022-07-05T11:53:35.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef48167fd0 0x7fef4818fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef48167fd0 0x7fef4818fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35490/0 (socket says 172.21.15.90:35490) 2022-07-05T11:53:35.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 -- 172.21.15.90:0/3646136425 learned_addr learned my addr 172.21.15.90:0/3646136425 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef480e7480 0x7fef48191eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480e7000 0x7fef481769e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 -- 172.21.15.90:0/3646136425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480e7000 msgr2=0x7fef481769e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480e7000 0x7fef481769e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 -- 172.21.15.90:0/3646136425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef480e7480 msgr2=0x7fef48191eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef480e7480 0x7fef48191eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 -- 172.21.15.90:0/3646136425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48175940 con 0x7fef48167fd0 2022-07-05T11:53:35.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef480e7480 0x7fef48191eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:35.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.635+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef48167fd0 0x7fef4818fdb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fef4400d010 tx=0x7fef44015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.636+0000 7fef357fa700 1 -- 172.21.15.90:0/3646136425 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44007670 con 0x7fef48167fd0 2022-07-05T11:53:35.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.636+0000 7fef357fa700 1 -- 172.21.15.90:0/3646136425 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440046b0 con 0x7fef48167fd0 2022-07-05T11:53:35.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.636+0000 7fef357fa700 1 -- 172.21.15.90:0/3646136425 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44004a70 con 0x7fef48167fd0 2022-07-05T11:53:35.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.636+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef48175c20 con 0x7fef48167fd0 2022-07-05T11:53:35.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.636+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef481761e0 con 0x7fef48167fd0 2022-07-05T11:53:35.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.639+0000 7fef357fa700 1 -- 172.21.15.90:0/3646136425 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fef44027070 con 0x7fef48167fd0 2022-07-05T11:53:35.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.639+0000 7fef357fa700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fef2808ba90 0x7fef2808df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.639+0000 7fef357fa700 1 -- 172.21.15.90:0/3646136425 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fef440b1140 con 0x7fef48167fd0 2022-07-05T11:53:35.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.639+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fef2808ba90 0x7fef2808df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.640+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fef2808ba90 0x7fef2808df50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fef48066b90 tx=0x7fef38008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.641+0000 7fef6115ab80 1 Processor -- start 2022-07-05T11:53:35.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.641+0000 7fef6115ab80 1 -- start start 2022-07-05T11:53:35.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42423c0 0x5652c41fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c424c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42427a0 0x5652c4242c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef6115ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c41c82d0 con 0x5652c41fecb0 2022-07-05T11:53:35.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef6115ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c413faa0 con 0x5652c42427a0 2022-07-05T11:53:35.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef6115ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c4154950 con 0x5652c42423c0 2022-07-05T11:53:35.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c424c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4dd6b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42427a0 0x5652c4242c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c424c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59178/0 (socket says 172.21.15.90:59178) 2022-07-05T11:53:35.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 -- 172.21.15.90:0/3310513740 learned_addr learned my addr 172.21.15.90:0/3310513740 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42423c0 0x5652c41fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 -- 172.21.15.90:0/3310513740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42423c0 msgr2=0x5652c41fe7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42423c0 0x5652c41fe7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.702 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 -- 172.21.15.90:0/3310513740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42427a0 msgr2=0x5652c4242c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.702 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42427a0 0x5652c4242c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4cd69700 1 -- 172.21.15.90:0/3310513740 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652c3f869e0 con 0x5652c41fecb0 2022-07-05T11:53:35.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.642+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42427a0 0x5652c4242c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:35.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.643+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c424c990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fef38013a60 tx=0x7fef38018000).ready entity=mon.0 client_cookie=2d51aaed6413a2f0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.643+0000 7fef2e7fc700 1 -- 172.21.15.90:0/3310513740 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef380168f0 con 0x5652c41fecb0 2022-07-05T11:53:35.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.643+0000 7fef2e7fc700 1 -- 172.21.15.90:0/3310513740 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38016a50 con 0x5652c41fecb0 2022-07-05T11:53:35.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.643+0000 7fef2e7fc700 1 -- 172.21.15.90:0/3310513740 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38016dd0 con 0x5652c41fecb0 2022-07-05T11:53:35.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.643+0000 7fef6115ab80 1 -- 172.21.15.90:0/3310513740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 msgr2=0x5652c424c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.643+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c424c990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fef38013a60 tx=0x7fef38018000).stop 2022-07-05T11:53:35.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.644+0000 7fef6115ab80 1 -- 172.21.15.90:0/3310513740 shutdown_connections 2022-07-05T11:53:35.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.644+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42427a0 0x5652c4242c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.644+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42423c0 0x5652c41fe7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.644+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3310513740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c424c990 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.644+0000 7fef6115ab80 1 -- 172.21.15.90:0/3310513740 >> 172.21.15.90:0/3310513740 conn(0x5652c406d1c0 msgr2=0x5652c4201ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.644+0000 7fef6115ab80 1 -- 172.21.15.90:0/3310513740 shutdown_connections 2022-07-05T11:53:35.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.644+0000 7fef6115ab80 1 -- 172.21.15.90:0/3310513740 wait complete. 2022-07-05T11:53:35.710 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.645+0000 7fef6115ab80 1 -- start start 2022-07-05T11:53:35.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.645+0000 7fef6115ab80 1 Processor -- start 2022-07-05T11:53:35.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c42732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.711 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c42373d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42427a0 0x5652c423ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef6115ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c411c120 con 0x5652c41fecb0 2022-07-05T11:53:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef6115ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c4273ce0 con 0x5652c42423c0 2022-07-05T11:53:35.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef6115ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c42819e0 con 0x5652c42427a0 2022-07-05T11:53:35.713 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef6115ab80 10 client.0 ll_register_callbacks cb 0x5652c41c21b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:35.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef4d56a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c42732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.714 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef4d56a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c42732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59184/0 (socket says 172.21.15.90:59184) 2022-07-05T11:53:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef4d56a700 1 -- 172.21.15.90:0/3886311100 learned_addr learned my addr 172.21.15.90:0/3886311100 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.646+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c42373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42427a0 0x5652c423ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4d56a700 1 -- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42427a0 msgr2=0x5652c423ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42427a0 0x5652c423ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4d56a700 1 -- 172.21.15.90:0/3886311100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 msgr2=0x5652c42373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c42373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4d56a700 1 -- 172.21.15.90:0/3886311100 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef400073e0 con 0x5652c41fecb0 2022-07-05T11:53:35.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c42373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:53:35.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef4d56a700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c42732d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fef44001ed0 tx=0x7fef440b1040).ready entity=mon.0 client_cookie=a8d946d6fe113989 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef237fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:53:35.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef237fe700 1 -- 172.21.15.90:0/3886311100 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44085a80 con 0x5652c41fecb0 2022-07-05T11:53:35.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.647+0000 7fef237fe700 1 -- 172.21.15.90:0/3886311100 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fef4408b360 con 0x5652c41fecb0 2022-07-05T11:53:35.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.648+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652c41fc440 con 0x5652c41fecb0 2022-07-05T11:53:35.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.649+0000 7fef237fe700 1 -- 172.21.15.90:0/3886311100 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef44084f70 con 0x5652c41fecb0 2022-07-05T11:53:35.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.649+0000 7fef6115ab80 10 client.5586 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:35.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.649+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7fef380136f0 con 0x5652c41fecb0 2022-07-05T11:53:35.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef237fe700 1 -- 172.21.15.90:0/3886311100 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652c41fc440 con 0x5652c41fecb0 2022-07-05T11:53:35.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef237fe700 1 -- 172.21.15.90:0/3886311100 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fef44093070 con 0x5652c41fecb0 2022-07-05T11:53:35.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef6115ab80 10 client.5586 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:35.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef6115ab80 10 client.5586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:35.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef6115ab80 20 client.5586 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:35.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c4202f60 0x5652c42408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef6115ab80 4 client.5586 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:53:35.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.650+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652c414a7f0 con 0x5652c4202f60 2022-07-05T11:53:35.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.651+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c4202f60 0x5652c42408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.652+0000 7fef237fe700 10 client.5586 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.652+0000 7fef4cd69700 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c4202f60 0x5652c42408c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=70e222cbd92e2f01 server_cookie=b1f8a230ace07743 in_seq=0 out_seq=0 2022-07-05T11:53:35.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef237fe700 1 -- 172.21.15.90:0/3886311100 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5652c414a7f0 con 0x5652c4202f60 2022-07-05T11:53:35.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef237fe700 10 client.5586 handle_command_reply: tid=0 2022-07-05T11:53:35.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 client.5586 shutdown 2022-07-05T11:53:35.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 msgr2=0x5652c42732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c42732d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fef44001ed0 tx=0x7fef440b1040).stop 2022-07-05T11:53:35.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 shutdown_connections 2022-07-05T11:53:35.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c4202f60 0x5652c42408c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c42427a0 0x5652c423ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef237fe700 0 client.5586 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c41fecb0 0x5652c42732d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 --2- 172.21.15.90:0/3886311100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c42373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.661+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 >> 172.21.15.90:0/3886311100 conn(0x5652c406d1c0 msgr2=0x5652c41ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.662+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 shutdown_connections 2022-07-05T11:53:35.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.662+0000 7fef6115ab80 1 -- 172.21.15.90:0/3886311100 wait complete. 2022-07-05T11:53:35.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.662+0000 7fef6115ab80 20 client.5586 trim_cache size 0 max 16384 2022-07-05T11:53:35.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.686+0000 7fef6115ab80 1 Processor -- start 2022-07-05T11:53:35.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.686+0000 7fef6115ab80 1 -- start start 2022-07-05T11:53:35.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c41ff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c4274eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c426dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef6115ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c41ffbf0 con 0x5652c4202f60 2022-07-05T11:53:35.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef6115ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c42753a0 con 0x5652c42423c0 2022-07-05T11:53:35.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef6115ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c4275a20 con 0x5652c41fecb0 2022-07-05T11:53:35.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef4cd69700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c4274eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef4cd69700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c4274eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59192/0 (socket says 172.21.15.90:59192) 2022-07-05T11:53:35.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef4cd69700 1 -- 172.21.15.90:0/1189653236 learned_addr learned my addr 172.21.15.90:0/1189653236 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.687+0000 7fef4d56a700 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c41ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c426dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4cd69700 1 -- 172.21.15.90:0/1189653236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 msgr2=0x5652c41ff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4cd69700 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c41ff700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4cd69700 1 -- 172.21.15.90:0/1189653236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 msgr2=0x5652c426dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4cd69700 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c426dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4cd69700 1 -- 172.21.15.90:0/1189653236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652c3ff5cd0 con 0x5652c4202f60 2022-07-05T11:53:35.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c426dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:53:35.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef4cd69700 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c4274eb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fef38008010 tx=0x7fef38034280).ready entity=mon.0 client_cookie=2fdc93ffb57f3abf server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef2effd700 1 -- 172.21.15.90:0/1189653236 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38032070 con 0x5652c4202f60 2022-07-05T11:53:35.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef2effd700 1 -- 172.21.15.90:0/1189653236 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38013e20 con 0x5652c4202f60 2022-07-05T11:53:35.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.688+0000 7fef2effd700 1 -- 172.21.15.90:0/1189653236 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef380168f0 con 0x5652c4202f60 2022-07-05T11:53:35.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 -- 172.21.15.90:0/1189653236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 msgr2=0x5652c4274eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c4274eb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fef38008010 tx=0x7fef38034280).stop 2022-07-05T11:53:35.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 -- 172.21.15.90:0/1189653236 shutdown_connections 2022-07-05T11:53:35.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c426dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c41ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 --2- 172.21.15.90:0/1189653236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c4274eb0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 -- 172.21.15.90:0/1189653236 >> 172.21.15.90:0/1189653236 conn(0x5652c406d1c0 msgr2=0x5652c4283b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 -- 172.21.15.90:0/1189653236 shutdown_connections 2022-07-05T11:53:35.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.689+0000 7fef6115ab80 1 -- 172.21.15.90:0/1189653236 wait complete. 2022-07-05T11:53:35.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.690+0000 7fef6115ab80 1 -- start start 2022-07-05T11:53:35.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.690+0000 7fef6115ab80 1 Processor -- start 2022-07-05T11:53:35.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.691+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c4283ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.691+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c426f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.691+0000 7fef6115ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c4274ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.691+0000 7fef6115ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c423f1f0 con 0x5652c4202f60 2022-07-05T11:53:35.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.691+0000 7fef6115ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c42d9000 con 0x5652c42423c0 2022-07-05T11:53:35.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.691+0000 7fef6115ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652c42d6660 con 0x5652c41fecb0 2022-07-05T11:53:35.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.691+0000 7fef6115ab80 10 client.0 ll_register_callbacks cb 0x5652c41c21b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:53:35.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c4274ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4d56a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c4283ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c4274ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.90:35522/0 (socket says 172.21.15.90:35522) 2022-07-05T11:53:35.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 -- 172.21.15.90:0/4005646955 learned_addr learned my addr 172.21.15.90:0/4005646955 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:53:35.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4cd69700 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c426f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 -- 172.21.15.90:0/4005646955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 msgr2=0x5652c4283ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c4283ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 -- 172.21.15.90:0/4005646955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 msgr2=0x5652c426f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:53:35.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c426f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 -- 172.21.15.90:0/4005646955 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652c3f869e0 con 0x5652c42423c0 2022-07-05T11:53:35.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef4dd6b700 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c4274ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fef480c1920 tx=0x7fef4000b040).ready entity=mon.1 client_cookie=92e5a438796cc40e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:53:35.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef237fe700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2022-07-05T11:53:35.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef237fe700 1 -- 172.21.15.90:0/4005646955 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40019460 con 0x5652c42423c0 2022-07-05T11:53:35.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef237fe700 1 -- 172.21.15.90:0/4005646955 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fef400195c0 con 0x5652c42423c0 2022-07-05T11:53:35.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.692+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef38016a50 con 0x5652c42423c0 2022-07-05T11:53:35.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef237fe700 1 -- 172.21.15.90:0/4005646955 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef400199d0 con 0x5652c42423c0 2022-07-05T11:53:35.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 10 client.5269 fetch_fsmap learned FSMap version 22 2022-07-05T11:53:35.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5652c3fc3fd0 con 0x5652c42423c0 2022-07-05T11:53:35.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef237fe700 1 -- 172.21.15.90:0/4005646955 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38016a50 con 0x5652c42423c0 2022-07-05T11:53:35.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef237fe700 1 -- 172.21.15.90:0/4005646955 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7fef40019b30 con 0x5652c42423c0 2022-07-05T11:53:35.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 10 client.5269 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:53:35.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 10 client.5269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:53:35.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 20 client.5269 populate_metadata read hostname 'smithi090' 2022-07-05T11:53:35.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c42427a0 0x5652c4238220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:53:35.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 4 client.5269 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:53:35.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.694+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5652c4141690 con 0x5652c42427a0 2022-07-05T11:53:35.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.697+0000 7fef4d56a700 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c42427a0 0x5652c4238220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:53:35.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.697+0000 7fef237fe700 10 client.5269 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.697+0000 7fef4d56a700 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c42427a0 0x5652c4238220 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b2306b5bc8f1e090 server_cookie=52be1ff1b54f6d6d in_seq=0 out_seq=0 2022-07-05T11:53:35.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef237fe700 1 -- 172.21.15.90:0/4005646955 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+269 (crc 0 0 0) 0x5652c4141690 con 0x5652c42427a0 2022-07-05T11:53:35.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef237fe700 10 client.5269 handle_command_reply: tid=0 2022-07-05T11:53:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 client.5269 shutdown 2022-07-05T11:53:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 msgr2=0x5652c4274ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c4274ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fef480c1920 tx=0x7fef4000b040).stop 2022-07-05T11:53:35.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 shutdown_connections 2022-07-05T11:53:35.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5652c42427a0 0x5652c4238220 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5652c42423c0 0x5652c4274ca0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5652c41fecb0 0x5652c4283ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef237fe700 0 client.5269 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:53:35.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 --2- 172.21.15.90:0/4005646955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652c4202f60 0x5652c426f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 >> 172.21.15.90:0/4005646955 conn(0x5652c406d1c0 msgr2=0x5652c42401d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 shutdown_connections 2022-07-05T11:53:35.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.712+0000 7fef6115ab80 1 -- 172.21.15.90:0/4005646955 wait complete. 2022-07-05T11:53:35.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.713+0000 7fef6115ab80 20 client.5269 trim_cache size 0 max 16384 2022-07-05T11:53:35.781 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:53:35.781 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "scrub active (10002 inodes in the stack)", 2022-07-05T11:53:35.781 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:53:35.782 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:53:35.782 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:53:35.783 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:53:35.783 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:53:35.783 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:53:35.784 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:53:35.784 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:53:35.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fef2808ba90 msgr2=0x7fef2808df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fef2808ba90 0x7fef2808df50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fef48066b90 tx=0x7fef38008040).stop 2022-07-05T11:53:35.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef48167fd0 msgr2=0x7fef4818fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:53:35.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef48167fd0 0x7fef4818fdb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fef4400d010 tx=0x7fef44015000).stop 2022-07-05T11:53:35.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 shutdown_connections 2022-07-05T11:53:35.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fef2808ba90 0x7fef2808df50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef480e7480 0x7fef48191eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef48167fd0 0x7fef4818fdb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 --2- 172.21.15.90:0/3646136425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480e7000 0x7fef481769e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:53:35.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 >> 172.21.15.90:0/3646136425 conn(0x7fef4805d9a0 msgr2=0x7fef480c2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:53:35.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 shutdown_connections 2022-07-05T11:53:35.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:53:35.714+0000 7fef4f7ce700 1 -- 172.21.15.90:0/3646136425 wait complete. 2022-07-05T11:53:35.792 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:54:05.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:54:05.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.918+0000 7f71b84a1700 1 Processor -- start 2022-07-05T11:54:05.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.919+0000 7f71b84a1700 1 -- start start 2022-07-05T11:54:05.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b84a1700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f71b00ed530 0x7f71b017eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b84a1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f71b0174ed0 0x7f71b01801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b84a1700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b00edb50 con 0x7f71b0174af0 2022-07-05T11:54:05.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b84a1700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00ede30 con 0x7f71b00ed530 2022-07-05T11:54:05.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b84a1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00ee110 con 0x7f71b0174ed0 2022-07-05T11:54:05.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f71b00ed530 0x7f71b017eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b623d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f71b0174af0 0x7f71b017faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52146/0 (socket says 172.21.15.90:52146) 2022-07-05T11:54:05.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f71b00ed530 0x7f71b017eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59208/0 (socket says 172.21.15.90:59208) 2022-07-05T11:54:05.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 -- 172.21.15.90:0/4088218200 learned_addr learned my addr 172.21.15.90:0/4088218200 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:05.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/4088218200 >> v2:172.21.15.149:3300/0 conn(0x7f71b0174ed0 0x7f71b01801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 -- 172.21.15.90:0/4088218200 >> v2:172.21.15.149:3300/0 conn(0x7f71b0174ed0 msgr2=0x7f71b01801b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:05.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 --2- 172.21.15.90:0/4088218200 >> v2:172.21.15.149:3300/0 conn(0x7f71b0174ed0 0x7f71b01801b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 -- 172.21.15.90:0/4088218200 >> v1:172.21.15.90:6789/0 conn(0x7f71b0174af0 legacy=0x7f71b017faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:05.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b523b700 1 -- 172.21.15.90:0/4088218200 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400561702 0 0) 0x7f71b00edb50 con 0x7f71b0174af0 2022-07-05T11:54:05.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 -- 172.21.15.90:0/4088218200 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00ee3f0 con 0x7f71b00ed530 2022-07-05T11:54:05.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.920+0000 7f71b5a3c700 1 --2- 172.21.15.90:0/4088218200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b00ed530 0x7f71b017eff0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f71b00c16d0 tx=0x7f71a40090f0).ready entity=mon.0 client_cookie=5b1d7aa1ec47bce3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:05.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b523b700 1 -- 172.21.15.90:0/4088218200 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400b520 con 0x7f71b00ed530 2022-07-05T11:54:05.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b523b700 1 -- 172.21.15.90:0/4088218200 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400b680 con 0x7f71b00ed530 2022-07-05T11:54:05.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b523b700 1 -- 172.21.15.90:0/4088218200 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400ba00 con 0x7f71b00ed530 2022-07-05T11:54:05.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 -- 172.21.15.90:0/4088218200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b00ed530 msgr2=0x7f71b017eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:05.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 --2- 172.21.15.90:0/4088218200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b00ed530 0x7f71b017eff0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f71b00c16d0 tx=0x7f71a40090f0).stop 2022-07-05T11:54:05.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 -- 172.21.15.90:0/4088218200 shutdown_connections 2022-07-05T11:54:05.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 --2- 172.21.15.90:0/4088218200 >> v2:172.21.15.149:3300/0 conn(0x7f71b0174ed0 0x7f71b01801b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 --2- 172.21.15.90:0/4088218200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b00ed530 0x7f71b017eff0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 -- 172.21.15.90:0/4088218200 >> 172.21.15.90:0/4088218200 conn(0x7f71b005d9a0 msgr2=0x7f71b005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:05.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 -- 172.21.15.90:0/4088218200 shutdown_connections 2022-07-05T11:54:05.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.921+0000 7f71b84a1700 1 -- 172.21.15.90:0/4088218200 wait complete. 2022-07-05T11:54:05.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.923+0000 7f71b84a1700 1 Processor -- start 2022-07-05T11:54:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.923+0000 7f71b84a1700 1 -- start start 2022-07-05T11:54:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.923+0000 7f71b84a1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b00ed530 0x7f71b01680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b84a1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71b0174af0 0x7f71b018fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b84a1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b0174ed0 0x7f71b018ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b84a1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01917f0 con 0x7f71b0174ed0 2022-07-05T11:54:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b84a1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b018f4c0 con 0x7f71b00ed530 2022-07-05T11:54:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b84a1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0190900 con 0x7f71b0174af0 2022-07-05T11:54:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b0174ed0 0x7f71b018ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b0174ed0 0x7f71b018ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59216/0 (socket says 172.21.15.90:59216) 2022-07-05T11:54:05.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 -- 172.21.15.90:0/316399350 learned_addr learned my addr 172.21.15.90:0/316399350 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:05.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b5a3c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71b0174af0 0x7f71b018fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b623d700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b00ed530 0x7f71b01680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 -- 172.21.15.90:0/316399350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71b0174af0 msgr2=0x7f71b018fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71b0174af0 0x7f71b018fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 -- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b00ed530 msgr2=0x7f71b01680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b00ed530 0x7f71b01680c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 -- 172.21.15.90:0/316399350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009370 con 0x7f71b0174ed0 2022-07-05T11:54:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b623d700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b00ed530 0x7f71b01680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:54:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b0174ed0 0x7f71b018ffd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f71a800e900 tx=0x7f71a8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71ae7fc700 1 -- 172.21.15.90:0/316399350 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80093b0 con 0x7f71b0174ed0 2022-07-05T11:54:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71ae7fc700 1 -- 172.21.15.90:0/316399350 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8012600 con 0x7f71b0174ed0 2022-07-05T11:54:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b0190be0 con 0x7f71b0174ed0 2022-07-05T11:54:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71ae7fc700 1 -- 172.21.15.90:0/316399350 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8012980 con 0x7f71b0174ed0 2022-07-05T11:54:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.924+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b01911a0 con 0x7f71b0174ed0 2022-07-05T11:54:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.926+0000 7f71ae7fc700 1 -- 172.21.15.90:0/316399350 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f71a8022070 con 0x7f71b0174ed0 2022-07-05T11:54:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.927+0000 7f71ae7fc700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f719008ba40 0x7f719008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.927+0000 7f71ae7fc700 1 -- 172.21.15.90:0/316399350 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f71a80b0c10 con 0x7f71b0174ed0 2022-07-05T11:54:05.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.927+0000 7f71b623d700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f719008ba40 0x7f719008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.927+0000 7f71b623d700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f719008ba40 0x7f719008df00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f71a0005fd0 tx=0x7f71a0007e90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:05.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.929+0000 7f71c9e2db80 1 Processor -- start 2022-07-05T11:54:05.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.929+0000 7f71c9e2db80 1 -- start start 2022-07-05T11:54:05.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d0c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d5a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478d50c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478cd62d0 con 0x55f478d507a0 2022-07-05T11:54:05.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478c4daa0 con 0x55f478d0ccb0 2022-07-05T11:54:05.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478c62950 con 0x55f478d503c0 2022-07-05T11:54:05.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478d50c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.950 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b5a3c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d5a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478d50c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59224/0 (socket says 172.21.15.90:59224) 2022-07-05T11:54:05.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 -- 172.21.15.90:0/2064413206 learned_addr learned my addr 172.21.15.90:0/2064413206 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:05.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b623d700 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d0c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.951 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 -- 172.21.15.90:0/2064413206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 msgr2=0x55f478d0c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:05.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d0c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 -- 172.21.15.90:0/2064413206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 msgr2=0x55f478d5a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:05.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d5a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 -- 172.21.15.90:0/2064413206 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f478a949e0 con 0x55f478d507a0 2022-07-05T11:54:05.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478d50c20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f71a80854d0 tx=0x7f71a80852a0).ready entity=mon.0 client_cookie=d106d343ea18448e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:05.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f718f7fe700 1 -- 172.21.15.90:0/2064413206 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8083870 con 0x55f478d507a0 2022-07-05T11:54:05.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f718f7fe700 1 -- 172.21.15.90:0/2064413206 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8012d70 con 0x55f478d507a0 2022-07-05T11:54:05.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.930+0000 7f718f7fe700 1 -- 172.21.15.90:0/2064413206 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80ae300 con 0x55f478d507a0 2022-07-05T11:54:05.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 -- 172.21.15.90:0/2064413206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 msgr2=0x55f478d50c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:05.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478d50c20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f71a80854d0 tx=0x7f71a80852a0).stop 2022-07-05T11:54:05.954 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 -- 172.21.15.90:0/2064413206 shutdown_connections 2022-07-05T11:54:05.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478d50c20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d0c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/2064413206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d5a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 -- 172.21.15.90:0/2064413206 >> 172.21.15.90:0/2064413206 conn(0x55f478b7b1c0 msgr2=0x55f478d0fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:05.955 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 -- 172.21.15.90:0/2064413206 shutdown_connections 2022-07-05T11:54:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.931+0000 7f71c9e2db80 1 -- 172.21.15.90:0/2064413206 wait complete. 2022-07-05T11:54:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.932+0000 7f71c9e2db80 1 -- start start 2022-07-05T11:54:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.932+0000 7f71c9e2db80 1 Processor -- start 2022-07-05T11:54:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d816d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d91e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478c2a120 con 0x55f478d0ccb0 2022-07-05T11:54:05.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478d4a8c0 con 0x55f478d503c0 2022-07-05T11:54:05.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478d806c0 con 0x55f478d507a0 2022-07-05T11:54:05.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71c9e2db80 10 client.0 ll_register_callbacks cb 0x55f478cd01b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:54:05.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59226/0 (socket says 172.21.15.90:59226) 2022-07-05T11:54:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 -- 172.21.15.90:0/326634109 learned_addr learned my addr 172.21.15.90:0/326634109 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d91e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b5a3c700 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d816d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 -- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 msgr2=0x55f478d91e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d91e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 -- 172.21.15.90:0/326634109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 msgr2=0x55f478d816d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:05.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d816d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.933+0000 7f71b623d700 1 -- 172.21.15.90:0/326634109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b01911a0 con 0x55f478d0ccb0 2022-07-05T11:54:05.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71b623d700 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d455e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f71a00188f0 tx=0x7f71a001a040).ready entity=mon.0 client_cookie=d08b0136e9d0e54d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f718cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:54:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f718cff9700 1 -- 172.21.15.90:0/326634109 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a001d040 con 0x55f478d0ccb0 2022-07-05T11:54:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f718cff9700 1 -- 172.21.15.90:0/326634109 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f71a00167d0 con 0x55f478d0ccb0 2022-07-05T11:54:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f478d0a440 con 0x55f478d0ccb0 2022-07-05T11:54:05.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f718cff9700 1 -- 172.21.15.90:0/326634109 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a0016ba0 con 0x55f478d0ccb0 2022-07-05T11:54:05.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 10 client.5607 fetch_fsmap learned FSMap version 22 2022-07-05T11:54:05.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55f478b03cd0 con 0x55f478d0ccb0 2022-07-05T11:54:05.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f718cff9700 1 -- 172.21.15.90:0/326634109 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f478d0a440 con 0x55f478d0ccb0 2022-07-05T11:54:05.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f718cff9700 1 -- 172.21.15.90:0/326634109 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f71a0016d00 con 0x55f478d0ccb0 2022-07-05T11:54:05.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 10 client.5607 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:54:05.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 10 client.5607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:54:05.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 20 client.5607 populate_metadata read hostname 'smithi090' 2022-07-05T11:54:05.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478d835a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 4 client.5607 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:54:05.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f478c587f0 con 0x55f478d83190 2022-07-05T11:54:05.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.934+0000 7f71b5a3c700 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478d835a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71b5a3c700 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478d835a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2b5b9001e329565a server_cookie=72cca497e765ec2 in_seq=0 out_seq=0 2022-07-05T11:54:05.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f718cff9700 10 client.5607 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:05.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f718cff9700 1 -- 172.21.15.90:0/326634109 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55f478c587f0 con 0x55f478d83190 2022-07-05T11:54:05.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f718cff9700 10 client.5607 handle_command_reply: tid=0 2022-07-05T11:54:05.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 client.5607 shutdown 2022-07-05T11:54:05.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 msgr2=0x55f478d455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:05.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d455e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f71a00188f0 tx=0x7f71a001a040).stop 2022-07-05T11:54:05.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 shutdown_connections 2022-07-05T11:54:05.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478d835a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d91e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f718cff9700 0 client.5607 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:05.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d455e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/326634109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d816d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.935+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 >> 172.21.15.90:0/326634109 conn(0x55f478b7b1c0 msgr2=0x55f478d7d150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:05.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.936+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 shutdown_connections 2022-07-05T11:54:05.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.936+0000 7f71c9e2db80 1 -- 172.21.15.90:0/326634109 wait complete. 2022-07-05T11:54:05.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.936+0000 7f71c9e2db80 20 client.5607 trim_cache size 0 max 16384 2022-07-05T11:54:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.951+0000 7f71c9e2db80 1 Processor -- start 2022-07-05T11:54:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.952+0000 7f71c9e2db80 1 -- start start 2022-07-05T11:54:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.952+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d0e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.952+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d80ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.952+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d58950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:05.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.952+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478d58e40 con 0x55f478d0ccb0 2022-07-05T11:54:05.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.952+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478d4f650 con 0x55f478d503c0 2022-07-05T11:54:05.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.952+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478d83570 con 0x55f478d507a0 2022-07-05T11:54:05.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d0e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d0e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59234/0 (socket says 172.21.15.90:59234) 2022-07-05T11:54:05.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 -- 172.21.15.90:0/843544446 learned_addr learned my addr 172.21.15.90:0/843544446 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:05.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d58950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b5a3c700 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d80ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:05.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 -- 172.21.15.90:0/843544446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 msgr2=0x55f478d58950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:05.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d58950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 -- 172.21.15.90:0/843544446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 msgr2=0x55f478d80ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:05.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d80ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:05.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 -- 172.21.15.90:0/843544446 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f478ad1fd0 con 0x55f478d0ccb0 2022-07-05T11:54:05.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f71b623d700 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d0e4c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f71a0001250 tx=0x7f71a0012000).ready entity=mon.0 client_cookie=1d34e354819e5389 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:05.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f718ffff700 1 -- 172.21.15.90:0/843544446 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a001d040 con 0x55f478d0ccb0 2022-07-05T11:54:05.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f718ffff700 1 -- 172.21.15.90:0/843544446 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a00167d0 con 0x55f478d0ccb0 2022-07-05T11:54:06.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.953+0000 7f718ffff700 1 -- 172.21.15.90:0/843544446 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a00163f0 con 0x55f478d0ccb0 2022-07-05T11:54:06.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 -- 172.21.15.90:0/843544446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 msgr2=0x55f478d0e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:06.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d0e4c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f71a0001250 tx=0x7f71a0012000).stop 2022-07-05T11:54:06.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 -- 172.21.15.90:0/843544446 shutdown_connections 2022-07-05T11:54:06.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d507a0 0x55f478d58950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d0ccb0 0x55f478d0e4c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/843544446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d503c0 0x55f478d80ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 -- 172.21.15.90:0/843544446 >> 172.21.15.90:0/843544446 conn(0x55f478b7b1c0 msgr2=0x55f478d0c230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:06.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 -- 172.21.15.90:0/843544446 shutdown_connections 2022-07-05T11:54:06.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 -- 172.21.15.90:0/843544446 wait complete. 2022-07-05T11:54:06.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 -- start start 2022-07-05T11:54:06.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.954+0000 7f71c9e2db80 1 Processor -- start 2022-07-05T11:54:06.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d06d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:06.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d4e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:06.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478dd67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:06.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478d4f0e0 con 0x55f478d507a0 2022-07-05T11:54:06.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478d4d130 con 0x55f478d0ccb0 2022-07-05T11:54:06.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f478dd6cd0 con 0x55f478d503c0 2022-07-05T11:54:06.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 10 client.0 ll_register_callbacks cb 0x55f478cd01b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:54:06.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478dd67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:06.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478dd67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59244/0 (socket says 172.21.15.90:59244) 2022-07-05T11:54:06.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 -- 172.21.15.90:0/1371908856 learned_addr learned my addr 172.21.15.90:0/1371908856 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:06.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b5a3c700 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d4e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:06.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b623d700 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d06d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:06.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 -- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 msgr2=0x55f478d4e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:06.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d4e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 -- 172.21.15.90:0/1371908856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 msgr2=0x55f478d06d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:06.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d06d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 -- 172.21.15.90:0/1371908856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f478b03cd0 con 0x55f478d507a0 2022-07-05T11:54:06.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71b6a3e700 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478dd67e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f71a80854d0 tx=0x7f71a8057000).ready entity=mon.0 client_cookie=2b76fa09f25814c6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:06.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f718cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:54:06.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f718cff9700 1 -- 172.21.15.90:0/1371908856 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8089220 con 0x55f478d507a0 2022-07-05T11:54:06.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f718cff9700 1 -- 172.21.15.90:0/1371908856 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f71a8019310 con 0x55f478d507a0 2022-07-05T11:54:06.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71a8012d70 con 0x55f478d507a0 2022-07-05T11:54:06.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f718cff9700 1 -- 172.21.15.90:0/1371908856 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a8089380 con 0x55f478d507a0 2022-07-05T11:54:06.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 10 client.5613 fetch_fsmap learned FSMap version 22 2022-07-05T11:54:06.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55f478d45ca0 con 0x55f478d507a0 2022-07-05T11:54:06.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.956+0000 7f718cff9700 1 -- 172.21.15.90:0/1371908856 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a809f020 con 0x55f478d507a0 2022-07-05T11:54:06.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f718cff9700 1 -- 172.21.15.90:0/1371908856 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f71a80849c0 con 0x55f478d507a0 2022-07-05T11:54:06.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 10 client.5613 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:54:06.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 10 client.5613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:54:06.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 20 client.5613 populate_metadata read hostname 'smithi090' 2022-07-05T11:54:06.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478dd6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:06.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 4 client.5613 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:54:06.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f478c4f690 con 0x55f478d83190 2022-07-05T11:54:06.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71b623d700 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478dd6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:06.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f718cff9700 10 client.5613 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:06.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71b623d700 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478dd6f20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=14b1e88d056efef server_cookie=8d3314267415e302 in_seq=0 out_seq=0 2022-07-05T11:54:06.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f718cff9700 1 -- 172.21.15.90:0/1371908856 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f478c4f690 con 0x55f478d83190 2022-07-05T11:54:06.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f718cff9700 10 client.5613 handle_command_reply: tid=0 2022-07-05T11:54:06.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 client.5613 shutdown 2022-07-05T11:54:06.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 msgr2=0x55f478dd67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:06.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478dd67e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f71a80854d0 tx=0x7f71a8057000).stop 2022-07-05T11:54:06.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 shutdown_connections 2022-07-05T11:54:06.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55f478d83190 0x55f478dd6f20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f478d507a0 0x55f478dd67e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f718cff9700 0 client.5613 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f478d0ccb0 0x55f478d06d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 --2- 172.21.15.90:0/1371908856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f478d503c0 0x55f478d4e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 >> 172.21.15.90:0/1371908856 conn(0x55f478b7b1c0 msgr2=0x55f478dd84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:06.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 shutdown_connections 2022-07-05T11:54:06.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.957+0000 7f71c9e2db80 1 -- 172.21.15.90:0/1371908856 wait complete. 2022-07-05T11:54:06.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71c9e2db80 20 client.5613 trim_cache size 0 max 16384 2022-07-05T11:54:06.029 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:54:06.030 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:54:06.030 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:54:06.031 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:54:06.031 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:54:06.032 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:54:06.032 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:54:06.032 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:54:06.033 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:54:06.033 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:54:06.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f719008ba40 msgr2=0x7f719008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:06.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f719008ba40 0x7f719008df00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f71a0005fd0 tx=0x7f71a0007e90).stop 2022-07-05T11:54:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b0174ed0 msgr2=0x7f71b018ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b0174ed0 0x7f71b018ffd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f71a800e900 tx=0x7f71a8009060).stop 2022-07-05T11:54:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 shutdown_connections 2022-07-05T11:54:06.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f719008ba40 0x7f719008df00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b0174ed0 0x7f71b018ffd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71b00ed530 0x7f71b01680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 --2- 172.21.15.90:0/316399350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71b0174af0 0x7f71b018fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 >> 172.21.15.90:0/316399350 conn(0x7f71b005d9a0 msgr2=0x7f71b005dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 shutdown_connections 2022-07-05T11:54:06.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:05.958+0000 7f71b84a1700 1 -- 172.21.15.90:0/316399350 wait complete. 2022-07-05T11:54:06.041 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:54:36.044 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:54:36.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.177+0000 7f9b4a616700 1 Processor -- start 2022-07-05T11:54:36.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.177+0000 7f9b4a616700 1 -- start start 2022-07-05T11:54:36.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b4a616700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b441789f0 0x7f9b4417f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b4a616700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4417d560 con 0x7f9b44178610 2022-07-05T11:54:36.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b4a616700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4417c670 con 0x7f9b4417e100 2022-07-05T11:54:36.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b4a616700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4417f8a0 con 0x7f9b441789f0 2022-07-05T11:54:36.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b43fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9b44178610 0x7f9b4417d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52188/0 (socket says 172.21.15.90:52188) 2022-07-05T11:54:36.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b43fff700 1 -- 172.21.15.90:0/2012363003 learned_addr learned my addr 172.21.15.90:0/2012363003 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:54:36.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/2012363003 >> v2:172.21.15.149:3300/0 conn(0x7f9b441789f0 0x7f9b4417f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b437fe700 1 -- 172.21.15.90:0/2012363003 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451596471 0 0) 0x7f9b4417d560 con 0x7f9b44178610 2022-07-05T11:54:36.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b437fe700 1 -- 172.21.15.90:0/2012363003 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b240033f0 con 0x7f9b44178610 2022-07-05T11:54:36.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b3bfff700 1 -- 172.21.15.90:0/2012363003 >> v1:172.21.15.149:6789/0 conn(0x7f9b4417e100 legacy=0x7f9b44063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b3bfff700 1 -- 172.21.15.90:0/2012363003 >> v1:172.21.15.90:6789/0 conn(0x7f9b44178610 legacy=0x7f9b4417d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b3bfff700 1 -- 172.21.15.90:0/2012363003 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4417c950 con 0x7f9b441789f0 2022-07-05T11:54:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.178+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/2012363003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 0x7f9b4417f3b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f9b2c009760 tx=0x7f9b2c009060).ready entity=mon.2 client_cookie=5eb36634ad2a120f server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b437fe700 1 -- 172.21.15.90:0/2012363003 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00f510 con 0x7f9b441789f0 2022-07-05T11:54:36.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b437fe700 1 -- 172.21.15.90:0/2012363003 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00f670 con 0x7f9b441789f0 2022-07-05T11:54:36.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b437fe700 1 -- 172.21.15.90:0/2012363003 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00f9f0 con 0x7f9b441789f0 2022-07-05T11:54:36.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b4a616700 1 -- 172.21.15.90:0/2012363003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 msgr2=0x7f9b4417f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b4a616700 1 --2- 172.21.15.90:0/2012363003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 0x7f9b4417f3b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f9b2c009760 tx=0x7f9b2c009060).stop 2022-07-05T11:54:36.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b4a616700 1 -- 172.21.15.90:0/2012363003 shutdown_connections 2022-07-05T11:54:36.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b4a616700 1 --2- 172.21.15.90:0/2012363003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 0x7f9b4417f3b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b4a616700 1 -- 172.21.15.90:0/2012363003 >> 172.21.15.90:0/2012363003 conn(0x7f9b440f2210 msgr2=0x7f9b44069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:36.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b4a616700 1 -- 172.21.15.90:0/2012363003 shutdown_connections 2022-07-05T11:54:36.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.179+0000 7f9b4a616700 1 -- 172.21.15.90:0/2012363003 wait complete. 2022-07-05T11:54:36.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.180+0000 7f9b4a616700 1 Processor -- start 2022-07-05T11:54:36.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.181+0000 7f9b4a616700 1 -- start start 2022-07-05T11:54:36.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.181+0000 7f9b4a616700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b44178610 0x7f9b44192bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b4a616700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 0x7f9b44171500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b4a616700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b4417e100 0x7f9b441719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b4a616700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44181070 con 0x7f9b44178610 2022-07-05T11:54:36.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b4a616700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440c86f0 con 0x7f9b4417e100 2022-07-05T11:54:36.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b4a616700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440c89d0 con 0x7f9b441789f0 2022-07-05T11:54:36.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b44178610 0x7f9b44192bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b44178610 0x7f9b44192bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59252/0 (socket says 172.21.15.90:59252) 2022-07-05T11:54:36.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 -- 172.21.15.90:0/4269978435 learned_addr learned my addr 172.21.15.90:0/4269978435 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:36.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 0x7f9b44171500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b4417e100 0x7f9b441719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 -- 172.21.15.90:0/4269978435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 msgr2=0x7f9b44171500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 0x7f9b44171500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 -- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b4417e100 msgr2=0x7f9b441719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b4417e100 0x7f9b441719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 -- 172.21.15.90:0/4269978435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c0092a0 con 0x7f9b44178610 2022-07-05T11:54:36.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b4417e100 0x7f9b441719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:54:36.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b43fff700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b44178610 0x7f9b44192bd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f9b3400c420 tx=0x7f9b34007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:36.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b40ff9700 1 -- 172.21.15.90:0/4269978435 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400ce80 con 0x7f9b44178610 2022-07-05T11:54:36.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b40ff9700 1 -- 172.21.15.90:0/4269978435 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b340072e0 con 0x7f9b44178610 2022-07-05T11:54:36.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b440c8cb0 con 0x7f9b44178610 2022-07-05T11:54:36.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b40ff9700 1 -- 172.21.15.90:0/4269978435 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34007660 con 0x7f9b44178610 2022-07-05T11:54:36.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.182+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b441930c0 con 0x7f9b44178610 2022-07-05T11:54:36.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.184+0000 7f9b40ff9700 1 -- 172.21.15.90:0/4269978435 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f9b3401a060 con 0x7f9b44178610 2022-07-05T11:54:36.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.184+0000 7f9b40ff9700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9b2808ba40 0x7f9b2808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.185+0000 7f9b40ff9700 1 -- 172.21.15.90:0/4269978435 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9b340afcb0 con 0x7f9b44178610 2022-07-05T11:54:36.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.185+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9b2808ba40 0x7f9b2808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.185+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9b2808ba40 0x7f9b2808df00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f9b4417d0d0 tx=0x7f9b2c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:36.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.186+0000 7f9b5bfa2b80 1 Processor -- start 2022-07-05T11:54:36.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.186+0000 7f9b5bfa2b80 1 -- start start 2022-07-05T11:54:36.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6847c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d684cb0 0x55681d6d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d6c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d64e2d0 con 0x55681d6c83c0 2022-07-05T11:54:36.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d5c5aa0 con 0x55681d684cb0 2022-07-05T11:54:36.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d5da950 con 0x55681d6c87a0 2022-07-05T11:54:36.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6847c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6847c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59260/0 (socket says 172.21.15.90:59260) 2022-07-05T11:54:36.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b43fff700 1 -- 172.21.15.90:0/2905841079 learned_addr learned my addr 172.21.15.90:0/2905841079 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:36.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.187+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d6c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d684cb0 0x55681d6d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b43fff700 1 -- 172.21.15.90:0/2905841079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 msgr2=0x55681d6c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b43fff700 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d6c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b43fff700 1 -- 172.21.15.90:0/2905841079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d684cb0 msgr2=0x55681d6d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b43fff700 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d684cb0 0x55681d6d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b43fff700 1 -- 172.21.15.90:0/2905841079 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55681d40c9e0 con 0x55681d6c83c0 2022-07-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b43fff700 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6847c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f9b340841b0 tx=0x7f9b34007eb0).ready entity=mon.0 client_cookie=49cd58bd69c5f194 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b397fa700 1 -- 172.21.15.90:0/2905841079 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34082910 con 0x55681d6c83c0 2022-07-05T11:54:36.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b397fa700 1 -- 172.21.15.90:0/2905841079 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34080c80 con 0x55681d6c83c0 2022-07-05T11:54:36.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.188+0000 7f9b397fa700 1 -- 172.21.15.90:0/2905841079 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34083c70 con 0x55681d6c83c0 2022-07-05T11:54:36.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/2905841079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 msgr2=0x55681d6847c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6847c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f9b340841b0 tx=0x7f9b34007eb0).stop 2022-07-05T11:54:36.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/2905841079 shutdown_connections 2022-07-05T11:54:36.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d6c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6847c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/2905841079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d684cb0 0x55681d6d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/2905841079 >> 172.21.15.90:0/2905841079 conn(0x55681d4f31c0 msgr2=0x55681d687ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:36.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/2905841079 shutdown_connections 2022-07-05T11:54:36.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/2905841079 wait complete. 2022-07-05T11:54:36.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.189+0000 7f9b5bfa2b80 1 -- start start 2022-07-05T11:54:36.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.190+0000 7f9b5bfa2b80 1 Processor -- start 2022-07-05T11:54:36.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.190+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d684cb0 0x55681d6fa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.190+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d6f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d5a2120 con 0x55681d6c83c0 2022-07-05T11:54:36.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d6c2a60 con 0x55681d6c87a0 2022-07-05T11:54:36.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d6fa0d0 con 0x55681d684cb0 2022-07-05T11:54:36.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 10 client.0 ll_register_callbacks cb 0x55681d6481b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:54:36.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59266/0 (socket says 172.21.15.90:59266) 2022-07-05T11:54:36.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 -- 172.21.15.90:0/979511853 learned_addr learned my addr 172.21.15.90:0/979511853 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:36.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b43fff700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d684cb0 0x55681d6fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d6f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 -- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d684cb0 msgr2=0x55681d6fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d684cb0 0x55681d6fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 -- 172.21.15.90:0/979511853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 msgr2=0x55681d6f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d6f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 -- 172.21.15.90:0/979511853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b441930c0 con 0x55681d6c83c0 2022-07-05T11:54:36.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d6f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:54:36.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6bd460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f9b2c009e00 tx=0x7f9b2c01e040).ready entity=mon.0 client_cookie=e1e6ed89f851c019 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:36.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b227fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:54:36.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b227fc700 1 -- 172.21.15.90:0/979511853 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c027620 con 0x55681d6c83c0 2022-07-05T11:54:36.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b227fc700 1 -- 172.21.15.90:0/979511853 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9b2c027780 con 0x55681d6c83c0 2022-07-05T11:54:36.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55681d682440 con 0x55681d6c83c0 2022-07-05T11:54:36.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b227fc700 1 -- 172.21.15.90:0/979511853 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b2c027940 con 0x55681d6c83c0 2022-07-05T11:54:36.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 10 client.5625 fetch_fsmap learned FSMap version 22 2022-07-05T11:54:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55681d47bcd0 con 0x55681d6c83c0 2022-07-05T11:54:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.191+0000 7f9b227fc700 1 -- 172.21.15.90:0/979511853 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55681d682440 con 0x55681d6c83c0 2022-07-05T11:54:36.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b227fc700 1 -- 172.21.15.90:0/979511853 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f9b2c027aa0 con 0x55681d6c83c0 2022-07-05T11:54:36.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b5bfa2b80 10 client.5625 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:54:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b5bfa2b80 10 client.5625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:54:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b5bfa2b80 20 client.5625 populate_metadata read hostname 'smithi090' 2022-07-05T11:54:36.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d706a90 0x55681d706ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b5bfa2b80 4 client.5625 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:54:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55681d5d07f0 con 0x55681d706a90 2022-07-05T11:54:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b43fff700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d706a90 0x55681d706ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b227fc700 10 client.5625 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.192+0000 7f9b43fff700 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d706a90 0x55681d706ea0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1ca647ca5ecdbf13 server_cookie=568f3c6a515355ac in_seq=0 out_seq=0 2022-07-05T11:54:36.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b227fc700 1 -- 172.21.15.90:0/979511853 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55681d5d07f0 con 0x55681d706a90 2022-07-05T11:54:36.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b227fc700 10 client.5625 handle_command_reply: tid=0 2022-07-05T11:54:36.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 client.5625 shutdown 2022-07-05T11:54:36.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 msgr2=0x55681d6bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6bd460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f9b2c009e00 tx=0x7f9b2c01e040).stop 2022-07-05T11:54:36.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 shutdown_connections 2022-07-05T11:54:36.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d706a90 0x55681d706ea0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d6f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b227fc700 0 client.5625 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:36.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d684cb0 0x55681d6fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/979511853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d6c83c0 0x55681d6bd460 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 >> 172.21.15.90:0/979511853 conn(0x55681d4f31c0 msgr2=0x55681d6f5150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:36.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 shutdown_connections 2022-07-05T11:54:36.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/979511853 wait complete. 2022-07-05T11:54:36.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.193+0000 7f9b5bfa2b80 20 client.5625 trim_cache size 0 max 16384 2022-07-05T11:54:36.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.209+0000 7f9b5bfa2b80 1 Processor -- start 2022-07-05T11:54:36.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.209+0000 7f9b5bfa2b80 1 -- start start 2022-07-05T11:54:36.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d70a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c83c0 0x55681d70a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d752a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d6c4880 con 0x55681d684cb0 2022-07-05T11:54:36.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d67ed70 con 0x55681d6c87a0 2022-07-05T11:54:36.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d6844e0 con 0x55681d6c83c0 2022-07-05T11:54:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d70a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d70a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59272/0 (socket says 172.21.15.90:59272) 2022-07-05T11:54:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 -- 172.21.15.90:0/3701973627 learned_addr learned my addr 172.21.15.90:0/3701973627 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c83c0 0x55681d70a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d752a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 -- 172.21.15.90:0/3701973627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c83c0 msgr2=0x55681d70a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c83c0 0x55681d70a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 -- 172.21.15.90:0/3701973627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 msgr2=0x55681d752a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d752a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 -- 172.21.15.90:0/3701973627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55681d449fd0 con 0x55681d684cb0 2022-07-05T11:54:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d752a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:54:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b43fff700 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d70a090 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9b34084500 tx=0x7f9b34018000).ready entity=mon.0 client_cookie=a412dd0a9492fa06 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b39ffb700 1 -- 172.21.15.90:0/3701973627 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34080df0 con 0x55681d684cb0 2022-07-05T11:54:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b39ffb700 1 -- 172.21.15.90:0/3701973627 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34089bd0 con 0x55681d684cb0 2022-07-05T11:54:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.210+0000 7f9b39ffb700 1 -- 172.21.15.90:0/3701973627 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34082910 con 0x55681d684cb0 2022-07-05T11:54:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/3701973627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 msgr2=0x55681d70a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d70a090 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9b34084500 tx=0x7f9b34018000).stop 2022-07-05T11:54:36.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/3701973627 shutdown_connections 2022-07-05T11:54:36.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c87a0 0x55681d752a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d70a090 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/3701973627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c83c0 0x55681d70a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/3701973627 >> 172.21.15.90:0/3701973627 conn(0x55681d4f31c0 msgr2=0x55681d685710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/3701973627 shutdown_connections 2022-07-05T11:54:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.211+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/3701973627 wait complete. 2022-07-05T11:54:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.212+0000 7f9b5bfa2b80 1 -- start start 2022-07-05T11:54:36.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.212+0000 7f9b5bfa2b80 1 Processor -- start 2022-07-05T11:54:36.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d6f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c83c0 0x55681d6c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d75fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d6d1af0 con 0x55681d684cb0 2022-07-05T11:54:36.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d75f6c0 con 0x55681d6c83c0 2022-07-05T11:54:36.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681d760560 con 0x55681d6c87a0 2022-07-05T11:54:36.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 10 client.0 ll_register_callbacks cb 0x55681d6481b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:54:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d6f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d6f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59278/0 (socket says 172.21.15.90:59278) 2022-07-05T11:54:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 -- 172.21.15.90:0/304960259 learned_addr learned my addr 172.21.15.90:0/304960259 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:54:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b48bb3700 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d75fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c83c0 0x55681d6c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 -- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 msgr2=0x55681d75fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d75fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 -- 172.21.15.90:0/304960259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c83c0 msgr2=0x55681d6c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:54:36.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c83c0 0x55681d6c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 -- 172.21.15.90:0/304960259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55681d40c9e0 con 0x55681d684cb0 2022-07-05T11:54:36.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b43fff700 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d6f15c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9b34084270 tx=0x7f9b34091000).ready entity=mon.0 client_cookie=673ef5ff10164adc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:54:36.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b227fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:54:36.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b227fc700 1 -- 172.21.15.90:0/304960259 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34083c70 con 0x55681d684cb0 2022-07-05T11:54:36.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b227fc700 1 -- 172.21.15.90:0/304960259 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9b3408e040 con 0x55681d684cb0 2022-07-05T11:54:36.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b34080c80 con 0x55681d684cb0 2022-07-05T11:54:36.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b227fc700 1 -- 172.21.15.90:0/304960259 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b34088150 con 0x55681d684cb0 2022-07-05T11:54:36.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 10 client.5631 fetch_fsmap learned FSMap version 22 2022-07-05T11:54:36.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55681d6c14e0 con 0x55681d684cb0 2022-07-05T11:54:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.213+0000 7f9b227fc700 1 -- 172.21.15.90:0/304960259 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34080c80 con 0x55681d684cb0 2022-07-05T11:54:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b227fc700 1 -- 172.21.15.90:0/304960259 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f9b3409c020 con 0x55681d684cb0 2022-07-05T11:54:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 10 client.5631 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:54:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 10 client.5631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:54:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 20 client.5631 populate_metadata read hostname 'smithi090' 2022-07-05T11:54:36.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d67ecf0 0x55681d6d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:54:36.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 4 client.5631 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:54:36.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55681d5c7690 con 0x55681d67ecf0 2022-07-05T11:54:36.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d67ecf0 0x55681d6d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:54:36.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b227fc700 10 client.5631 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:36.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b3bfff700 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d67ecf0 0x55681d6d0f70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8045cd944c6277e6 server_cookie=3efa40f44394a813 in_seq=0 out_seq=0 2022-07-05T11:54:36.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b227fc700 1 -- 172.21.15.90:0/304960259 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55681d5c7690 con 0x55681d67ecf0 2022-07-05T11:54:36.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b227fc700 10 client.5631 handle_command_reply: tid=0 2022-07-05T11:54:36.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 1 client.5631 shutdown 2022-07-05T11:54:36.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 msgr2=0x55681d6f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d6f15c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9b34084270 tx=0x7f9b34091000).stop 2022-07-05T11:54:36.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.214+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 shutdown_connections 2022-07-05T11:54:36.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55681d67ecf0 0x55681d6d0f70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55681d6c87a0 0x55681d75fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b227fc700 0 client.5631 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:54:36.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55681d684cb0 0x55681d6f15c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 1 --2- 172.21.15.90:0/304960259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681d6c83c0 0x55681d6c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 >> 172.21.15.90:0/304960259 conn(0x55681d4f31c0 msgr2=0x55681d6cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 shutdown_connections 2022-07-05T11:54:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 1 -- 172.21.15.90:0/304960259 wait complete. 2022-07-05T11:54:36.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b5bfa2b80 20 client.5631 trim_cache size 0 max 16384 2022-07-05T11:54:36.367 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:54:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:54:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:54:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:54:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:54:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:54:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:54:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:54:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:54:36.370 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:54:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9b2808ba40 msgr2=0x7f9b2808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9b2808ba40 0x7f9b2808df00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f9b4417d0d0 tx=0x7f9b2c017000).stop 2022-07-05T11:54:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b44178610 msgr2=0x7f9b44192bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:54:36.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b44178610 0x7f9b44192bd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f9b3400c420 tx=0x7f9b34007c80).stop 2022-07-05T11:54:36.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 shutdown_connections 2022-07-05T11:54:36.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9b2808ba40 0x7f9b2808df00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b4417e100 0x7f9b441719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b44178610 0x7f9b44192bd0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 --2- 172.21.15.90:0/4269978435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b441789f0 0x7f9b44171500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:54:36.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 >> 172.21.15.90:0/4269978435 conn(0x7f9b440f2210 msgr2=0x7f9b440ec010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:54:36.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 shutdown_connections 2022-07-05T11:54:36.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:54:36.215+0000 7f9b4a616700 1 -- 172.21.15.90:0/4269978435 wait complete. 2022-07-05T11:54:36.376 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:55:06.377 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:55:06.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.511+0000 7ff449e3f700 1 Processor -- start 2022-07-05T11:55:06.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.511+0000 7ff449e3f700 1 -- start start 2022-07-05T11:55:06.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff449e3f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff44417dda0 0x7ff44417e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff449e3f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4440e6110 0x7ff44406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff449e3f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff444083570 0x7ff444067cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff449e3f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44406a610 con 0x7ff444083570 2022-07-05T11:55:06.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff449e3f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff444068da0 con 0x7ff4440e6110 2022-07-05T11:55:06.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff449e3f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff444069080 con 0x7ff44417dda0 2022-07-05T11:55:06.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff444083570 0x7ff444067cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff444083570 0x7ff444067cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59288/0 (socket says 172.21.15.90:59288) 2022-07-05T11:55:06.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 -- 172.21.15.90:0/2100376556 learned_addr learned my addr 172.21.15.90:0/2100376556 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:06.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff43affd700 1 --2- 172.21.15.90:0/2100376556 >> v2:172.21.15.110:3300/0 conn(0x7ff4440e6110 0x7ff44406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff4437fe700 1 --2- 172.21.15.90:0/2100376556 >> v2:172.21.15.149:3300/0 conn(0x7ff44417dda0 0x7ff44417e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 -- 172.21.15.90:0/2100376556 >> v2:172.21.15.149:3300/0 conn(0x7ff44417dda0 msgr2=0x7ff44417e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 --2- 172.21.15.90:0/2100376556 >> v2:172.21.15.149:3300/0 conn(0x7ff44417dda0 0x7ff44417e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 -- 172.21.15.90:0/2100376556 >> v2:172.21.15.110:3300/0 conn(0x7ff4440e6110 msgr2=0x7ff44406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 --2- 172.21.15.90:0/2100376556 >> v2:172.21.15.110:3300/0 conn(0x7ff4440e6110 0x7ff44406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 -- 172.21.15.90:0/2100376556 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff444069360 con 0x7ff444083570 2022-07-05T11:55:06.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.512+0000 7ff443fff700 1 --2- 172.21.15.90:0/2100376556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff444083570 0x7ff444067cc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff4440f04f0 tx=0x7ff43c009840).ready entity=mon.0 client_cookie=df09635e46938a16 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:06.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff442ffd700 1 -- 172.21.15.90:0/2100376556 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00e070 con 0x7ff444083570 2022-07-05T11:55:06.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff442ffd700 1 -- 172.21.15.90:0/2100376556 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00b9f0 con 0x7ff444083570 2022-07-05T11:55:06.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff442ffd700 1 -- 172.21.15.90:0/2100376556 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00bd70 con 0x7ff444083570 2022-07-05T11:55:06.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 -- 172.21.15.90:0/2100376556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff444083570 msgr2=0x7ff444067cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 --2- 172.21.15.90:0/2100376556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff444083570 0x7ff444067cc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff4440f04f0 tx=0x7ff43c009840).stop 2022-07-05T11:55:06.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 -- 172.21.15.90:0/2100376556 shutdown_connections 2022-07-05T11:55:06.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 --2- 172.21.15.90:0/2100376556 >> v2:172.21.15.149:3300/0 conn(0x7ff44417dda0 0x7ff44417e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 --2- 172.21.15.90:0/2100376556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff444083570 0x7ff444067cc0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 --2- 172.21.15.90:0/2100376556 >> v2:172.21.15.110:3300/0 conn(0x7ff4440e6110 0x7ff44406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 -- 172.21.15.90:0/2100376556 >> 172.21.15.90:0/2100376556 conn(0x7ff4440f0030 msgr2=0x7ff444061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:06.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 -- 172.21.15.90:0/2100376556 shutdown_connections 2022-07-05T11:55:06.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.513+0000 7ff449e3f700 1 -- 172.21.15.90:0/2100376556 wait complete. 2022-07-05T11:55:06.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.514+0000 7ff449e3f700 1 Processor -- start 2022-07-05T11:55:06.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.515+0000 7ff449e3f700 1 -- start start 2022-07-05T11:55:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff449e3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444083570 0x7ff444182450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff449e3f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4440e6110 0x7ff44417d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff449e3f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44417dda0 0x7ff44416f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff449e3f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44417d710 con 0x7ff44417dda0 2022-07-05T11:55:06.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff449e3f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4441810d0 con 0x7ff4440e6110 2022-07-05T11:55:06.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff449e3f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4441813b0 con 0x7ff444083570 2022-07-05T11:55:06.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44417dda0 0x7ff44416f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44417dda0 0x7ff44416f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59294/0 (socket says 172.21.15.90:59294) 2022-07-05T11:55:06.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 -- 172.21.15.90:0/1656184553 learned_addr learned my addr 172.21.15.90:0/1656184553 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:06.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff43affd700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4440e6110 0x7ff44417d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff4437fe700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444083570 0x7ff444182450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 -- 172.21.15.90:0/1656184553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444083570 msgr2=0x7ff444182450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444083570 0x7ff444182450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 -- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4440e6110 msgr2=0x7ff44417d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4440e6110 0x7ff44417d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 -- 172.21.15.90:0/1656184553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009ae0 con 0x7ff44417dda0 2022-07-05T11:55:06.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff4437fe700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444083570 0x7ff444182450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:55:06.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff443fff700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44417dda0 0x7ff44416f210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff4440f0550 tx=0x7ff43c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:06.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff43bfff700 1 -- 172.21.15.90:0/1656184553 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c013e60 con 0x7ff44417dda0 2022-07-05T11:55:06.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff43bfff700 1 -- 172.21.15.90:0/1656184553 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c0092e0 con 0x7ff44417dda0 2022-07-05T11:55:06.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff444181690 con 0x7ff44417dda0 2022-07-05T11:55:06.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.516+0000 7ff43bfff700 1 -- 172.21.15.90:0/1656184553 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c01e6c0 con 0x7ff44417dda0 2022-07-05T11:55:06.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.517+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff444181c50 con 0x7ff44417dda0 2022-07-05T11:55:06.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.518+0000 7ff43bfff700 1 -- 172.21.15.90:0/1656184553 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff43c025030 con 0x7ff44417dda0 2022-07-05T11:55:06.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.519+0000 7ff43bfff700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42808ba40 0x7ff42808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.519+0000 7ff43bfff700 1 -- 172.21.15.90:0/1656184553 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff43c0b2090 con 0x7ff44417dda0 2022-07-05T11:55:06.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.519+0000 7ff4437fe700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42808ba40 0x7ff42808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.519+0000 7ff4437fe700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42808ba40 0x7ff42808df00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7ff434006fd0 tx=0x7ff434008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:06.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.520+0000 7ff45b7cbb80 1 Processor -- start 2022-07-05T11:55:06.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.520+0000 7ff45b7cbb80 1 -- start start 2022-07-05T11:55:06.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.521+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d43c0 0x55bfb12907c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.521+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb12de990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.521+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.521+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb125a2d0 con 0x55bfb12d43c0 2022-07-05T11:55:06.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.521+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb11d1aa0 con 0x55bfb12d47a0 2022-07-05T11:55:06.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.521+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb11e6950 con 0x55bfb1290cb0 2022-07-05T11:55:06.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.521+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d43c0 0x55bfb12907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d43c0 0x55bfb12907c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59298/0 (socket says 172.21.15.90:59298) 2022-07-05T11:55:06.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 -- 172.21.15.90:0/3154594756 learned_addr learned my addr 172.21.15.90:0/3154594756 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:06.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff43affd700 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb12de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff443fff700 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 -- 172.21.15.90:0/3154594756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 msgr2=0x55bfb12de990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb12de990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 -- 172.21.15.90:0/3154594756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 msgr2=0x55bfb12d4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 -- 172.21.15.90:0/3154594756 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfb10189e0 con 0x55bfb12d43c0 2022-07-05T11:55:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff443fff700 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:55:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff4437fe700 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d43c0 0x55bfb12907c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7ff43400fa00 tx=0x7ff434014000).ready entity=mon.0 client_cookie=d194149adb5cad45 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff438ff9700 1 -- 172.21.15.90:0/3154594756 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43400fe90 con 0x55bfb12d43c0 2022-07-05T11:55:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff438ff9700 1 -- 172.21.15.90:0/3154594756 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434013890 con 0x55bfb12d43c0 2022-07-05T11:55:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.522+0000 7ff438ff9700 1 -- 172.21.15.90:0/3154594756 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434013c10 con 0x55bfb12d43c0 2022-07-05T11:55:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3154594756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d43c0 msgr2=0x55bfb12907c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d43c0 0x55bfb12907c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7ff43400fa00 tx=0x7ff434014000).stop 2022-07-05T11:55:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3154594756 shutdown_connections 2022-07-05T11:55:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d43c0 0x55bfb12907c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3154594756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb12de990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3154594756 >> 172.21.15.90:0/3154594756 conn(0x55bfb10ff1c0 msgr2=0x55bfb1293ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3154594756 shutdown_connections 2022-07-05T11:55:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.523+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3154594756 wait complete. 2022-07-05T11:55:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.524+0000 7ff45b7cbb80 1 -- start start 2022-07-05T11:55:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.524+0000 7ff45b7cbb80 1 Processor -- start 2022-07-05T11:55:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb1312620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d43c0 0x55bfb12ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d47a0 0x55bfb12d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb11ae120 con 0x55bfb12d47a0 2022-07-05T11:55:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb1312b10 con 0x55bfb12d43c0 2022-07-05T11:55:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb1313590 con 0x55bfb1290cb0 2022-07-05T11:55:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 10 client.0 ll_register_callbacks cb 0x55bfb12541b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:55:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d47a0 0x55bfb12d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d47a0 0x55bfb12d24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59308/0 (socket says 172.21.15.90:59308) 2022-07-05T11:55:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 -- 172.21.15.90:0/3726584771 learned_addr learned my addr 172.21.15.90:0/3726584771 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff43affd700 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d43c0 0x55bfb12ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff4437fe700 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb1312620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 -- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 msgr2=0x55bfb1312620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb1312620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 -- 172.21.15.90:0/3726584771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d43c0 msgr2=0x55bfb12ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d43c0 0x55bfb12ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 -- 172.21.15.90:0/3726584771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43400e040 con 0x55bfb12d47a0 2022-07-05T11:55:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff443fff700 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d47a0 0x55bfb12d24f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7ff43c0094b0 tx=0x7ff43c082da0).ready entity=mon.0 client_cookie=34a8d47e1d8a9fbc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff421ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:55:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff421ffb700 1 -- 172.21.15.90:0/3726584771 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0867a0 con 0x55bfb12d47a0 2022-07-05T11:55:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff421ffb700 1 -- 172.21.15.90:0/3726584771 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff43c053e40 con 0x55bfb12d47a0 2022-07-05T11:55:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfb128e440 con 0x55bfb12d47a0 2022-07-05T11:55:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff421ffb700 1 -- 172.21.15.90:0/3726584771 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff43c08be20 con 0x55bfb12d47a0 2022-07-05T11:55:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 10 client.5643 fetch_fsmap learned FSMap version 22 2022-07-05T11:55:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55bfb1087cd0 con 0x55bfb12d47a0 2022-07-05T11:55:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.525+0000 7ff421ffb700 1 -- 172.21.15.90:0/3726584771 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bfb128e440 con 0x55bfb12d47a0 2022-07-05T11:55:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff421ffb700 1 -- 172.21.15.90:0/3726584771 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7ff43c0827c0 con 0x55bfb12d47a0 2022-07-05T11:55:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff45b7cbb80 10 client.5643 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:55:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff45b7cbb80 10 client.5643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:55:06.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff45b7cbb80 20 client.5643 populate_metadata read hostname 'smithi090' 2022-07-05T11:55:06.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb12c96c0 0x55bfb1315b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff45b7cbb80 4 client.5643 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:55:06.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfb11dc7f0 con 0x55bfb12c96c0 2022-07-05T11:55:06.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff4437fe700 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb12c96c0 0x55bfb1315b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff4437fe700 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb12c96c0 0x55bfb1315b70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c11cc7ca8c91b69c server_cookie=f4da919e9fb6009c in_seq=0 out_seq=0 2022-07-05T11:55:06.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.526+0000 7ff421ffb700 10 client.5643 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:06.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff421ffb700 1 -- 172.21.15.90:0/3726584771 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55bfb11dc7f0 con 0x55bfb12c96c0 2022-07-05T11:55:06.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff421ffb700 10 client.5643 handle_command_reply: tid=0 2022-07-05T11:55:06.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 client.5643 shutdown 2022-07-05T11:55:06.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d47a0 msgr2=0x55bfb12d24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d47a0 0x55bfb12d24f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7ff43c0094b0 tx=0x7ff43c082da0).stop 2022-07-05T11:55:06.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 shutdown_connections 2022-07-05T11:55:06.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb12c96c0 0x55bfb1315b70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb12d47a0 0x55bfb12d24f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff421ffb700 0 client.5643 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:06.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb1290cb0 0x55bfb1312620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/3726584771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d43c0 0x55bfb12ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 >> 172.21.15.90:0/3726584771 conn(0x55bfb10ff1c0 msgr2=0x55bfb1291770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:06.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 shutdown_connections 2022-07-05T11:55:06.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/3726584771 wait complete. 2022-07-05T11:55:06.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.527+0000 7ff45b7cbb80 20 client.5643 trim_cache size 0 max 16384 2022-07-05T11:55:06.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.543+0000 7ff45b7cbb80 1 Processor -- start 2022-07-05T11:55:06.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.543+0000 7ff45b7cbb80 1 -- start start 2022-07-05T11:55:06.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb12cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb1301150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb1291090 con 0x55bfb1290cb0 2022-07-05T11:55:06.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb12db8c0 con 0x55bfb12d47a0 2022-07-05T11:55:06.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb12dbdd0 con 0x55bfb12d43c0 2022-07-05T11:55:06.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb12cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb12cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59314/0 (socket says 172.21.15.90:59314) 2022-07-05T11:55:06.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 -- 172.21.15.90:0/669463326 learned_addr learned my addr 172.21.15.90:0/669463326 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:06.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff43affd700 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb1301150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 -- 172.21.15.90:0/669463326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 msgr2=0x55bfb1301150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb1301150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff443fff700 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 -- 172.21.15.90:0/669463326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 msgr2=0x55bfb12d3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 -- 172.21.15.90:0/669463326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfb1055fd0 con 0x55bfb1290cb0 2022-07-05T11:55:06.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff443fff700 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:55:06.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.544+0000 7ff4437fe700 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb12cf280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff43400fa00 tx=0x7ff43401e000).ready entity=mon.0 client_cookie=ebc87036b960173e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:06.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff4397fa700 1 -- 172.21.15.90:0/669463326 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43402d030 con 0x55bfb1290cb0 2022-07-05T11:55:06.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff4397fa700 1 -- 172.21.15.90:0/669463326 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434015c70 con 0x55bfb1290cb0 2022-07-05T11:55:06.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff4397fa700 1 -- 172.21.15.90:0/669463326 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434015de0 con 0x55bfb1290cb0 2022-07-05T11:55:06.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/669463326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 msgr2=0x55bfb12cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb12cf280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff43400fa00 tx=0x7ff43401e000).stop 2022-07-05T11:55:06.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/669463326 shutdown_connections 2022-07-05T11:55:06.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12d3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb12cf280 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/669463326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb1301150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/669463326 >> 172.21.15.90:0/669463326 conn(0x55bfb10ff1c0 msgr2=0x55bfb1311c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:06.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/669463326 shutdown_connections 2022-07-05T11:55:06.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.545+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/669463326 wait complete. 2022-07-05T11:55:06.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.546+0000 7ff45b7cbb80 1 -- start start 2022-07-05T11:55:06.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.546+0000 7ff45b7cbb80 1 Processor -- start 2022-07-05T11:55:06.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb1290640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb136b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff45b7cbb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb12dd560 con 0x55bfb1290cb0 2022-07-05T11:55:06.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb12cdc50 con 0x55bfb12d47a0 2022-07-05T11:55:06.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff45b7cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfb12dcc30 con 0x55bfb12d43c0 2022-07-05T11:55:06.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff45b7cbb80 10 client.0 ll_register_callbacks cb 0x55bfb12541b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:55:06.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb1290640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb1290640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59318/0 (socket says 172.21.15.90:59318) 2022-07-05T11:55:06.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 -- 172.21.15.90:0/1253991606 learned_addr learned my addr 172.21.15.90:0/1253991606 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:06.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff443fff700 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff43affd700 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb136b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 -- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 msgr2=0x55bfb136b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb136b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 -- 172.21.15.90:0/1253991606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 msgr2=0x55bfb12cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:06.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 -- 172.21.15.90:0/1253991606 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bfb10189e0 con 0x55bfb1290cb0 2022-07-05T11:55:06.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff4437fe700 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb1290640 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff434011010 tx=0x7ff43402b000).ready entity=mon.0 client_cookie=c9333fcde27a3a6b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:06.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.547+0000 7ff421ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:55:06.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff421ffb700 1 -- 172.21.15.90:0/1253991606 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43402d040 con 0x55bfb1290cb0 2022-07-05T11:55:06.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff421ffb700 1 -- 172.21.15.90:0/1253991606 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff43402d690 con 0x55bfb1290cb0 2022-07-05T11:55:06.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff434013890 con 0x55bfb1290cb0 2022-07-05T11:55:06.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff421ffb700 1 -- 172.21.15.90:0/1253991606 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff43402da60 con 0x55bfb1290cb0 2022-07-05T11:55:06.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 10 client.5649 fetch_fsmap learned FSMap version 22 2022-07-05T11:55:06.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55bfb12dd1f0 con 0x55bfb1290cb0 2022-07-05T11:55:06.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff421ffb700 1 -- 172.21.15.90:0/1253991606 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434013890 con 0x55bfb1290cb0 2022-07-05T11:55:06.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff421ffb700 1 -- 172.21.15.90:0/1253991606 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7ff434035070 con 0x55bfb1290cb0 2022-07-05T11:55:06.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 10 client.5649 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:55:06.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 10 client.5649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:55:06.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 20 client.5649 populate_metadata read hostname 'smithi090' 2022-07-05T11:55:06.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb1294e70 0x55bfb1367480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:06.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 4 client.5649 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:55:06.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bfb11d3690 con 0x55bfb1294e70 2022-07-05T11:55:06.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff43affd700 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb1294e70 0x55bfb1367480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:06.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff421ffb700 10 client.5649 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:06.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.548+0000 7ff43affd700 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb1294e70 0x55bfb1367480 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fd4add1606ca004f server_cookie=bc5eec5c06663501 in_seq=0 out_seq=0 2022-07-05T11:55:06.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff421ffb700 1 -- 172.21.15.90:0/1253991606 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bfb11d3690 con 0x55bfb1294e70 2022-07-05T11:55:06.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff421ffb700 10 client.5649 handle_command_reply: tid=0 2022-07-05T11:55:06.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 client.5649 shutdown 2022-07-05T11:55:06.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 msgr2=0x55bfb1290640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb1290640 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff434011010 tx=0x7ff43402b000).stop 2022-07-05T11:55:06.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 shutdown_connections 2022-07-05T11:55:06.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bfb1294e70 0x55bfb1367480 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfb12d47a0 0x55bfb12cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff421ffb700 0 client.5649 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:06.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bfb1290cb0 0x55bfb1290640 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 --2- 172.21.15.90:0/1253991606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bfb12d43c0 0x55bfb136b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 >> 172.21.15.90:0/1253991606 conn(0x55bfb10ff1c0 msgr2=0x55bfb1291770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:06.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 shutdown_connections 2022-07-05T11:55:06.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 1 -- 172.21.15.90:0/1253991606 wait complete. 2022-07-05T11:55:06.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff45b7cbb80 20 client.5649 trim_cache size 0 max 16384 2022-07-05T11:55:06.596 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:55:06.597 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:55:06.597 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:55:06.597 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:55:06.598 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:55:06.598 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:55:06.598 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:55:06.598 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:55:06.599 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:55:06.599 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:55:06.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42808ba40 msgr2=0x7ff42808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42808ba40 0x7ff42808df00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7ff434006fd0 tx=0x7ff434008040).stop 2022-07-05T11:55:06.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44417dda0 msgr2=0x7ff44416f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:06.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44417dda0 0x7ff44416f210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff4440f0550 tx=0x7ff43c009840).stop 2022-07-05T11:55:06.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 shutdown_connections 2022-07-05T11:55:06.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff42808ba40 0x7ff42808df00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff44417dda0 0x7ff44416f210 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444083570 0x7ff444182450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 --2- 172.21.15.90:0/1656184553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4440e6110 0x7ff44417d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.549+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 >> 172.21.15.90:0/1656184553 conn(0x7ff4440f0030 msgr2=0x7ff4440eb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.550+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 shutdown_connections 2022-07-05T11:55:06.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:06.550+0000 7ff449e3f700 1 -- 172.21.15.90:0/1656184553 wait complete. 2022-07-05T11:55:06.606 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:55:19.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:55:19.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:55:19.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:55:36.607 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:55:36.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.735+0000 7f6b39fe0700 1 Processor -- start 2022-07-05T11:55:36.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.735+0000 7f6b39fe0700 1 -- start start 2022-07-05T11:55:36.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.736+0000 7f6b39fe0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6b341789f0 0x7f6b3417f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b39fe0700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3417d560 con 0x7f6b34178610 2022-07-05T11:55:36.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b39fe0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3417c670 con 0x7f6b3417e100 2022-07-05T11:55:36.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b39fe0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3417f8a0 con 0x7f6b341789f0 2022-07-05T11:55:36.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b337fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6b34178610 0x7f6b3417d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52266/0 (socket says 172.21.15.90:52266) 2022-07-05T11:55:36.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b337fe700 1 -- 172.21.15.90:0/3823856847 learned_addr learned my addr 172.21.15.90:0/3823856847 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:55:36.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/3823856847 >> v2:172.21.15.149:3300/0 conn(0x7f6b341789f0 0x7f6b3417f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462719665 0 0) 0x7f6b3417d560 con 0x7f6b34178610 2022-07-05T11:55:36.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b200033f0 con 0x7f6b34178610 2022-07-05T11:55:36.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1659353143 0 0) 0x7f6b200033f0 con 0x7f6b34178610 2022-07-05T11:55:36.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 >> v2:172.21.15.149:3300/0 conn(0x7f6b341789f0 msgr2=0x7f6b3417f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 --2- 172.21.15.90:0/3823856847 >> v2:172.21.15.149:3300/0 conn(0x7f6b341789f0 0x7f6b3417f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 >> v1:172.21.15.149:6789/0 conn(0x7f6b3417e100 legacy=0x7f6b34063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3417c950 con 0x7f6b34178610 2022-07-05T11:55:36.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f6b240017f0 con 0x7f6b34178610 2022-07-05T11:55:36.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 >> v1:172.21.15.90:6789/0 conn(0x7f6b34178610 legacy=0x7f6b3417d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b20003930 0x7f6b20003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20004690 0x7f6b20004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20005000 0x7f6b2000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3417f8a0 con 0x7f6b20003930 2022-07-05T11:55:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2000bfe0 con 0x7f6b20004690 2022-07-05T11:55:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2000c1a0 con 0x7f6b20005000 2022-07-05T11:55:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b337fe700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b20003930 0x7f6b20003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.737+0000 7f6b33fff700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20005000 0x7f6b2000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20004690 0x7f6b20004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b337fe700 1 -- 172.21.15.90:0/3823856847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20005000 msgr2=0x7f6b2000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b337fe700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20005000 0x7f6b2000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b337fe700 1 -- 172.21.15.90:0/3823856847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20004690 msgr2=0x7f6b20004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b337fe700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b20004690 0x7f6b20004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b33fff700 1 -- 172.21.15.90:0/3823856847 reap_dead start 2022-07-05T11:55:36.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b337fe700 1 -- 172.21.15.90:0/3823856847 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200033f0 con 0x7f6b20003930 2022-07-05T11:55:36.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b337fe700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b20003930 0x7f6b20003d50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f6b2400c480 tx=0x7f6b2400c790).ready entity=mon.0 client_cookie=d5d89dae29514bc9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:36.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24002030 con 0x7f6b20003930 2022-07-05T11:55:36.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2400cde0 con 0x7f6b20003930 2022-07-05T11:55:36.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b327fc700 1 -- 172.21.15.90:0/3823856847 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24005d30 con 0x7f6b20003930 2022-07-05T11:55:36.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b39fe0700 1 -- 172.21.15.90:0/3823856847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b20003930 msgr2=0x7f6b20003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b20003930 0x7f6b20003d50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f6b2400c480 tx=0x7f6b2400c790).stop 2022-07-05T11:55:36.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b39fe0700 1 -- 172.21.15.90:0/3823856847 shutdown_connections 2022-07-05T11:55:36.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/3823856847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b20003930 0x7f6b20003d50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b39fe0700 1 -- 172.21.15.90:0/3823856847 >> 172.21.15.90:0/3823856847 conn(0x7f6b340f2210 msgr2=0x7f6b34069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:36.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b39fe0700 1 -- 172.21.15.90:0/3823856847 shutdown_connections 2022-07-05T11:55:36.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.738+0000 7f6b39fe0700 1 -- 172.21.15.90:0/3823856847 wait complete. 2022-07-05T11:55:36.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.740+0000 7f6b39fe0700 1 Processor -- start 2022-07-05T11:55:36.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.740+0000 7f6b39fe0700 1 -- start start 2022-07-05T11:55:36.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b39fe0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20003930 0x7f6b34164190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b39fe0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b34164680 0x7f6b34190be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b39fe0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b341910d0 0x7f6b34191550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b39fe0700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3416b130 con 0x7f6b341910d0 2022-07-05T11:55:36.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b39fe0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b34190750 con 0x7f6b34164680 2022-07-05T11:55:36.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b39fe0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b34168450 con 0x7f6b20003930 2022-07-05T11:55:36.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b341910d0 0x7f6b34191550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b341910d0 0x7f6b34191550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59340/0 (socket says 172.21.15.90:59340) 2022-07-05T11:55:36.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 -- 172.21.15.90:0/2810539028 learned_addr learned my addr 172.21.15.90:0/2810539028 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:36.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b34164680 0x7f6b34190be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 -- 172.21.15.90:0/2810539028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20003930 msgr2=0x7f6b34164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b337fe700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20003930 0x7f6b34164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20003930 0x7f6b34164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 -- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b34164680 msgr2=0x7f6b34190be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b34164680 0x7f6b34190be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b33fff700 1 -- 172.21.15.90:0/2810539028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34168730 con 0x7f6b341910d0 2022-07-05T11:55:36.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.741+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b34164680 0x7f6b34190be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:55:36.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.742+0000 7f6b33fff700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b341910d0 0x7f6b34191550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f6b340f1710 tx=0x7f6b2c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:36.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.742+0000 7f6b1b7fe700 1 -- 172.21.15.90:0/2810539028 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c007240 con 0x7f6b341910d0 2022-07-05T11:55:36.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.742+0000 7f6b1b7fe700 1 -- 172.21.15.90:0/2810539028 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0073a0 con 0x7f6b341910d0 2022-07-05T11:55:36.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.742+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b34168a10 con 0x7f6b341910d0 2022-07-05T11:55:36.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.742+0000 7f6b1b7fe700 1 -- 172.21.15.90:0/2810539028 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0066f0 con 0x7f6b341910d0 2022-07-05T11:55:36.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.742+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b34168fd0 con 0x7f6b341910d0 2022-07-05T11:55:36.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.744+0000 7f6b1b7fe700 1 -- 172.21.15.90:0/2810539028 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6b2c006a60 con 0x7f6b341910d0 2022-07-05T11:55:36.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.744+0000 7f6b1b7fe700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6b1408ba40 0x7f6b1408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.744+0000 7f6b1b7fe700 1 -- 172.21.15.90:0/2810539028 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f6b2c0b0750 con 0x7f6b341910d0 2022-07-05T11:55:36.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.744+0000 7f6b337fe700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6b1408ba40 0x7f6b1408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.745+0000 7f6b337fe700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6b1408ba40 0x7f6b1408df00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f6b2400c480 tx=0x7f6b24015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.746+0000 7f6b4b96cb80 1 Processor -- start 2022-07-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.746+0000 7f6b4b96cb80 1 -- start start 2022-07-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fda7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c5fdacb0 0x5600c6028990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c601e7a0 0x5600c601ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c5fa42d0 con 0x5600c601e3c0 2022-07-05T11:55:36.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c5f1baa0 con 0x5600c5fdacb0 2022-07-05T11:55:36.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c5f30950 con 0x5600c601e7a0 2022-07-05T11:55:36.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fda7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fda7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59344/0 (socket says 172.21.15.90:59344) 2022-07-05T11:55:36.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 -- 172.21.15.90:0/2132750912 learned_addr learned my addr 172.21.15.90:0/2132750912 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:36.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c5fdacb0 0x5600c6028990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 -- 172.21.15.90:0/2132750912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c601e7a0 msgr2=0x5600c601ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b33fff700 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c601e7a0 0x5600c601ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c601e7a0 0x5600c601ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 -- 172.21.15.90:0/2132750912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c5fdacb0 msgr2=0x5600c6028990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c5fdacb0 0x5600c6028990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 -- 172.21.15.90:0/2132750912 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c5d629e0 con 0x5600c601e3c0 2022-07-05T11:55:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b33fff700 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c601e7a0 0x5600c601ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:55:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.747+0000 7f6b337fe700 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fda7c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f6b24000ff0 tx=0x7f6b2401d000).ready entity=mon.0 client_cookie=a8de565a9678c51 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b18ff9700 1 -- 172.21.15.90:0/2132750912 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b240072e0 con 0x5600c601e3c0 2022-07-05T11:55:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b18ff9700 1 -- 172.21.15.90:0/2132750912 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b24007440 con 0x5600c601e3c0 2022-07-05T11:55:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b18ff9700 1 -- 172.21.15.90:0/2132750912 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b240077c0 con 0x5600c601e3c0 2022-07-05T11:55:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/2132750912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 msgr2=0x5600c5fda7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fda7c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f6b24000ff0 tx=0x7f6b2401d000).stop 2022-07-05T11:55:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/2132750912 shutdown_connections 2022-07-05T11:55:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c601e7a0 0x5600c601ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fda7c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/2132750912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c5fdacb0 0x5600c6028990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/2132750912 >> 172.21.15.90:0/2132750912 conn(0x5600c5e491c0 msgr2=0x5600c5fddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:36.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/2132750912 shutdown_connections 2022-07-05T11:55:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.748+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/2132750912 wait complete. 2022-07-05T11:55:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.749+0000 7f6b4b96cb80 1 -- start start 2022-07-05T11:55:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.749+0000 7f6b4b96cb80 1 Processor -- start 2022-07-05T11:55:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c5fe5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c6013b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 0x5600c6051610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c5ef8120 con 0x5600c601e3c0 2022-07-05T11:55:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6051b00 con 0x5600c601e7a0 2022-07-05T11:55:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c605dad0 con 0x5600c5fdacb0 2022-07-05T11:55:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b4b96cb80 10 client.0 ll_register_callbacks cb 0x5600c5f9e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:55:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b32ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c6013b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b32ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c6013b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59352/0 (socket says 172.21.15.90:59352) 2022-07-05T11:55:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1528691423 learned_addr learned my addr 172.21.15.90:0/1528691423 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b337fe700 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c5fe5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.750+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 msgr2=0x5600c5fe5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c5fe5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1528691423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 msgr2=0x5600c6051610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 0x5600c6051610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:55:36.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1528691423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b200033f0 con 0x5600c601e3c0 2022-07-05T11:55:36.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c6013b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f6b28009de0 tx=0x7f6b28008040).ready entity=mon.0 client_cookie=5accd43f0fd2faf2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:36.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:55:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b0dffb700 1 -- 172.21.15.90:0/1528691423 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28015d90 con 0x5600c601e3c0 2022-07-05T11:55:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b0dffb700 1 -- 172.21.15.90:0/1528691423 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f6b28017440 con 0x5600c601e3c0 2022-07-05T11:55:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600c5fd8440 con 0x5600c601e3c0 2022-07-05T11:55:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b0dffb700 1 -- 172.21.15.90:0/1528691423 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b280178a0 con 0x5600c601e3c0 2022-07-05T11:55:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 10 client.5661 fetch_fsmap learned FSMap version 22 2022-07-05T11:55:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5600c5dd1cd0 con 0x5600c601e3c0 2022-07-05T11:55:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b0dffb700 1 -- 172.21.15.90:0/1528691423 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600c5fd8440 con 0x5600c601e3c0 2022-07-05T11:55:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b0dffb700 1 -- 172.21.15.90:0/1528691423 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f6b28017a00 con 0x5600c601e3c0 2022-07-05T11:55:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 10 client.5661 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:55:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 10 client.5661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:55:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 20 client.5661 populate_metadata read hostname 'smithi090' 2022-07-05T11:55:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c60504f0 0x5600c6050ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 4 client.5661 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:55:36.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.751+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600c5f267f0 con 0x5600c60504f0 2022-07-05T11:55:36.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.752+0000 7f6b337fe700 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c60504f0 0x5600c6050ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.752+0000 7f6b0dffb700 10 client.5661 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:36.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.752+0000 7f6b337fe700 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c60504f0 0x5600c6050ca0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bc753e1d78afdb87 server_cookie=3a3c5cbc38e80306 in_seq=0 out_seq=0 2022-07-05T11:55:36.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.752+0000 7f6b0dffb700 1 -- 172.21.15.90:0/1528691423 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5600c5f267f0 con 0x5600c60504f0 2022-07-05T11:55:36.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.752+0000 7f6b0dffb700 10 client.5661 handle_command_reply: tid=0 2022-07-05T11:55:36.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.752+0000 7f6b4b96cb80 1 client.5661 shutdown 2022-07-05T11:55:36.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 msgr2=0x5600c6013b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c6013b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f6b28009de0 tx=0x7f6b28008040).stop 2022-07-05T11:55:36.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 shutdown_connections 2022-07-05T11:55:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c60504f0 0x5600c6050ca0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 0x5600c6051610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:55:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c5fe5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b0dffb700 0 client.5661 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1528691423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c6013b00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 >> 172.21.15.90:0/1528691423 conn(0x5600c5e491c0 msgr2=0x5600c604b180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 shutdown_connections 2022-07-05T11:55:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1528691423 wait complete. 2022-07-05T11:55:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.753+0000 7f6b4b96cb80 20 client.5661 trim_cache size 0 max 16384 2022-07-05T11:55:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.768+0000 7f6b4b96cb80 1 Processor -- start 2022-07-05T11:55:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.768+0000 7f6b4b96cb80 1 -- start start 2022-07-05T11:55:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.769+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6029030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.769+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fdb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.769+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 0x5600c6060450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.769+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6027500 con 0x5600c601e3c0 2022-07-05T11:55:36.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.769+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c601af50 con 0x5600c601e7a0 2022-07-05T11:55:36.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.769+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c5fdc770 con 0x5600c5fdacb0 2022-07-05T11:55:36.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fdb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fdb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59358/0 (socket says 172.21.15.90:59358) 2022-07-05T11:55:36.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1983118628 learned_addr learned my addr 172.21.15.90:0/1983118628 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b33fff700 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 0x5600c6060450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b337fe700 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6029030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1983118628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 msgr2=0x5600c6029030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6029030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1983118628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 msgr2=0x5600c6060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 0x5600c6060450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 -- 172.21.15.90:0/1983118628 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c5d9ffd0 con 0x5600c601e3c0 2022-07-05T11:55:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b337fe700 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6029030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:55:36.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fdb090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f6b28015f40 tx=0x7f6b28025000).ready entity=mon.0 client_cookie=862cd7febb80003d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:36.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b197fa700 1 -- 172.21.15.90:0/1983118628 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b280159d0 con 0x5600c601e3c0 2022-07-05T11:55:36.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b197fa700 1 -- 172.21.15.90:0/1983118628 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b28009a90 con 0x5600c601e3c0 2022-07-05T11:55:36.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b197fa700 1 -- 172.21.15.90:0/1983118628 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b280095f0 con 0x5600c601e3c0 2022-07-05T11:55:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1983118628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 msgr2=0x5600c5fdb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.770+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fdb090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f6b28015f40 tx=0x7f6b28025000).stop 2022-07-05T11:55:36.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1983118628 shutdown_connections 2022-07-05T11:55:36.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e7a0 0x5600c6060450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6029030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/1983118628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e3c0 0x5600c5fdb090 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1983118628 >> 172.21.15.90:0/1983118628 conn(0x5600c5e491c0 msgr2=0x5600c6050ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:36.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1983118628 shutdown_connections 2022-07-05T11:55:36.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/1983118628 wait complete. 2022-07-05T11:55:36.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 -- start start 2022-07-05T11:55:36.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.771+0000 7f6b4b96cb80 1 Processor -- start 2022-07-05T11:55:36.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6060450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e3c0 0x5600c5fe3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b4b96cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e7a0 0x5600c6012a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c5fe4a80 con 0x5600c601e7a0 2022-07-05T11:55:36.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6017d70 con 0x5600c601e3c0 2022-07-05T11:55:36.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b4b96cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6016e80 con 0x5600c5fdacb0 2022-07-05T11:55:36.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b4b96cb80 10 client.0 ll_register_callbacks cb 0x5600c6014bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:55:36.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b33fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e7a0 0x5600c6012a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b33fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e7a0 0x5600c6012a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59366/0 (socket says 172.21.15.90:59366) 2022-07-05T11:55:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.772+0000 7f6b33fff700 1 -- 172.21.15.90:0/3423295694 learned_addr learned my addr 172.21.15.90:0/3423295694 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:55:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b32ffd700 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e3c0 0x5600c5fe3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b337fe700 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6060450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b33fff700 1 -- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 msgr2=0x5600c6060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b33fff700 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6060450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b33fff700 1 -- 172.21.15.90:0/3423295694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e3c0 msgr2=0x5600c5fe3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:55:36.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b33fff700 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e3c0 0x5600c5fe3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b33fff700 1 -- 172.21.15.90:0/3423295694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600c5dd1cd0 con 0x5600c601e7a0 2022-07-05T11:55:36.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b33fff700 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e7a0 0x5600c6012a30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f6b2c084d90 tx=0x7f6b2c081460).ready entity=mon.0 client_cookie=6b203ac47565406e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:55:36.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:55:36.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b0dffb700 1 -- 172.21.15.90:0/3423295694 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c057070 con 0x5600c601e7a0 2022-07-05T11:55:36.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b0dffb700 1 -- 172.21.15.90:0/3423295694 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f6b2c08a970 con 0x5600c601e7a0 2022-07-05T11:55:36.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b24007440 con 0x5600c601e7a0 2022-07-05T11:55:36.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b0dffb700 1 -- 172.21.15.90:0/3423295694 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b2c0817a0 con 0x5600c601e7a0 2022-07-05T11:55:36.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 10 client.5667 fetch_fsmap learned FSMap version 22 2022-07-05T11:55:36.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5600c6017780 con 0x5600c601e7a0 2022-07-05T11:55:36.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b0dffb700 1 -- 172.21.15.90:0/3423295694 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b24007440 con 0x5600c601e7a0 2022-07-05T11:55:36.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b0dffb700 1 -- 172.21.15.90:0/3423295694 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 22) v1 ==== 7480+0+0 (secure 0 0 0) 0x7f6b2c084580 con 0x5600c601e7a0 2022-07-05T11:55:36.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 10 client.5667 fetch_fsmap finished waiting for FSMap version 22 2022-07-05T11:55:36.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 10 client.5667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:55:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 20 client.5667 populate_metadata read hostname 'smithi090' 2022-07-05T11:55:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c601aad0 0x5600c60256b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:55:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 4 client.5667 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:55:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.773+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5600c5f1d690 con 0x5600c601aad0 2022-07-05T11:55:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b337fe700 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c601aad0 0x5600c60256b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:55:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b337fe700 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c601aad0 0x5600c60256b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=da8dce59bd9924b0 server_cookie=b2f1451b301d8f8b in_seq=0 out_seq=0 2022-07-05T11:55:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b0dffb700 10 client.5667 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b0dffb700 1 -- 172.21.15.90:0/3423295694 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5600c5f1d690 con 0x5600c601aad0 2022-07-05T11:55:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b0dffb700 10 client.5667 handle_command_reply: tid=0 2022-07-05T11:55:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 client.5667 shutdown 2022-07-05T11:55:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e7a0 msgr2=0x5600c6012a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e7a0 0x5600c6012a30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f6b2c084d90 tx=0x7f6b2c081460).stop 2022-07-05T11:55:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 shutdown_connections 2022-07-05T11:55:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5600c601aad0 0x5600c60256b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5600c601e7a0 0x5600c6012a30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5600c5fdacb0 0x5600c6060450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 --2- 172.21.15.90:0/3423295694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5600c601e3c0 0x5600c5fe3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b0dffb700 0 client.5667 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:55:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 >> 172.21.15.90:0/3423295694 conn(0x5600c5e491c0 msgr2=0x5600c601b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 shutdown_connections 2022-07-05T11:55:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 1 -- 172.21.15.90:0/3423295694 wait complete. 2022-07-05T11:55:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.774+0000 7f6b4b96cb80 20 client.5667 trim_cache size 0 max 16384 2022-07-05T11:55:36.831 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:55:36.831 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:55:36.831 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:55:36.832 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:55:36.832 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:55:36.832 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:55:36.832 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:55:36.833 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:55:36.833 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:55:36.833 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:55:36.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6b1408ba40 msgr2=0x7f6b1408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6b1408ba40 0x7f6b1408df00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f6b2400c480 tx=0x7f6b24015000).stop 2022-07-05T11:55:36.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b341910d0 msgr2=0x7f6b34191550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:55:36.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b341910d0 0x7f6b34191550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f6b340f1710 tx=0x7f6b2c007c00).stop 2022-07-05T11:55:36.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 shutdown_connections 2022-07-05T11:55:36.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6b1408ba40 0x7f6b1408df00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b341910d0 0x7f6b34191550 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b20003930 0x7f6b34164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 --2- 172.21.15.90:0/2810539028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b34164680 0x7f6b34190be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:55:36.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 >> 172.21.15.90:0/2810539028 conn(0x7f6b340f2210 msgr2=0x7f6b340699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:55:36.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 shutdown_connections 2022-07-05T11:55:36.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:55:36.775+0000 7f6b39fe0700 1 -- 172.21.15.90:0/2810539028 wait complete. 2022-07-05T11:55:36.838 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:55:49.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:55:49.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:55:49.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:56:06.840 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:56:06.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.965+0000 7f508a422700 1 Processor -- start 2022-07-05T11:56:06.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.966+0000 7f508a422700 1 -- start start 2022-07-05T11:56:06.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f508a422700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f508417e0e0 0x7f508417e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f508a422700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508417d5d0 con 0x7f508417ea50 2022-07-05T11:56:06.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f508a422700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840c36e0 con 0x7f5084179db0 2022-07-05T11:56:06.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f508a422700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840c4260 con 0x7f508417e0e0 2022-07-05T11:56:06.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50837fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f508417e0e0 0x7f508417e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:06.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50837fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f508417e0e0 0x7f508417e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59394/0 (socket says 172.21.15.90:59394) 2022-07-05T11:56:06.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50889bf700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f508417ea50 0x7f50840ee6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52332/0 (socket says 172.21.15.90:52332) 2022-07-05T11:56:06.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50837fe700 1 -- 172.21.15.90:0/869696347 learned_addr learned my addr 172.21.15.90:0/869696347 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:06.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50837fe700 1 -- 172.21.15.90:0/869696347 >> v1:172.21.15.110:6789/0 conn(0x7f5084179db0 legacy=0x7f50840c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:06.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50837fe700 1 -- 172.21.15.90:0/869696347 >> v1:172.21.15.90:6789/0 conn(0x7f508417ea50 legacy=0x7f50840ee6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:06.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50837fe700 1 -- 172.21.15.90:0/869696347 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840c39c0 con 0x7f508417e0e0 2022-07-05T11:56:06.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f5082ffd700 1 -- 172.21.15.90:0/869696347 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310597069 0 0) 0x7f508417d5d0 con 0x7f508417ea50 2022-07-05T11:56:06.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f50837fe700 1 --2- 172.21.15.90:0/869696347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f508417e560 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5074006fd0 tx=0x7f50740090f0).ready entity=mon.0 client_cookie=b20ed4610efb54d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:06.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f5082ffd700 1 -- 172.21.15.90:0/869696347 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400b600 con 0x7f508417e0e0 2022-07-05T11:56:06.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f5082ffd700 1 -- 172.21.15.90:0/869696347 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507400b760 con 0x7f508417e0e0 2022-07-05T11:56:06.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.967+0000 7f5082ffd700 1 -- 172.21.15.90:0/869696347 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400bb00 con 0x7f508417e0e0 2022-07-05T11:56:06.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.968+0000 7f508a422700 1 -- 172.21.15.90:0/869696347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 msgr2=0x7f508417e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:06.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.968+0000 7f508a422700 1 --2- 172.21.15.90:0/869696347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f508417e560 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5074006fd0 tx=0x7f50740090f0).stop 2022-07-05T11:56:06.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.968+0000 7f508a422700 1 -- 172.21.15.90:0/869696347 shutdown_connections 2022-07-05T11:56:06.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.968+0000 7f508a422700 1 --2- 172.21.15.90:0/869696347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f508417e560 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:06.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.968+0000 7f508a422700 1 -- 172.21.15.90:0/869696347 >> 172.21.15.90:0/869696347 conn(0x7f50840edd30 msgr2=0x7f508405d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:06.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.968+0000 7f508a422700 1 -- 172.21.15.90:0/869696347 shutdown_connections 2022-07-05T11:56:06.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.968+0000 7f508a422700 1 -- 172.21.15.90:0/869696347 wait complete. 2022-07-05T11:56:06.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.970+0000 7f508a422700 1 Processor -- start 2022-07-05T11:56:06.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.970+0000 7f508a422700 1 -- start start 2022-07-05T11:56:06.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f508a422700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5084179db0 0x7f5084178f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f508a422700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f5084190430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f508a422700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f508417ea50 0x7f50840c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f508a422700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084169070 con 0x7f508417e0e0 2022-07-05T11:56:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f508a422700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084168d20 con 0x7f508417ea50 2022-07-05T11:56:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f508a422700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50840c8630 con 0x7f5084179db0 2022-07-05T11:56:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f5084190430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f5084190430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59398/0 (socket says 172.21.15.90:59398) 2022-07-05T11:56:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 -- 172.21.15.90:0/4098051444 learned_addr learned my addr 172.21.15.90:0/4098051444 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50889bf700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f508417ea50 0x7f50840c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f5083fff700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5084179db0 0x7f5084178f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 -- 172.21.15.90:0/4098051444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5084179db0 msgr2=0x7f5084178f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5084179db0 0x7f5084178f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 -- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f508417ea50 msgr2=0x7f50840c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f508417ea50 0x7f50840c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 -- 172.21.15.90:0/4098051444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074009370 con 0x7f508417e0e0 2022-07-05T11:56:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f5083fff700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5084179db0 0x7f5084178f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:56:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f50837fe700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f5084190430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f508406b090 tx=0x7f5074017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.971+0000 7f506bfff700 1 -- 172.21.15.90:0/4098051444 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400b8d0 con 0x7f508417e0e0 2022-07-05T11:56:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.972+0000 7f506bfff700 1 -- 172.21.15.90:0/4098051444 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507400ba30 con 0x7f508417e0e0 2022-07-05T11:56:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.972+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50840c8910 con 0x7f508417e0e0 2022-07-05T11:56:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.972+0000 7f506bfff700 1 -- 172.21.15.90:0/4098051444 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507401c670 con 0x7f508417e0e0 2022-07-05T11:56:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.972+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50840c8ed0 con 0x7f508417e0e0 2022-07-05T11:56:06.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.973+0000 7f506bfff700 1 -- 172.21.15.90:0/4098051444 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f507402c070 con 0x7f508417e0e0 2022-07-05T11:56:06.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.974+0000 7f506bfff700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f506408ba70 0x7f506408df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.974+0000 7f506bfff700 1 -- 172.21.15.90:0/4098051444 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f50740b2520 con 0x7f508417e0e0 2022-07-05T11:56:06.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.974+0000 7f5083fff700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f506408ba70 0x7f506408df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:06.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.975+0000 7f5083fff700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f506408ba70 0x7f506408df30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5078000c00 tx=0x7f5078009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:06.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.975+0000 7f509bdaeb80 1 Processor -- start 2022-07-05T11:56:06.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.975+0000 7f509bdaeb80 1 -- start start 2022-07-05T11:56:06.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8ff04bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff01eb70 0x55d8ff04a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eff0 0x55d8ff01dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:06.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fefa32d0 con 0x55d8ff01eb70 2022-07-05T11:56:06.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fef1aaa0 con 0x55d8ff01eff0 2022-07-05T11:56:06.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fef2f950 con 0x55d8ff01d8f0 2022-07-05T11:56:06.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff01eb70 0x55d8ff04a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:06.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff01eb70 0x55d8ff04a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59406/0 (socket says 172.21.15.90:59406) 2022-07-05T11:56:07.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 -- 172.21.15.90:0/2277011035 learned_addr learned my addr 172.21.15.90:0/2277011035 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:07.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50889bf700 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eff0 0x55d8ff01dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f5083fff700 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8ff04bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 -- 172.21.15.90:0/2277011035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 msgr2=0x55d8ff04bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8ff04bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 -- 172.21.15.90:0/2277011035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eff0 msgr2=0x55d8ff01dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eff0 0x55d8ff01dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 -- 172.21.15.90:0/2277011035 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8fed619e0 con 0x55d8ff01eb70 2022-07-05T11:56:07.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50837fe700 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff01eb70 0x55d8ff04a1a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f5074006940 tx=0x7f507400bba0).ready entity=mon.0 client_cookie=e5a8cef644b772d1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:07.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50697fa700 1 -- 172.21.15.90:0/2277011035 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50740867c0 con 0x55d8ff01eb70 2022-07-05T11:56:07.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50697fa700 1 -- 172.21.15.90:0/2277011035 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50740b2380 con 0x55d8ff01eb70 2022-07-05T11:56:07.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.977+0000 7f50697fa700 1 -- 172.21.15.90:0/2277011035 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074086e60 con 0x55d8ff01eb70 2022-07-05T11:56:07.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 -- 172.21.15.90:0/2277011035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff01eb70 msgr2=0x55d8ff04a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff01eb70 0x55d8ff04a1a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f5074006940 tx=0x7f507400bba0).stop 2022-07-05T11:56:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 -- 172.21.15.90:0/2277011035 shutdown_connections 2022-07-05T11:56:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eff0 0x55d8ff01dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8ff04bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/2277011035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff01eb70 0x55d8ff04a1a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 -- 172.21.15.90:0/2277011035 >> 172.21.15.90:0/2277011035 conn(0x55d8fee481c0 msgr2=0x55d8fefdcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:07.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 -- 172.21.15.90:0/2277011035 shutdown_connections 2022-07-05T11:56:07.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.978+0000 7f509bdaeb80 1 -- 172.21.15.90:0/2277011035 wait complete. 2022-07-05T11:56:07.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.979+0000 7f509bdaeb80 1 -- start start 2022-07-05T11:56:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.979+0000 7f509bdaeb80 1 Processor -- start 2022-07-05T11:56:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff050d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8ff016350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff0632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8feef7120 con 0x55d8ff048d70 2022-07-05T11:56:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff016840 con 0x55d8ff01d8f0 2022-07-05T11:56:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff049a40 con 0x55d8ff01eb70 2022-07-05T11:56:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f509bdaeb80 10 client.0 ll_register_callbacks cb 0x55d8fef9d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:56:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff0632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff0632d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59414/0 (socket says 172.21.15.90:59414) 2022-07-05T11:56:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 -- 172.21.15.90:0/1022213203 learned_addr learned my addr 172.21.15.90:0/1022213203 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f5083fff700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff050d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 -- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 msgr2=0x55d8ff016350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50837fe700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8ff016350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8ff016350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 -- 172.21.15.90:0/1022213203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 msgr2=0x55d8ff050d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff050d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f50889bf700 1 -- 172.21.15.90:0/1022213203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50840c8ed0 con 0x55d8ff048d70 2022-07-05T11:56:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.980+0000 7f5083fff700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff050d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:56:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f50889bf700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff0632d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f507c004ed0 tx=0x7f507c007e90).ready entity=mon.0 client_cookie=bd0a5912f0954797 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f505e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:56:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f505e7fc700 1 -- 172.21.15.90:0/1022213203 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c002120 con 0x55d8ff048d70 2022-07-05T11:56:07.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f505e7fc700 1 -- 172.21.15.90:0/1022213203 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f507c004d00 con 0x55d8ff048d70 2022-07-05T11:56:07.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8fefd7440 con 0x55d8ff048d70 2022-07-05T11:56:07.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f505e7fc700 1 -- 172.21.15.90:0/1022213203 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f507c0147c0 con 0x55d8ff048d70 2022-07-05T11:56:07.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 10 client.5682 fetch_fsmap learned FSMap version 26 2022-07-05T11:56:07.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d8fedd0cd0 con 0x55d8ff048d70 2022-07-05T11:56:07.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f505e7fc700 1 -- 172.21.15.90:0/1022213203 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8fefd7440 con 0x55d8ff048d70 2022-07-05T11:56:07.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f505e7fc700 1 -- 172.21.15.90:0/1022213203 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f507c014920 con 0x55d8ff048d70 2022-07-05T11:56:07.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 10 client.5682 fetch_fsmap finished waiting for FSMap version 26 2022-07-05T11:56:07.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 10 client.5682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:56:07.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 20 client.5682 populate_metadata read hostname 'smithi090' 2022-07-05T11:56:07.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff0491f0 0x55d8fefdd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 4 client.5682 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:56:07.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.981+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8fef257f0 con 0x55d8ff0491f0 2022-07-05T11:56:07.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.982+0000 7f5083fff700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff0491f0 0x55d8fefdd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.982+0000 7f505e7fc700 10 client.5682 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:07.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.982+0000 7f5083fff700 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff0491f0 0x55d8fefdd5f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=96df673cee6a74ef server_cookie=d95325acde53da6b in_seq=0 out_seq=0 2022-07-05T11:56:07.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f505e7fc700 1 -- 172.21.15.90:0/1022213203 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55d8fef257f0 con 0x55d8ff0491f0 2022-07-05T11:56:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f505e7fc700 10 client.5682 handle_command_reply: tid=0 2022-07-05T11:56:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 client.5682 shutdown 2022-07-05T11:56:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 msgr2=0x55d8ff0632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff0632d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f507c004ed0 tx=0x7f507c007e90).stop 2022-07-05T11:56:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 shutdown_connections 2022-07-05T11:56:07.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff0491f0 0x55d8fefdd5f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff0632d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f505e7fc700 0 client.5682 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:07.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff050d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/1022213203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8ff016350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 >> 172.21.15.90:0/1022213203 conn(0x55d8fee481c0 msgr2=0x55d8fefe4580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:07.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 shutdown_connections 2022-07-05T11:56:07.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 1 -- 172.21.15.90:0/1022213203 wait complete. 2022-07-05T11:56:07.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:06.983+0000 7f509bdaeb80 20 client.5682 trim_cache size 0 max 16384 2022-07-05T11:56:07.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.010+0000 7f509bdaeb80 1 Processor -- start 2022-07-05T11:56:07.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.010+0000 7f509bdaeb80 1 -- start start 2022-07-05T11:56:07.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8fefdca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eb70 0x55d8fefdddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fefde2e0 con 0x55d8ff048d70 2022-07-05T11:56:07.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff051010 con 0x55d8ff01eb70 2022-07-05T11:56:07.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff051360 con 0x55d8ff01d8f0 2022-07-05T11:56:07.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f50889bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f50889bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59422/0 (socket says 172.21.15.90:59422) 2022-07-05T11:56:07.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.011+0000 7f50889bf700 1 -- 172.21.15.90:0/3317258255 learned_addr learned my addr 172.21.15.90:0/3317258255 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:07.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50837fe700 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eb70 0x55d8fefdddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f5083fff700 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8fefdca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50889bf700 1 -- 172.21.15.90:0/3317258255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 msgr2=0x55d8fefdca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50889bf700 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8fefdca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50889bf700 1 -- 172.21.15.90:0/3317258255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eb70 msgr2=0x55d8fefdddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50889bf700 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eb70 0x55d8fefdddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50889bf700 1 -- 172.21.15.90:0/3317258255 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8fed9efd0 con 0x55d8ff048d70 2022-07-05T11:56:07.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50837fe700 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eb70 0x55d8fefdddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:56:07.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f50889bf700 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f507c008f20 tx=0x7f507c019000).ready entity=mon.0 client_cookie=c3e193080d74f1ba server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:07.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f5069ffb700 1 -- 172.21.15.90:0/3317258255 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c004d00 con 0x55d8ff048d70 2022-07-05T11:56:07.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f5069ffb700 1 -- 172.21.15.90:0/3317258255 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c014de0 con 0x55d8ff048d70 2022-07-05T11:56:07.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.012+0000 7f5069ffb700 1 -- 172.21.15.90:0/3317258255 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c007820 con 0x55d8ff048d70 2022-07-05T11:56:07.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 -- 172.21.15.90:0/3317258255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 msgr2=0x55d8ff01dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:07.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f507c008f20 tx=0x7f507c019000).stop 2022-07-05T11:56:07.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 -- 172.21.15.90:0/3317258255 shutdown_connections 2022-07-05T11:56:07.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01d8f0 0x55d8fefdca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/3317258255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01eb70 0x55d8fefdddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 -- 172.21.15.90:0/3317258255 >> 172.21.15.90:0/3317258255 conn(0x55d8fee481c0 msgr2=0x55d8fefdd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 -- 172.21.15.90:0/3317258255 shutdown_connections 2022-07-05T11:56:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 -- 172.21.15.90:0/3317258255 wait complete. 2022-07-05T11:56:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 -- start start 2022-07-05T11:56:07.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.013+0000 7f509bdaeb80 1 Processor -- start 2022-07-05T11:56:07.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.014+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff01bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.014+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8fefd3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff04f610 con 0x55d8ff048d70 2022-07-05T11:56:07.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff0b9f00 con 0x55d8ff01d8f0 2022-07-05T11:56:07.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff01cd80 con 0x55d8ff01eb70 2022-07-05T11:56:07.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 10 client.0 ll_register_callbacks cb 0x55d8fef9d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:56:07.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59428/0 (socket says 172.21.15.90:59428) 2022-07-05T11:56:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 -- 172.21.15.90:0/513954826 learned_addr learned my addr 172.21.15.90:0/513954826 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50837fe700 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8fefd3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f5083fff700 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff01bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 -- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 msgr2=0x55d8fefd3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8fefd3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 -- 172.21.15.90:0/513954826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 msgr2=0x55d8ff01bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff01bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 -- 172.21.15.90:0/513954826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8fedd0cd0 con 0x55d8ff048d70 2022-07-05T11:56:07.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f50889bf700 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f507c008f50 tx=0x7f507c027000).ready entity=mon.0 client_cookie=b5966b89f6857b58 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:07.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f505e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:56:07.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f505e7fc700 1 -- 172.21.15.90:0/513954826 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c007820 con 0x55d8ff048d70 2022-07-05T11:56:07.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f505e7fc700 1 -- 172.21.15.90:0/513954826 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f507c0147c0 con 0x55d8ff048d70 2022-07-05T11:56:07.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50740b2380 con 0x55d8ff048d70 2022-07-05T11:56:07.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f505e7fc700 1 -- 172.21.15.90:0/513954826 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f507c031440 con 0x55d8ff048d70 2022-07-05T11:56:07.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 10 client.5688 fetch_fsmap learned FSMap version 26 2022-07-05T11:56:07.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d8ff0b98b0 con 0x55d8ff048d70 2022-07-05T11:56:07.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.015+0000 7f505e7fc700 1 -- 172.21.15.90:0/513954826 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50740b2380 con 0x55d8ff048d70 2022-07-05T11:56:07.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f505e7fc700 1 -- 172.21.15.90:0/513954826 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f507c01e070 con 0x55d8ff048d70 2022-07-05T11:56:07.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f509bdaeb80 10 client.5688 fetch_fsmap finished waiting for FSMap version 26 2022-07-05T11:56:07.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f509bdaeb80 10 client.5688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:56:07.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f509bdaeb80 20 client.5688 populate_metadata read hostname 'smithi090' 2022-07-05T11:56:07.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff01e1c0 0x55d8ff0a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:07.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f509bdaeb80 4 client.5688 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:56:07.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d8fef1c690 con 0x55d8ff01e1c0 2022-07-05T11:56:07.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f5083fff700 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff01e1c0 0x55d8ff0a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:07.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f5083fff700 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff01e1c0 0x55d8ff0a6d00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6dd9683c01308e44 server_cookie=eb42c279aad42713 in_seq=0 out_seq=0 2022-07-05T11:56:07.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f505e7fc700 10 client.5688 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:07.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f505e7fc700 1 -- 172.21.15.90:0/513954826 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d8fef1c690 con 0x55d8ff01e1c0 2022-07-05T11:56:07.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f505e7fc700 10 client.5688 handle_command_reply: tid=0 2022-07-05T11:56:07.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.016+0000 7f509bdaeb80 1 client.5688 shutdown 2022-07-05T11:56:07.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 msgr2=0x55d8ff01dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:07.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f507c008f50 tx=0x7f507c027000).stop 2022-07-05T11:56:07.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 shutdown_connections 2022-07-05T11:56:07.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d8ff01e1c0 0x55d8ff0a6d00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d8ff048d70 0x55d8ff01dcd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d8ff01d8f0 0x55d8ff01bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 --2- 172.21.15.90:0/513954826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8ff01eb70 0x55d8fefd3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f505e7fc700 0 client.5688 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:07.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 >> 172.21.15.90:0/513954826 conn(0x55d8fee481c0 msgr2=0x55d8fefe3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:07.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 shutdown_connections 2022-07-05T11:56:07.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 1 -- 172.21.15.90:0/513954826 wait complete. 2022-07-05T11:56:07.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f509bdaeb80 20 client.5688 trim_cache size 0 max 16384 2022-07-05T11:56:07.049 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:56:07.049 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:56:07.049 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:56:07.049 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:56:07.050 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:56:07.050 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:56:07.050 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:56:07.050 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:56:07.051 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:56:07.051 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:56:07.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f506408ba70 msgr2=0x7f506408df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:07.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f506408ba70 0x7f506408df30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5078000c00 tx=0x7f5078009040).stop 2022-07-05T11:56:07.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 msgr2=0x7f5084190430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:07.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f5084190430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f508406b090 tx=0x7f5074017000).stop 2022-07-05T11:56:07.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 shutdown_connections 2022-07-05T11:56:07.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f506408ba70 0x7f506408df30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f508417ea50 0x7f50840c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5084179db0 0x7f5084178f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 --2- 172.21.15.90:0/4098051444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f508417e0e0 0x7f5084190430 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:07.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 >> 172.21.15.90:0/4098051444 conn(0x7f50840edd30 msgr2=0x7f508416b140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:07.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.017+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 shutdown_connections 2022-07-05T11:56:07.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:07.018+0000 7f508a422700 1 -- 172.21.15.90:0/4098051444 wait complete. 2022-07-05T11:56:07.056 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:56:19.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:56:19.453 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:56:19.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:56:37.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:56:37.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.191+0000 7fee1c9ca700 1 Processor -- start 2022-07-05T11:56:37.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.191+0000 7fee1c9ca700 1 -- start start 2022-07-05T11:56:37.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1c9ca700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fee18179db0 0x7fee180c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1c9ca700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fee1817e7f0 0x7fee180ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1c9ca700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee180c36e0 con 0x7fee180c31b0 2022-07-05T11:56:37.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1c9ca700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180c4260 con 0x7fee1817e7f0 2022-07-05T11:56:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1c9ca700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180c6d60 con 0x7fee18179db0 2022-07-05T11:56:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee16d9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fee1817e7f0 0x7fee180ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee15d9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fee180c31b0 0x7fee1817e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52376/0 (socket says 172.21.15.90:52376) 2022-07-05T11:56:37.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee15d9b700 1 -- 172.21.15.90:0/1861217783 learned_addr learned my addr 172.21.15.90:0/1861217783 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:56:37.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1659c700 1 --2- 172.21.15.90:0/1861217783 >> v2:172.21.15.110:3300/0 conn(0x7fee18179db0 0x7fee180c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee16d9d700 1 -- 172.21.15.90:0/1861217783 >> v2:172.21.15.110:3300/0 conn(0x7fee18179db0 msgr2=0x7fee180c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee16d9d700 1 --2- 172.21.15.90:0/1861217783 >> v2:172.21.15.110:3300/0 conn(0x7fee18179db0 0x7fee180c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee16d9d700 1 -- 172.21.15.90:0/1861217783 >> v1:172.21.15.90:6789/0 conn(0x7fee180c31b0 legacy=0x7fee1817e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee16d9d700 1 -- 172.21.15.90:0/1861217783 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1817d5d0 con 0x7fee1817e7f0 2022-07-05T11:56:37.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1559a700 1 -- 172.21.15.90:0/1861217783 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862992197 0 0) 0x7fee180c36e0 con 0x7fee180c31b0 2022-07-05T11:56:37.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee16d9d700 1 --2- 172.21.15.90:0/1861217783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee180ee6f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fee1806af70 tx=0x7fee10009060).ready entity=mon.0 client_cookie=95456c042c59eb76 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:37.208 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.193+0000 7fee1559a700 1 -- 172.21.15.90:0/1861217783 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100090d0 con 0x7fee1817e7f0 2022-07-05T11:56:37.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1559a700 1 -- 172.21.15.90:0/1861217783 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000b580 con 0x7fee1817e7f0 2022-07-05T11:56:37.209 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1559a700 1 -- 172.21.15.90:0/1861217783 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000b900 con 0x7fee1817e7f0 2022-07-05T11:56:37.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 -- 172.21.15.90:0/1861217783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 msgr2=0x7fee180ee6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/1861217783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee180ee6f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fee1806af70 tx=0x7fee10009060).stop 2022-07-05T11:56:37.210 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 -- 172.21.15.90:0/1861217783 shutdown_connections 2022-07-05T11:56:37.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/1861217783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee180ee6f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/1861217783 >> v2:172.21.15.110:3300/0 conn(0x7fee18179db0 0x7fee180c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.211 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 -- 172.21.15.90:0/1861217783 >> 172.21.15.90:0/1861217783 conn(0x7fee180edd30 msgr2=0x7fee1805d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:37.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 -- 172.21.15.90:0/1861217783 shutdown_connections 2022-07-05T11:56:37.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.194+0000 7fee1c9ca700 1 -- 172.21.15.90:0/1861217783 wait complete. 2022-07-05T11:56:37.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.196+0000 7fee1c9ca700 1 Processor -- start 2022-07-05T11:56:37.212 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.196+0000 7fee1c9ca700 1 -- start start 2022-07-05T11:56:37.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.196+0000 7fee1c9ca700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee180c31b0 0x7fee1817fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1c9ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18179db0 0x7fee1816b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1c9ca700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee18177470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1c9ca700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1816d7d0 con 0x7fee1817e7f0 2022-07-05T11:56:37.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1c9ca700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1816bcd0 con 0x7fee180c31b0 2022-07-05T11:56:37.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1c9ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1816d4f0 con 0x7fee18179db0 2022-07-05T11:56:37.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee18177470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee18177470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59442/0 (socket says 172.21.15.90:59442) 2022-07-05T11:56:37.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 -- 172.21.15.90:0/43735506 learned_addr learned my addr 172.21.15.90:0/43735506 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:37.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee15d9b700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18179db0 0x7fee1816b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1659c700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee180c31b0 0x7fee1817fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.215 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 -- 172.21.15.90:0/43735506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18179db0 msgr2=0x7fee1816b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18179db0 0x7fee1816b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 -- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee180c31b0 msgr2=0x7fee1817fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee180c31b0 0x7fee1817fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.216 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 -- 172.21.15.90:0/43735506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100092a0 con 0x7fee1817e7f0 2022-07-05T11:56:37.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1659c700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee180c31b0 0x7fee1817fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:56:37.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee16d9d700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee18177470 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fee10009fd0 tx=0x7fee10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:37.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee0e7fc700 1 -- 172.21.15.90:0/43735506 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10006950 con 0x7fee1817e7f0 2022-07-05T11:56:37.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee0e7fc700 1 -- 172.21.15.90:0/43735506 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000bcc0 con 0x7fee1817e7f0 2022-07-05T11:56:37.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee0e7fc700 1 -- 172.21.15.90:0/43735506 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1001b440 con 0x7fee1817e7f0 2022-07-05T11:56:37.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1817eda0 con 0x7fee1817e7f0 2022-07-05T11:56:37.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.197+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1817f360 con 0x7fee1817e7f0 2022-07-05T11:56:37.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.199+0000 7fee0e7fc700 1 -- 172.21.15.90:0/43735506 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fee1000f070 con 0x7fee1817e7f0 2022-07-05T11:56:37.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.199+0000 7fee0e7fc700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fedfc08ba40 0x7fedfc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.200+0000 7fee0e7fc700 1 -- 172.21.15.90:0/43735506 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fee100b2200 con 0x7fee1817e7f0 2022-07-05T11:56:37.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.200+0000 7fee1659c700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fedfc08ba40 0x7fedfc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.200+0000 7fee1659c700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fedfc08ba40 0x7fedfc08df00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fee08007540 tx=0x7fee0800b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:37.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.201+0000 7fee2e356b80 1 Processor -- start 2022-07-05T11:56:37.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.201+0000 7fee2e356b80 1 -- start start 2022-07-05T11:56:37.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.202+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19be77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.202+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c35990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.202+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c2bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.202+0000 7fee2e356b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19bb12d0 con 0x559c19c2b3c0 2022-07-05T11:56:37.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.202+0000 7fee2e356b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19b28aa0 con 0x559c19c2b7a0 2022-07-05T11:56:37.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.202+0000 7fee2e356b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19b3d950 con 0x559c19be7cb0 2022-07-05T11:56:37.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.202+0000 7fee1659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19be77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19be77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59446/0 (socket says 172.21.15.90:59446) 2022-07-05T11:56:37.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 -- 172.21.15.90:0/3219063104 learned_addr learned my addr 172.21.15.90:0/3219063104 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:37.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee16d9d700 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c2bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c35990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 -- 172.21.15.90:0/3219063104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 msgr2=0x559c19c35990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c35990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 -- 172.21.15.90:0/3219063104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 msgr2=0x559c19c2bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c2bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 -- 172.21.15.90:0/3219063104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1996f9e0 con 0x559c19c2b3c0 2022-07-05T11:56:37.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee16d9d700 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c2bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:56:37.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fee1659c700 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19be77c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fee08017740 tx=0x7fee08013000).ready entity=mon.0 client_cookie=f7723c607beea559 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:37.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fedf77fe700 1 -- 172.21.15.90:0/3219063104 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0801c070 con 0x559c19c2b3c0 2022-07-05T11:56:37.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fedf77fe700 1 -- 172.21.15.90:0/3219063104 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee080172e0 con 0x559c19c2b3c0 2022-07-05T11:56:37.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.203+0000 7fedf77fe700 1 -- 172.21.15.90:0/3219063104 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080146e0 con 0x559c19c2b3c0 2022-07-05T11:56:37.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 -- 172.21.15.90:0/3219063104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 msgr2=0x559c19be77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19be77c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fee08017740 tx=0x7fee08013000).stop 2022-07-05T11:56:37.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 -- 172.21.15.90:0/3219063104 shutdown_connections 2022-07-05T11:56:37.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c2bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19be77c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3219063104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c35990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 -- 172.21.15.90:0/3219063104 >> 172.21.15.90:0/3219063104 conn(0x559c19a561c0 msgr2=0x559c19beaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:37.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 -- 172.21.15.90:0/3219063104 shutdown_connections 2022-07-05T11:56:37.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.204+0000 7fee2e356b80 1 -- 172.21.15.90:0/3219063104 wait complete. 2022-07-05T11:56:37.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.205+0000 7fee2e356b80 1 -- start start 2022-07-05T11:56:37.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.205+0000 7fee2e356b80 1 Processor -- start 2022-07-05T11:56:37.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19be7cb0 0x559c19c6bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c2b3c0 0x559c19c19700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b7a0 0x559c19c2a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee2e356b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19b05120 con 0x559c19c2b7a0 2022-07-05T11:56:37.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee2e356b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19c2a9b0 con 0x559c19be7cb0 2022-07-05T11:56:37.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee2e356b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19c6b880 con 0x559c19c2b3c0 2022-07-05T11:56:37.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee2e356b80 10 client.0 ll_register_callbacks cb 0x559c19bab1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:56:37.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b7a0 0x559c19c2a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b7a0 0x559c19c2a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59454/0 (socket says 172.21.15.90:59454) 2022-07-05T11:56:37.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 -- 172.21.15.90:0/805780251 learned_addr learned my addr 172.21.15.90:0/805780251 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:37.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee1659c700 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19be7cb0 0x559c19c6bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 -- 172.21.15.90:0/805780251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c2b3c0 msgr2=0x559c19c19700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c2b3c0 0x559c19c19700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:56:37.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 -- 172.21.15.90:0/805780251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19be7cb0 msgr2=0x559c19c6bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19be7cb0 0x559c19c6bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 -- 172.21.15.90:0/805780251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee08017450 con 0x559c19c2b7a0 2022-07-05T11:56:37.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fee16d9d700 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b7a0 0x559c19c2a070 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fee10009e80 tx=0x7fee100b2040).ready entity=mon.0 client_cookie=30fefb95a472ef45 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:37.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fedf4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:56:37.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.206+0000 7fedf4ff9700 1 -- 172.21.15.90:0/805780251 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10086910 con 0x559c19c2b7a0 2022-07-05T11:56:37.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fedf4ff9700 1 -- 172.21.15.90:0/805780251 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fee10086030 con 0x559c19c2b7a0 2022-07-05T11:56:37.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c19be5440 con 0x559c19c2b7a0 2022-07-05T11:56:37.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fedf4ff9700 1 -- 172.21.15.90:0/805780251 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee10059200 con 0x559c19c2b7a0 2022-07-05T11:56:37.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 10 client.5703 fetch_fsmap learned FSMap version 28 2022-07-05T11:56:37.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x559c199decd0 con 0x559c19c2b7a0 2022-07-05T11:56:37.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fedf4ff9700 1 -- 172.21.15.90:0/805780251 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c19be5440 con 0x559c19c2b7a0 2022-07-05T11:56:37.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fedf4ff9700 1 -- 172.21.15.90:0/805780251 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 28) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fee1008bf90 con 0x559c19c2b7a0 2022-07-05T11:56:37.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 10 client.5703 fetch_fsmap finished waiting for FSMap version 28 2022-07-05T11:56:37.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 10 client.5703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:56:37.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 20 client.5703 populate_metadata read hostname 'smithi090' 2022-07-05T11:56:37.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c6c200 0x559c19c29230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 4 client.5703 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:56:37.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c19b337f0 con 0x559c19c6c200 2022-07-05T11:56:37.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.207+0000 7fee1659c700 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c6c200 0x559c19c29230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.208+0000 7fedf4ff9700 10 client.5703 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:37.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.208+0000 7fee1659c700 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c6c200 0x559c19c29230 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=684c7b38492af96a server_cookie=e49565a20635036f in_seq=0 out_seq=0 2022-07-05T11:56:37.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.208+0000 7fedf4ff9700 1 -- 172.21.15.90:0/805780251 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x559c19b337f0 con 0x559c19c6c200 2022-07-05T11:56:37.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.208+0000 7fedf4ff9700 10 client.5703 handle_command_reply: tid=0 2022-07-05T11:56:37.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.208+0000 7fee2e356b80 1 client.5703 shutdown 2022-07-05T11:56:37.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b7a0 msgr2=0x559c19c2a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b7a0 0x559c19c2a070 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fee10009e80 tx=0x7fee100b2040).stop 2022-07-05T11:56:37.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 shutdown_connections 2022-07-05T11:56:37.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c6c200 0x559c19c29230 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b7a0 0x559c19c2a070 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19be7cb0 0x559c19c6bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 --2- 172.21.15.90:0/805780251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c2b3c0 0x559c19c19700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:56:37.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 >> 172.21.15.90:0/805780251 conn(0x559c19a561c0 msgr2=0x559c19c2bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:37.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fedf4ff9700 0 client.5703 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:37.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 shutdown_connections 2022-07-05T11:56:37.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 1 -- 172.21.15.90:0/805780251 wait complete. 2022-07-05T11:56:37.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.209+0000 7fee2e356b80 20 client.5703 trim_cache size 0 max 16384 2022-07-05T11:56:37.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.224+0000 7fee2e356b80 1 Processor -- start 2022-07-05T11:56:37.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.224+0000 7fee2e356b80 1 -- start start 2022-07-05T11:56:37.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.225+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c5d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.225+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19c5ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.225+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c35ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.225+0000 7fee2e356b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee18064070 con 0x559c19c2b3c0 2022-07-05T11:56:37.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.225+0000 7fee2e356b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19c71a80 con 0x559c19c2b7a0 2022-07-05T11:56:37.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.225+0000 7fee2e356b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19be76f0 con 0x559c19be7cb0 2022-07-05T11:56:37.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.225+0000 7fee15d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19c5ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19c5ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59462/0 (socket says 172.21.15.90:59462) 2022-07-05T11:56:37.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 -- 172.21.15.90:0/3525347420 learned_addr learned my addr 172.21.15.90:0/3525347420 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:37.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee16d9d700 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c35ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 -- 172.21.15.90:0/3525347420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 msgr2=0x559c19c5d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee1659c700 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c5d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c5d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 -- 172.21.15.90:0/3525347420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 msgr2=0x559c19c35ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c35ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 -- 172.21.15.90:0/3525347420 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c199acfd0 con 0x559c19c2b3c0 2022-07-05T11:56:37.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19c5ae40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fee00007380 tx=0x7fee00009040).ready entity=mon.0 client_cookie=32505a5aa9772491 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:37.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fedf7fff700 1 -- 172.21.15.90:0/3525347420 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00006cf0 con 0x559c19c2b3c0 2022-07-05T11:56:37.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fedf7fff700 1 -- 172.21.15.90:0/3525347420 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00006e50 con 0x559c19c2b3c0 2022-07-05T11:56:37.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fedf7fff700 1 -- 172.21.15.90:0/3525347420 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00015650 con 0x559c19c2b3c0 2022-07-05T11:56:37.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 -- 172.21.15.90:0/3525347420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 msgr2=0x559c19c5ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19c5ae40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fee00007380 tx=0x7fee00009040).stop 2022-07-05T11:56:37.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 -- 172.21.15.90:0/3525347420 shutdown_connections 2022-07-05T11:56:37.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19c35ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19be7cb0 0x559c19c5d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3525347420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19c2b3c0 0x559c19c5ae40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 -- 172.21.15.90:0/3525347420 >> 172.21.15.90:0/3525347420 conn(0x559c19a561c0 msgr2=0x559c19c58150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 -- 172.21.15.90:0/3525347420 shutdown_connections 2022-07-05T11:56:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.226+0000 7fee2e356b80 1 -- 172.21.15.90:0/3525347420 wait complete. 2022-07-05T11:56:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.227+0000 7fee2e356b80 1 -- start start 2022-07-05T11:56:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.227+0000 7fee2e356b80 1 Processor -- start 2022-07-05T11:56:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19be7cb0 0x559c19bf06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19be6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee2e356b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c18ee0 0x559c19ccb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee2e356b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19c23e80 con 0x559c19be7cb0 2022-07-05T11:56:37.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee2e356b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19c24020 con 0x559c19c2b7a0 2022-07-05T11:56:37.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee2e356b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c19bf0be0 con 0x559c19c18ee0 2022-07-05T11:56:37.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee2e356b80 10 client.0 ll_register_callbacks cb 0x559c19bab1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:56:37.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee1659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19be7cb0 0x559c19bf06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee1659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19be7cb0 0x559c19bf06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59464/0 (socket says 172.21.15.90:59464) 2022-07-05T11:56:37.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.228+0000 7fee1659c700 1 -- 172.21.15.90:0/3631308065 learned_addr learned my addr 172.21.15.90:0/3631308065 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:56:37.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee16d9d700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c18ee0 0x559c19ccb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19be6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee1659c700 1 -- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c18ee0 msgr2=0x559c19ccb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee1659c700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c18ee0 0x559c19ccb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee1659c700 1 -- 172.21.15.90:0/3631308065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 msgr2=0x559c19be6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:56:37.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee1659c700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19be6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee1659c700 1 -- 172.21.15.90:0/3631308065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee000070e0 con 0x559c19be7cb0 2022-07-05T11:56:37.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee16d9d700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c18ee0 0x559c19ccb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:56:37.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19be6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:56:37.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee1659c700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19be7cb0 0x559c19bf06f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fee08009f50 tx=0x7fee0801d000).ready entity=mon.0 client_cookie=9c94b3755ad2e96 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:56:37.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fedf4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:56:37.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fedf4ff9700 1 -- 172.21.15.90:0/3631308065 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08014c60 con 0x559c19be7cb0 2022-07-05T11:56:37.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fedf4ff9700 1 -- 172.21.15.90:0/3631308065 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fee08014dc0 con 0x559c19be7cb0 2022-07-05T11:56:37.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c19c21a10 con 0x559c19be7cb0 2022-07-05T11:56:37.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fedf4ff9700 1 -- 172.21.15.90:0/3631308065 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee0802c670 con 0x559c19be7cb0 2022-07-05T11:56:37.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee2e356b80 10 client.5709 fetch_fsmap learned FSMap version 28 2022-07-05T11:56:37.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x559c19c27ba0 con 0x559c19be7cb0 2022-07-05T11:56:37.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fedf4ff9700 1 -- 172.21.15.90:0/3631308065 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c19c21a10 con 0x559c19be7cb0 2022-07-05T11:56:37.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fedf4ff9700 1 -- 172.21.15.90:0/3631308065 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 28) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fee0802c7d0 con 0x559c19be7cb0 2022-07-05T11:56:37.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee2e356b80 10 client.5709 fetch_fsmap finished waiting for FSMap version 28 2022-07-05T11:56:37.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee2e356b80 10 client.5709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:56:37.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.229+0000 7fee2e356b80 20 client.5709 populate_metadata read hostname 'smithi090' 2022-07-05T11:56:37.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c5d440 0x559c19be17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:56:37.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 4 client.5709 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:56:37.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fee080172e0 con 0x559c19c5d440 2022-07-05T11:56:37.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c5d440 0x559c19be17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:56:37.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fedf4ff9700 10 client.5709 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:37.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee15d9b700 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c5d440 0x559c19be17e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=703f0823b3644024 server_cookie=8a644379cf85071e in_seq=0 out_seq=0 2022-07-05T11:56:37.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fedf4ff9700 1 -- 172.21.15.90:0/3631308065 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7fee080172e0 con 0x559c19c5d440 2022-07-05T11:56:37.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fedf4ff9700 10 client.5709 handle_command_reply: tid=0 2022-07-05T11:56:37.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 client.5709 shutdown 2022-07-05T11:56:37.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19be7cb0 msgr2=0x559c19bf06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19be7cb0 0x559c19bf06f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fee08009f50 tx=0x7fee0801d000).stop 2022-07-05T11:56:37.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 shutdown_connections 2022-07-05T11:56:37.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559c19c5d440 0x559c19be17e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c19c18ee0 0x559c19ccb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fedf4ff9700 0 client.5709 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:56:37.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c19be7cb0 0x559c19bf06f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 --2- 172.21.15.90:0/3631308065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c19c2b7a0 0x559c19be6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 >> 172.21.15.90:0/3631308065 conn(0x559c19a561c0 msgr2=0x559c19c5e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:37.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.230+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 shutdown_connections 2022-07-05T11:56:37.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee2e356b80 1 -- 172.21.15.90:0/3631308065 wait complete. 2022-07-05T11:56:37.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee2e356b80 20 client.5709 trim_cache size 0 max 16384 2022-07-05T11:56:37.286 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:56:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:56:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:56:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:56:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:56:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:56:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:56:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:56:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:56:37.289 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:56:37.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fedfc08ba40 msgr2=0x7fedfc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fedfc08ba40 0x7fedfc08df00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fee08007540 tx=0x7fee0800b040).stop 2022-07-05T11:56:37.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 msgr2=0x7fee18177470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:56:37.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee18177470 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fee10009fd0 tx=0x7fee10017000).stop 2022-07-05T11:56:37.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 shutdown_connections 2022-07-05T11:56:37.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fedfc08ba40 0x7fedfc08df00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee1817e7f0 0x7fee18177470 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee180c31b0 0x7fee1817fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 --2- 172.21.15.90:0/43735506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18179db0 0x7fee1816b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:56:37.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 >> 172.21.15.90:0/43735506 conn(0x7fee180edd30 msgr2=0x7fee1817e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:56:37.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 shutdown_connections 2022-07-05T11:56:37.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:56:37.231+0000 7fee1c9ca700 1 -- 172.21.15.90:0/43735506 wait complete. 2022-07-05T11:56:37.296 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:56:49.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:56:49.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:56:49.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:57:07.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:57:07.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.439+0000 7f65b2bea700 1 Processor -- start 2022-07-05T11:57:07.442 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.439+0000 7f65b2bea700 1 -- start start 2022-07-05T11:57:07.497 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65b2bea700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac17c4f0 con 0x7f65ac17f2f0 2022-07-05T11:57:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65b2bea700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac17c7d0 con 0x7f65ac1785a0 2022-07-05T11:57:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65b2bea700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac17cab0 con 0x7f65ac178980 2022-07-05T11:57:07.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65b1187700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f65ac17f2f0 0x7f65ac17df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52416/0 (socket says 172.21.15.90:52416) 2022-07-05T11:57:07.499 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65b1187700 1 -- 172.21.15.90:0/3972836814 learned_addr learned my addr 172.21.15.90:0/3972836814 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:57:07.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293476571 0 0) 0x7f65ac17c4f0 con 0x7f65ac17f2f0 2022-07-05T11:57:07.500 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f658c0033f0 con 0x7f65ac17f2f0 2022-07-05T11:57:07.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3680571425 0 0) 0x7f658c0033f0 con 0x7f65ac17f2f0 2022-07-05T11:57:07.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.440+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 >> v1:172.21.15.149:6789/0 conn(0x7f65ac178980 legacy=0x7f65ac17d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 >> v1:172.21.15.110:6789/0 conn(0x7f65ac1785a0 legacy=0x7f65ac17ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac17cd90 con 0x7f65ac17f2f0 2022-07-05T11:57:07.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7f65a4001470 con 0x7f65ac17f2f0 2022-07-05T11:57:07.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 >> v1:172.21.15.90:6789/0 conn(0x7f65ac17f2f0 legacy=0x7f65ac17df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c003960 0x7f658c003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c004690 0x7f658c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c005250 0x7f658c00b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c00c160 con 0x7f658c005250 2022-07-05T11:57:07.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c00c2d0 con 0x7f658c004690 2022-07-05T11:57:07.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c00c490 con 0x7f658c003960 2022-07-05T11:57:07.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c005250 0x7f658c00b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65abfff700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c004690 0x7f658c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b0986700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c003960 0x7f658c003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 -- 172.21.15.90:0/3972836814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c003960 msgr2=0x7f658c003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c003960 0x7f658c003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 -- 172.21.15.90:0/3972836814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c004690 msgr2=0x7f658c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c004690 0x7f658c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 -- 172.21.15.90:0/3972836814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0033f0 con 0x7f658c005250 2022-07-05T11:57:07.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 -- 172.21.15.90:0/3972836814 reap_dead start 2022-07-05T11:57:07.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65b1187700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c005250 0x7f658c00b900 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f65a400c190 tx=0x7f65a4001e30).ready entity=mon.0 client_cookie=7cfb1cf52069c7e9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:07.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a400ca80 con 0x7f658c005250 2022-07-05T11:57:07.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a400cbe0 con 0x7f658c005250 2022-07-05T11:57:07.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.441+0000 7f65ab7fe700 1 -- 172.21.15.90:0/3972836814 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40070d0 con 0x7f658c005250 2022-07-05T11:57:07.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.442+0000 7f65b2bea700 1 -- 172.21.15.90:0/3972836814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c005250 msgr2=0x7f658c00b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.442+0000 7f65b2bea700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c005250 0x7f658c00b900 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f65a400c190 tx=0x7f65a4001e30).stop 2022-07-05T11:57:07.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.442+0000 7f65b2bea700 1 -- 172.21.15.90:0/3972836814 shutdown_connections 2022-07-05T11:57:07.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.442+0000 7f65b2bea700 1 --2- 172.21.15.90:0/3972836814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c005250 0x7f658c00b900 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.442+0000 7f65b2bea700 1 -- 172.21.15.90:0/3972836814 >> 172.21.15.90:0/3972836814 conn(0x7f65ac083570 msgr2=0x7f65ac083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:07.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.442+0000 7f65b2bea700 1 -- 172.21.15.90:0/3972836814 shutdown_connections 2022-07-05T11:57:07.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.442+0000 7f65b2bea700 1 -- 172.21.15.90:0/3972836814 wait complete. 2022-07-05T11:57:07.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.443+0000 7f65b2bea700 1 Processor -- start 2022-07-05T11:57:07.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.443+0000 7f65b2bea700 1 -- start start 2022-07-05T11:57:07.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.444+0000 7f65b2bea700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c005250 0x7f65ac0e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.444+0000 7f65b2bea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac069d50 0x7f65ac190620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.444+0000 7f65b2bea700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65ac190b10 0x7f65ac160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.444+0000 7f65b2bea700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac06a1d0 con 0x7f65ac190b10 2022-07-05T11:57:07.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.444+0000 7f65b2bea700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0e94e0 con 0x7f658c005250 2022-07-05T11:57:07.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.444+0000 7f65b2bea700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0e97c0 con 0x7f65ac069d50 2022-07-05T11:57:07.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.444+0000 7f65b1187700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65ac190b10 0x7f65ac160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65ac190b10 0x7f65ac160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59488/0 (socket says 172.21.15.90:59488) 2022-07-05T11:57:07.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b0986700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c005250 0x7f65ac0e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 -- 172.21.15.90:0/1202307755 learned_addr learned my addr 172.21.15.90:0/1202307755 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:07.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65abfff700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac069d50 0x7f65ac190620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 -- 172.21.15.90:0/1202307755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac069d50 msgr2=0x7f65ac190620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac069d50 0x7f65ac190620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 -- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c005250 msgr2=0x7f65ac0e8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c005250 0x7f65ac0e8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 -- 172.21.15.90:0/1202307755 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0e9aa0 con 0x7f65ac190b10 2022-07-05T11:57:07.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b0986700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c005250 0x7f65ac0e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:57:07.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b1187700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65ac190b10 0x7f65ac160150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f65a4000c00 tx=0x7f65a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:07.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65a8ff9700 1 -- 172.21.15.90:0/1202307755 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40070d0 con 0x7f65ac190b10 2022-07-05T11:57:07.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65a8ff9700 1 -- 172.21.15.90:0/1202307755 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4001430 con 0x7f65ac190b10 2022-07-05T11:57:07.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac0e9d80 con 0x7f65ac190b10 2022-07-05T11:57:07.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65a8ff9700 1 -- 172.21.15.90:0/1202307755 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4004af0 con 0x7f65ac190b10 2022-07-05T11:57:07.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.445+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac0ea340 con 0x7f65ac190b10 2022-07-05T11:57:07.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.447+0000 7f65a8ff9700 1 -- 172.21.15.90:0/1202307755 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f65a401d070 con 0x7f65ac190b10 2022-07-05T11:57:07.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.448+0000 7f65a8ff9700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f659008ba40 0x7f659008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.448+0000 7f65a8ff9700 1 -- 172.21.15.90:0/1202307755 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f65a40b17b0 con 0x7f65ac190b10 2022-07-05T11:57:07.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.448+0000 7f65b0986700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f659008ba40 0x7f659008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.448+0000 7f65b0986700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f659008ba40 0x7f659008df00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f659c000f80 tx=0x7f659c00c040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:07.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.449+0000 7f65c4576b80 1 Processor -- start 2022-07-05T11:57:07.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.449+0000 7f65c4576b80 1 -- start start 2022-07-05T11:57:07.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9923c0 0x557cbd94e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9927a0 0x557cbd992c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65c4576b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd9182d0 con 0x557cbd9927a0 2022-07-05T11:57:07.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65c4576b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd88faa0 con 0x557cbd9923c0 2022-07-05T11:57:07.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65c4576b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd8a4950 con 0x557cbd94ecb0 2022-07-05T11:57:07.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9927a0 0x557cbd992c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9927a0 0x557cbd992c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59496/0 (socket says 172.21.15.90:59496) 2022-07-05T11:57:07.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 -- 172.21.15.90:0/999707824 learned_addr learned my addr 172.21.15.90:0/999707824 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:07.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b0986700 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9923c0 0x557cbd94e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 -- 172.21.15.90:0/999707824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 msgr2=0x557cbd99c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65abfff700 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 -- 172.21.15.90:0/999707824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9923c0 msgr2=0x557cbd94e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9923c0 0x557cbd94e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b1187700 1 -- 172.21.15.90:0/999707824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cbd6d69e0 con 0x557cbd9927a0 2022-07-05T11:57:07.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.450+0000 7f65b0986700 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9923c0 0x557cbd94e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:57:07.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65b1187700 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9927a0 0x557cbd992c20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f65a4085c90 tx=0x7f65a400c780).ready entity=mon.0 client_cookie=b45847384df94603 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:07.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65a1ffb700 1 -- 172.21.15.90:0/999707824 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a408b9d0 con 0x557cbd9927a0 2022-07-05T11:57:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65a1ffb700 1 -- 172.21.15.90:0/999707824 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4084490 con 0x557cbd9927a0 2022-07-05T11:57:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65a1ffb700 1 -- 172.21.15.90:0/999707824 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40855e0 con 0x557cbd9927a0 2022-07-05T11:57:07.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 -- 172.21.15.90:0/999707824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9927a0 msgr2=0x557cbd992c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9927a0 0x557cbd992c20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f65a4085c90 tx=0x7f65a400c780).stop 2022-07-05T11:57:07.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 -- 172.21.15.90:0/999707824 shutdown_connections 2022-07-05T11:57:07.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9927a0 0x557cbd992c20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9923c0 0x557cbd94e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 --2- 172.21.15.90:0/999707824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 -- 172.21.15.90:0/999707824 >> 172.21.15.90:0/999707824 conn(0x557cbd7bd1c0 msgr2=0x557cbd951ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:07.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 -- 172.21.15.90:0/999707824 shutdown_connections 2022-07-05T11:57:07.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.451+0000 7f65c4576b80 1 -- 172.21.15.90:0/999707824 wait complete. 2022-07-05T11:57:07.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.452+0000 7f65c4576b80 1 -- start start 2022-07-05T11:57:07.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.452+0000 7f65c4576b80 1 Processor -- start 2022-07-05T11:57:07.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbd9bb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd996270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65c4576b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd86c120 con 0x557cbd94ecb0 2022-07-05T11:57:07.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65c4576b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd98c040 con 0x557cbd9927a0 2022-07-05T11:57:07.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65c4576b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd9960c0 con 0x557cbd9923c0 2022-07-05T11:57:07.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65c4576b80 10 client.0 ll_register_callbacks cb 0x557cbd9121b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:57:07.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.453+0000 7f65b0986700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59498/0 (socket says 172.21.15.90:59498) 2022-07-05T11:57:07.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 -- 172.21.15.90:0/471997106 learned_addr learned my addr 172.21.15.90:0/471997106 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:07.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b1187700 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd996270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65abfff700 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbd9bb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 -- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 msgr2=0x557cbd9bb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbd9bb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 -- 172.21.15.90:0/471997106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 msgr2=0x557cbd996270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd996270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 -- 172.21.15.90:0/471997106 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac0ea340 con 0x557cbd94ecb0 2022-07-05T11:57:07.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65b0986700 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d2d10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f659c016c10 tx=0x7f659c018040).ready entity=mon.0 client_cookie=8f1a5cbedb16ea8b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f6582ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:57:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f6582ffd700 1 -- 172.21.15.90:0/471997106 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c014a80 con 0x557cbd94ecb0 2022-07-05T11:57:07.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f6582ffd700 1 -- 172.21.15.90:0/471997106 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f659c014be0 con 0x557cbd94ecb0 2022-07-05T11:57:07.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cbd94c440 con 0x557cbd94ecb0 2022-07-05T11:57:07.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f6582ffd700 1 -- 172.21.15.90:0/471997106 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f659c029430 con 0x557cbd94ecb0 2022-07-05T11:57:07.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65c4576b80 10 client.5721 fetch_fsmap learned FSMap version 30 2022-07-05T11:57:07.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x557cbd745cd0 con 0x557cbd94ecb0 2022-07-05T11:57:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f6582ffd700 1 -- 172.21.15.90:0/471997106 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c02d020 con 0x557cbd94ecb0 2022-07-05T11:57:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.454+0000 7f6582ffd700 1 -- 172.21.15.90:0/471997106 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f659c029590 con 0x557cbd94ecb0 2022-07-05T11:57:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65c4576b80 10 client.5721 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:57:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65c4576b80 10 client.5721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:57:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65c4576b80 20 client.5721 populate_metadata read hostname 'smithi090' 2022-07-05T11:57:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65c4576b80 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd996760 0x557cbd9d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65c4576b80 4 client.5721 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:57:07.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cbd89a7f0 con 0x557cbd996760 2022-07-05T11:57:07.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65abfff700 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd996760 0x557cbd9d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f6582ffd700 10 client.5721 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:07.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.455+0000 7f65abfff700 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd996760 0x557cbd9d0bf0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=515eca82070869a4 server_cookie=3341f9cc13e650d8 in_seq=0 out_seq=0 2022-07-05T11:57:07.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f6582ffd700 1 -- 172.21.15.90:0/471997106 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x557cbd89a7f0 con 0x557cbd996760 2022-07-05T11:57:07.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f6582ffd700 10 client.5721 handle_command_reply: tid=0 2022-07-05T11:57:07.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 client.5721 shutdown 2022-07-05T11:57:07.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 msgr2=0x557cbd9d2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d2d10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f659c016c10 tx=0x7f659c018040).stop 2022-07-05T11:57:07.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 shutdown_connections 2022-07-05T11:57:07.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd996760 0x557cbd9d0bf0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd996270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d2d10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f6582ffd700 0 client.5721 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:07.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 --2- 172.21.15.90:0/471997106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbd9bb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 >> 172.21.15.90:0/471997106 conn(0x557cbd7bd1c0 msgr2=0x557cbd9bf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:07.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 shutdown_connections 2022-07-05T11:57:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 1 -- 172.21.15.90:0/471997106 wait complete. 2022-07-05T11:57:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.456+0000 7f65c4576b80 20 client.5721 trim_cache size 0 max 16384 2022-07-05T11:57:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.472+0000 7f65c4576b80 1 Processor -- start 2022-07-05T11:57:07.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.472+0000 7f65c4576b80 1 -- start start 2022-07-05T11:57:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9923c0 0x557cbd9bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd9503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65c4576b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd9d0370 con 0x557cbd9923c0 2022-07-05T11:57:07.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65c4576b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd9508b0 con 0x557cbd9927a0 2022-07-05T11:57:07.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65c4576b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd999da0 con 0x557cbd94ecb0 2022-07-05T11:57:07.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9923c0 0x557cbd9bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9923c0 0x557cbd9bf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59508/0 (socket says 172.21.15.90:59508) 2022-07-05T11:57:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 -- 172.21.15.90:0/1714121511 learned_addr learned my addr 172.21.15.90:0/1714121511 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65b0986700 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 -- 172.21.15.90:0/1714121511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 msgr2=0x557cbd99aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65b1187700 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd9503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 -- 172.21.15.90:0/1714121511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 msgr2=0x557cbd9503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd9503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 -- 172.21.15.90:0/1714121511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cbd713fd0 con 0x557cbd9923c0 2022-07-05T11:57:07.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65b0986700 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:57:07.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65b1187700 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd9503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:57:07.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65abfff700 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9923c0 0x557cbd9bf4d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f65ac17e580 tx=0x7f6594009040).ready entity=mon.0 client_cookie=4b6bb6f06bc146fb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:07.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65a27fc700 1 -- 172.21.15.90:0/1714121511 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594002040 con 0x557cbd9923c0 2022-07-05T11:57:07.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65a27fc700 1 -- 172.21.15.90:0/1714121511 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594003040 con 0x557cbd9923c0 2022-07-05T11:57:07.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.473+0000 7f65a27fc700 1 -- 172.21.15.90:0/1714121511 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659401b0d0 con 0x557cbd9923c0 2022-07-05T11:57:07.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 -- 172.21.15.90:0/1714121511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9923c0 msgr2=0x557cbd9bf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9923c0 0x557cbd9bf4d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f65ac17e580 tx=0x7f6594009040).stop 2022-07-05T11:57:07.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 -- 172.21.15.90:0/1714121511 shutdown_connections 2022-07-05T11:57:07.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd9503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd94ecb0 0x557cbd99aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 --2- 172.21.15.90:0/1714121511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd9923c0 0x557cbd9bf4d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 -- 172.21.15.90:0/1714121511 >> 172.21.15.90:0/1714121511 conn(0x557cbd7bd1c0 msgr2=0x557cbd9bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:07.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 -- 172.21.15.90:0/1714121511 shutdown_connections 2022-07-05T11:57:07.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 -- 172.21.15.90:0/1714121511 wait complete. 2022-07-05T11:57:07.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.474+0000 7f65c4576b80 1 -- start start 2022-07-05T11:57:07.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.475+0000 7f65c4576b80 1 Processor -- start 2022-07-05T11:57:07.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbda16280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd998b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd99bea0 con 0x557cbd94ecb0 2022-07-05T11:57:07.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd991d80 con 0x557cbd9927a0 2022-07-05T11:57:07.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cbd9c51b0 con 0x557cbd9923c0 2022-07-05T11:57:07.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 10 client.0 ll_register_callbacks cb 0x557cbd9121b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:57:07.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59512/0 (socket says 172.21.15.90:59512) 2022-07-05T11:57:07.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 -- 172.21.15.90:0/2339429070 learned_addr learned my addr 172.21.15.90:0/2339429070 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:07.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b1187700 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd998b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65abfff700 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbda16280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 -- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 msgr2=0x557cbda16280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbda16280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 -- 172.21.15.90:0/2339429070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 msgr2=0x557cbd998b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:07.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd998b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 -- 172.21.15.90:0/2339429070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac17cab0 con 0x557cbd94ecb0 2022-07-05T11:57:07.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65b0986700 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d4170 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f659c016fd0 tx=0x7f659c01b000).ready entity=mon.0 client_cookie=1b8d262331518ead server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:07.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f6582ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:57:07.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f6582ffd700 1 -- 172.21.15.90:0/2339429070 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c029430 con 0x557cbd94ecb0 2022-07-05T11:57:07.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f6582ffd700 1 -- 172.21.15.90:0/2339429070 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f659c02e080 con 0x557cbd94ecb0 2022-07-05T11:57:07.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65a4084490 con 0x557cbd94ecb0 2022-07-05T11:57:07.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f6582ffd700 1 -- 172.21.15.90:0/2339429070 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f659c006a20 con 0x557cbd94ecb0 2022-07-05T11:57:07.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 10 client.5727 fetch_fsmap learned FSMap version 30 2022-07-05T11:57:07.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x557cbd9c5640 con 0x557cbd94ecb0 2022-07-05T11:57:07.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.476+0000 7f6582ffd700 1 -- 172.21.15.90:0/2339429070 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4084490 con 0x557cbd94ecb0 2022-07-05T11:57:07.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f6582ffd700 1 -- 172.21.15.90:0/2339429070 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f659c006b80 con 0x557cbd94ecb0 2022-07-05T11:57:07.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65c4576b80 10 client.5727 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:57:07.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65c4576b80 10 client.5727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:57:07.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65c4576b80 20 client.5727 populate_metadata read hostname 'smithi090' 2022-07-05T11:57:07.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65c4576b80 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd99cb10 0x557cbd999050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:07.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65c4576b80 4 client.5727 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:57:07.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557cbd891690 con 0x557cbd99cb10 2022-07-05T11:57:07.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65abfff700 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd99cb10 0x557cbd999050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:07.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65abfff700 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd99cb10 0x557cbd999050 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3d8f849b3c58a9e5 server_cookie=9f0883a4d3d5eb5e in_seq=0 out_seq=0 2022-07-05T11:57:07.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f6582ffd700 10 client.5727 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:07.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f6582ffd700 1 -- 172.21.15.90:0/2339429070 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557cbd891690 con 0x557cbd99cb10 2022-07-05T11:57:07.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f6582ffd700 10 client.5727 handle_command_reply: tid=0 2022-07-05T11:57:07.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.477+0000 7f65c4576b80 1 client.5727 shutdown 2022-07-05T11:57:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 msgr2=0x557cbd9d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d4170 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f659c016fd0 tx=0x7f659c01b000).stop 2022-07-05T11:57:07.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 shutdown_connections 2022-07-05T11:57:07.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557cbd99cb10 0x557cbd999050 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557cbd9927a0 0x557cbd998b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f6582ffd700 0 client.5727 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:07.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557cbd94ecb0 0x557cbd9d4170 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 --2- 172.21.15.90:0/2339429070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557cbd9923c0 0x557cbda16280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 >> 172.21.15.90:0/2339429070 conn(0x557cbd7bd1c0 msgr2=0x557cbd9bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:07.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 shutdown_connections 2022-07-05T11:57:07.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 1 -- 172.21.15.90:0/2339429070 wait complete. 2022-07-05T11:57:07.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65c4576b80 20 client.5727 trim_cache size 0 max 16384 2022-07-05T11:57:07.629 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:57:07.629 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:57:07.630 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:57:07.631 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:57:07.631 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:57:07.632 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:57:07.632 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:57:07.633 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:57:07.633 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:57:07.634 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:57:07.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f659008ba40 msgr2=0x7f659008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f659008ba40 0x7f659008df00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f659c000f80 tx=0x7f659c00c040).stop 2022-07-05T11:57:07.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65ac190b10 msgr2=0x7f65ac160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:07.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65ac190b10 0x7f65ac160150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f65a4000c00 tx=0x7f65a4015000).stop 2022-07-05T11:57:07.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 shutdown_connections 2022-07-05T11:57:07.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f659008ba40 0x7f659008df00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65ac190b10 0x7f65ac160150 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f658c005250 0x7f65ac0e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 --2- 172.21.15.90:0/1202307755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac069d50 0x7f65ac190620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:07.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 >> 172.21.15.90:0/1202307755 conn(0x7f65ac083570 msgr2=0x7f65ac1634d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:07.643 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 shutdown_connections 2022-07-05T11:57:07.644 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:07.478+0000 7f65b2bea700 1 -- 172.21.15.90:0/1202307755 wait complete. 2022-07-05T11:57:07.645 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:57:19.584 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:57:19.611 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:57:19.615 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:57:37.647 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:57:37.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.774+0000 7f4877154700 1 Processor -- start 2022-07-05T11:57:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.774+0000 7f4877154700 1 -- start start 2022-07-05T11:57:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4877154700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4870178610 0x7f48701789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4877154700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f487017f3b0 0x7f487017d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4877154700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487017d560 con 0x7f487017dee0 2022-07-05T11:57:37.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4877154700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4870064bd0 con 0x7f4870178610 2022-07-05T11:57:37.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4877154700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487017f830 con 0x7f487017f3b0 2022-07-05T11:57:37.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4870178610 0x7f48701789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4870178610 0x7f48701789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59520/0 (socket says 172.21.15.90:59520) 2022-07-05T11:57:37.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 -- 172.21.15.90:0/3840305742 learned_addr learned my addr 172.21.15.90:0/3840305742 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:37.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f486ffff700 1 --2- 172.21.15.90:0/3840305742 >> v2:172.21.15.149:3300/0 conn(0x7f487017f3b0 0x7f487017d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 -- 172.21.15.90:0/3840305742 >> v2:172.21.15.149:3300/0 conn(0x7f487017f3b0 msgr2=0x7f487017d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 --2- 172.21.15.90:0/3840305742 >> v2:172.21.15.149:3300/0 conn(0x7f487017f3b0 0x7f487017d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 -- 172.21.15.90:0/3840305742 >> v1:172.21.15.110:6789/0 conn(0x7f487017dee0 legacy=0x7f4870181e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 -- 172.21.15.90:0/3840305742 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487017c670 con 0x7f4870178610 2022-07-05T11:57:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f4874ef0700 1 --2- 172.21.15.90:0/3840305742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4870178610 0x7f48701789f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f487005ff10 tx=0x7f4860009840).ready entity=mon.0 client_cookie=328e5285715fa74 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f486f7fe700 1 -- 172.21.15.90:0/3840305742 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000e070 con 0x7f4870178610 2022-07-05T11:57:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f486f7fe700 1 -- 172.21.15.90:0/3840305742 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000ba50 con 0x7f4870178610 2022-07-05T11:57:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.775+0000 7f486f7fe700 1 -- 172.21.15.90:0/3840305742 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000bdd0 con 0x7f4870178610 2022-07-05T11:57:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 -- 172.21.15.90:0/3840305742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4870178610 msgr2=0x7f48701789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 --2- 172.21.15.90:0/3840305742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4870178610 0x7f48701789f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f487005ff10 tx=0x7f4860009840).stop 2022-07-05T11:57:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 -- 172.21.15.90:0/3840305742 shutdown_connections 2022-07-05T11:57:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 --2- 172.21.15.90:0/3840305742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4870178610 0x7f48701789f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 --2- 172.21.15.90:0/3840305742 >> v2:172.21.15.149:3300/0 conn(0x7f487017f3b0 0x7f487017d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 -- 172.21.15.90:0/3840305742 >> 172.21.15.90:0/3840305742 conn(0x7f48700f2210 msgr2=0x7f4870069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:37.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 -- 172.21.15.90:0/3840305742 shutdown_connections 2022-07-05T11:57:37.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.776+0000 7f4877154700 1 -- 172.21.15.90:0/3840305742 wait complete. 2022-07-05T11:57:37.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.777+0000 7f4877154700 1 Processor -- start 2022-07-05T11:57:37.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.778+0000 7f4877154700 1 -- start start 2022-07-05T11:57:37.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.778+0000 7f4877154700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4870178610 0x7f48700ec120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.778+0000 7f4877154700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487017dee0 0x7f487017bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.778+0000 7f4877154700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f487017f3b0 0x7f487017a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f4877154700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487017b870 con 0x7f487017f3b0 2022-07-05T11:57:37.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f4877154700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487017a980 con 0x7f4870178610 2022-07-05T11:57:37.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f4877154700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487017ac60 con 0x7f487017dee0 2022-07-05T11:57:37.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f487017f3b0 0x7f487017a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f487017f3b0 0x7f487017a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59530/0 (socket says 172.21.15.90:59530) 2022-07-05T11:57:37.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 -- 172.21.15.90:0/4198959592 learned_addr learned my addr 172.21.15.90:0/4198959592 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:37.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f486ffff700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487017dee0 0x7f487017bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f4874ef0700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4870178610 0x7f48700ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 -- 172.21.15.90:0/4198959592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487017dee0 msgr2=0x7f487017bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487017dee0 0x7f487017bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 -- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4870178610 msgr2=0x7f48700ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4870178610 0x7f48700ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 -- 172.21.15.90:0/4198959592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860009ae0 con 0x7f487017f3b0 2022-07-05T11:57:37.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f4874ef0700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4870178610 0x7f48700ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:57:37.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f48756f1700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f487017f3b0 0x7f487017a1b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f486800c440 tx=0x7f4868007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:37.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f486cff9700 1 -- 172.21.15.90:0/4198959592 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868012400 con 0x7f487017f3b0 2022-07-05T11:57:37.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f486cff9700 1 -- 172.21.15.90:0/4198959592 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4868012560 con 0x7f487017f3b0 2022-07-05T11:57:37.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487017af40 con 0x7f487017f3b0 2022-07-05T11:57:37.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f486cff9700 1 -- 172.21.15.90:0/4198959592 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48680128e0 con 0x7f487017f3b0 2022-07-05T11:57:37.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.779+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487017b500 con 0x7f487017f3b0 2022-07-05T11:57:37.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.781+0000 7f486cff9700 1 -- 172.21.15.90:0/4198959592 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4868010070 con 0x7f487017f3b0 2022-07-05T11:57:37.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.782+0000 7f486cff9700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f485008ba40 0x7f485008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.782+0000 7f486cff9700 1 -- 172.21.15.90:0/4198959592 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f48680afb90 con 0x7f487017f3b0 2022-07-05T11:57:37.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.782+0000 7f4874ef0700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f485008ba40 0x7f485008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.782+0000 7f4874ef0700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f485008ba40 0x7f485008df00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f486000ba20 tx=0x7f487017d4d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:37.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.783+0000 7f4888ae0b80 1 Processor -- start 2022-07-05T11:57:37.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.783+0000 7f4888ae0b80 1 -- start start 2022-07-05T11:57:37.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d23c0 0x561b5988e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 0x561b598dc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b598582d0 con 0x561b598d23c0 2022-07-05T11:57:37.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b597cfaa0 con 0x561b598d27a0 2022-07-05T11:57:37.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b597e4950 con 0x561b5988ecb0 2022-07-05T11:57:37.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4874ef0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d23c0 0x561b5988e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4874ef0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d23c0 0x561b5988e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59536/0 (socket says 172.21.15.90:59536) 2022-07-05T11:57:37.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.784+0000 7f4874ef0700 1 -- 172.21.15.90:0/3561134140 learned_addr learned my addr 172.21.15.90:0/3561134140 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:37.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f48756f1700 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f486ffff700 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 0x561b598dc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4874ef0700 1 -- 172.21.15.90:0/3561134140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 msgr2=0x561b598dc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4874ef0700 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 0x561b598dc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4874ef0700 1 -- 172.21.15.90:0/3561134140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 msgr2=0x561b598d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4874ef0700 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4874ef0700 1 -- 172.21.15.90:0/3561134140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b596169e0 con 0x561b598d23c0 2022-07-05T11:57:37.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4874ef0700 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d23c0 0x561b5988e7c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f486000bd10 tx=0x7f486001d000).ready entity=mon.0 client_cookie=2d016c0e3cb51782 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:37.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4855ffb700 1 -- 172.21.15.90:0/3561134140 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000bd40 con 0x561b598d23c0 2022-07-05T11:57:37.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4855ffb700 1 -- 172.21.15.90:0/3561134140 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486001e480 con 0x561b598d23c0 2022-07-05T11:57:37.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4855ffb700 1 -- 172.21.15.90:0/3561134140 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486001e630 con 0x561b598d23c0 2022-07-05T11:57:37.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4888ae0b80 1 -- 172.21.15.90:0/3561134140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d23c0 msgr2=0x561b5988e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.785+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d23c0 0x561b5988e7c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f486000bd10 tx=0x7f486001d000).stop 2022-07-05T11:57:37.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 -- 172.21.15.90:0/3561134140 shutdown_connections 2022-07-05T11:57:37.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d23c0 0x561b5988e7c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/3561134140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 0x561b598dc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 -- 172.21.15.90:0/3561134140 >> 172.21.15.90:0/3561134140 conn(0x561b596fd1c0 msgr2=0x561b59891ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:37.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 -- 172.21.15.90:0/3561134140 shutdown_connections 2022-07-05T11:57:37.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 -- 172.21.15.90:0/3561134140 wait complete. 2022-07-05T11:57:37.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.786+0000 7f4888ae0b80 1 -- start start 2022-07-05T11:57:37.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.787+0000 7f4888ae0b80 1 Processor -- start 2022-07-05T11:57:37.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b598fb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d23c0 0x561b59912170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b597ac120 con 0x561b5988ecb0 2022-07-05T11:57:37.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b598fb710 con 0x561b598d27a0 2022-07-05T11:57:37.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b59912e40 con 0x561b598d23c0 2022-07-05T11:57:37.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 10 client.0 ll_register_callbacks cb 0x561b598521b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:57:37.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b598fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b598fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59540/0 (socket says 172.21.15.90:59540) 2022-07-05T11:57:37.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 -- 172.21.15.90:0/1504957904 learned_addr learned my addr 172.21.15.90:0/1504957904 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:37.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f486ffff700 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d23c0 0x561b59912170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f48756f1700 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 -- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d23c0 msgr2=0x561b59912170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d23c0 0x561b59912170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 -- 172.21.15.90:0/1504957904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 msgr2=0x561b598cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 -- 172.21.15.90:0/1504957904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4860017040 con 0x561b5988ecb0 2022-07-05T11:57:37.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4874ef0700 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b598fb220 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f4860009590 tx=0x7f4860026000).ready entity=mon.0 client_cookie=2bcaba4d65f0331f server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:37.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f484affd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:57:37.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f484affd700 1 -- 172.21.15.90:0/1504957904 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486002f070 con 0x561b5988ecb0 2022-07-05T11:57:37.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f484affd700 1 -- 172.21.15.90:0/1504957904 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f486001ec70 con 0x561b5988ecb0 2022-07-05T11:57:37.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b5988c440 con 0x561b5988ecb0 2022-07-05T11:57:37.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f484affd700 1 -- 172.21.15.90:0/1504957904 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f486001ee30 con 0x561b5988ecb0 2022-07-05T11:57:37.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 10 client.5739 fetch_fsmap learned FSMap version 30 2022-07-05T11:57:37.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.788+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x561b59685cd0 con 0x561b5988ecb0 2022-07-05T11:57:37.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f484affd700 1 -- 172.21.15.90:0/1504957904 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b5988c440 con 0x561b5988ecb0 2022-07-05T11:57:37.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f484affd700 1 -- 172.21.15.90:0/1504957904 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f486002a660 con 0x561b5988ecb0 2022-07-05T11:57:37.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f4888ae0b80 10 client.5739 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:57:37.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f4888ae0b80 10 client.5739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:57:37.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f4888ae0b80 20 client.5739 populate_metadata read hostname 'smithi090' 2022-07-05T11:57:37.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d0230 0x561b59913f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f4888ae0b80 4 client.5739 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:57:37.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b597da7f0 con 0x561b598d0230 2022-07-05T11:57:37.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f486ffff700 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d0230 0x561b59913f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f484affd700 10 client.5739 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:37.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.789+0000 7f486ffff700 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d0230 0x561b59913f60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=39fd1594c5343ada server_cookie=4c4ae77e621dfaec in_seq=0 out_seq=0 2022-07-05T11:57:37.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f484affd700 1 -- 172.21.15.90:0/1504957904 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x561b597da7f0 con 0x561b598d0230 2022-07-05T11:57:37.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f484affd700 10 client.5739 handle_command_reply: tid=0 2022-07-05T11:57:37.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 client.5739 shutdown 2022-07-05T11:57:37.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 msgr2=0x561b598fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b598fb220 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f4860009590 tx=0x7f4860026000).stop 2022-07-05T11:57:37.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 shutdown_connections 2022-07-05T11:57:37.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d0230 0x561b59913f60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d27a0 0x561b598cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f484affd700 0 client.5739 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:37.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b598fb220 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1504957904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d23c0 0x561b59912170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 >> 172.21.15.90:0/1504957904 conn(0x561b596fd1c0 msgr2=0x561b5988f820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:37.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 shutdown_connections 2022-07-05T11:57:37.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1504957904 wait complete. 2022-07-05T11:57:37.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.790+0000 7f4888ae0b80 20 client.5739 trim_cache size 0 max 16384 2022-07-05T11:57:37.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.806+0000 7f4888ae0b80 1 Processor -- start 2022-07-05T11:57:37.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.806+0000 7f4888ae0b80 1 -- start start 2022-07-05T11:57:37.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 0x561b59892f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d0230 0x561b59898dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b5988e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b598cf630 con 0x561b598d0230 2022-07-05T11:57:37.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b598992c0 con 0x561b598d23c0 2022-07-05T11:57:37.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5988e0d0 con 0x561b5988ecb0 2022-07-05T11:57:37.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d0230 0x561b59898dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d0230 0x561b59898dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59548/0 (socket says 172.21.15.90:59548) 2022-07-05T11:57:37.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 -- 172.21.15.90:0/2976044405 learned_addr learned my addr 172.21.15.90:0/2976044405 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:37.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f48756f1700 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b5988e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 -- 172.21.15.90:0/2976044405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 msgr2=0x561b59892f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 0x561b59892f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:57:37.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 -- 172.21.15.90:0/2976044405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 msgr2=0x561b5988e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b5988e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 -- 172.21.15.90:0/2976044405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b59653fd0 con 0x561b598d0230 2022-07-05T11:57:37.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f48756f1700 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b5988e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:57:37.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.807+0000 7f486ffff700 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d0230 0x561b59898dd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x561b59892440 tx=0x7f4864008040).ready entity=mon.0 client_cookie=9697ea4344cd2b6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:37.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f48567fc700 1 -- 172.21.15.90:0/2976044405 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864016b20 con 0x561b598d0230 2022-07-05T11:57:37.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f48567fc700 1 -- 172.21.15.90:0/2976044405 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486401c040 con 0x561b598d0230 2022-07-05T11:57:37.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f48567fc700 1 -- 172.21.15.90:0/2976044405 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486401f460 con 0x561b598d0230 2022-07-05T11:57:37.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 -- 172.21.15.90:0/2976044405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d0230 msgr2=0x561b59898dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d0230 0x561b59898dd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x561b59892440 tx=0x7f4864008040).stop 2022-07-05T11:57:37.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 -- 172.21.15.90:0/2976044405 shutdown_connections 2022-07-05T11:57:37.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b5988e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b5988ecb0 0x561b59892f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:57:37.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/2976044405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b598d0230 0x561b59898dd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 -- 172.21.15.90:0/2976044405 >> 172.21.15.90:0/2976044405 conn(0x561b596fd1c0 msgr2=0x561b598dce00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:37.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 -- 172.21.15.90:0/2976044405 shutdown_connections 2022-07-05T11:57:37.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.808+0000 7f4888ae0b80 1 -- 172.21.15.90:0/2976044405 wait complete. 2022-07-05T11:57:37.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.809+0000 7f4888ae0b80 1 -- start start 2022-07-05T11:57:37.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.809+0000 7f4888ae0b80 1 Processor -- start 2022-07-05T11:57:37.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b59953f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d0230 0x561b5988f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4888ae0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b598cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b59957560 con 0x561b5988ecb0 2022-07-05T11:57:37.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5988fe90 con 0x561b598d23c0 2022-07-05T11:57:37.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4888ae0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b598dbc30 con 0x561b598d0230 2022-07-05T11:57:37.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4888ae0b80 10 client.0 ll_register_callbacks cb 0x561b598521b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:57:37.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b59953f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b59953f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59554/0 (socket says 172.21.15.90:59554) 2022-07-05T11:57:37.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 -- 172.21.15.90:0/1993458489 learned_addr learned my addr 172.21.15.90:0/1993458489 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:57:37.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 -- 172.21.15.90:0/1993458489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d0230 msgr2=0x561b5988f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d0230 0x561b5988f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:57:37.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 -- 172.21.15.90:0/1993458489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 msgr2=0x561b598cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:57:37.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f48756f1700 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b598cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b598cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 -- 172.21.15.90:0/1993458489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486400e040 con 0x561b5988ecb0 2022-07-05T11:57:37.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f4874ef0700 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b59953f70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f4860009440 tx=0x7f486002f000).ready entity=mon.0 client_cookie=1676176eec20ebc7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:57:37.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.810+0000 7f484affd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:57:37.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f484affd700 1 -- 172.21.15.90:0/1993458489 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486001e5f0 con 0x561b5988ecb0 2022-07-05T11:57:37.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f484affd700 1 -- 172.21.15.90:0/1993458489 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f486002a660 con 0x561b5988ecb0 2022-07-05T11:57:37.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f486001e480 con 0x561b5988ecb0 2022-07-05T11:57:37.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f484affd700 1 -- 172.21.15.90:0/1993458489 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f486002a820 con 0x561b5988ecb0 2022-07-05T11:57:37.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 10 client.5745 fetch_fsmap learned FSMap version 30 2022-07-05T11:57:37.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x561b598dc1f0 con 0x561b5988ecb0 2022-07-05T11:57:37.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f484affd700 1 -- 172.21.15.90:0/1993458489 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486001e480 con 0x561b5988ecb0 2022-07-05T11:57:37.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f484affd700 1 -- 172.21.15.90:0/1993458489 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f4860038470 con 0x561b5988ecb0 2022-07-05T11:57:37.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 10 client.5745 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:57:37.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 10 client.5745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:57:37.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 20 client.5745 populate_metadata read hostname 'smithi090' 2022-07-05T11:57:37.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d27a0 0x561b59969b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:57:37.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 4 client.5745 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:57:37.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561b597d1690 con 0x561b598d27a0 2022-07-05T11:57:37.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.811+0000 7f486ffff700 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d27a0 0x561b59969b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:57:37.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f484affd700 10 client.5745 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:37.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f486ffff700 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d27a0 0x561b59969b00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=da36ffedb8e0351f server_cookie=a589b9a553d1cfaf in_seq=0 out_seq=0 2022-07-05T11:57:37.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f484affd700 1 -- 172.21.15.90:0/1993458489 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561b597d1690 con 0x561b598d27a0 2022-07-05T11:57:37.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f484affd700 10 client.5745 handle_command_reply: tid=0 2022-07-05T11:57:37.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 client.5745 shutdown 2022-07-05T11:57:37.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 msgr2=0x561b59953f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b59953f70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f4860009440 tx=0x7f486002f000).stop 2022-07-05T11:57:37.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 shutdown_connections 2022-07-05T11:57:37.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561b598d27a0 0x561b59969b00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b598d23c0 0x561b598cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b5988ecb0 0x561b59953f70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 --2- 172.21.15.90:0/1993458489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b598d0230 0x561b5988f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:57:37.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 >> 172.21.15.90:0/1993458489 conn(0x561b596fd1c0 msgr2=0x561b598dab30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:37.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f484affd700 0 client.5745 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:57:37.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 shutdown_connections 2022-07-05T11:57:37.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 1 -- 172.21.15.90:0/1993458489 wait complete. 2022-07-05T11:57:37.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.812+0000 7f4888ae0b80 20 client.5745 trim_cache size 0 max 16384 2022-07-05T11:57:37.874 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:57:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:57:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:57:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:57:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:57:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:57:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:57:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:57:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:57:37.878 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:57:37.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f485008ba40 msgr2=0x7f485008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f485008ba40 0x7f485008df00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f486000ba20 tx=0x7f487017d4d0).stop 2022-07-05T11:57:37.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f487017f3b0 msgr2=0x7f487017a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:57:37.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f487017f3b0 0x7f487017a1b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f486800c440 tx=0x7f4868007d70).stop 2022-07-05T11:57:37.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 shutdown_connections 2022-07-05T11:57:37.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f485008ba40 0x7f485008df00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f487017f3b0 0x7f487017a1b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4870178610 0x7f48700ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 --2- 172.21.15.90:0/4198959592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487017dee0 0x7f487017bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:57:37.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 >> 172.21.15.90:0/4198959592 conn(0x7f48700f2210 msgr2=0x7f48700626b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:57:37.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 shutdown_connections 2022-07-05T11:57:37.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:57:37.813+0000 7f4877154700 1 -- 172.21.15.90:0/4198959592 wait complete. 2022-07-05T11:57:37.888 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:57:49.699 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:57:49.704 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:57:49.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:58:07.889 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:58:08.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.016+0000 7fd20a5df700 1 Processor -- start 2022-07-05T11:58:08.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.016+0000 7fd20a5df700 1 -- start start 2022-07-05T11:58:08.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd20a5df700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd20417dcd0 0x7fd204063200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd20a5df700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2040636f0 0x7fd204063b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd20a5df700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd204061f10 con 0x7fd20417e4b0 2022-07-05T11:58:08.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd20a5df700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd204062d70 con 0x7fd20417dcd0 2022-07-05T11:58:08.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd20a5df700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd204062160 con 0x7fd2040636f0 2022-07-05T11:58:08.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd2095dd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd20417dcd0 0x7fd204063200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd2095dd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd20417dcd0 0x7fd204063200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59562/0 (socket says 172.21.15.90:59562) 2022-07-05T11:58:08.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd2095dd700 1 -- 172.21.15.90:0/3215920325 learned_addr learned my addr 172.21.15.90:0/3215920325 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:08.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.017+0000 7fd209dde700 1 --1- 172.21.15.90:0/3215920325 >> v1:172.21.15.90:6789/0 conn(0x7fd20417e4b0 0x7fd20417e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52506/0 (socket says 172.21.15.90:52506) 2022-07-05T11:58:08.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd208ddc700 1 --2- 172.21.15.90:0/3215920325 >> v2:172.21.15.110:3300/0 conn(0x7fd2040636f0 0x7fd204063b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd2095dd700 1 -- 172.21.15.90:0/3215920325 >> v2:172.21.15.110:3300/0 conn(0x7fd2040636f0 msgr2=0x7fd204063b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3215920325 >> v2:172.21.15.110:3300/0 conn(0x7fd2040636f0 0x7fd204063b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd203fff700 1 -- 172.21.15.90:0/3215920325 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088311065 0 0) 0x7fd204061f10 con 0x7fd20417e4b0 2022-07-05T11:58:08.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd2095dd700 1 -- 172.21.15.90:0/3215920325 >> v1:172.21.15.90:6789/0 conn(0x7fd20417e4b0 legacy=0x7fd20417e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd2095dd700 1 -- 172.21.15.90:0/3215920325 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204062440 con 0x7fd20417dcd0 2022-07-05T11:58:08.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd208ddc700 1 --2- 172.21.15.90:0/3215920325 >> v2:172.21.15.110:3300/0 conn(0x7fd2040636f0 0x7fd204063b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:58:08.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3215920325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204063200 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd204088fb0 tx=0x7fd1f4009840).ready entity=mon.0 client_cookie=61d9c950bafa0f62 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:08.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd203fff700 1 -- 172.21.15.90:0/3215920325 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f400e070 con 0x7fd20417dcd0 2022-07-05T11:58:08.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd203fff700 1 -- 172.21.15.90:0/3215920325 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f400ba50 con 0x7fd20417dcd0 2022-07-05T11:58:08.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.018+0000 7fd203fff700 1 -- 172.21.15.90:0/3215920325 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f400bdd0 con 0x7fd20417dcd0 2022-07-05T11:58:08.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 -- 172.21.15.90:0/3215920325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 msgr2=0x7fd204063200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 --2- 172.21.15.90:0/3215920325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204063200 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd204088fb0 tx=0x7fd1f4009840).stop 2022-07-05T11:58:08.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 -- 172.21.15.90:0/3215920325 shutdown_connections 2022-07-05T11:58:08.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 --2- 172.21.15.90:0/3215920325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204063200 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 --2- 172.21.15.90:0/3215920325 >> v2:172.21.15.110:3300/0 conn(0x7fd2040636f0 0x7fd204063b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 -- 172.21.15.90:0/3215920325 >> 172.21.15.90:0/3215920325 conn(0x7fd2040f5470 msgr2=0x7fd2040f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:08.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 -- 172.21.15.90:0/3215920325 shutdown_connections 2022-07-05T11:58:08.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.019+0000 7fd20a5df700 1 -- 172.21.15.90:0/3215920325 wait complete. 2022-07-05T11:58:08.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.020+0000 7fd20a5df700 1 Processor -- start 2022-07-05T11:58:08.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.020+0000 7fd20a5df700 1 -- start start 2022-07-05T11:58:08.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd20a5df700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040636f0 0x7fd2041917b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd20a5df700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204191ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd20a5df700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd20417e4b0 0x7fd204171470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd20a5df700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040ca3b0 con 0x7fd20417dcd0 2022-07-05T11:58:08.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd20a5df700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204190430 con 0x7fd2040636f0 2022-07-05T11:58:08.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd20a5df700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204190710 con 0x7fd20417e4b0 2022-07-05T11:58:08.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd208ddc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204191ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd208ddc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204191ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59568/0 (socket says 172.21.15.90:59568) 2022-07-05T11:58:08.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.021+0000 7fd208ddc700 1 -- 172.21.15.90:0/602022121 learned_addr learned my addr 172.21.15.90:0/602022121 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:08.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd2095dd700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040636f0 0x7fd2041917b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd208ddc700 1 -- 172.21.15.90:0/602022121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd20417e4b0 msgr2=0x7fd204171470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd209dde700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd20417e4b0 0x7fd204171470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd208ddc700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd20417e4b0 0x7fd204171470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd208ddc700 1 -- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040636f0 msgr2=0x7fd2041917b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd208ddc700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040636f0 0x7fd2041917b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd208ddc700 1 -- 172.21.15.90:0/602022121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009ae0 con 0x7fd20417dcd0 2022-07-05T11:58:08.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd209dde700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd20417e4b0 0x7fd204171470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:58:08.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd208ddc700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204191ca0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd1f800c880 tx=0x7fd1f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:08.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd2017fa700 1 -- 172.21.15.90:0/602022121 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8010580 con 0x7fd20417dcd0 2022-07-05T11:58:08.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd2017fa700 1 -- 172.21.15.90:0/602022121 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80106e0 con 0x7fd20417dcd0 2022-07-05T11:58:08.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2041909f0 con 0x7fd20417dcd0 2022-07-05T11:58:08.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd2017fa700 1 -- 172.21.15.90:0/602022121 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8010a60 con 0x7fd20417dcd0 2022-07-05T11:58:08.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.022+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd204190fb0 con 0x7fd20417dcd0 2022-07-05T11:58:08.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.024+0000 7fd2017fa700 1 -- 172.21.15.90:0/602022121 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd1f801b460 con 0x7fd20417dcd0 2022-07-05T11:58:08.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.024+0000 7fd2017fa700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd1e408ba40 0x7fd1e408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.024+0000 7fd2017fa700 1 -- 172.21.15.90:0/602022121 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd1f80b0b00 con 0x7fd20417dcd0 2022-07-05T11:58:08.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.024+0000 7fd2095dd700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd1e408ba40 0x7fd1e408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.025+0000 7fd2095dd700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd1e408ba40 0x7fd1e408df00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fd1f400ba20 tx=0x7fd204062eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:08.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.026+0000 7fd21d1cdb80 1 Processor -- start 2022-07-05T11:58:08.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.026+0000 7fd21d1cdb80 1 -- start start 2022-07-05T11:58:08.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x5559489998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555948999da0 0x5559489e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x5559489ddd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559489632d0 con 0x5559489dd890 2022-07-05T11:58:08.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559488daaa0 con 0x5559489dd4b0 2022-07-05T11:58:08.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559488ef950 con 0x555948999da0 2022-07-05T11:58:08.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x5559489ddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x5559489ddd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59578/0 (socket says 172.21.15.90:59578) 2022-07-05T11:58:08.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 -- 172.21.15.90:0/2730354095 learned_addr learned my addr 172.21.15.90:0/2730354095 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:08.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd2095dd700 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x5559489998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 -- 172.21.15.90:0/2730354095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555948999da0 msgr2=0x5559489e7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555948999da0 0x5559489e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:58:08.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 -- 172.21.15.90:0/2730354095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 msgr2=0x5559489998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x5559489998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 -- 172.21.15.90:0/2730354095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559487219e0 con 0x5559489dd890 2022-07-05T11:58:08.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd209dde700 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x5559489ddd10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fd1fc001640 tx=0x7fd1fc009040).ready entity=mon.0 client_cookie=eaab04a558d3cb30 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:08.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd1ea7fc700 1 -- 172.21.15.90:0/2730354095 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc000fe0 con 0x5559489dd890 2022-07-05T11:58:08.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd1ea7fc700 1 -- 172.21.15.90:0/2730354095 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0072e0 con 0x5559489dd890 2022-07-05T11:58:08.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.027+0000 7fd1ea7fc700 1 -- 172.21.15.90:0/2730354095 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0056e0 con 0x5559489dd890 2022-07-05T11:58:08.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2730354095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 msgr2=0x5559489ddd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x5559489ddd10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fd1fc001640 tx=0x7fd1fc009040).stop 2022-07-05T11:58:08.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2730354095 shutdown_connections 2022-07-05T11:58:08.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x5559489ddd10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x5559489998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2730354095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555948999da0 0x5559489e7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:58:08.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2730354095 >> 172.21.15.90:0/2730354095 conn(0x5559488081c0 msgr2=0x55594899cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:08.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2730354095 shutdown_connections 2022-07-05T11:58:08.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.028+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2730354095 wait complete. 2022-07-05T11:58:08.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.029+0000 7fd21d1cdb80 1 -- start start 2022-07-05T11:58:08.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.029+0000 7fd21d1cdb80 1 Processor -- start 2022-07-05T11:58:08.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a10660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 0x555948a1cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559488b7120 con 0x555948999da0 2022-07-05T11:58:08.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555948a10b50 con 0x5559489dd4b0 2022-07-05T11:58:08.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559489d7c30 con 0x5559489dd890 2022-07-05T11:58:08.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd21d1cdb80 10 client.0 ll_register_callbacks cb 0x55594895d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:58:08.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59582/0 (socket says 172.21.15.90:59582) 2022-07-05T11:58:08.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 -- 172.21.15.90:0/2989699677 learned_addr learned my addr 172.21.15.90:0/2989699677 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:08.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd208ddc700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a10660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd209dde700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 0x555948a1cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 -- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 msgr2=0x555948a1cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 0x555948a1cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 -- 172.21.15.90:0/2989699677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 msgr2=0x555948a10660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a10660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd2095dd700 1 -- 172.21.15.90:0/2989699677 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc001190 con 0x555948999da0 2022-07-05T11:58:08.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.030+0000 7fd208ddc700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a10660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:58:08.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd2095dd700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1e660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd204088dd0 tx=0x7fd1f401d000).ready entity=mon.0 client_cookie=a5b8708248e5c2c1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:08.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd1df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:58:08.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd1df7fe700 1 -- 172.21.15.90:0/2989699677 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f401eaf0 con 0x555948999da0 2022-07-05T11:58:08.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd1df7fe700 1 -- 172.21.15.90:0/2989699677 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd1f401ec50 con 0x555948999da0 2022-07-05T11:58:08.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555948997690 con 0x555948999da0 2022-07-05T11:58:08.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd1df7fe700 1 -- 172.21.15.90:0/2989699677 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1f401ee10 con 0x555948999da0 2022-07-05T11:58:08.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 10 client.5760 fetch_fsmap learned FSMap version 30 2022-07-05T11:58:08.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x555948790cd0 con 0x555948999da0 2022-07-05T11:58:08.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd1df7fe700 1 -- 172.21.15.90:0/2989699677 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555948997690 con 0x555948999da0 2022-07-05T11:58:08.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd1df7fe700 1 -- 172.21.15.90:0/2989699677 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fd1f4029070 con 0x555948999da0 2022-07-05T11:58:08.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 10 client.5760 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:58:08.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 10 client.5760 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:58:08.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 20 client.5760 populate_metadata read hostname 'smithi090' 2022-07-05T11:58:08.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5559489d7530 0x555948a1f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 4 client.5760 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:58:08.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559488e57f0 con 0x5559489d7530 2022-07-05T11:58:08.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.031+0000 7fd208ddc700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5559489d7530 0x555948a1f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.032+0000 7fd1df7fe700 10 client.5760 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:08.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.032+0000 7fd208ddc700 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5559489d7530 0x555948a1f190 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=469fb223a252f7cd server_cookie=af5fc1ecb1ecd4f1 in_seq=0 out_seq=0 2022-07-05T11:58:08.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.032+0000 7fd1df7fe700 1 -- 172.21.15.90:0/2989699677 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5559488e57f0 con 0x5559489d7530 2022-07-05T11:58:08.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.032+0000 7fd1df7fe700 10 client.5760 handle_command_reply: tid=0 2022-07-05T11:58:08.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.032+0000 7fd21d1cdb80 1 client.5760 shutdown 2022-07-05T11:58:08.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 msgr2=0x555948a1e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1e660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd204088dd0 tx=0x7fd1f401d000).stop 2022-07-05T11:58:08.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 shutdown_connections 2022-07-05T11:58:08.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5559489d7530 0x555948a1f190 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 0x555948a1cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1e660 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/2989699677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a10660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 >> 172.21.15.90:0/2989699677 conn(0x5559488081c0 msgr2=0x555948a0a240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:08.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd1df7fe700 0 client.5760 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:08.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 shutdown_connections 2022-07-05T11:58:08.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/2989699677 wait complete. 2022-07-05T11:58:08.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.033+0000 7fd21d1cdb80 20 client.5760 trim_cache size 0 max 16384 2022-07-05T11:58:08.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.048+0000 7fd21d1cdb80 1 Processor -- start 2022-07-05T11:58:08.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.048+0000 7fd21d1cdb80 1 -- start start 2022-07-05T11:58:08.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a1e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 0x5559489e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555948a1eb30 con 0x555948999da0 2022-07-05T11:58:08.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559489e87c0 con 0x5559489dd4b0 2022-07-05T11:58:08.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555948a1dc10 con 0x5559489dd890 2022-07-05T11:58:08.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59592/0 (socket says 172.21.15.90:59592) 2022-07-05T11:58:08.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 -- 172.21.15.90:0/3469981548 learned_addr learned my addr 172.21.15.90:0/3469981548 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:08.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 -- 172.21.15.90:0/3469981548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 msgr2=0x5559489e82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3469981548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 0x5559489e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:58:08.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 -- 172.21.15.90:0/3469981548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 msgr2=0x555948a1e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3469981548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a1e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:58:08.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.049+0000 7fd2095dd700 1 -- 172.21.15.90:0/3469981548 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555948a1cee0 con 0x555948999da0 2022-07-05T11:58:08.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3469981548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1c800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fd1f401efd0 tx=0x7fd1f4029000).ready entity=mon.0 client_cookie=552cf77ea1a6627 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:08.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd1eaffd700 1 -- 172.21.15.90:0/3469981548 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4013e00 con 0x555948999da0 2022-07-05T11:58:08.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd1eaffd700 1 -- 172.21.15.90:0/3469981548 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4019040 con 0x555948999da0 2022-07-05T11:58:08.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd1eaffd700 1 -- 172.21.15.90:0/3469981548 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f401ed20 con 0x555948999da0 2022-07-05T11:58:08.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3469981548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 msgr2=0x555948a1c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3469981548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1c800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fd1f401efd0 tx=0x7fd1f4029000).stop 2022-07-05T11:58:08.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3469981548 shutdown_connections 2022-07-05T11:58:08.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3469981548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd890 0x5559489e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:58:08.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3469981548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555948999da0 0x555948a1c800 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3469981548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559489dd4b0 0x555948a1e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:58:08.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3469981548 >> 172.21.15.90:0/3469981548 conn(0x5559488081c0 msgr2=0x555948a1c060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:08.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3469981548 shutdown_connections 2022-07-05T11:58:08.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.050+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3469981548 wait complete. 2022-07-05T11:58:08.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.051+0000 7fd21d1cdb80 1 -- start start 2022-07-05T11:58:08.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.051+0000 7fd21d1cdb80 1 Processor -- start 2022-07-05T11:58:08.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555948999da0 0x5559489e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd4b0 0x5559489dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd21d1cdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x555948a71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559489db2f0 con 0x5559489dd890 2022-07-05T11:58:08.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555948a71740 con 0x555948999da0 2022-07-05T11:58:08.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd21d1cdb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555948a0f890 con 0x5559489dd4b0 2022-07-05T11:58:08.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd21d1cdb80 10 client.0 ll_register_callbacks cb 0x55594895d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:58:08.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd209dde700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x555948a71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd209dde700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x555948a71b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59600/0 (socket says 172.21.15.90:59600) 2022-07-05T11:58:08.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd209dde700 1 -- 172.21.15.90:0/3360680635 learned_addr learned my addr 172.21.15.90:0/3360680635 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:08.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.052+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555948999da0 0x5559489e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd208ddc700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd4b0 0x5559489dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd209dde700 1 -- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd4b0 msgr2=0x5559489dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd209dde700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd4b0 0x5559489dae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd209dde700 1 -- 172.21.15.90:0/3360680635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555948999da0 msgr2=0x5559489e3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:08.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd209dde700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555948999da0 0x5559489e3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd209dde700 1 -- 172.21.15.90:0/3360680635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555948790cd0 con 0x5559489dd890 2022-07-05T11:58:08.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555948999da0 0x5559489e3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:58:08.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd209dde700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x555948a71b80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fd1fc001480 tx=0x5559489e8930).ready entity=mon.0 client_cookie=171e74154434e815 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:08.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd1df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:58:08.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd1df7fe700 1 -- 172.21.15.90:0/3360680635 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc005240 con 0x5559489dd890 2022-07-05T11:58:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd1df7fe700 1 -- 172.21.15.90:0/3360680635 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd1fc0053a0 con 0x5559489dd890 2022-07-05T11:58:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1fc0072e0 con 0x5559489dd890 2022-07-05T11:58:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd1df7fe700 1 -- 172.21.15.90:0/3360680635 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1fc0046b0 con 0x5559489dd890 2022-07-05T11:58:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 10 client.5766 fetch_fsmap learned FSMap version 30 2022-07-05T11:58:08.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55594875efd0 con 0x5559489dd890 2022-07-05T11:58:08.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd1df7fe700 1 -- 172.21.15.90:0/3360680635 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0072e0 con 0x5559489dd890 2022-07-05T11:58:08.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd1df7fe700 1 -- 172.21.15.90:0/3360680635 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fd1fc004810 con 0x5559489dd890 2022-07-05T11:58:08.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 10 client.5766 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:58:08.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 10 client.5766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:58:08.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 20 client.5766 populate_metadata read hostname 'smithi090' 2022-07-05T11:58:08.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555948a0f0c0 0x5559489dc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:08.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 4 client.5766 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:58:08.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.053+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5559488dc690 con 0x555948a0f0c0 2022-07-05T11:58:08.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555948a0f0c0 0x5559489dc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:08.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd1df7fe700 10 client.5766 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd2095dd700 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555948a0f0c0 0x5559489dc8e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bf2a32775a088e52 server_cookie=15e7f40a86ee42a8 in_seq=0 out_seq=0 2022-07-05T11:58:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd1df7fe700 1 -- 172.21.15.90:0/3360680635 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5559488dc690 con 0x555948a0f0c0 2022-07-05T11:58:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd1df7fe700 10 client.5766 handle_command_reply: tid=0 2022-07-05T11:58:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 client.5766 shutdown 2022-07-05T11:58:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 msgr2=0x555948a71b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x555948a71b80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fd1fc001480 tx=0x5559489e8930).stop 2022-07-05T11:58:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 shutdown_connections 2022-07-05T11:58:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555948a0f0c0 0x5559489dc8e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5559489dd890 0x555948a71b80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555948999da0 0x5559489e3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 --2- 172.21.15.90:0/3360680635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559489dd4b0 0x5559489dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd1df7fe700 0 client.5766 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:08.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 >> 172.21.15.90:0/3360680635 conn(0x5559488081c0 msgr2=0x5559489a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:08.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 shutdown_connections 2022-07-05T11:58:08.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 1 -- 172.21.15.90:0/3360680635 wait complete. 2022-07-05T11:58:08.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.054+0000 7fd21d1cdb80 20 client.5766 trim_cache size 0 max 16384 2022-07-05T11:58:08.101 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:58:08.101 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:58:08.101 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:58:08.102 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:58:08.102 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:58:08.102 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:58:08.102 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:58:08.103 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:58:08.103 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:58:08.103 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:58:08.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd1e408ba40 msgr2=0x7fd1e408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd1e408ba40 0x7fd1e408df00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fd1f400ba20 tx=0x7fd204062eb0).stop 2022-07-05T11:58:08.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 msgr2=0x7fd204191ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:08.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204191ca0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd1f800c880 tx=0x7fd1f8008040).stop 2022-07-05T11:58:08.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 shutdown_connections 2022-07-05T11:58:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd1e408ba40 0x7fd1e408df00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd20417e4b0 0x7fd204171470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040636f0 0x7fd2041917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 --2- 172.21.15.90:0/602022121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20417dcd0 0x7fd204191ca0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 >> 172.21.15.90:0/602022121 conn(0x7fd2040f5470 msgr2=0x7fd2040c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:08.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 shutdown_connections 2022-07-05T11:58:08.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:08.055+0000 7fd20a5df700 1 -- 172.21.15.90:0/602022121 wait complete. 2022-07-05T11:58:08.108 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:58:19.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:58:19.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:58:19.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:58:35.806 INFO:tasks.ceph.mds.i.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7fc6aa41a700 time 2022-07-05T11:58:35.806508+0000 2022-07-05T11:58:35.806 INFO:tasks.ceph.mds.i.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.815 INFO:tasks.ceph.mds.b.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7f6f22dcc700 time 2022-07-05T11:58:35.805734+0000 2022-07-05T11:58:35.815 INFO:tasks.ceph.mds.b.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.816 INFO:tasks.ceph.mds.e.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7ff3d3d0d700 time 2022-07-05T11:58:35.805733+0000 2022-07-05T11:58:35.816 INFO:tasks.ceph.mds.e.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.817 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.817 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f6f2b5def78] 2022-07-05T11:58:35.817 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.817 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.818 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.818 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.818 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.819 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.819 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.819 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.819 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.819 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.820 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.820 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.820 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.821 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.821 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7ff3dc51ff78] 2022-07-05T11:58:35.821 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.821 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.822 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.822 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.822 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.822 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.823 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.823 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.823 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.824 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.824 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.824 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.825 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.825 INFO:tasks.ceph.mds.e.smithi110.stderr:2022-07-05T11:58:35.806+0000 7ff3d3d0d700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7ff3d3d0d700 time 2022-07-05T11:58:35.805733+0000 2022-07-05T11:58:35.825 INFO:tasks.ceph.mds.e.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.825 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.826 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.826 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7ff3dc51ff78] 2022-07-05T11:58:35.826 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.826 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.827 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.827 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.827 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.827 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.828 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.828 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.828 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.828 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.828 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.829 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.829 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.829 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.830 INFO:tasks.ceph.mds.b.smithi110.stderr:2022-07-05T11:58:35.806+0000 7f6f22dcc700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7f6f22dcc700 time 2022-07-05T11:58:35.805734+0000 2022-07-05T11:58:35.830 INFO:tasks.ceph.mds.b.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.831 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.831 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.831 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f6f2b5def78] 2022-07-05T11:58:35.832 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.832 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.832 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.832 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.832 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.833 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.833 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.833 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.833 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.834 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.834 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.834 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.835 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.835 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.835 INFO:tasks.ceph.mds.b.smithi110.stderr:*** Caught signal (Aborted) ** 2022-07-05T11:58:35.836 INFO:tasks.ceph.mds.b.smithi110.stderr: in thread 7f6f22dcc700 thread_name:ms_dispatch 2022-07-05T11:58:35.836 INFO:tasks.ceph.mds.e.smithi110.stderr:*** Caught signal (Aborted) ** 2022-07-05T11:58:35.837 INFO:tasks.ceph.mds.e.smithi110.stderr: in thread 7ff3d3d0d700 thread_name:ms_dispatch 2022-07-05T11:58:35.837 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.837 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7ff3db50fb20] 2022-07-05T11:58:35.837 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.838 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.838 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7ff3dc51ffc9] 2022-07-05T11:58:35.838 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.838 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.838 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.839 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.839 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.839 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.839 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.840 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.840 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.840 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.840 INFO:tasks.ceph.mds.e.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.840 INFO:tasks.ceph.mds.e.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.841 INFO:tasks.ceph.mds.e.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.841 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.842 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f6f2a5ceb20] 2022-07-05T11:58:35.842 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.842 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.842 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f6f2b5defc9] 2022-07-05T11:58:35.843 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.843 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.843 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.843 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.843 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.844 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.844 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.844 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.844 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.845 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.845 INFO:tasks.ceph.mds.b.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.845 INFO:tasks.ceph.mds.b.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.845 INFO:tasks.ceph.mds.b.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.846 INFO:tasks.ceph.mds.e.smithi110.stderr:2022-07-05T11:58:35.808+0000 7ff3d3d0d700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.846 INFO:tasks.ceph.mds.e.smithi110.stderr: in thread 7ff3d3d0d700 thread_name:ms_dispatch 2022-07-05T11:58:35.846 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.847 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.847 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7ff3db50fb20] 2022-07-05T11:58:35.847 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.847 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.848 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7ff3dc51ffc9] 2022-07-05T11:58:35.848 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.848 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.848 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.848 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.849 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.849 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.849 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.849 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.850 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.850 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.850 INFO:tasks.ceph.mds.e.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.850 INFO:tasks.ceph.mds.e.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.850 INFO:tasks.ceph.mds.e.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.851 INFO:tasks.ceph.mds.e.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.851 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.851 INFO:tasks.ceph.mds.b.smithi110.stderr:2022-07-05T11:58:35.808+0000 7f6f22dcc700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.852 INFO:tasks.ceph.mds.b.smithi110.stderr: in thread 7f6f22dcc700 thread_name:ms_dispatch 2022-07-05T11:58:35.852 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.852 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.853 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f6f2a5ceb20] 2022-07-05T11:58:35.853 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.853 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.853 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f6f2b5defc9] 2022-07-05T11:58:35.853 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.854 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.854 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.854 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.855 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.855 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.855 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.855 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.856 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.856 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.857 INFO:tasks.ceph.mds.b.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.857 INFO:tasks.ceph.mds.b.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.857 INFO:tasks.ceph.mds.b.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.857 INFO:tasks.ceph.mds.b.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.858 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.859 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.859 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fc6b2c2cf78] 2022-07-05T11:58:35.859 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.859 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.860 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.860 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.860 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.860 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.861 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.861 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.861 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.861 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.862 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.862 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.862 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: clone() 2022-07-05T11:58:35.863 INFO:tasks.ceph.mds.i.smithi149.stderr:*** Caught signal (Aborted) ** 2022-07-05T11:58:35.863 INFO:tasks.ceph.mds.i.smithi149.stderr: in thread 7fc6aa41a700 thread_name:ms_dispatch 2022-07-05T11:58:35.863 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.864 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc6b1c1cb20] 2022-07-05T11:58:35.864 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: gsignal() 2022-07-05T11:58:35.864 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: abort() 2022-07-05T11:58:35.864 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fc6b2c2cfc9] 2022-07-05T11:58:35.865 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.865 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.865 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.865 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.866 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.866 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.866 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.866 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.867 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.867 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.867 INFO:tasks.ceph.mds.i.smithi149.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.867 INFO:tasks.ceph.mds.i.smithi149.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.867 INFO:tasks.ceph.mds.i.smithi149.stderr: 17: clone() 2022-07-05T11:58:35.868 INFO:tasks.ceph.mds.i.smithi149.stderr:2022-07-05T11:58:35.821+0000 7fc6aa41a700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7fc6aa41a700 time 2022-07-05T11:58:35.806508+0000 2022-07-05T11:58:35.868 INFO:tasks.ceph.mds.i.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.868 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.869 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.869 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fc6b2c2cf78] 2022-07-05T11:58:35.869 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.869 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.870 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.870 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.870 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.870 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.871 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.871 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.871 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.871 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.871 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.872 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.872 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: clone() 2022-07-05T11:58:35.872 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.873 INFO:tasks.ceph.mds.i.smithi149.stderr:2022-07-05T11:58:35.823+0000 7fc6aa41a700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.873 INFO:tasks.ceph.mds.i.smithi149.stderr: in thread 7fc6aa41a700 thread_name:ms_dispatch 2022-07-05T11:58:35.873 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.873 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.873 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc6b1c1cb20] 2022-07-05T11:58:35.874 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: gsignal() 2022-07-05T11:58:35.874 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: abort() 2022-07-05T11:58:35.874 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fc6b2c2cfc9] 2022-07-05T11:58:35.874 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.875 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.875 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.875 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.875 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.876 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.876 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.877 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.880 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.880 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.881 INFO:tasks.ceph.mds.i.smithi149.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.881 INFO:tasks.ceph.mds.i.smithi149.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.883 INFO:tasks.ceph.mds.i.smithi149.stderr: 17: clone() 2022-07-05T11:58:35.883 INFO:tasks.ceph.mds.i.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.884 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.884 INFO:tasks.ceph.mds.i.smithi149.stderr: -1> 2022-07-05T11:58:35.821+0000 7fc6aa41a700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7fc6aa41a700 time 2022-07-05T11:58:35.806508+0000 2022-07-05T11:58:35.885 INFO:tasks.ceph.mds.i.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.886 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.886 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.887 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fc6b2c2cf78] 2022-07-05T11:58:35.888 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.888 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.889 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.889 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.890 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.890 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.891 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.891 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.892 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.893 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.893 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.894 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.894 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: clone() 2022-07-05T11:58:35.896 INFO:tasks.ceph.mds.b.smithi110.stderr: -1> 2022-07-05T11:58:35.806+0000 7f6f22dcc700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7f6f22dcc700 time 2022-07-05T11:58:35.805734+0000 2022-07-05T11:58:35.897 INFO:tasks.ceph.mds.b.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.898 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.898 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.899 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f6f2b5def78] 2022-07-05T11:58:35.900 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.901 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.901 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.903 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.903 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.904 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.904 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.905 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.905 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.906 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.906 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.907 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.907 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.907 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.908 INFO:tasks.ceph.mds.b.smithi110.stderr: 0> 2022-07-05T11:58:35.808+0000 7f6f22dcc700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.908 INFO:tasks.ceph.mds.b.smithi110.stderr: in thread 7f6f22dcc700 thread_name:ms_dispatch 2022-07-05T11:58:35.909 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.910 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.910 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f6f2a5ceb20] 2022-07-05T11:58:35.911 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.912 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.912 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f6f2b5defc9] 2022-07-05T11:58:35.913 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.914 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.914 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.915 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.915 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.916 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.916 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.916 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.917 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.917 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.918 INFO:tasks.ceph.mds.b.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.919 INFO:tasks.ceph.mds.b.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.920 INFO:tasks.ceph.mds.b.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.920 INFO:tasks.ceph.mds.b.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.921 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.922 INFO:tasks.ceph.mds.e.smithi110.stderr: -1> 2022-07-05T11:58:35.806+0000 7ff3d3d0d700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7ff3d3d0d700 time 2022-07-05T11:58:35.805733+0000 2022-07-05T11:58:35.923 INFO:tasks.ceph.mds.e.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.923 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.924 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.924 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7ff3dc51ff78] 2022-07-05T11:58:35.925 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.925 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.925 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.926 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.926 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.927 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.927 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.928 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.928 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.929 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.929 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.930 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.930 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.931 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.931 INFO:tasks.ceph.mds.e.smithi110.stderr: 0> 2022-07-05T11:58:35.808+0000 7ff3d3d0d700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.931 INFO:tasks.ceph.mds.e.smithi110.stderr: in thread 7ff3d3d0d700 thread_name:ms_dispatch 2022-07-05T11:58:35.932 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.932 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.933 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7ff3db50fb20] 2022-07-05T11:58:35.933 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.938 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.938 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7ff3dc51ffc9] 2022-07-05T11:58:35.938 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.939 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.939 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.939 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.940 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.940 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.940 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.940 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.941 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.941 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.941 INFO:tasks.ceph.mds.e.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.941 INFO:tasks.ceph.mds.e.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.942 INFO:tasks.ceph.mds.e.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.942 INFO:tasks.ceph.mds.e.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.942 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.943 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.944 INFO:tasks.ceph.mds.i.smithi149.stderr: 0> 2022-07-05T11:58:35.823+0000 7fc6aa41a700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.944 INFO:tasks.ceph.mds.i.smithi149.stderr: in thread 7fc6aa41a700 thread_name:ms_dispatch 2022-07-05T11:58:35.944 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.944 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.944 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc6b1c1cb20] 2022-07-05T11:58:35.945 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: gsignal() 2022-07-05T11:58:35.945 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: abort() 2022-07-05T11:58:35.945 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fc6b2c2cfc9] 2022-07-05T11:58:35.945 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.946 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.946 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.946 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.947 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.947 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.948 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.948 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.948 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.948 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.949 INFO:tasks.ceph.mds.i.smithi149.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.949 INFO:tasks.ceph.mds.i.smithi149.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.949 INFO:tasks.ceph.mds.i.smithi149.stderr: 17: clone() 2022-07-05T11:58:35.949 INFO:tasks.ceph.mds.i.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.950 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.950 INFO:tasks.ceph.mds.i.smithi149.stderr: -1> 2022-07-05T11:58:35.821+0000 7fc6aa41a700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7fc6aa41a700 time 2022-07-05T11:58:35.806508+0000 2022-07-05T11:58:35.950 INFO:tasks.ceph.mds.i.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.950 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.950 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.951 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fc6b2c2cf78] 2022-07-05T11:58:35.951 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.951 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.952 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.952 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.952 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.952 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.953 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.953 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.953 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.953 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.953 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.954 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.954 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: clone() 2022-07-05T11:58:35.954 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.954 INFO:tasks.ceph.mds.i.smithi149.stderr: 0> 2022-07-05T11:58:35.823+0000 7fc6aa41a700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.955 INFO:tasks.ceph.mds.i.smithi149.stderr: in thread 7fc6aa41a700 thread_name:ms_dispatch 2022-07-05T11:58:35.955 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.955 INFO:tasks.ceph.mds.i.smithi149.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.955 INFO:tasks.ceph.mds.i.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc6b1c1cb20] 2022-07-05T11:58:35.955 INFO:tasks.ceph.mds.i.smithi149.stderr: 2: gsignal() 2022-07-05T11:58:35.956 INFO:tasks.ceph.mds.i.smithi149.stderr: 3: abort() 2022-07-05T11:58:35.956 INFO:tasks.ceph.mds.i.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fc6b2c2cfc9] 2022-07-05T11:58:35.956 INFO:tasks.ceph.mds.i.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7fc6b2c2d192] 2022-07-05T11:58:35.956 INFO:tasks.ceph.mds.i.smithi149.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55ea84fb437f] 2022-07-05T11:58:35.956 INFO:tasks.ceph.mds.i.smithi149.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55ea84ce1e4c] 2022-07-05T11:58:35.957 INFO:tasks.ceph.mds.i.smithi149.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55ea84ce25a2] 2022-07-05T11:58:35.957 INFO:tasks.ceph.mds.i.smithi149.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55ea84ce285d] 2022-07-05T11:58:35.957 INFO:tasks.ceph.mds.i.smithi149.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55ea84c9ee94] 2022-07-05T11:58:35.957 INFO:tasks.ceph.mds.i.smithi149.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55ea84c9f1d6] 2022-07-05T11:58:35.958 INFO:tasks.ceph.mds.i.smithi149.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55ea84c8920b] 2022-07-05T11:58:35.958 INFO:tasks.ceph.mds.i.smithi149.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55ea84c89af3] 2022-07-05T11:58:35.958 INFO:tasks.ceph.mds.i.smithi149.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7fc6b2e7342a] 2022-07-05T11:58:35.958 INFO:tasks.ceph.mds.i.smithi149.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc6b2f26091] 2022-07-05T11:58:35.959 INFO:tasks.ceph.mds.i.smithi149.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7fc6b1c1214a] 2022-07-05T11:58:35.959 INFO:tasks.ceph.mds.i.smithi149.stderr: 17: clone() 2022-07-05T11:58:35.959 INFO:tasks.ceph.mds.i.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.959 INFO:tasks.ceph.mds.i.smithi149.stderr: 2022-07-05T11:58:35.960 INFO:tasks.ceph.mds.b.smithi110.stderr: -1> 2022-07-05T11:58:35.806+0000 7f6f22dcc700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7f6f22dcc700 time 2022-07-05T11:58:35.805734+0000 2022-07-05T11:58:35.960 INFO:tasks.ceph.mds.b.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.960 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.960 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.961 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f6f2b5def78] 2022-07-05T11:58:35.961 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.962 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.962 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.962 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.963 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.963 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.963 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.963 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.963 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.964 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.964 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.964 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.964 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.965 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.965 INFO:tasks.ceph.mds.b.smithi110.stderr: 0> 2022-07-05T11:58:35.808+0000 7f6f22dcc700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.965 INFO:tasks.ceph.mds.b.smithi110.stderr: in thread 7f6f22dcc700 thread_name:ms_dispatch 2022-07-05T11:58:35.965 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.965 INFO:tasks.ceph.mds.b.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.966 INFO:tasks.ceph.mds.b.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f6f2a5ceb20] 2022-07-05T11:58:35.966 INFO:tasks.ceph.mds.b.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.966 INFO:tasks.ceph.mds.b.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.966 INFO:tasks.ceph.mds.b.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f6f2b5defc9] 2022-07-05T11:58:35.967 INFO:tasks.ceph.mds.b.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7f6f2b5df192] 2022-07-05T11:58:35.967 INFO:tasks.ceph.mds.b.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55cfcff4737f] 2022-07-05T11:58:35.967 INFO:tasks.ceph.mds.b.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55cfcfc74e4c] 2022-07-05T11:58:35.967 INFO:tasks.ceph.mds.b.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55cfcfc755a2] 2022-07-05T11:58:35.967 INFO:tasks.ceph.mds.b.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55cfcfc7585d] 2022-07-05T11:58:35.968 INFO:tasks.ceph.mds.b.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55cfcfc31e94] 2022-07-05T11:58:35.968 INFO:tasks.ceph.mds.b.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55cfcfc321d6] 2022-07-05T11:58:35.968 INFO:tasks.ceph.mds.b.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55cfcfc1c20b] 2022-07-05T11:58:35.968 INFO:tasks.ceph.mds.b.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55cfcfc1caf3] 2022-07-05T11:58:35.969 INFO:tasks.ceph.mds.b.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7f6f2b82542a] 2022-07-05T11:58:35.969 INFO:tasks.ceph.mds.b.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f2b8d8091] 2022-07-05T11:58:35.969 INFO:tasks.ceph.mds.b.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f6f2a5c414a] 2022-07-05T11:58:35.969 INFO:tasks.ceph.mds.b.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.969 INFO:tasks.ceph.mds.b.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.970 INFO:tasks.ceph.mds.b.smithi110.stderr: 2022-07-05T11:58:35.970 INFO:tasks.ceph.mds.e.smithi110.stderr: -1> 2022-07-05T11:58:35.806+0000 7ff3d3d0d700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: In function 'void MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)' thread 7ff3d3d0d700 time 2022-07-05T11:58:35.805733+0000 2022-07-05T11:58:35.970 INFO:tasks.ceph.mds.e.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.9-390-g494bbf8c/rpm/el8/BUILD/ceph-16.2.9-390-g494bbf8c/src/mds/MDLog.cc: 281: FAILED ceph_assert(!mds->is_any_replay()) 2022-07-05T11:58:35.971 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.971 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.971 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7ff3dc51ff78] 2022-07-05T11:58:35.971 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.972 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.972 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.972 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.972 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.973 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.973 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.973 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.974 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.974 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.974 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.974 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.975 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: clone() 2022-07-05T11:58:35.975 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.975 INFO:tasks.ceph.mds.e.smithi110.stderr: 0> 2022-07-05T11:58:35.808+0000 7ff3d3d0d700 -1 *** Caught signal (Aborted) ** 2022-07-05T11:58:35.975 INFO:tasks.ceph.mds.e.smithi110.stderr: in thread 7ff3d3d0d700 thread_name:ms_dispatch 2022-07-05T11:58:35.976 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:35.976 INFO:tasks.ceph.mds.e.smithi110.stderr: ceph version 16.2.9-390-g494bbf8c (494bbf8c4cff5775f04a6a479335587c213bcf08) pacific (stable) 2022-07-05T11:58:35.976 INFO:tasks.ceph.mds.e.smithi110.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7ff3db50fb20] 2022-07-05T11:58:35.976 INFO:tasks.ceph.mds.e.smithi110.stderr: 2: gsignal() 2022-07-05T11:58:35.977 INFO:tasks.ceph.mds.e.smithi110.stderr: 3: abort() 2022-07-05T11:58:35.977 INFO:tasks.ceph.mds.e.smithi110.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7ff3dc51ffc9] 2022-07-05T11:58:35.977 INFO:tasks.ceph.mds.e.smithi110.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x278192) [0x7ff3dc520192] 2022-07-05T11:58:35.977 INFO:tasks.ceph.mds.e.smithi110.stderr: 6: (MDLog::_submit_entry(LogEvent*, MDSLogContextBase*)+0x3f) [0x55597f29237f] 2022-07-05T11:58:35.977 INFO:tasks.ceph.mds.e.smithi110.stderr: 7: (Server::journal_close_session(Session*, int, Context*)+0x78c) [0x55597efbfe4c] 2022-07-05T11:58:35.978 INFO:tasks.ceph.mds.e.smithi110.stderr: 8: (Server::kill_session(Session*, Context*)+0x212) [0x55597efc05a2] 2022-07-05T11:58:35.978 INFO:tasks.ceph.mds.e.smithi110.stderr: 9: (Server::apply_blocklist()+0x10d) [0x55597efc085d] 2022-07-05T11:58:35.978 INFO:tasks.ceph.mds.e.smithi110.stderr: 10: (MDSRank::apply_blocklist(std::set, std::allocator > const&, unsigned int)+0x34) [0x55597ef7ce94] 2022-07-05T11:58:35.978 INFO:tasks.ceph.mds.e.smithi110.stderr: 11: (MDSRankDispatcher::handle_osd_map()+0xf6) [0x55597ef7d1d6] 2022-07-05T11:58:35.979 INFO:tasks.ceph.mds.e.smithi110.stderr: 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0x33b) [0x55597ef6720b] 2022-07-05T11:58:35.979 INFO:tasks.ceph.mds.e.smithi110.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55597ef67af3] 2022-07-05T11:58:35.979 INFO:tasks.ceph.mds.e.smithi110.stderr: 14: (DispatchQueue::entry()+0x126a) [0x7ff3dc76642a] 2022-07-05T11:58:35.979 INFO:tasks.ceph.mds.e.smithi110.stderr: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff3dc819091] 2022-07-05T11:58:35.979 INFO:tasks.ceph.mds.e.smithi110.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7ff3db50514a] 2022-07-05T11:58:35.980 INFO:tasks.ceph.mds.e.smithi110.stderr: 17: clone() 2022-07-05T11:58:35.980 INFO:tasks.ceph.mds.e.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-07-05T11:58:35.980 INFO:tasks.ceph.mds.e.smithi110.stderr: 2022-07-05T11:58:37.164 INFO:tasks.ceph.mds.i.smithi149.stderr:daemon-helper: command crashed with signal 6 2022-07-05T11:58:37.561 INFO:tasks.ceph.mds.b.smithi110.stderr:daemon-helper: command crashed with signal 6 2022-07-05T11:58:37.784 INFO:tasks.ceph.mds.e.smithi110.stderr:daemon-helper: command crashed with signal 6 2022-07-05T11:58:38.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~0s 2022-07-05T11:58:38.109 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:58:38.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.232+0000 7f8e1b175700 1 Processor -- start 2022-07-05T11:58:38.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.232+0000 7f8e1b175700 1 -- start start 2022-07-05T11:58:38.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e1b175700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8e1417a560 0x7f8e140c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e1b175700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1417a9e0 con 0x7f8e140c77b0 2022-07-05T11:58:38.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e1b175700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e140c8d20 con 0x7f8e1417a180 2022-07-05T11:58:38.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e1b175700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e140c9000 con 0x7f8e1417a560 2022-07-05T11:58:38.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e13fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8e1417a560 0x7f8e140c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e13fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8e1417a560 0x7f8e140c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59608/0 (socket says 172.21.15.90:59608) 2022-07-05T11:58:38.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e13fff700 1 -- 172.21.15.90:0/2808833681 learned_addr learned my addr 172.21.15.90:0/2808833681 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:38.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e13fff700 1 -- 172.21.15.90:0/2808833681 >> v1:172.21.15.149:6789/0 conn(0x7f8e1417a180 legacy=0x7f8e140c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e13fff700 1 -- 172.21.15.90:0/2808833681 >> v1:172.21.15.110:6789/0 conn(0x7f8e140c77b0 legacy=0x7f8e140c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.233+0000 7f8e13fff700 1 -- 172.21.15.90:0/2808833681 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140c92e0 con 0x7f8e1417a560 2022-07-05T11:58:38.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e13fff700 1 --2- 172.21.15.90:0/2808833681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a560 0x7f8e140c3f20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f8e00006fd0 tx=0x7f8e000090f0).ready entity=mon.0 client_cookie=648890ab71834371 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:38.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e137fe700 1 -- 172.21.15.90:0/2808833681 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00010620 con 0x7f8e1417a560 2022-07-05T11:58:38.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e137fe700 1 -- 172.21.15.90:0/2808833681 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00010780 con 0x7f8e1417a560 2022-07-05T11:58:38.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e137fe700 1 -- 172.21.15.90:0/2808833681 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00010b00 con 0x7f8e1417a560 2022-07-05T11:58:38.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e1b175700 1 -- 172.21.15.90:0/2808833681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a560 msgr2=0x7f8e140c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2808833681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a560 0x7f8e140c3f20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f8e00006fd0 tx=0x7f8e000090f0).stop 2022-07-05T11:58:38.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e1b175700 1 -- 172.21.15.90:0/2808833681 shutdown_connections 2022-07-05T11:58:38.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2808833681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a560 0x7f8e140c3f20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e1b175700 1 -- 172.21.15.90:0/2808833681 >> 172.21.15.90:0/2808833681 conn(0x7f8e14083570 msgr2=0x7f8e14083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:38.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e1b175700 1 -- 172.21.15.90:0/2808833681 shutdown_connections 2022-07-05T11:58:38.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.234+0000 7f8e1b175700 1 -- 172.21.15.90:0/2808833681 wait complete. 2022-07-05T11:58:38.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.236+0000 7f8e1b175700 1 Processor -- start 2022-07-05T11:58:38.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.236+0000 7f8e1b175700 1 -- start start 2022-07-05T11:58:38.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e1b175700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e140c77b0 0x7f8e14166ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e1b175700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a180 0x7f8e1418f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e1b175700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1417a560 0x7f8e1416a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e1b175700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1416d330 con 0x7f8e1417a180 2022-07-05T11:58:38.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e1b175700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e14190450 con 0x7f8e140c77b0 2022-07-05T11:58:38.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e1b175700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1418fc90 con 0x7f8e1417a560 2022-07-05T11:58:38.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a180 0x7f8e1418f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a180 0x7f8e1418f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59612/0 (socket says 172.21.15.90:59612) 2022-07-05T11:58:38.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 -- 172.21.15.90:0/2682103598 learned_addr learned my addr 172.21.15.90:0/2682103598 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:38.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e19712700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1417a560 0x7f8e1416a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e18f11700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e140c77b0 0x7f8e14166ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 -- 172.21.15.90:0/2682103598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1417a560 msgr2=0x7f8e1416a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1417a560 0x7f8e1416a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 -- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e140c77b0 msgr2=0x7f8e14166ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e140c77b0 0x7f8e14166ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 -- 172.21.15.90:0/2682103598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00009370 con 0x7f8e1417a180 2022-07-05T11:58:38.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.237+0000 7f8e13fff700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a180 0x7f8e1418f7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f8e14084f10 tx=0x7f8e00018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:38.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.238+0000 7f8e10ff9700 1 -- 172.21.15.90:0/2682103598 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00010b00 con 0x7f8e1417a180 2022-07-05T11:58:38.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.238+0000 7f8e10ff9700 1 -- 172.21.15.90:0/2682103598 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00000c90 con 0x7f8e1417a180 2022-07-05T11:58:38.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.238+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1416c7b0 con 0x7f8e1417a180 2022-07-05T11:58:38.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.238+0000 7f8e10ff9700 1 -- 172.21.15.90:0/2682103598 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00023690 con 0x7f8e1417a180 2022-07-05T11:58:38.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.238+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1416cd70 con 0x7f8e1417a180 2022-07-05T11:58:38.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.240+0000 7f8e10ff9700 1 -- 172.21.15.90:0/2682103598 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f8e0000e040 con 0x7f8e1417a180 2022-07-05T11:58:38.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.240+0000 7f8e10ff9700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8dfc08ba40 0x7f8dfc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.240+0000 7f8e10ff9700 1 -- 172.21.15.90:0/2682103598 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f8e000b1e40 con 0x7f8e1417a180 2022-07-05T11:58:38.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.240+0000 7f8e18f11700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8dfc08ba40 0x7f8dfc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.241+0000 7f8e18f11700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8dfc08ba40 0x7f8dfc08df00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8e08003960 tx=0x7f8e08000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:38.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.241+0000 7f8e2cb01b80 1 Processor -- start 2022-07-05T11:58:38.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.242+0000 7f8e2cb01b80 1 -- start start 2022-07-05T11:58:38.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.242+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.242+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6fe990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.242+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.242+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa67a2d0 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.242+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa5f1aa0 con 0x55ceaa6f47a0 2022-07-05T11:58:38.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.242+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa606950 con 0x55ceaa6f43c0 2022-07-05T11:58:38.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6fe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6fe990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59622/0 (socket says 172.21.15.90:59622) 2022-07-05T11:58:38.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 -- 172.21.15.90:0/914226914 learned_addr learned my addr 172.21.15.90:0/914226914 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:38.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e18f11700 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e19712700 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 -- 172.21.15.90:0/914226914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 msgr2=0x55ceaa6b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 -- 172.21.15.90:0/914226914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 msgr2=0x55ceaa6f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 -- 172.21.15.90:0/914226914 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceaa4389e0 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8e13fff700 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6fe990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f8e00086140 tx=0x7f8e00082b50).ready entity=mon.0 client_cookie=39b8cc2a3fe7d13 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:38.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8df5ffb700 1 -- 172.21.15.90:0/914226914 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0008c040 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8df5ffb700 1 -- 172.21.15.90:0/914226914 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00084b00 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.243+0000 7f8df5ffb700 1 -- 172.21.15.90:0/914226914 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00082e70 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/914226914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 msgr2=0x55ceaa6fe990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6fe990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f8e00086140 tx=0x7f8e00082b50).stop 2022-07-05T11:58:38.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/914226914 shutdown_connections 2022-07-05T11:58:38.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/914226914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6fe990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/914226914 >> 172.21.15.90:0/914226914 conn(0x55ceaa51f1c0 msgr2=0x55ceaa6b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/914226914 shutdown_connections 2022-07-05T11:58:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.244+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/914226914 wait complete. 2022-07-05T11:58:38.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.245+0000 7f8e2cb01b80 1 -- start start 2022-07-05T11:58:38.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.245+0000 7f8e2cb01b80 1 Processor -- start 2022-07-05T11:58:38.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6e93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa5ce120 con 0x55ceaa6f47a0 2022-07-05T11:58:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa6efd90 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa6eec30 con 0x55ceaa6f43c0 2022-07-05T11:58:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e2cb01b80 10 client.0 ll_register_callbacks cb 0x55ceaa6741b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:58:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59628/0 (socket says 172.21.15.90:59628) 2022-07-05T11:58:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e13fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6e93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 -- 172.21.15.90:0/1386254311 learned_addr learned my addr 172.21.15.90:0/1386254311 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:38.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 -- 172.21.15.90:0/1386254311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 msgr2=0x55ceaa6e93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6e93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 -- 172.21.15.90:0/1386254311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6b0cb0 msgr2=0x55ceaa6ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e19712700 1 -- 172.21.15.90:0/1386254311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1416cd70 con 0x55ceaa6f47a0 2022-07-05T11:58:38.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.246+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:58:38.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e19712700 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f22d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8e0c011620 tx=0x7f8e0c001460).ready entity=mon.0 client_cookie=66b5f6c0cddf86be server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:38.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8deeffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:58:38.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8deeffd700 1 -- 172.21.15.90:0/1386254311 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0027e0 con 0x55ceaa6f47a0 2022-07-05T11:58:38.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8deeffd700 1 -- 172.21.15.90:0/1386254311 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f8e0c006c30 con 0x55ceaa6f47a0 2022-07-05T11:58:38.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ceaa6ae440 con 0x55ceaa6f47a0 2022-07-05T11:58:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8deeffd700 1 -- 172.21.15.90:0/1386254311 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e0c006e40 con 0x55ceaa6f47a0 2022-07-05T11:58:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 10 client.5778 fetch_fsmap learned FSMap version 30 2022-07-05T11:58:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55ceaa4a7cd0 con 0x55ceaa6f47a0 2022-07-05T11:58:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8deeffd700 1 -- 172.21.15.90:0/1386254311 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ceaa6ae440 con 0x55ceaa6f47a0 2022-07-05T11:58:38.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8deeffd700 1 -- 172.21.15.90:0/1386254311 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f8e0c007240 con 0x55ceaa6f47a0 2022-07-05T11:58:38.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 10 client.5778 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:58:38.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 10 client.5778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:58:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 20 client.5778 populate_metadata read hostname 'smithi090' 2022-07-05T11:58:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6ef5b0 0x55ceaa735ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 4 client.5778 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:58:38.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ceaa5fc7f0 con 0x55ceaa6ef5b0 2022-07-05T11:58:38.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.247+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6ef5b0 0x55ceaa735ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.248+0000 7f8deeffd700 10 client.5778 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:38.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.248+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6ef5b0 0x55ceaa735ea0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8abb4afb7184b90c server_cookie=ec838ed83023972d in_seq=0 out_seq=0 2022-07-05T11:58:38.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8deeffd700 1 -- 172.21.15.90:0/1386254311 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55ceaa5fc7f0 con 0x55ceaa6ef5b0 2022-07-05T11:58:38.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8deeffd700 10 client.5778 handle_command_reply: tid=0 2022-07-05T11:58:38.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 client.5778 shutdown 2022-07-05T11:58:38.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f47a0 msgr2=0x55ceaa6f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f22d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8e0c011620 tx=0x7f8e0c001460).stop 2022-07-05T11:58:38.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 shutdown_connections 2022-07-05T11:58:38.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6ef5b0 0x55ceaa735ea0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6f22d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8deeffd700 0 client.5778 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1386254311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6e93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 >> 172.21.15.90:0/1386254311 conn(0x55ceaa51f1c0 msgr2=0x55ceaa721150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:38.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 shutdown_connections 2022-07-05T11:58:38.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.249+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1386254311 wait complete. 2022-07-05T11:58:38.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.250+0000 7f8e2cb01b80 20 client.5778 trim_cache size 0 max 16384 2022-07-05T11:58:38.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.266+0000 7f8e2cb01b80 1 Processor -- start 2022-07-05T11:58:38.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.266+0000 7f8e2cb01b80 1 -- start start 2022-07-05T11:58:38.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa720ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa7838c0 con 0x55ceaa6f43c0 2022-07-05T11:58:38.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa6b42e0 con 0x55ceaa6f47a0 2022-07-05T11:58:38.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa6b22d0 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e13fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e13fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59632/0 (socket says 172.21.15.90:59632) 2022-07-05T11:58:38.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e13fff700 1 -- 172.21.15.90:0/1184988935 learned_addr learned my addr 172.21.15.90:0/1184988935 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:38.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa720ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e19712700 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e13fff700 1 -- 172.21.15.90:0/1184988935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6b0cb0 msgr2=0x55ceaa720ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e13fff700 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa720ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e13fff700 1 -- 172.21.15.90:0/1184988935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 msgr2=0x55ceaa6bb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.267+0000 7f8e13fff700 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6bb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e13fff700 1 -- 172.21.15.90:0/1184988935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceaa475fd0 con 0x55ceaa6f43c0 2022-07-05T11:58:38.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e13fff700 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b3df0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f8e00084ab0 tx=0x7f8e00092000).ready entity=mon.0 client_cookie=6d138ab087a020a6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:38.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8df67fc700 1 -- 172.21.15.90:0/1184988935 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e000108f0 con 0x55ceaa6f43c0 2022-07-05T11:58:38.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8df67fc700 1 -- 172.21.15.90:0/1184988935 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00085e60 con 0x55ceaa6f43c0 2022-07-05T11:58:38.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8df67fc700 1 -- 172.21.15.90:0/1184988935 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00082e70 con 0x55ceaa6f43c0 2022-07-05T11:58:38.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1184988935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f43c0 msgr2=0x55ceaa6b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b3df0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f8e00084ab0 tx=0x7f8e00092000).stop 2022-07-05T11:58:38.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1184988935 shutdown_connections 2022-07-05T11:58:38.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa720ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1184988935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b3df0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1184988935 >> 172.21.15.90:0/1184988935 conn(0x55ceaa51f1c0 msgr2=0x55ceaa6fb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:38.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1184988935 shutdown_connections 2022-07-05T11:58:38.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.268+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1184988935 wait complete. 2022-07-05T11:58:38.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.269+0000 7f8e2cb01b80 1 -- start start 2022-07-05T11:58:38.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.269+0000 7f8e2cb01b80 1 Processor -- start 2022-07-05T11:58:38.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6f3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e2cb01b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6fdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa77f0a0 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa6f0300 con 0x55ceaa6f43c0 2022-07-05T11:58:38.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e2cb01b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceaa6fd8a0 con 0x55ceaa6f47a0 2022-07-05T11:58:38.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e2cb01b80 10 client.0 ll_register_callbacks cb 0x55ceaa6741b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:58:38.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e18f11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e18f11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59638/0 (socket says 172.21.15.90:59638) 2022-07-05T11:58:38.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e18f11700 1 -- 172.21.15.90:0/1635111929 learned_addr learned my addr 172.21.15.90:0/1635111929 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:58:38.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e19712700 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6fdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.270+0000 7f8e13fff700 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e18f11700 1 -- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f47a0 msgr2=0x55ceaa6fdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6fdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e18f11700 1 -- 172.21.15.90:0/1635111929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f43c0 msgr2=0x55ceaa6b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:58:38.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e18f11700 1 -- 172.21.15.90:0/1635111929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ceaa4389e0 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e18f11700 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6f3540 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x55ceaa6f3090 tx=0x7f8e0800c000).ready entity=mon.0 client_cookie=d9c07447ed25e4a9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:58:38.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8deeffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:58:38.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8deeffd700 1 -- 172.21.15.90:0/1635111929 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08029030 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e00084b00 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8deeffd700 1 -- 172.21.15.90:0/1635111929 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f8e0802a070 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8deeffd700 1 -- 172.21.15.90:0/1635111929 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e0801c040 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 10 client.5784 fetch_fsmap learned FSMap version 30 2022-07-05T11:58:38.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55ceaa783220 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8deeffd700 1 -- 172.21.15.90:0/1635111929 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00084b00 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8deeffd700 1 -- 172.21.15.90:0/1635111929 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f8e08025a40 con 0x55ceaa6b0cb0 2022-07-05T11:58:38.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 10 client.5784 fetch_fsmap finished waiting for FSMap version 30 2022-07-05T11:58:38.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 10 client.5784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:58:38.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 20 client.5784 populate_metadata read hostname 'smithi090' 2022-07-05T11:58:38.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6f1700 0x55ceaa735ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:58:38.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 4 client.5784 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:58:38.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ceaa5f3690 con 0x55ceaa6f1700 2022-07-05T11:58:38.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.271+0000 7f8e13fff700 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6f1700 0x55ceaa735ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:58:38.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.272+0000 7f8deeffd700 10 client.5784 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:38.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.272+0000 7f8e13fff700 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6f1700 0x55ceaa735ea0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c774e782fa4651f3 server_cookie=828d7a5ca28505b2 in_seq=0 out_seq=0 2022-07-05T11:58:38.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8deeffd700 1 -- 172.21.15.90:0/1635111929 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ceaa5f3690 con 0x55ceaa6f1700 2022-07-05T11:58:38.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8deeffd700 10 client.5784 handle_command_reply: tid=0 2022-07-05T11:58:38.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 client.5784 shutdown 2022-07-05T11:58:38.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 msgr2=0x55ceaa6f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6f3540 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x55ceaa6f3090 tx=0x7f8e0800c000).stop 2022-07-05T11:58:38.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 shutdown_connections 2022-07-05T11:58:38.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ceaa6f1700 0x55ceaa735ea0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ceaa6f47a0 0x55ceaa6fdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ceaa6b0cb0 0x55ceaa6f3540 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 --2- 172.21.15.90:0/1635111929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ceaa6f43c0 0x55ceaa6b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8deeffd700 0 client.5784 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:58:38.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 >> 172.21.15.90:0/1635111929 conn(0x55ceaa51f1c0 msgr2=0x55ceaa6fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:38.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 shutdown_connections 2022-07-05T11:58:38.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 1 -- 172.21.15.90:0/1635111929 wait complete. 2022-07-05T11:58:38.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.273+0000 7f8e2cb01b80 20 client.5784 trim_cache size 0 max 16384 2022-07-05T11:58:38.336 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:58:38.336 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:58:38.337 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:58:38.337 INFO:teuthology.orchestra.run.smithi090.stdout: "57d57167-6f8e-45c4-82a1-d19640411606": { 2022-07-05T11:58:38.338 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:58:38.338 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "57d57167-6f8e-45c4-82a1-d19640411606", 2022-07-05T11:58:38.339 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:58:38.339 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:58:38.339 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:58:38.340 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:58:38.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8dfc08ba40 msgr2=0x7f8dfc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8dfc08ba40 0x7f8dfc08df00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8e08003960 tx=0x7f8e08000bc0).stop 2022-07-05T11:58:38.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a180 msgr2=0x7f8e1418f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:58:38.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a180 0x7f8e1418f7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f8e14084f10 tx=0x7f8e00018000).stop 2022-07-05T11:58:38.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 shutdown_connections 2022-07-05T11:58:38.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8dfc08ba40 0x7f8dfc08df00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1417a560 0x7f8e1416a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e140c77b0 0x7f8e14166ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 --2- 172.21.15.90:0/2682103598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e1417a180 0x7f8e1418f7a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:58:38.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 >> 172.21.15.90:0/2682103598 conn(0x7f8e14083570 msgr2=0x7f8e1405d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:58:38.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 shutdown_connections 2022-07-05T11:58:38.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:58:38.274+0000 7f8e1b175700 1 -- 172.21.15.90:0/2682103598 wait complete. 2022-07-05T11:58:38.345 INFO:tasks.cephfs.filesystem:scrub status for tag:57d57167-6f8e-45c4-82a1-d19640411606 - {'path': '/', 'tag': '57d57167-6f8e-45c4-82a1-d19640411606', 'options': 'recursive,force'} 2022-07-05T11:58:45.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2022-07-05T11:58:45.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2022-07-05T11:58:45.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~8s 2022-07-05T11:58:49.894 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:58:49.898 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:58:49.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:58:53.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~8s 2022-07-05T11:58:53.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~8s 2022-07-05T11:58:53.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~16s 2022-07-05T11:59:01.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~15s 2022-07-05T11:59:01.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~15s 2022-07-05T11:59:01.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~23s 2022-07-05T11:59:08.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:59:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.475+0000 7feaab59e700 1 Processor -- start 2022-07-05T11:59:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.475+0000 7feaab59e700 1 -- start start 2022-07-05T11:59:08.480 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaab59e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feaac063910 0x7feaac0ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaab59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac061f10 con 0x7feaac17dcd0 2022-07-05T11:59:08.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaab59e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac062d70 con 0x7feaac0ef830 2022-07-05T11:59:08.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaab59e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac062160 con 0x7feaac063910 2022-07-05T11:59:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaaa59c700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7feaac17dcd0 0x7feaac063200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52610/0 (socket says 172.21.15.90:52610) 2022-07-05T11:59:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaaa59c700 1 -- 172.21.15.90:0/3265808133 learned_addr learned my addr 172.21.15.90:0/3265808133 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:59:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455072112 0 0) 0x7feaac061f10 con 0x7feaac17dcd0 2022-07-05T11:59:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3265808133 >> v2:172.21.15.149:3300/0 conn(0x7feaac063910 0x7feaac0ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.476+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea900033f0 con 0x7feaac17dcd0 2022-07-05T11:59:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2988481984 0 0) 0x7fea900033f0 con 0x7feaac17dcd0 2022-07-05T11:59:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 >> v2:172.21.15.149:3300/0 conn(0x7feaac063910 msgr2=0x7feaac0ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 --2- 172.21.15.90:0/3265808133 >> v2:172.21.15.149:3300/0 conn(0x7feaac063910 0x7feaac0ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 >> v1:172.21.15.149:6789/0 conn(0x7feaac0ef830 legacy=0x7feaac0efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac062440 con 0x7feaac17dcd0 2022-07-05T11:59:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 490690693 0 0) 0x7feaa4001470 con 0x7feaac17dcd0 2022-07-05T11:59:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 >> v1:172.21.15.90:6789/0 conn(0x7feaac17dcd0 legacy=0x7feaac063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90003930 0x7fea90003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea90004690 0x7fea90004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea90005120 0x7fea9000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac062160 con 0x7fea90004690 2022-07-05T11:59:08.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9000c030 con 0x7fea90005120 2022-07-05T11:59:08.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9000c1f0 con 0x7fea90003930 2022-07-05T11:59:08.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea90004690 0x7fea90004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaaa59c700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90003930 0x7fea90003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3265808133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90003930 msgr2=0x7fea90003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90003930 0x7fea90003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3265808133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea90005120 msgr2=0x7fea9000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.487 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea90005120 0x7fea9000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:08.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaaad9d700 1 -- 172.21.15.90:0/3265808133 reap_dead start 2022-07-05T11:59:08.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3265808133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900033f0 con 0x7fea90004690 2022-07-05T11:59:08.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea90004690 0x7fea90004b10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7feaa000e1c0 tx=0x7feaa000b040).ready entity=mon.0 client_cookie=8eec4750b8cd2cea server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:08.488 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.477+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0009ac0 con 0x7fea90004690 2022-07-05T11:59:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000f040 con 0x7fea90004690 2022-07-05T11:59:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaa959a700 1 -- 172.21.15.90:0/3265808133 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000eca0 con 0x7fea90004690 2022-07-05T11:59:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaab59e700 1 -- 172.21.15.90:0/3265808133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea90004690 msgr2=0x7fea90004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaab59e700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea90004690 0x7fea90004b10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7feaa000e1c0 tx=0x7feaa000b040).stop 2022-07-05T11:59:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaab59e700 1 -- 172.21.15.90:0/3265808133 shutdown_connections 2022-07-05T11:59:08.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaab59e700 1 --2- 172.21.15.90:0/3265808133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea90004690 0x7fea90004b10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaab59e700 1 -- 172.21.15.90:0/3265808133 >> 172.21.15.90:0/3265808133 conn(0x7feaac0f5470 msgr2=0x7feaac0f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:08.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaab59e700 1 -- 172.21.15.90:0/3265808133 shutdown_connections 2022-07-05T11:59:08.490 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.478+0000 7feaab59e700 1 -- 172.21.15.90:0/3265808133 wait complete. 2022-07-05T11:59:08.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.479+0000 7feaab59e700 1 Processor -- start 2022-07-05T11:59:08.491 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.479+0000 7feaab59e700 1 -- start start 2022-07-05T11:59:08.501 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.480+0000 7feaab59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90004690 0x7feaac159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.480+0000 7feaab59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaac191fa0 0x7feaac192420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.480+0000 7feaab59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaac192910 0x7feaac0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.480+0000 7feaab59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0c8460 con 0x7feaac192910 2022-07-05T11:59:08.502 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.480+0000 7feaab59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0c7b50 con 0x7feaac191fa0 2022-07-05T11:59:08.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.480+0000 7feaab59e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0cb470 con 0x7fea90004690 2022-07-05T11:59:08.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaac192910 0x7feaac0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaac192910 0x7feaac0c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59686/0 (socket says 172.21.15.90:59686) 2022-07-05T11:59:08.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 -- 172.21.15.90:0/1063779777 learned_addr learned my addr 172.21.15.90:0/1063779777 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:08.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaa59c700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90004690 0x7feaac159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaac191fa0 0x7feaac192420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 -- 172.21.15.90:0/1063779777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90004690 msgr2=0x7feaac159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90004690 0x7feaac159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 -- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaac191fa0 msgr2=0x7feaac192420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaac191fa0 0x7feaac192420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 -- 172.21.15.90:0/1063779777 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0cb750 con 0x7feaac192910 2022-07-05T11:59:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaa59c700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90004690 0x7feaac159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:59:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaac191fa0 0x7feaac192420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:59:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaaad9d700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaac192910 0x7feaac0c88f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7feaac0f0780 tx=0x7fea9c007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:08.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7fea9a7fc700 1 -- 172.21.15.90:0/1063779777 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00cd20 con 0x7feaac192910 2022-07-05T11:59:08.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7fea9a7fc700 1 -- 172.21.15.90:0/1063779777 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00ce80 con 0x7feaac192910 2022-07-05T11:59:08.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0c7e10 con 0x7feaac192910 2022-07-05T11:59:08.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7fea9a7fc700 1 -- 172.21.15.90:0/1063779777 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0072e0 con 0x7feaac192910 2022-07-05T11:59:08.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.481+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac159f70 con 0x7feaac192910 2022-07-05T11:59:08.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.483+0000 7fea9a7fc700 1 -- 172.21.15.90:0/1063779777 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fea9c01a060 con 0x7feaac192910 2022-07-05T11:59:08.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.484+0000 7fea9a7fc700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fea8808ba70 0x7fea8808df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.484+0000 7fea9a7fc700 1 -- 172.21.15.90:0/1063779777 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fea9c0afc50 con 0x7feaac192910 2022-07-05T11:59:08.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.484+0000 7feaaa59c700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fea8808ba70 0x7fea8808df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.484+0000 7feaaa59c700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fea8808ba70 0x7fea8808df30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7feaa4001ce0 tx=0x7feaa4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:08.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.485+0000 7feac2533b80 1 Processor -- start 2022-07-05T11:59:08.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.485+0000 7feac2533b80 1 -- start start 2022-07-05T11:59:08.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.486+0000 7feac2533b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb028b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.486+0000 7feac2533b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb50a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.486+0000 7feac2533b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 0x56164cb46d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.486+0000 7feac2533b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cacc2d0 con 0x56164cb02da0 2022-07-05T11:59:08.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.486+0000 7feac2533b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164ca43aa0 con 0x56164cb46890 2022-07-05T11:59:08.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.486+0000 7feac2533b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164ca58950 con 0x56164cb464b0 2022-07-05T11:59:08.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb50a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb50a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59692/0 (socket says 172.21.15.90:59692) 2022-07-05T11:59:08.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3228235479 learned_addr learned my addr 172.21.15.90:0/3228235479 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:08.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaaa59c700 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaaad9d700 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 0x56164cb46d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3228235479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 msgr2=0x56164cb028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3228235479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 msgr2=0x56164cb46d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 0x56164cb46d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3228235479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56164c88a9e0 con 0x56164cb02da0 2022-07-05T11:59:08.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb50a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7feaa0009b40 tx=0x7feaa001a000).ready entity=mon.0 client_cookie=41b37249d15e3ea server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7fea877fe700 1 -- 172.21.15.90:0/3228235479 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000eb70 con 0x56164cb02da0 2022-07-05T11:59:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7fea877fe700 1 -- 172.21.15.90:0/3228235479 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa001e410 con 0x56164cb02da0 2022-07-05T11:59:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.487+0000 7fea877fe700 1 -- 172.21.15.90:0/3228235479 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa001e790 con 0x56164cb02da0 2022-07-05T11:59:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 -- 172.21.15.90:0/3228235479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 msgr2=0x56164cb50a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb50a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7feaa0009b40 tx=0x7feaa001a000).stop 2022-07-05T11:59:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 -- 172.21.15.90:0/3228235479 shutdown_connections 2022-07-05T11:59:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 0x56164cb46d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 --2- 172.21.15.90:0/3228235479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb50a80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 -- 172.21.15.90:0/3228235479 >> 172.21.15.90:0/3228235479 conn(0x56164c9711c0 msgr2=0x56164cb05ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:08.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 -- 172.21.15.90:0/3228235479 shutdown_connections 2022-07-05T11:59:08.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.488+0000 7feac2533b80 1 -- 172.21.15.90:0/3228235479 wait complete. 2022-07-05T11:59:08.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.489+0000 7feac2533b80 1 -- start start 2022-07-05T11:59:08.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.489+0000 7feac2533b80 1 Processor -- start 2022-07-05T11:59:08.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feac2533b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb3a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feac2533b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb39290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feac2533b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb46890 0x56164cb78d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feac2533b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164ca20120 con 0x56164cb46890 2022-07-05T11:59:08.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feac2533b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb3b1a0 con 0x56164cb02da0 2022-07-05T11:59:08.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feac2533b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb39d40 con 0x56164cb464b0 2022-07-05T11:59:08.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feac2533b80 10 client.0 ll_register_callbacks cb 0x56164cac6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:08.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb46890 0x56164cb78d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb46890 0x56164cb78d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59700/0 (socket says 172.21.15.90:59700) 2022-07-05T11:59:08.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 -- 172.21.15.90:0/400269144 learned_addr learned my addr 172.21.15.90:0/400269144 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:08.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaa59c700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb3a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb39290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 -- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 msgr2=0x56164cb39290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb39290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 -- 172.21.15.90:0/400269144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 msgr2=0x56164cb3a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb3a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 -- 172.21.15.90:0/400269144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea900033f0 con 0x56164cb46890 2022-07-05T11:59:08.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaa59c700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb3a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:59:08.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7feaaad9d700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb46890 0x56164cb78d90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fea9c084670 tx=0x7fea9c0808b0).ready entity=mon.0 client_cookie=5453b9af3839d854 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:08.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.490+0000 7fea84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:08.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7fea84ff9700 1 -- 172.21.15.90:0/400269144 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c083a60 con 0x56164cb46890 2022-07-05T11:59:08.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7fea84ff9700 1 -- 172.21.15.90:0/400269144 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fea9c083bc0 con 0x56164cb46890 2022-07-05T11:59:08.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56164cb00690 con 0x56164cb46890 2022-07-05T11:59:08.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7fea84ff9700 1 -- 172.21.15.90:0/400269144 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea9c089bd0 con 0x56164cb46890 2022-07-05T11:59:08.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 10 client.5796 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:08.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x56164c8f9cd0 con 0x56164cb46890 2022-07-05T11:59:08.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7fea84ff9700 1 -- 172.21.15.90:0/400269144 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56164cb00690 con 0x56164cb46890 2022-07-05T11:59:08.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7fea84ff9700 1 -- 172.21.15.90:0/400269144 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7fea9c088120 con 0x56164cb46890 2022-07-05T11:59:08.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 10 client.5796 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:08.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 10 client.5796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:08.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 20 client.5796 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:08.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb79950 0x56164cb79280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 4 client.5796 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:59:08.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56164ca4e7f0 con 0x56164cb79950 2022-07-05T11:59:08.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.491+0000 7feaaa59c700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb79950 0x56164cb79280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7fea84ff9700 10 client.5796 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:08.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feaaa59c700 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb79950 0x56164cb79280 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=76ceb2921d221650 server_cookie=556aadb647bbf878 in_seq=0 out_seq=0 2022-07-05T11:59:08.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7fea84ff9700 1 -- 172.21.15.90:0/400269144 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x56164ca4e7f0 con 0x56164cb79950 2022-07-05T11:59:08.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7fea84ff9700 10 client.5796 handle_command_reply: tid=0 2022-07-05T11:59:08.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 client.5796 shutdown 2022-07-05T11:59:08.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb46890 msgr2=0x56164cb78d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb46890 0x56164cb78d90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fea9c084670 tx=0x7fea9c0808b0).stop 2022-07-05T11:59:08.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 shutdown_connections 2022-07-05T11:59:08.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb79950 0x56164cb79280 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb46890 0x56164cb78d90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb3a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7fea84ff9700 0 client.5796 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:08.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.492+0000 7feac2533b80 1 --2- 172.21.15.90:0/400269144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cb39290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.493+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 >> 172.21.15.90:0/400269144 conn(0x56164c9711c0 msgr2=0x56164cb037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:08.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.493+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 shutdown_connections 2022-07-05T11:59:08.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.493+0000 7feac2533b80 1 -- 172.21.15.90:0/400269144 wait complete. 2022-07-05T11:59:08.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.493+0000 7feac2533b80 20 client.5796 trim_cache size 0 max 16384 2022-07-05T11:59:08.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.508+0000 7feac2533b80 1 Processor -- start 2022-07-05T11:59:08.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.508+0000 7feac2533b80 1 -- start start 2022-07-05T11:59:08.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feac2533b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb84060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feac2533b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cbd0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feac2533b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 0x56164cb0d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feac2533b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb79600 con 0x56164cb02da0 2022-07-05T11:59:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feac2533b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb50ff0 con 0x56164cb46890 2022-07-05T11:59:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feac2533b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb44eb0 con 0x56164cb464b0 2022-07-05T11:59:08.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feaaa59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb84060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feaaa59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb84060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59706/0 (socket says 172.21.15.90:59706) 2022-07-05T11:59:08.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.509+0000 7feaaa59c700 1 -- 172.21.15.90:0/2159594398 learned_addr learned my addr 172.21.15.90:0/2159594398 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:08.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feaaa59c700 1 -- 172.21.15.90:0/2159594398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 msgr2=0x56164cbd0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feaaa59c700 1 --2- 172.21.15.90:0/2159594398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cbd0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feaaa59c700 1 -- 172.21.15.90:0/2159594398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 msgr2=0x56164cb0d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feaaa59c700 1 --2- 172.21.15.90:0/2159594398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 0x56164cb0d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feaaa59c700 1 -- 172.21.15.90:0/2159594398 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56164c8c7fd0 con 0x56164cb02da0 2022-07-05T11:59:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feaaa59c700 1 --2- 172.21.15.90:0/2159594398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb84060 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7feaa4007c30 tx=0x7feaa4019040).ready entity=mon.0 client_cookie=97da5ee023aeb5b4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7fea87fff700 1 -- 172.21.15.90:0/2159594398 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa402b030 con 0x56164cb02da0 2022-07-05T11:59:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7fea87fff700 1 -- 172.21.15.90:0/2159594398 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40158d0 con 0x56164cb02da0 2022-07-05T11:59:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7fea87fff700 1 -- 172.21.15.90:0/2159594398 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4015c50 con 0x56164cb02da0 2022-07-05T11:59:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 -- 172.21.15.90:0/2159594398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 msgr2=0x56164cb84060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 --2- 172.21.15.90:0/2159594398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb84060 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7feaa4007c30 tx=0x7feaa4019040).stop 2022-07-05T11:59:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 -- 172.21.15.90:0/2159594398 shutdown_connections 2022-07-05T11:59:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 --2- 172.21.15.90:0/2159594398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb46890 0x56164cb0d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 --2- 172.21.15.90:0/2159594398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb02da0 0x56164cb84060 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 --2- 172.21.15.90:0/2159594398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb464b0 0x56164cbd0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 -- 172.21.15.90:0/2159594398 >> 172.21.15.90:0/2159594398 conn(0x56164c9711c0 msgr2=0x56164cb05b00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 -- 172.21.15.90:0/2159594398 shutdown_connections 2022-07-05T11:59:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.510+0000 7feac2533b80 1 -- 172.21.15.90:0/2159594398 wait complete. 2022-07-05T11:59:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.511+0000 7feac2533b80 1 -- start start 2022-07-05T11:59:08.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.511+0000 7feac2533b80 1 Processor -- start 2022-07-05T11:59:08.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.512+0000 7feac2533b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb51130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.512+0000 7feac2533b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb464b0 0x56164cb4a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.512+0000 7feac2533b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb46890 0x56164cb49d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.512+0000 7feac2533b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb02b00 con 0x56164cb464b0 2022-07-05T11:59:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.512+0000 7feac2533b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb72470 con 0x56164cb02da0 2022-07-05T11:59:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.512+0000 7feac2533b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164cb4a200 con 0x56164cb46890 2022-07-05T11:59:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.512+0000 7feac2533b80 10 client.0 ll_register_callbacks cb 0x56164cac6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb464b0 0x56164cb4a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb464b0 0x56164cb4a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59712/0 (socket says 172.21.15.90:59712) 2022-07-05T11:59:08.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3531671843 learned_addr learned my addr 172.21.15.90:0/3531671843 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:08.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaaad9d700 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb46890 0x56164cb49d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaaa59c700 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb51130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb46890 msgr2=0x56164cb49d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb46890 0x56164cb49d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3531671843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 msgr2=0x56164cb51130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:08.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb51130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 -- 172.21.15.90:0/3531671843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa401f040 con 0x56164cb464b0 2022-07-05T11:59:08.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feaa9d9b700 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb464b0 0x56164cb4a570 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7feaa0000f80 tx=0x7feaa0021040).ready entity=mon.0 client_cookie=f9fcc33b9afbf5e8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:08.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7fea84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:08.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7fea84ff9700 1 -- 172.21.15.90:0/3531671843 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa001ebc0 con 0x56164cb464b0 2022-07-05T11:59:08.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7fea84ff9700 1 -- 172.21.15.90:0/3531671843 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7feaa001ed20 con 0x56164cb464b0 2022-07-05T11:59:08.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feaa001e410 con 0x56164cb464b0 2022-07-05T11:59:08.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7fea84ff9700 1 -- 172.21.15.90:0/3531671843 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa0029650 con 0x56164cb464b0 2022-07-05T11:59:08.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feac2533b80 10 client.5802 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:08.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x56164cafceb0 con 0x56164cb464b0 2022-07-05T11:59:08.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.513+0000 7fea84ff9700 1 -- 172.21.15.90:0/3531671843 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa001e410 con 0x56164cb464b0 2022-07-05T11:59:08.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7fea84ff9700 1 -- 172.21.15.90:0/3531671843 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7feaa00297b0 con 0x56164cb464b0 2022-07-05T11:59:08.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 10 client.5802 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:08.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 10 client.5802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:08.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 20 client.5802 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:08.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb46c70 0x56164cbd3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:08.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 4 client.5802 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:59:08.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56164ca45690 con 0x56164cb46c70 2022-07-05T11:59:08.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feaaa59c700 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb46c70 0x56164cbd3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:08.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7fea84ff9700 10 client.5802 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:08.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feaaa59c700 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb46c70 0x56164cbd3fd0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=77954daef7eac47e server_cookie=b3934b86483c6dc5 in_seq=0 out_seq=0 2022-07-05T11:59:08.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7fea84ff9700 1 -- 172.21.15.90:0/3531671843 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56164ca45690 con 0x56164cb46c70 2022-07-05T11:59:08.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7fea84ff9700 10 client.5802 handle_command_reply: tid=0 2022-07-05T11:59:08.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 client.5802 shutdown 2022-07-05T11:59:08.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb464b0 msgr2=0x56164cb4a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb464b0 0x56164cb4a570 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7feaa0000f80 tx=0x7feaa0021040).stop 2022-07-05T11:59:08.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 shutdown_connections 2022-07-05T11:59:08.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x56164cb46c70 0x56164cbd3fd0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56164cb46890 0x56164cb49d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56164cb02da0 0x56164cb51130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7fea84ff9700 0 client.5802 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:08.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 --2- 172.21.15.90:0/3531671843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56164cb464b0 0x56164cb4a570 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.514+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 >> 172.21.15.90:0/3531671843 conn(0x56164c9711c0 msgr2=0x56164cb0d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:08.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 shutdown_connections 2022-07-05T11:59:08.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feac2533b80 1 -- 172.21.15.90:0/3531671843 wait complete. 2022-07-05T11:59:08.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feac2533b80 20 client.5802 trim_cache size 0 max 16384 2022-07-05T11:59:08.556 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:59:08.556 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "no active scrubs running", 2022-07-05T11:59:08.557 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": {} 2022-07-05T11:59:08.557 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:59:08.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fea8808ba70 msgr2=0x7fea8808df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fea8808ba70 0x7fea8808df30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7feaa4001ce0 tx=0x7feaa4009040).stop 2022-07-05T11:59:08.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaac192910 msgr2=0x7feaac0c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:08.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaac192910 0x7feaac0c88f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7feaac0f0780 tx=0x7fea9c007a20).stop 2022-07-05T11:59:08.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 shutdown_connections 2022-07-05T11:59:08.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fea8808ba70 0x7fea8808df30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaac192910 0x7feaac0c88f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea90004690 0x7feaac159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 --2- 172.21.15.90:0/1063779777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feaac191fa0 0x7feaac192420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:08.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 >> 172.21.15.90:0/1063779777 conn(0x7feaac0f5470 msgr2=0x7feaac0c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:08.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 shutdown_connections 2022-07-05T11:59:08.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:08.515+0000 7feaab59e700 1 -- 172.21.15.90:0/1063779777 wait complete. 2022-07-05T11:59:08.562 INFO:tasks.cephfs.filesystem:all active scrubs completed 2022-07-05T11:59:09.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~23s 2022-07-05T11:59:09.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~23s 2022-07-05T11:59:09.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~31s 2022-07-05T11:59:09.563 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2022-07-05T11:59:09.564 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2022-07-05T11:59:09.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.692+0000 7ff0157c4700 1 Processor -- start 2022-07-05T11:59:09.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.692+0000 7ff0157c4700 1 -- start start 2022-07-05T11:59:09.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.693+0000 7ff0157c4700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff01017df30 0x7ff0100cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.693+0000 7ff0157c4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0100cc4b0 con 0x7ff0100cce30 2022-07-05T11:59:09.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.693+0000 7ff0157c4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0100cb5c0 con 0x7ff01017db50 2022-07-05T11:59:09.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.693+0000 7ff0157c4700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0100cb8a0 con 0x7ff01017df30 2022-07-05T11:59:09.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.693+0000 7ff00e7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff01017df30 0x7ff0100cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.693+0000 7ff00e7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff01017df30 0x7ff0100cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59722/0 (socket says 172.21.15.90:59722) 2022-07-05T11:59:09.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.693+0000 7ff00e7fc700 1 -- 172.21.15.90:0/375887412 learned_addr learned my addr 172.21.15.90:0/375887412 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.718 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff00e7fc700 1 -- 172.21.15.90:0/375887412 >> v1:172.21.15.149:6789/0 conn(0x7ff01017db50 legacy=0x7ff0100efc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff00e7fc700 1 -- 172.21.15.90:0/375887412 >> v1:172.21.15.110:6789/0 conn(0x7ff0100cce30 legacy=0x7ff010184cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.719 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff00e7fc700 1 -- 172.21.15.90:0/375887412 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100cbb80 con 0x7ff01017df30 2022-07-05T11:59:09.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/375887412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017df30 0x7ff0100cc940 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7feff8006fd0 tx=0x7feff80090f0).ready entity=mon.0 client_cookie=9ba45ba218690fab server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.720 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff00dffb700 1 -- 172.21.15.90:0/375887412 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800b580 con 0x7ff01017df30 2022-07-05T11:59:09.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff00dffb700 1 -- 172.21.15.90:0/375887412 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff800b6e0 con 0x7ff01017df30 2022-07-05T11:59:09.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff00dffb700 1 -- 172.21.15.90:0/375887412 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800ba60 con 0x7ff01017df30 2022-07-05T11:59:09.721 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff0157c4700 1 -- 172.21.15.90:0/375887412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017df30 msgr2=0x7ff0100cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff0157c4700 1 --2- 172.21.15.90:0/375887412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017df30 0x7ff0100cc940 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7feff8006fd0 tx=0x7feff80090f0).stop 2022-07-05T11:59:09.722 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff0157c4700 1 -- 172.21.15.90:0/375887412 shutdown_connections 2022-07-05T11:59:09.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff0157c4700 1 --2- 172.21.15.90:0/375887412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017df30 0x7ff0100cc940 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff0157c4700 1 -- 172.21.15.90:0/375887412 >> 172.21.15.90:0/375887412 conn(0x7ff0100f5590 msgr2=0x7ff0100f1560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.694+0000 7ff0157c4700 1 -- 172.21.15.90:0/375887412 shutdown_connections 2022-07-05T11:59:09.724 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.695+0000 7ff0157c4700 1 -- 172.21.15.90:0/375887412 wait complete. 2022-07-05T11:59:09.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.696+0000 7ff0157c4700 1 Processor -- start 2022-07-05T11:59:09.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.696+0000 7ff0157c4700 1 -- start start 2022-07-05T11:59:09.725 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff0157c4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0100cce30 0x7ff0101915b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff0157c4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017db50 0x7ff01018fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.726 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff0157c4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01017df30 0x7ff0100ebb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff0157c4700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff010191120 con 0x7ff01017db50 2022-07-05T11:59:09.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff0157c4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01018ffc0 con 0x7ff01017df30 2022-07-05T11:59:09.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff0157c4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff010190230 con 0x7ff0100cce30 2022-07-05T11:59:09.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff00e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017db50 0x7ff01018fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff00e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017db50 0x7ff01018fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59728/0 (socket says 172.21.15.90:59728) 2022-07-05T11:59:09.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff00e7fc700 1 -- 172.21.15.90:0/1164164976 learned_addr learned my addr 172.21.15.90:0/1164164976 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01017df30 0x7ff0100ebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.697+0000 7ff00effd700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0100cce30 0x7ff0101915b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff00e7fc700 1 -- 172.21.15.90:0/1164164976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0100cce30 msgr2=0x7ff0101915b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0100cce30 0x7ff0101915b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff00e7fc700 1 -- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01017df30 msgr2=0x7ff0100ebb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01017df30 0x7ff0100ebb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff00e7fc700 1 -- 172.21.15.90:0/1164164976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009370 con 0x7ff01017db50 2022-07-05T11:59:09.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01017df30 0x7ff0100ebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:59:09.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017db50 0x7ff01018fad0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ff010089170 tx=0x7feff8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff006ffd700 1 -- 172.21.15.90:0/1164164976 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800b850 con 0x7ff01017db50 2022-07-05T11:59:09.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff006ffd700 1 -- 172.21.15.90:0/1164164976 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff800b9b0 con 0x7ff01017db50 2022-07-05T11:59:09.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010190510 con 0x7ff01017db50 2022-07-05T11:59:09.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff006ffd700 1 -- 172.21.15.90:0/1164164976 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff801b640 con 0x7ff01017db50 2022-07-05T11:59:09.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.698+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010190ad0 con 0x7ff01017db50 2022-07-05T11:59:09.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.700+0000 7ff006ffd700 1 -- 172.21.15.90:0/1164164976 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7feff802b070 con 0x7ff01017db50 2022-07-05T11:59:09.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.700+0000 7ff006ffd700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff408ba40 0x7feff408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.700+0000 7ff006ffd700 1 -- 172.21.15.90:0/1164164976 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7feff80b2460 con 0x7ff01017db50 2022-07-05T11:59:09.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.700+0000 7ff00effd700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff408ba40 0x7feff408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.701+0000 7ff00effd700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff408ba40 0x7feff408df00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7ff000003e80 tx=0x7ff000009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.738 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.702+0000 7ff027150b80 1 Processor -- start 2022-07-05T11:59:09.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.702+0000 7ff027150b80 1 -- start start 2022-07-05T11:59:09.739 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff027150b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 0x5597eb84f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff027150b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb89da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.740 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff027150b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893820 0x5597eb893ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff027150b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb819350 con 0x5597eb893820 2022-07-05T11:59:09.741 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff027150b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb790b20 con 0x5597eb893440 2022-07-05T11:59:09.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff027150b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb7a59d0 con 0x5597eb84fd30 2022-07-05T11:59:09.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff00f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893820 0x5597eb893ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.743 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff00f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893820 0x5597eb893ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59736/0 (socket says 172.21.15.90:59736) 2022-07-05T11:59:09.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff00f7fe700 1 -- 172.21.15.90:0/1668157340 learned_addr learned my addr 172.21.15.90:0/1668157340 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb89da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.703+0000 7ff00effd700 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 0x5597eb84f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff00f7fe700 1 -- 172.21.15.90:0/1668157340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 msgr2=0x5597eb89da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb89da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff00f7fe700 1 -- 172.21.15.90:0/1668157340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 msgr2=0x5597eb84f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 0x5597eb84f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff00f7fe700 1 -- 172.21.15.90:0/1668157340 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597eb5d7a60 con 0x5597eb893820 2022-07-05T11:59:09.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893820 0x5597eb893ca0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7ff008002600 tx=0x7ff008009040).ready entity=mon.0 client_cookie=55a14604c7742ae1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7fefeffff700 1 -- 172.21.15.90:0/1668157340 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008010520 con 0x5597eb893820 2022-07-05T11:59:09.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7fefeffff700 1 -- 172.21.15.90:0/1668157340 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008010680 con 0x5597eb893820 2022-07-05T11:59:09.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7fefeffff700 1 -- 172.21.15.90:0/1668157340 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008010a00 con 0x5597eb893820 2022-07-05T11:59:09.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff027150b80 1 -- 172.21.15.90:0/1668157340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893820 msgr2=0x5597eb893ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.704+0000 7ff027150b80 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893820 0x5597eb893ca0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7ff008002600 tx=0x7ff008009040).stop 2022-07-05T11:59:09.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 -- 172.21.15.90:0/1668157340 shutdown_connections 2022-07-05T11:59:09.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893820 0x5597eb893ca0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 0x5597eb84f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 --2- 172.21.15.90:0/1668157340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb89da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 -- 172.21.15.90:0/1668157340 >> 172.21.15.90:0/1668157340 conn(0x5597eb6be240 msgr2=0x5597eb852b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 -- 172.21.15.90:0/1668157340 shutdown_connections 2022-07-05T11:59:09.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 -- 172.21.15.90:0/1668157340 wait complete. 2022-07-05T11:59:09.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 -- start start 2022-07-05T11:59:09.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.705+0000 7ff027150b80 1 Processor -- start 2022-07-05T11:59:09.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb888800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893440 0x5597eb891310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb89d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb76d1a0 con 0x5597eb84fd30 2022-07-05T11:59:09.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb8c3740 con 0x5597eb893820 2022-07-05T11:59:09.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb8c4b40 con 0x5597eb893440 2022-07-05T11:59:09.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 10 client.0 ll_register_callbacks cb 0x5597eb813230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:09.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb888800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb888800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59738/0 (socket says 172.21.15.90:59738) 2022-07-05T11:59:09.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 -- 172.21.15.90:0/3354931438 learned_addr learned my addr 172.21.15.90:0/3354931438 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb89d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893440 0x5597eb891310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 -- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893440 msgr2=0x5597eb891310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893440 0x5597eb891310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 -- 172.21.15.90:0/3354931438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 msgr2=0x5597eb89d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb89d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 -- 172.21.15.90:0/3354931438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00800f040 con 0x5597eb84fd30 2022-07-05T11:59:09.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb89d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:59:09.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff00effd700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb888800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7ff000013550 tx=0x7ff000013000).ready entity=mon.0 client_cookie=6be3b1bcb3c68ce6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7fefed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:09.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7fefed7fa700 1 -- 172.21.15.90:0/3354931438 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000012590 con 0x5597eb84fd30 2022-07-05T11:59:09.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7fefed7fa700 1 -- 172.21.15.90:0/3354931438 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7ff0000126f0 con 0x5597eb84fd30 2022-07-05T11:59:09.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597eb84d4c0 con 0x5597eb84fd30 2022-07-05T11:59:09.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7fefed7fa700 1 -- 172.21.15.90:0/3354931438 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff000003020 con 0x5597eb84fd30 2022-07-05T11:59:09.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 10 client.5814 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:09.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.707+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5597eb646d50 con 0x5597eb84fd30 2022-07-05T11:59:09.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7fefed7fa700 1 -- 172.21.15.90:0/3354931438 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597eb84d4c0 con 0x5597eb84fd30 2022-07-05T11:59:09.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7fefed7fa700 1 -- 172.21.15.90:0/3354931438 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7ff000003180 con 0x5597eb84fd30 2022-07-05T11:59:09.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff027150b80 10 client.5814 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:09.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff027150b80 10 client.5814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:09.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff027150b80 20 client.5814 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:09.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff027150b80 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8c4360 0x5597eb8d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff027150b80 4 client.5814 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:59:09.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597eb79b870 con 0x5597eb8c4360 2022-07-05T11:59:09.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8c4360 0x5597eb8d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8c4360 0x5597eb8d4e70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=61f55f6ee0c4ce2a server_cookie=664dbe20dac54813 in_seq=0 out_seq=0 2022-07-05T11:59:09.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.708+0000 7fefed7fa700 10 client.5814 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:09.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7fefed7fa700 1 -- 172.21.15.90:0/3354931438 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5597eb79b870 con 0x5597eb8c4360 2022-07-05T11:59:09.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7fefed7fa700 10 client.5814 handle_command_reply: tid=0 2022-07-05T11:59:09.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 client.5814 shutdown 2022-07-05T11:59:09.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 msgr2=0x5597eb888800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb888800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7ff000013550 tx=0x7ff000013000).stop 2022-07-05T11:59:09.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 shutdown_connections 2022-07-05T11:59:09.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8c4360 0x5597eb8d4e70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb89d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb888800 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7fefed7fa700 0 client.5814 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 --2- 172.21.15.90:0/3354931438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893440 0x5597eb891310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 >> 172.21.15.90:0/3354931438 conn(0x5597eb6be240 msgr2=0x5597eb8c02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 shutdown_connections 2022-07-05T11:59:09.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 1 -- 172.21.15.90:0/3354931438 wait complete. 2022-07-05T11:59:09.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.709+0000 7ff027150b80 20 client.5814 trim_cache size 0 max 16384 2022-07-05T11:59:09.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.725+0000 7ff027150b80 1 Processor -- start 2022-07-05T11:59:09.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.725+0000 7ff027150b80 1 -- start start 2022-07-05T11:59:09.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff027150b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb8517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff027150b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 0x5597eb8912f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff027150b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893820 0x5597eb85a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff027150b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb8c3a30 con 0x5597eb84fd30 2022-07-05T11:59:09.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff027150b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb89aa50 con 0x5597eb893440 2022-07-05T11:59:09.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff027150b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb89cd60 con 0x5597eb893820 2022-07-05T11:59:09.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb8517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb8517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59746/0 (socket says 172.21.15.90:59746) 2022-07-05T11:59:09.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 -- 172.21.15.90:0/1853275996 learned_addr learned my addr 172.21.15.90:0/1853275996 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 -- 172.21.15.90:0/1853275996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893820 msgr2=0x5597eb85a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 --2- 172.21.15.90:0/1853275996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893820 0x5597eb85a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:09.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 -- 172.21.15.90:0/1853275996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 msgr2=0x5597eb8912f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 --2- 172.21.15.90:0/1853275996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 0x5597eb8912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:09.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.726+0000 7ff00effd700 1 -- 172.21.15.90:0/1853275996 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597eb8c5b60 con 0x5597eb84fd30 2022-07-05T11:59:09.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff00effd700 1 --2- 172.21.15.90:0/1853275996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb8517a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff00000ee30 tx=0x7ff00001f000).ready entity=mon.0 client_cookie=431bb6ea94a82c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff004ff9700 1 -- 172.21.15.90:0/1853275996 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000000f40 con 0x5597eb84fd30 2022-07-05T11:59:09.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff004ff9700 1 -- 172.21.15.90:0/1853275996 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000012590 con 0x5597eb84fd30 2022-07-05T11:59:09.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff004ff9700 1 -- 172.21.15.90:0/1853275996 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000010a0 con 0x5597eb84fd30 2022-07-05T11:59:09.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 -- 172.21.15.90:0/1853275996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 msgr2=0x5597eb8517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 --2- 172.21.15.90:0/1853275996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb8517a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff00000ee30 tx=0x7ff00001f000).stop 2022-07-05T11:59:09.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 -- 172.21.15.90:0/1853275996 shutdown_connections 2022-07-05T11:59:09.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 --2- 172.21.15.90:0/1853275996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb893820 0x5597eb85a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:09.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 --2- 172.21.15.90:0/1853275996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb84fd30 0x5597eb8517a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 --2- 172.21.15.90:0/1853275996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893440 0x5597eb8912f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T11:59:09.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 -- 172.21.15.90:0/1853275996 >> 172.21.15.90:0/1853275996 conn(0x5597eb6be240 msgr2=0x5597eb8d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 -- 172.21.15.90:0/1853275996 shutdown_connections 2022-07-05T11:59:09.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.727+0000 7ff027150b80 1 -- 172.21.15.90:0/1853275996 wait complete. 2022-07-05T11:59:09.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.728+0000 7ff027150b80 1 -- start start 2022-07-05T11:59:09.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.728+0000 7ff027150b80 1 Processor -- start 2022-07-05T11:59:09.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff027150b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb858c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff027150b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893440 0x5597eb8bf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff027150b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb891090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff027150b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb8beef0 con 0x5597eb893440 2022-07-05T11:59:09.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff027150b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb8bebf0 con 0x5597eb893820 2022-07-05T11:59:09.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff027150b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597eb92bec0 con 0x5597eb84fd30 2022-07-05T11:59:09.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff027150b80 10 client.0 ll_register_callbacks cb 0x5597eb813230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:09.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff00e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893440 0x5597eb8bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff00e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893440 0x5597eb8bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59752/0 (socket says 172.21.15.90:59752) 2022-07-05T11:59:09.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.729+0000 7ff00e7fc700 1 -- 172.21.15.90:0/2831018655 learned_addr learned my addr 172.21.15.90:0/2831018655 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00effd700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb858c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb891090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00e7fc700 1 -- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 msgr2=0x5597eb858c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb858c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00e7fc700 1 -- 172.21.15.90:0/2831018655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 msgr2=0x5597eb891090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb891090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00e7fc700 1 -- 172.21.15.90:0/2831018655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597eb646d50 con 0x5597eb893440 2022-07-05T11:59:09.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00effd700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb858c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:59:09.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00f7fe700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb891090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T11:59:09.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00e7fc700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893440 0x5597eb8bf380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7feff8006aa0 tx=0x7feff8002f70).ready entity=mon.0 client_cookie=2a64cfdf578423e4 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7fefed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:09.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7fefed7fa700 1 -- 172.21.15.90:0/2831018655 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80afbb0 con 0x5597eb893440 2022-07-05T11:59:09.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7fefed7fa700 1 -- 172.21.15.90:0/2831018655 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7feff80afd10 con 0x5597eb893440 2022-07-05T11:59:09.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff008010680 con 0x5597eb893440 2022-07-05T11:59:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7fefed7fa700 1 -- 172.21.15.90:0/2831018655 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feff8086270 con 0x5597eb893440 2022-07-05T11:59:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 10 client.5820 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5597eb615050 con 0x5597eb893440 2022-07-05T11:59:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7fefed7fa700 1 -- 172.21.15.90:0/2831018655 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008010680 con 0x5597eb893440 2022-07-05T11:59:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7fefed7fa700 1 -- 172.21.15.90:0/2831018655 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7feff808c1d0 con 0x5597eb893440 2022-07-05T11:59:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 10 client.5820 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 10 client.5820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 20 client.5820 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8594d0 0x5597eb853520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 4 client.5820 mds_command: new command op to 4371 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2022-07-05T11:59:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5597eb792710 con 0x5597eb8594d0 2022-07-05T11:59:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.730+0000 7ff00effd700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8594d0 0x5597eb853520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.731+0000 7ff00effd700 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8594d0 0x5597eb853520 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7f852730ff8d3236 server_cookie=8bf7cb8d42cc58df in_seq=0 out_seq=0 2022-07-05T11:59:09.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.731+0000 7fefed7fa700 10 client.5820 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:09.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7fefed7fa700 1 -- 172.21.15.90:0/2831018655 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5597eb792710 con 0x5597eb8594d0 2022-07-05T11:59:09.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7fefed7fa700 10 client.5820 handle_command_reply: tid=0 2022-07-05T11:59:09.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 client.5820 shutdown 2022-07-05T11:59:09.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893440 msgr2=0x5597eb8bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893440 0x5597eb8bf380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7feff8006aa0 tx=0x7feff8002f70).stop 2022-07-05T11:59:09.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 shutdown_connections 2022-07-05T11:59:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5597eb8594d0 0x5597eb853520 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5597eb893820 0x5597eb891090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5597eb84fd30 0x5597eb858c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 --2- 172.21.15.90:0/2831018655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597eb893440 0x5597eb8bf380 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7fefed7fa700 0 client.5820 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:09.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 >> 172.21.15.90:0/2831018655 conn(0x5597eb6be240 msgr2=0x5597eb8d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.815 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 shutdown_connections 2022-07-05T11:59:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.732+0000 7ff027150b80 1 -- 172.21.15.90:0/2831018655 wait complete. 2022-07-05T11:59:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff027150b80 20 client.5820 trim_cache size 0 max 16384 2022-07-05T11:59:09.817 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:59:09.817 INFO:teuthology.orchestra.run.smithi090.stdout: "return_code": 0, 2022-07-05T11:59:09.817 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T11:59:09.818 INFO:teuthology.orchestra.run.smithi090.stdout: "mode": "asynchronous" 2022-07-05T11:59:09.818 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:59:09.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff408ba40 msgr2=0x7feff408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff408ba40 0x7feff408df00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7ff000003e80 tx=0x7ff000009040).stop 2022-07-05T11:59:09.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017db50 msgr2=0x7ff01018fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017db50 0x7ff01018fad0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ff010089170 tx=0x7feff8017000).stop 2022-07-05T11:59:09.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 shutdown_connections 2022-07-05T11:59:09.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7feff408ba40 0x7feff408df00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff01017df30 0x7ff0100ebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0100cce30 0x7ff0101915b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 --2- 172.21.15.90:0/1164164976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff01017db50 0x7ff01018fad0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 >> 172.21.15.90:0/1164164976 conn(0x7ff0100f5590 msgr2=0x7ff0100c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 shutdown_connections 2022-07-05T11:59:09.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.733+0000 7ff0157c4700 1 -- 172.21.15.90:0/1164164976 wait complete. 2022-07-05T11:59:09.824 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:59:09.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.940+0000 7fab9dd27700 1 Processor -- start 2022-07-05T11:59:09.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.940+0000 7fab9dd27700 1 -- start start 2022-07-05T11:59:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9dd27700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab9817a710 0x7fab980c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9dd27700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980c8b40 con 0x7fab980c73d0 2022-07-05T11:59:09.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9dd27700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980c8e20 con 0x7fab9817aaf0 2022-07-05T11:59:09.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9dd27700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980c9a30 con 0x7fab9817a710 2022-07-05T11:59:09.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9d526700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fab980c73d0 0x7fab980c7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52704/0 (socket says 172.21.15.90:52704) 2022-07-05T11:59:09.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9d526700 1 -- 172.21.15.90:0/2515763495 learned_addr learned my addr 172.21.15.90:0/2515763495 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:59:09.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9cd25700 1 --2- 172.21.15.90:0/2515763495 >> v2:172.21.15.110:3300/0 conn(0x7fab9817a710 0x7fab980c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab977fe700 1 -- 172.21.15.90:0/2515763495 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851424326 0 0) 0x7fab980c8b40 con 0x7fab980c73d0 2022-07-05T11:59:09.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab977fe700 1 -- 172.21.15.90:0/2515763495 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab7c0033f0 con 0x7fab980c73d0 2022-07-05T11:59:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9cd25700 1 -- 172.21.15.90:0/2515763495 >> v1:172.21.15.149:6789/0 conn(0x7fab9817aaf0 legacy=0x7fab980c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9cd25700 1 -- 172.21.15.90:0/2515763495 >> v1:172.21.15.90:6789/0 conn(0x7fab980c73d0 legacy=0x7fab980c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9cd25700 1 -- 172.21.15.90:0/2515763495 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980c9100 con 0x7fab9817a710 2022-07-05T11:59:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab9cd25700 1 --2- 172.21.15.90:0/2515763495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab9817a710 0x7fab980c3650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fab8c009760 tx=0x7fab8c009060).ready entity=mon.1 client_cookie=453c7dadf7cdabea server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab977fe700 1 -- 172.21.15.90:0/2515763495 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00f510 con 0x7fab9817a710 2022-07-05T11:59:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab977fe700 1 -- 172.21.15.90:0/2515763495 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c00f670 con 0x7fab9817a710 2022-07-05T11:59:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.942+0000 7fab977fe700 1 -- 172.21.15.90:0/2515763495 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00f9f0 con 0x7fab9817a710 2022-07-05T11:59:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.943+0000 7fab9dd27700 1 -- 172.21.15.90:0/2515763495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab9817a710 msgr2=0x7fab980c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.943+0000 7fab9dd27700 1 --2- 172.21.15.90:0/2515763495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab9817a710 0x7fab980c3650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fab8c009760 tx=0x7fab8c009060).stop 2022-07-05T11:59:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.943+0000 7fab9dd27700 1 -- 172.21.15.90:0/2515763495 shutdown_connections 2022-07-05T11:59:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.943+0000 7fab9dd27700 1 --2- 172.21.15.90:0/2515763495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab9817a710 0x7fab980c3650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.943+0000 7fab9dd27700 1 -- 172.21.15.90:0/2515763495 >> 172.21.15.90:0/2515763495 conn(0x7fab980ed8d0 msgr2=0x7fab980edce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.943+0000 7fab9dd27700 1 -- 172.21.15.90:0/2515763495 shutdown_connections 2022-07-05T11:59:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.943+0000 7fab9dd27700 1 -- 172.21.15.90:0/2515763495 wait complete. 2022-07-05T11:59:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.944+0000 7fab9dd27700 1 Processor -- start 2022-07-05T11:59:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.945+0000 7fab9dd27700 1 -- start start 2022-07-05T11:59:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9dd27700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab980c73d0 0x7fab98179980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9dd27700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9817a710 0x7fab9816a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9dd27700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab9817aaf0 0x7fab9816cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9dd27700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9816bab0 con 0x7fab9817aaf0 2022-07-05T11:59:09.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9dd27700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9816c630 con 0x7fab980c73d0 2022-07-05T11:59:09.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9dd27700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98179e70 con 0x7fab9817a710 2022-07-05T11:59:09.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab9817aaf0 0x7fab9816cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab9817aaf0 0x7fab9816cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59770/0 (socket says 172.21.15.90:59770) 2022-07-05T11:59:09.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 -- 172.21.15.90:0/476795136 learned_addr learned my addr 172.21.15.90:0/476795136 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9cd25700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab980c73d0 0x7fab98179980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab97fff700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9817a710 0x7fab9816a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 -- 172.21.15.90:0/476795136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9817a710 msgr2=0x7fab9816a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9817a710 0x7fab9816a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 -- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab980c73d0 msgr2=0x7fab98179980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab980c73d0 0x7fab98179980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 -- 172.21.15.90:0/476795136 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0092a0 con 0x7fab9817aaf0 2022-07-05T11:59:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9d526700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab9817aaf0 0x7fab9816cac0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fab90005ad0 tx=0x7fab900015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab94ff9700 1 -- 172.21.15.90:0/476795136 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90005d30 con 0x7fab9817aaf0 2022-07-05T11:59:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab94ff9700 1 -- 172.21.15.90:0/476795136 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab90005e90 con 0x7fab9817aaf0 2022-07-05T11:59:09.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab94ff9700 1 -- 172.21.15.90:0/476795136 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900072e0 con 0x7fab9817aaf0 2022-07-05T11:59:09.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.946+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab98064db0 con 0x7fab9817aaf0 2022-07-05T11:59:09.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.947+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9816bfe0 con 0x7fab9817aaf0 2022-07-05T11:59:09.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.949+0000 7fab94ff9700 1 -- 172.21.15.90:0/476795136 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fab90010070 con 0x7fab9817aaf0 2022-07-05T11:59:09.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.949+0000 7fab94ff9700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fab8008ba10 0x7fab8008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.949+0000 7fab94ff9700 1 -- 172.21.15.90:0/476795136 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fab900b0110 con 0x7fab9817aaf0 2022-07-05T11:59:09.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.950+0000 7fab9cd25700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fab8008ba10 0x7fab8008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.950+0000 7fab9cd25700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fab8008ba10 0x7fab8008ded0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fab8c006d10 tx=0x7fab8c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.951+0000 7fabb0915b80 1 Processor -- start 2022-07-05T11:59:09.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.951+0000 7fabb0915b80 1 -- start start 2022-07-05T11:59:09.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c61a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c57d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fabb0915b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141bdd2d0 con 0x559141c13da0 2022-07-05T11:59:09.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fabb0915b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141b54aa0 con 0x559141c57890 2022-07-05T11:59:09.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fabb0915b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141b69950 con 0x559141c574b0 2022-07-05T11:59:09.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c61a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c61a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59778/0 (socket says 172.21.15.90:59778) 2022-07-05T11:59:09.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 -- 172.21.15.90:0/2459324896 learned_addr learned my addr 172.21.15.90:0/2459324896 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:09.988 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab9d526700 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c57d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab9cd25700 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:09.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 -- 172.21.15.90:0/2459324896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 msgr2=0x559141c138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 -- 172.21.15.90:0/2459324896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 msgr2=0x559141c57d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:09.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c57d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab97fff700 1 -- 172.21.15.90:0/2459324896 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55914199b9e0 con 0x559141c13da0 2022-07-05T11:59:09.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.952+0000 7fab9d526700 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c57d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T11:59:09.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fab97fff700 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c61a80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fab84003770 tx=0x7fab84000bc0).ready entity=mon.0 client_cookie=913b16d237c46f37 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:09.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fab79ffb700 1 -- 172.21.15.90:0/2459324896 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84003040 con 0x559141c13da0 2022-07-05T11:59:09.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fab79ffb700 1 -- 172.21.15.90:0/2459324896 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400a560 con 0x559141c13da0 2022-07-05T11:59:09.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fab79ffb700 1 -- 172.21.15.90:0/2459324896 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400a8e0 con 0x559141c13da0 2022-07-05T11:59:09.993 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 -- 172.21.15.90:0/2459324896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 msgr2=0x559141c61a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:09.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c61a80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fab84003770 tx=0x7fab84000bc0).stop 2022-07-05T11:59:09.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 -- 172.21.15.90:0/2459324896 shutdown_connections 2022-07-05T11:59:09.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c57d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 --2- 172.21.15.90:0/2459324896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c61a80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:09.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 -- 172.21.15.90:0/2459324896 >> 172.21.15.90:0/2459324896 conn(0x559141a821c0 msgr2=0x559141c16ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:09.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 -- 172.21.15.90:0/2459324896 shutdown_connections 2022-07-05T11:59:09.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.953+0000 7fabb0915b80 1 -- 172.21.15.90:0/2459324896 wait complete. 2022-07-05T11:59:09.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.954+0000 7fabb0915b80 1 -- start start 2022-07-05T11:59:09.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.955+0000 7fabb0915b80 1 Processor -- start 2022-07-05T11:59:09.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c13da0 0x559141c96a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c574b0 0x559141c4d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:09.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141b31120 con 0x559141c574b0 2022-07-05T11:59:09.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141c976e0 con 0x559141c13da0 2022-07-05T11:59:09.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141c537c0 con 0x559141c57890 2022-07-05T11:59:10.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 10 client.0 ll_register_callbacks cb 0x559141bd7380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:10.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c574b0 0x559141c4d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c574b0 0x559141c4d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59782/0 (socket says 172.21.15.90:59782) 2022-07-05T11:59:10.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 -- 172.21.15.90:0/241995726 learned_addr learned my addr 172.21.15.90:0/241995726 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:10.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab9cd25700 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c13da0 0x559141c96a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab9d526700 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 -- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 msgr2=0x559141c552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:10.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 -- 172.21.15.90:0/241995726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c13da0 msgr2=0x559141c96a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:10.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c13da0 0x559141c96a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 -- 172.21.15.90:0/241995726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab900ade70 con 0x559141c574b0 2022-07-05T11:59:10.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab97fff700 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c574b0 0x559141c4d3a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fab84000fb0 tx=0x7fab8401a000).ready entity=mon.0 client_cookie=8a6959c6eb67220b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:10.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:10.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab72ffd700 1 -- 172.21.15.90:0/241995726 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400aea0 con 0x559141c574b0 2022-07-05T11:59:10.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab72ffd700 1 -- 172.21.15.90:0/241995726 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fab84017640 con 0x559141c574b0 2022-07-05T11:59:10.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559141c11690 con 0x559141c574b0 2022-07-05T11:59:10.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fab72ffd700 1 -- 172.21.15.90:0/241995726 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab84017a10 con 0x559141c574b0 2022-07-05T11:59:10.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 10 client.5832 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:10.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.956+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x7fab980c8e20 con 0x559141c574b0 2022-07-05T11:59:10.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fab72ffd700 1 -- 172.21.15.90:0/241995726 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559141c11690 con 0x559141c574b0 2022-07-05T11:59:10.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fab72ffd700 1 -- 172.21.15.90:0/241995726 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7fab84017b70 con 0x559141c574b0 2022-07-05T11:59:10.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fabb0915b80 10 client.5832 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:10.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fabb0915b80 10 client.5832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:10.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fabb0915b80 20 client.5832 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:10.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fabb0915b80 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141c996e0 0x559141c95570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fabb0915b80 4 client.5832 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:59:10.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559141b5f7f0 con 0x559141c996e0 2022-07-05T11:59:10.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fab9cd25700 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141c996e0 0x559141c95570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fab72ffd700 10 client.5832 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:10.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.957+0000 7fab9cd25700 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141c996e0 0x559141c95570 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a7914b4249854026 server_cookie=ffded5697da28597 in_seq=0 out_seq=0 2022-07-05T11:59:10.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fab72ffd700 1 -- 172.21.15.90:0/241995726 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x559141b5f7f0 con 0x559141c996e0 2022-07-05T11:59:10.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fab72ffd700 10 client.5832 handle_command_reply: tid=0 2022-07-05T11:59:10.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 client.5832 shutdown 2022-07-05T11:59:10.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c574b0 msgr2=0x559141c4d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:10.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c574b0 0x559141c4d3a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fab84000fb0 tx=0x7fab8401a000).stop 2022-07-05T11:59:10.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 shutdown_connections 2022-07-05T11:59:10.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141c996e0 0x559141c95570 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fab72ffd700 0 client.5832 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:10.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c13da0 0x559141c96a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 --2- 172.21.15.90:0/241995726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c574b0 0x559141c4d3a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.961+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 >> 172.21.15.90:0/241995726 conn(0x559141a821c0 msgr2=0x559141c84240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:10.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.962+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 shutdown_connections 2022-07-05T11:59:10.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.962+0000 7fabb0915b80 1 -- 172.21.15.90:0/241995726 wait complete. 2022-07-05T11:59:10.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.962+0000 7fabb0915b80 20 client.5832 trim_cache size 0 max 16384 2022-07-05T11:59:10.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.979+0000 7fabb0915b80 1 Processor -- start 2022-07-05T11:59:10.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.980+0000 7fabb0915b80 1 -- start start 2022-07-05T11:59:10.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.980+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c56db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.980+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c574b0 0x559141c13550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.980+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c88c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fabb0915b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141ce1e10 con 0x559141c13da0 2022-07-05T11:59:10.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fabb0915b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141c0e0e0 con 0x559141c574b0 2022-07-05T11:59:10.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fabb0915b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141c13a40 con 0x559141c57890 2022-07-05T11:59:10.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c56db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c56db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59788/0 (socket says 172.21.15.90:59788) 2022-07-05T11:59:10.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 -- 172.21.15.90:0/3728083952 learned_addr learned my addr 172.21.15.90:0/3728083952 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:10.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab97fff700 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c574b0 0x559141c13550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9d526700 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c88c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 -- 172.21.15.90:0/3728083952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 msgr2=0x559141c88c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:10.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c88c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 -- 172.21.15.90:0/3728083952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c574b0 msgr2=0x559141c13550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:10.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c574b0 0x559141c13550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 -- 172.21.15.90:0/3728083952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559141a0acd0 con 0x559141c13da0 2022-07-05T11:59:10.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab9cd25700 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c56db0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fab8c00f640 tx=0x7fab8c02f280).ready entity=mon.0 client_cookie=73f12c5ced6c290e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:10.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab7a7fc700 1 -- 172.21.15.90:0/3728083952 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c02c070 con 0x559141c13da0 2022-07-05T11:59:10.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab7a7fc700 1 -- 172.21.15.90:0/3728083952 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c01c9d0 con 0x559141c13da0 2022-07-05T11:59:10.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.981+0000 7fab7a7fc700 1 -- 172.21.15.90:0/3728083952 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c01cb40 con 0x559141c13da0 2022-07-05T11:59:10.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 -- 172.21.15.90:0/3728083952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 msgr2=0x559141c56db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:10.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c56db0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fab8c00f640 tx=0x7fab8c02f280).stop 2022-07-05T11:59:10.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 -- 172.21.15.90:0/3728083952 shutdown_connections 2022-07-05T11:59:10.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c57890 0x559141c88c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141c56db0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 --2- 172.21.15.90:0/3728083952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c574b0 0x559141c13550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 -- 172.21.15.90:0/3728083952 >> 172.21.15.90:0/3728083952 conn(0x559141a821c0 msgr2=0x559141c5e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:10.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 -- 172.21.15.90:0/3728083952 shutdown_connections 2022-07-05T11:59:10.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.982+0000 7fabb0915b80 1 -- 172.21.15.90:0/3728083952 wait complete. 2022-07-05T11:59:10.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.983+0000 7fabb0915b80 1 -- start start 2022-07-05T11:59:10.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.983+0000 7fabb0915b80 1 Processor -- start 2022-07-05T11:59:10.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141ce0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fabb0915b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c5e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fabb0915b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141cef920 con 0x559141c13da0 2022-07-05T11:59:10.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fabb0915b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141c55c20 con 0x559141c57890 2022-07-05T11:59:10.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fabb0915b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559141c55080 con 0x559141c574b0 2022-07-05T11:59:10.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fabb0915b80 10 client.0 ll_register_callbacks cb 0x559141bd7380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:10.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fab9cd25700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141ce0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fab9cd25700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141ce0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59794/0 (socket says 172.21.15.90:59794) 2022-07-05T11:59:10.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fab9cd25700 1 -- 172.21.15.90:0/1331460709 learned_addr learned my addr 172.21.15.90:0/1331460709 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:10.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fab9d526700 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c5e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.984+0000 7fab97fff700 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab9cd25700 1 -- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 msgr2=0x559141c583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:10.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab9cd25700 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab9cd25700 1 -- 172.21.15.90:0/1331460709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 msgr2=0x559141c5e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:10.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab9cd25700 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c5e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab9cd25700 1 -- 172.21.15.90:0/1331460709 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab980c9100 con 0x559141c13da0 2022-07-05T11:59:10.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab9cd25700 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141ce0360 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fab8c000e50 tx=0x7fab8c02c000).ready entity=mon.0 client_cookie=89d3f4c6cd88adcc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:10.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:10.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab72ffd700 1 -- 172.21.15.90:0/1331460709 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c01cb40 con 0x559141c13da0 2022-07-05T11:59:10.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab8400a560 con 0x559141c13da0 2022-07-05T11:59:10.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab72ffd700 1 -- 172.21.15.90:0/1331460709 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fab8c032650 con 0x559141c13da0 2022-07-05T11:59:10.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab72ffd700 1 -- 172.21.15.90:0/1331460709 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab8c032a20 con 0x559141c13da0 2022-07-05T11:59:10.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 10 client.5838 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:10.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5591419d8fd0 con 0x559141c13da0 2022-07-05T11:59:10.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab72ffd700 1 -- 172.21.15.90:0/1331460709 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400a560 con 0x559141c13da0 2022-07-05T11:59:10.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fab72ffd700 1 -- 172.21.15.90:0/1331460709 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7fab8c032b80 con 0x559141c13da0 2022-07-05T11:59:10.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 10 client.5838 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:10.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 10 client.5838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:10.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 20 client.5838 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:10.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141cdcad0 0x559141ceec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:10.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 4 client.5838 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:59:10.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.985+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559141b56690 con 0x559141cdcad0 2022-07-05T11:59:10.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.986+0000 7fab97fff700 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141cdcad0 0x559141ceec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:10.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.986+0000 7fab72ffd700 10 client.5838 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:10.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.986+0000 7fab97fff700 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141cdcad0 0x559141ceec90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8481baafb00a18b1 server_cookie=4ef8c943a2e90f9d in_seq=0 out_seq=0 2022-07-05T11:59:10.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.986+0000 7fab72ffd700 1 -- 172.21.15.90:0/1331460709 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+269 (crc 0 0 0) 0x559141b56690 con 0x559141cdcad0 2022-07-05T11:59:10.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.986+0000 7fab72ffd700 10 client.5838 handle_command_reply: tid=0 2022-07-05T11:59:10.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.986+0000 7fabb0915b80 1 client.5838 shutdown 2022-07-05T11:59:10.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 msgr2=0x559141ce0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:10.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141ce0360 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fab8c000e50 tx=0x7fab8c02c000).stop 2022-07-05T11:59:10.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 shutdown_connections 2022-07-05T11:59:10.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x559141cdcad0 0x559141ceec90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559141c57890 0x559141c5e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559141c13da0 0x559141ce0360 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 --2- 172.21.15.90:0/1331460709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559141c574b0 0x559141c583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab72ffd700 0 client.5838 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:10.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 >> 172.21.15.90:0/1331460709 conn(0x559141a821c0 msgr2=0x559141c569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:10.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 shutdown_connections 2022-07-05T11:59:10.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 1 -- 172.21.15.90:0/1331460709 wait complete. 2022-07-05T11:59:10.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fabb0915b80 20 client.5838 trim_cache size 0 max 16384 2022-07-05T11:59:10.069 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:59:10.070 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "scrub active (13762 inodes in the stack)", 2022-07-05T11:59:10.070 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:59:10.070 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T11:59:10.071 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:59:10.071 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T11:59:10.072 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:59:10.072 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:59:10.073 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:59:10.073 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:59:10.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fab8008ba10 msgr2=0x7fab8008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:10.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fab8008ba10 0x7fab8008ded0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fab8c006d10 tx=0x7fab8c017000).stop 2022-07-05T11:59:10.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab9817aaf0 msgr2=0x7fab9816cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:10.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab9817aaf0 0x7fab9816cac0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fab90005ad0 tx=0x7fab900015b0).stop 2022-07-05T11:59:10.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 shutdown_connections 2022-07-05T11:59:10.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fab8008ba10 0x7fab8008ded0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab9817aaf0 0x7fab9816cac0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab980c73d0 0x7fab98179980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 --2- 172.21.15.90:0/476795136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9817a710 0x7fab9816a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:10.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.987+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 >> 172.21.15.90:0/476795136 conn(0x7fab980ed8d0 msgr2=0x7fab980f0350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:10.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.988+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 shutdown_connections 2022-07-05T11:59:10.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:09.988+0000 7fab9dd27700 1 -- 172.21.15.90:0/476795136 wait complete. 2022-07-05T11:59:10.081 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T11:59:16.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~31s 2022-07-05T11:59:16.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~31s 2022-07-05T11:59:16.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~39s 2022-07-05T11:59:19.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:59:19.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:59:19.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:59:24.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~39s 2022-07-05T11:59:24.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~39s 2022-07-05T11:59:24.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~47s 2022-07-05T11:59:32.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~46s 2022-07-05T11:59:32.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~46s 2022-07-05T11:59:32.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~54s 2022-07-05T11:59:39.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~54s 2022-07-05T11:59:39.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~54s 2022-07-05T11:59:39.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~62s 2022-07-05T11:59:40.082 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T11:59:40.213 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.213+0000 7ff425849700 1 Processor -- start 2022-07-05T11:59:40.214 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.213+0000 7ff425849700 1 -- start start 2022-07-05T11:59:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.214+0000 7ff425849700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff420178610 0x7ff4201789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.214+0000 7ff425849700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff42017f3b0 0x7ff42017d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.214+0000 7ff425849700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42017d560 con 0x7ff42017dee0 2022-07-05T11:59:40.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.214+0000 7ff425849700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff420064bd0 con 0x7ff420178610 2022-07-05T11:59:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.214+0000 7ff425849700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42017f830 con 0x7ff42017f3b0 2022-07-05T11:59:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41f7fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff42017dee0 0x7ff420181e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52744/0 (socket says 172.21.15.90:52744) 2022-07-05T11:59:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41f7fe700 1 -- 172.21.15.90:0/1698266758 learned_addr learned my addr 172.21.15.90:0/1698266758 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T11:59:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/1698266758 >> v2:172.21.15.149:3300/0 conn(0x7ff42017f3b0 0x7ff42017d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41effd700 1 --2- 172.21.15.90:0/1698266758 >> v2:172.21.15.110:3300/0 conn(0x7ff420178610 0x7ff4201789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41dffb700 1 -- 172.21.15.90:0/1698266758 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221834537 0 0) 0x7ff42017d560 con 0x7ff42017dee0 2022-07-05T11:59:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41dffb700 1 -- 172.21.15.90:0/1698266758 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff40c0033f0 con 0x7ff42017dee0 2022-07-05T11:59:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41e7fc700 1 -- 172.21.15.90:0/1698266758 >> v2:172.21.15.110:3300/0 conn(0x7ff420178610 msgr2=0x7ff4201789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/1698266758 >> v2:172.21.15.110:3300/0 conn(0x7ff420178610 0x7ff4201789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41e7fc700 1 -- 172.21.15.90:0/1698266758 >> v1:172.21.15.90:6789/0 conn(0x7ff42017dee0 legacy=0x7ff420181e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41e7fc700 1 -- 172.21.15.90:0/1698266758 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42017c670 con 0x7ff42017f3b0 2022-07-05T11:59:40.245 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/1698266758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff42017f3b0 0x7ff42017d9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff42005ff10 tx=0x7ff414009060).ready entity=mon.2 client_cookie=901be1106c3cdfa2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:40.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41dffb700 1 -- 172.21.15.90:0/1698266758 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4140090d0 con 0x7ff42017f3b0 2022-07-05T11:59:40.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41dffb700 1 -- 172.21.15.90:0/1698266758 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41400d4a0 con 0x7ff42017f3b0 2022-07-05T11:59:40.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.215+0000 7ff41dffb700 1 -- 172.21.15.90:0/1698266758 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400d820 con 0x7ff42017f3b0 2022-07-05T11:59:40.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 -- 172.21.15.90:0/1698266758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff42017f3b0 msgr2=0x7ff42017d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 --2- 172.21.15.90:0/1698266758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff42017f3b0 0x7ff42017d9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff42005ff10 tx=0x7ff414009060).stop 2022-07-05T11:59:40.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 -- 172.21.15.90:0/1698266758 shutdown_connections 2022-07-05T11:59:40.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 --2- 172.21.15.90:0/1698266758 >> v2:172.21.15.110:3300/0 conn(0x7ff420178610 0x7ff4201789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 --2- 172.21.15.90:0/1698266758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff42017f3b0 0x7ff42017d9f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 -- 172.21.15.90:0/1698266758 >> 172.21.15.90:0/1698266758 conn(0x7ff4200f2210 msgr2=0x7ff420069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:40.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 -- 172.21.15.90:0/1698266758 shutdown_connections 2022-07-05T11:59:40.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.216+0000 7ff425849700 1 -- 172.21.15.90:0/1698266758 wait complete. 2022-07-05T11:59:40.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.217+0000 7ff425849700 1 Processor -- start 2022-07-05T11:59:40.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.218+0000 7ff425849700 1 -- start start 2022-07-05T11:59:40.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.218+0000 7ff425849700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff420178610 0x7ff420152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.218+0000 7ff425849700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42017dee0 0x7ff42017fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff425849700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff42017f3b0 0x7ff420180040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff425849700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42017a5e0 con 0x7ff42017f3b0 2022-07-05T11:59:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff425849700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42017a8c0 con 0x7ff42017dee0 2022-07-05T11:59:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff425849700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42017aba0 con 0x7ff420178610 2022-07-05T11:59:40.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff42017f3b0 0x7ff420180040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff42017f3b0 0x7ff420180040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59812/0 (socket says 172.21.15.90:59812) 2022-07-05T11:59:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff420178610 0x7ff420152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 -- 172.21.15.90:0/3403522268 learned_addr learned my addr 172.21.15.90:0/3403522268 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:40.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42017dee0 0x7ff42017fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 -- 172.21.15.90:0/3403522268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff420178610 msgr2=0x7ff420152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.256 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff420178610 0x7ff420152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 -- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42017dee0 msgr2=0x7ff42017fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42017dee0 0x7ff42017fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 -- 172.21.15.90:0/3403522268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140092a0 con 0x7ff42017f3b0 2022-07-05T11:59:40.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42017dee0 0x7ff42017fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:59:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff41f7fe700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff42017f3b0 0x7ff420180040 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7ff41800c3f0 tx=0x7ff418007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff406ffd700 1 -- 172.21.15.90:0/3403522268 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180070d0 con 0x7ff42017f3b0 2022-07-05T11:59:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff406ffd700 1 -- 172.21.15.90:0/3403522268 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418007230 con 0x7ff42017f3b0 2022-07-05T11:59:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42017ae80 con 0x7ff42017f3b0 2022-07-05T11:59:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff406ffd700 1 -- 172.21.15.90:0/3403522268 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180075b0 con 0x7ff42017f3b0 2022-07-05T11:59:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.219+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42017b440 con 0x7ff42017f3b0 2022-07-05T11:59:40.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.221+0000 7ff406ffd700 1 -- 172.21.15.90:0/3403522268 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff418010070 con 0x7ff42017f3b0 2022-07-05T11:59:40.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.222+0000 7ff406ffd700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff40008ba40 0x7ff40008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.222+0000 7ff406ffd700 1 -- 172.21.15.90:0/3403522268 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7ff4180afe40 con 0x7ff42017f3b0 2022-07-05T11:59:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.222+0000 7ff41effd700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff40008ba40 0x7ff40008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.222+0000 7ff41effd700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff40008ba40 0x7ff40008df00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7ff410009fd0 tx=0x7ff41000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.223+0000 7ff4371d5b80 1 Processor -- start 2022-07-05T11:59:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.223+0000 7ff4371d5b80 1 -- start start 2022-07-05T11:59:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.224+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a044fb17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.224+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044fff990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.224+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a044ff5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.224+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044f7b2d0 con 0x55a044fb1cb0 2022-07-05T11:59:40.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.224+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044ef2aa0 con 0x55a044ff53c0 2022-07-05T11:59:40.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.224+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044f07950 con 0x55a044ff57a0 2022-07-05T11:59:40.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044fff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044fff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59818/0 (socket says 172.21.15.90:59818) 2022-07-05T11:59:40.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 -- 172.21.15.90:0/928252325 learned_addr learned my addr 172.21.15.90:0/928252325 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:40.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41f7fe700 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a044ff5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41effd700 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a044fb17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 -- 172.21.15.90:0/928252325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 msgr2=0x55a044ff5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a044ff5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 -- 172.21.15.90:0/928252325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 msgr2=0x55a044fb17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a044fb17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 -- 172.21.15.90:0/928252325 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a044d399e0 con 0x55a044fb1cb0 2022-07-05T11:59:40.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044fff990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7ff414009d20 tx=0x7ff414016000).ready entity=mon.0 client_cookie=e74b9e2b8dcfba76 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:40.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff3fbfff700 1 -- 172.21.15.90:0/928252325 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414000c90 con 0x55a044fb1cb0 2022-07-05T11:59:40.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff3fbfff700 1 -- 172.21.15.90:0/928252325 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41400d610 con 0x55a044fb1cb0 2022-07-05T11:59:40.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.225+0000 7ff3fbfff700 1 -- 172.21.15.90:0/928252325 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400dbd0 con 0x55a044fb1cb0 2022-07-05T11:59:40.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 -- 172.21.15.90:0/928252325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 msgr2=0x55a044fff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044fff990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7ff414009d20 tx=0x7ff414016000).stop 2022-07-05T11:59:40.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 -- 172.21.15.90:0/928252325 shutdown_connections 2022-07-05T11:59:40.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a044ff5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a044fb17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/928252325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044fff990 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 -- 172.21.15.90:0/928252325 >> 172.21.15.90:0/928252325 conn(0x55a044e201c0 msgr2=0x55a044fb4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:40.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 -- 172.21.15.90:0/928252325 shutdown_connections 2022-07-05T11:59:40.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.226+0000 7ff4371d5b80 1 -- 172.21.15.90:0/928252325 wait complete. 2022-07-05T11:59:40.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.227+0000 7ff4371d5b80 1 -- start start 2022-07-05T11:59:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.227+0000 7ff4371d5b80 1 Processor -- start 2022-07-05T11:59:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044fb1cb0 0x55a044ff3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044ff53c0 0x55a04501e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045026ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044ecf120 con 0x55a044ff53c0 2022-07-05T11:59:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044ff4520 con 0x55a044fb1cb0 2022-07-05T11:59:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044ff33c0 con 0x55a044ff57a0 2022-07-05T11:59:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff4371d5b80 10 client.0 ll_register_callbacks cb 0x55a044f751b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044ff53c0 0x55a04501e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044ff53c0 0x55a04501e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59824/0 (socket says 172.21.15.90:59824) 2022-07-05T11:59:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 -- 172.21.15.90:0/1039383574 learned_addr learned my addr 172.21.15.90:0/1039383574 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41f7fe700 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045026ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41effd700 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044fb1cb0 0x55a044ff3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 -- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 msgr2=0x55a045026ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045026ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 -- 172.21.15.90:0/1039383574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044fb1cb0 msgr2=0x55a044ff3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044fb1cb0 0x55a044ff3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 -- 172.21.15.90:0/1039383574 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42017c670 con 0x55a044ff53c0 2022-07-05T11:59:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044ff53c0 0x55a04501e0b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x55a045027c70 tx=0x7ff41401e000).ready entity=mon.0 client_cookie=1b943dc3d4758499 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.228+0000 7ff3f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff3f97fa700 1 -- 172.21.15.90:0/1039383574 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414006ad0 con 0x55a044ff53c0 2022-07-05T11:59:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff3f97fa700 1 -- 172.21.15.90:0/1039383574 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7ff414000bc0 con 0x55a044ff53c0 2022-07-05T11:59:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a044faf440 con 0x55a044ff53c0 2022-07-05T11:59:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff3f97fa700 1 -- 172.21.15.90:0/1039383574 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff414011cc0 con 0x55a044ff53c0 2022-07-05T11:59:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 10 client.5850 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55a044da8cd0 con 0x55a044ff53c0 2022-07-05T11:59:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff3f97fa700 1 -- 172.21.15.90:0/1039383574 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a044faf440 con 0x55a044ff53c0 2022-07-05T11:59:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff3f97fa700 1 -- 172.21.15.90:0/1039383574 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7ff414029480 con 0x55a044ff53c0 2022-07-05T11:59:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 10 client.5850 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 10 client.5850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 20 client.5850 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a045033e00 0x55a045034210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 4 client.5850 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T11:59:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a044efd7f0 con 0x55a045033e00 2022-07-05T11:59:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.229+0000 7ff41effd700 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a045033e00 0x55a045034210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.230+0000 7ff3f97fa700 10 client.5850 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:40.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.230+0000 7ff41effd700 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a045033e00 0x55a045034210 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d3ffe9773c750cfe server_cookie=4477b72f8d598f0f in_seq=0 out_seq=0 2022-07-05T11:59:40.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.230+0000 7ff3f97fa700 1 -- 172.21.15.90:0/1039383574 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55a044efd7f0 con 0x55a045033e00 2022-07-05T11:59:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.230+0000 7ff3f97fa700 10 client.5850 handle_command_reply: tid=0 2022-07-05T11:59:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.230+0000 7ff4371d5b80 1 client.5850 shutdown 2022-07-05T11:59:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.230+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044ff53c0 msgr2=0x55a04501e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.230+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044ff53c0 0x55a04501e0b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x55a045027c70 tx=0x7ff41401e000).stop 2022-07-05T11:59:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 shutdown_connections 2022-07-05T11:59:40.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a045033e00 0x55a045034210 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045026ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff3f97fa700 0 client.5850 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044fb1cb0 0x55a044ff3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/1039383574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044ff53c0 0x55a04501e0b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 >> 172.21.15.90:0/1039383574 conn(0x55a044e201c0 msgr2=0x55a0450222a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 shutdown_connections 2022-07-05T11:59:40.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 1 -- 172.21.15.90:0/1039383574 wait complete. 2022-07-05T11:59:40.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.231+0000 7ff4371d5b80 20 client.5850 trim_cache size 0 max 16384 2022-07-05T11:59:40.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.247+0000 7ff4371d5b80 1 Processor -- start 2022-07-05T11:59:40.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.247+0000 7ff4371d5b80 1 -- start start 2022-07-05T11:59:40.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044ff4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff53c0 0x55a044fea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff57a0 0x55a044fbc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044ffddd0 con 0x55a044fb1cb0 2022-07-05T11:59:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0450221b0 con 0x55a044ff57a0 2022-07-05T11:59:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044ff5b80 con 0x55a044ff53c0 2022-07-05T11:59:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044ff4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044ff4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59832/0 (socket says 172.21.15.90:59832) 2022-07-05T11:59:40.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 -- 172.21.15.90:0/10386568 learned_addr learned my addr 172.21.15.90:0/10386568 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:40.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41f7fe700 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff57a0 0x55a044fbc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff53c0 0x55a044fea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 -- 172.21.15.90:0/10386568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff53c0 msgr2=0x55a044fea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff53c0 0x55a044fea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 -- 172.21.15.90:0/10386568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff57a0 msgr2=0x55a044fbc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff57a0 0x55a044fbc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.248+0000 7ff41effd700 1 -- 172.21.15.90:0/10386568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a044d76fd0 con 0x55a044fb1cb0 2022-07-05T11:59:40.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff41effd700 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044ff4cc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x55a045034880 tx=0x7ff410017000).ready entity=mon.0 client_cookie=1218c3b0e74c7861 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:40.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff404ff9700 1 -- 172.21.15.90:0/10386568 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410026070 con 0x55a044fb1cb0 2022-07-05T11:59:40.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff404ff9700 1 -- 172.21.15.90:0/10386568 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41000f040 con 0x55a044fb1cb0 2022-07-05T11:59:40.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff404ff9700 1 -- 172.21.15.90:0/10386568 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000e040 con 0x55a044fb1cb0 2022-07-05T11:59:40.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 -- 172.21.15.90:0/10386568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 msgr2=0x55a044ff4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044ff4cc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x55a045034880 tx=0x7ff410017000).stop 2022-07-05T11:59:40.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 -- 172.21.15.90:0/10386568 shutdown_connections 2022-07-05T11:59:40.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff57a0 0x55a044fbc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a044ff4cc0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/10386568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff53c0 0x55a044fea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 -- 172.21.15.90:0/10386568 >> 172.21.15.90:0/10386568 conn(0x55a044e201c0 msgr2=0x55a044ffc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:40.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 -- 172.21.15.90:0/10386568 shutdown_connections 2022-07-05T11:59:40.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.249+0000 7ff4371d5b80 1 -- 172.21.15.90:0/10386568 wait complete. 2022-07-05T11:59:40.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.250+0000 7ff4371d5b80 1 -- start start 2022-07-05T11:59:40.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.250+0000 7ff4371d5b80 1 Processor -- start 2022-07-05T11:59:40.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a04507f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a04507faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff4371d5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045024b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a04507ff90 con 0x55a044fb1cb0 2022-07-05T11:59:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a04508cd60 con 0x55a044ff53c0 2022-07-05T11:59:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff4371d5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a045024ff0 con 0x55a044ff57a0 2022-07-05T11:59:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff4371d5b80 10 client.0 ll_register_callbacks cb 0x55a044f751b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T11:59:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff41effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a04507f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff41effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a04507f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59836/0 (socket says 172.21.15.90:59836) 2022-07-05T11:59:40.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff41effd700 1 -- 172.21.15.90:0/2657020173 learned_addr learned my addr 172.21.15.90:0/2657020173 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T11:59:40.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.251+0000 7ff41f7fe700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045024b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a04507faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41effd700 1 -- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 msgr2=0x55a045024b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41effd700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045024b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41effd700 1 -- 172.21.15.90:0/2657020173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 msgr2=0x55a04507faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T11:59:40.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41effd700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a04507faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41effd700 1 -- 172.21.15.90:0/2657020173 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff410015650 con 0x55a044fb1cb0 2022-07-05T11:59:40.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a04507faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T11:59:40.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff41effd700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a04507f520 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff410000f80 tx=0x7ff410029000).ready entity=mon.0 client_cookie=3e1d6c91031057ed server_cookie=0 in_seq=0 out_seq=0 2022-07-05T11:59:40.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff3f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T11:59:40.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff3f97fa700 1 -- 172.21.15.90:0/2657020173 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000e040 con 0x55a044fb1cb0 2022-07-05T11:59:40.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff3f97fa700 1 -- 172.21.15.90:0/2657020173 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7ff41001a040 con 0x55a044fb1cb0 2022-07-05T11:59:40.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff41400d610 con 0x55a044fb1cb0 2022-07-05T11:59:40.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff3f97fa700 1 -- 172.21.15.90:0/2657020173 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff410021d00 con 0x55a044fb1cb0 2022-07-05T11:59:40.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 10 client.5856 fetch_fsmap learned FSMap version 37 2022-07-05T11:59:40.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55a04508c5d0 con 0x55a044fb1cb0 2022-07-05T11:59:40.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff3f97fa700 1 -- 172.21.15.90:0/2657020173 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41400d610 con 0x55a044fb1cb0 2022-07-05T11:59:40.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff3f97fa700 1 -- 172.21.15.90:0/2657020173 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7ff410032440 con 0x55a044fb1cb0 2022-07-05T11:59:40.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 10 client.5856 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T11:59:40.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 10 client.5856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T11:59:40.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 20 client.5856 populate_metadata read hostname 'smithi090' 2022-07-05T11:59:40.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a044feb360 0x55a044ff4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T11:59:40.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 4 client.5856 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T11:59:40.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.252+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a044ef4690 con 0x55a044feb360 2022-07-05T11:59:40.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a044feb360 0x55a044ff4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T11:59:40.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff3f97fa700 10 client.5856 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:40.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff41e7fc700 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a044feb360 0x55a044ff4b00 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8933c4af269ebfdd server_cookie=70ae13f4a6899e00 in_seq=0 out_seq=0 2022-07-05T11:59:40.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff3f97fa700 1 -- 172.21.15.90:0/2657020173 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a044ef4690 con 0x55a044feb360 2022-07-05T11:59:40.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff3f97fa700 10 client.5856 handle_command_reply: tid=0 2022-07-05T11:59:40.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 client.5856 shutdown 2022-07-05T11:59:40.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 msgr2=0x55a04507f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a04507f520 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff410000f80 tx=0x7ff410029000).stop 2022-07-05T11:59:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 shutdown_connections 2022-07-05T11:59:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a044feb360 0x55a044ff4b00 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a044ff57a0 0x55a045024b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff3f97fa700 0 client.5856 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T11:59:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a044fb1cb0 0x55a04507f520 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 --2- 172.21.15.90:0/2657020173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a044ff53c0 0x55a04507faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 >> 172.21.15.90:0/2657020173 conn(0x55a044e201c0 msgr2=0x55a044fbc050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 shutdown_connections 2022-07-05T11:59:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 1 -- 172.21.15.90:0/2657020173 wait complete. 2022-07-05T11:59:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.253+0000 7ff4371d5b80 20 client.5856 trim_cache size 0 max 16384 2022-07-05T11:59:40.324 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T11:59:40.324 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T11:59:40.324 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T11:59:40.325 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T11:59:40.325 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T11:59:40.325 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T11:59:40.326 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T11:59:40.326 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:59:40.327 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T11:59:40.327 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T11:59:40.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff40008ba40 msgr2=0x7ff40008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff40008ba40 0x7ff40008df00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7ff410009fd0 tx=0x7ff41000b040).stop 2022-07-05T11:59:40.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff42017f3b0 msgr2=0x7ff420180040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T11:59:40.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff42017f3b0 0x7ff420180040 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7ff41800c3f0 tx=0x7ff418007be0).stop 2022-07-05T11:59:40.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 shutdown_connections 2022-07-05T11:59:40.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7ff40008ba40 0x7ff40008df00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff42017f3b0 0x7ff420180040 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff420178610 0x7ff420152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 --2- 172.21.15.90:0/3403522268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff42017dee0 0x7ff42017fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T11:59:40.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 >> 172.21.15.90:0/3403522268 conn(0x7ff4200f2210 msgr2=0x7ff4200ebd40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T11:59:40.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 shutdown_connections 2022-07-05T11:59:40.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T11:59:40.254+0000 7ff425849700 1 -- 172.21.15.90:0/3403522268 wait complete. 2022-07-05T11:59:40.342 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T11:59:47.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~62s 2022-07-05T11:59:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~62s 2022-07-05T11:59:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~70s 2022-07-05T11:59:50.266 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:59:50.270 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:59:50.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T11:59:55.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2022-07-05T11:59:55.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~70s 2022-07-05T11:59:55.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~77s 2022-07-05T12:00:03.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~77s 2022-07-05T12:00:03.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~77s 2022-07-05T12:00:03.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~85s 2022-07-05T12:00:10.344 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:00:10.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.481+0000 7f6d76e90700 1 Processor -- start 2022-07-05T12:00:10.481 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.481+0000 7f6d76e90700 1 -- start start 2022-07-05T12:00:10.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d76e90700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6d70062f20 0x7f6d7017f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.503 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d76e90700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7017d560 con 0x7f6d701789f0 2022-07-05T12:00:10.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d76e90700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7017c670 con 0x7f6d70178610 2022-07-05T12:00:10.504 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d76e90700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7017f8a0 con 0x7f6d70062f20 2022-07-05T12:00:10.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d67fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6d701789f0 0x7f6d70063bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52786/0 (socket says 172.21.15.90:52786) 2022-07-05T12:00:10.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d67fff700 1 -- 172.21.15.90:0/1691086537 learned_addr learned my addr 172.21.15.90:0/1691086537 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:00:10.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d7542d700 1 --2- 172.21.15.90:0/1691086537 >> v2:172.21.15.149:3300/0 conn(0x7f6d70062f20 0x7f6d7017f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.505 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d677fe700 1 -- 172.21.15.90:0/1691086537 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312432132 0 0) 0x7f6d7017d560 con 0x7f6d701789f0 2022-07-05T12:00:10.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d677fe700 1 -- 172.21.15.90:0/1691086537 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d5c0033f0 con 0x7f6d701789f0 2022-07-05T12:00:10.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d7542d700 1 -- 172.21.15.90:0/1691086537 >> v1:172.21.15.149:6789/0 conn(0x7f6d70178610 legacy=0x7f6d7017d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d7542d700 1 -- 172.21.15.90:0/1691086537 >> v1:172.21.15.90:6789/0 conn(0x7f6d701789f0 legacy=0x7f6d70063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.506 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.482+0000 7f6d7542d700 1 -- 172.21.15.90:0/1691086537 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7017c950 con 0x7f6d70062f20 2022-07-05T12:00:10.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d7542d700 1 --2- 172.21.15.90:0/1691086537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d70062f20 0x7f6d7017f3b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f6d68009750 tx=0x7f6d68006f90).ready entity=mon.2 client_cookie=b229861abfa358bf server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:10.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d677fe700 1 -- 172.21.15.90:0/1691086537 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680058d0 con 0x7f6d70062f20 2022-07-05T12:00:10.507 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d677fe700 1 -- 172.21.15.90:0/1691086537 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68005a30 con 0x7f6d70062f20 2022-07-05T12:00:10.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d677fe700 1 -- 172.21.15.90:0/1691086537 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68005db0 con 0x7f6d70062f20 2022-07-05T12:00:10.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d76e90700 1 -- 172.21.15.90:0/1691086537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d70062f20 msgr2=0x7f6d7017f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.508 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d76e90700 1 --2- 172.21.15.90:0/1691086537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d70062f20 0x7f6d7017f3b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f6d68009750 tx=0x7f6d68006f90).stop 2022-07-05T12:00:10.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d76e90700 1 -- 172.21.15.90:0/1691086537 shutdown_connections 2022-07-05T12:00:10.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d76e90700 1 --2- 172.21.15.90:0/1691086537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d70062f20 0x7f6d7017f3b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d76e90700 1 -- 172.21.15.90:0/1691086537 >> 172.21.15.90:0/1691086537 conn(0x7f6d700f2210 msgr2=0x7f6d70069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:10.509 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d76e90700 1 -- 172.21.15.90:0/1691086537 shutdown_connections 2022-07-05T12:00:10.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.483+0000 7f6d76e90700 1 -- 172.21.15.90:0/1691086537 wait complete. 2022-07-05T12:00:10.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.485+0000 7f6d76e90700 1 Processor -- start 2022-07-05T12:00:10.510 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.485+0000 7f6d76e90700 1 -- start start 2022-07-05T12:00:10.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d76e90700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d70062f20 0x7f6d70171180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d76e90700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d70178610 0x7f6d700ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d76e90700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d701789f0 0x7f6d700ec230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.511 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d76e90700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700c7150 con 0x7f6d70178610 2022-07-05T12:00:10.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d76e90700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700c7430 con 0x7f6d70062f20 2022-07-05T12:00:10.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d76e90700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700ec7f0 con 0x7f6d701789f0 2022-07-05T12:00:10.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d70178610 0x7f6d700ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d70178610 0x7f6d700ebd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59852/0 (socket says 172.21.15.90:59852) 2022-07-05T12:00:10.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 -- 172.21.15.90:0/2873138642 learned_addr learned my addr 172.21.15.90:0/2873138642 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:10.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d7542d700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d701789f0 0x7f6d700ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d70062f20 0x7f6d70171180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 -- 172.21.15.90:0/2873138642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d701789f0 msgr2=0x7f6d700ec230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d701789f0 0x7f6d700ec230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.514 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 -- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d70062f20 msgr2=0x7f6d70171180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d70062f20 0x7f6d70171180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 -- 172.21.15.90:0/2873138642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68009290 con 0x7f6d70178610 2022-07-05T12:00:10.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d70178610 0x7f6d700ebd40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f6d60001ed0 tx=0x7f6d60007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:10.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d64ff9700 1 -- 172.21.15.90:0/2873138642 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600072e0 con 0x7f6d70178610 2022-07-05T12:00:10.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d64ff9700 1 -- 172.21.15.90:0/2873138642 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60007440 con 0x7f6d70178610 2022-07-05T12:00:10.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.486+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d700ecad0 con 0x7f6d70178610 2022-07-05T12:00:10.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.487+0000 7f6d64ff9700 1 -- 172.21.15.90:0/2873138642 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600057a0 con 0x7f6d70178610 2022-07-05T12:00:10.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.487+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d700ed090 con 0x7f6d70178610 2022-07-05T12:00:10.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.488+0000 7f6d64ff9700 1 -- 172.21.15.90:0/2873138642 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6d60010070 con 0x7f6d70178610 2022-07-05T12:00:10.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.489+0000 7f6d64ff9700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6d5008ba40 0x7f6d5008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.489+0000 7f6d64ff9700 1 -- 172.21.15.90:0/2873138642 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6d600afe10 con 0x7f6d70178610 2022-07-05T12:00:10.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.489+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6d5008ba40 0x7f6d5008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.490+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6d5008ba40 0x7f6d5008df00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f6d6c007fd0 tx=0x7f6d6c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:10.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.490+0000 7f6d8881cb80 1 Processor -- start 2022-07-05T12:00:10.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.491+0000 7f6d8881cb80 1 -- start start 2022-07-05T12:00:10.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.491+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.491+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89562cb0 0x55ef895b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.491+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef895a67a0 0x55ef895a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.491+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef8952c2d0 con 0x55ef895a67a0 2022-07-05T12:00:10.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.491+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef894a3aa0 con 0x55ef895a63c0 2022-07-05T12:00:10.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.491+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef894b8950 con 0x55ef89562cb0 2022-07-05T12:00:10.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef895a67a0 0x55ef895a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef895a67a0 0x55ef895a6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59858/0 (socket says 172.21.15.90:59858) 2022-07-05T12:00:10.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 -- 172.21.15.90:0/3887793171 learned_addr learned my addr 172.21.15.90:0/3887793171 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:10.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d67fff700 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89562cb0 0x55ef895b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 -- 172.21.15.90:0/3887793171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89562cb0 msgr2=0x55ef895b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89562cb0 0x55ef895b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 -- 172.21.15.90:0/3887793171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 msgr2=0x55ef895627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895627c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 -- 172.21.15.90:0/3887793171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef892ea9e0 con 0x55ef895a67a0 2022-07-05T12:00:10.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d7542d700 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef895a67a0 0x55ef895a6c20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f6d68006df0 tx=0x7f6d68016000).ready entity=mon.0 client_cookie=72f12dd4a42cbb12 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:10.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d55ffb700 1 -- 172.21.15.90:0/3887793171 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68005d70 con 0x55ef895a67a0 2022-07-05T12:00:10.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d55ffb700 1 -- 172.21.15.90:0/3887793171 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68006240 con 0x55ef895a67a0 2022-07-05T12:00:10.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.492+0000 7f6d55ffb700 1 -- 172.21.15.90:0/3887793171 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680065c0 con 0x55ef895a67a0 2022-07-05T12:00:10.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 -- 172.21.15.90:0/3887793171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef895a67a0 msgr2=0x55ef895a6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef895a67a0 0x55ef895a6c20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f6d68006df0 tx=0x7f6d68016000).stop 2022-07-05T12:00:10.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 -- 172.21.15.90:0/3887793171 shutdown_connections 2022-07-05T12:00:10.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef895a67a0 0x55ef895a6c20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895627c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/3887793171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89562cb0 0x55ef895b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 -- 172.21.15.90:0/3887793171 >> 172.21.15.90:0/3887793171 conn(0x55ef893d11c0 msgr2=0x55ef89565ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:10.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 -- 172.21.15.90:0/3887793171 shutdown_connections 2022-07-05T12:00:10.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 -- 172.21.15.90:0/3887793171 wait complete. 2022-07-05T12:00:10.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.493+0000 7f6d8881cb80 1 -- start start 2022-07-05T12:00:10.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.494+0000 7f6d8881cb80 1 Processor -- start 2022-07-05T12:00:10.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef895a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895d7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef89560dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef89480120 con 0x55ef89562cb0 2022-07-05T12:00:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef895d7f10 con 0x55ef895a63c0 2022-07-05T12:00:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef895d6db0 con 0x55ef895a67a0 2022-07-05T12:00:10.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 10 client.0 ll_register_callbacks cb 0x55ef895261b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:00:10.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef895a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef895a55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59864/0 (socket says 172.21.15.90:59864) 2022-07-05T12:00:10.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2769064993 learned_addr learned my addr 172.21.15.90:0/2769064993 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:10.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d7542d700 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef89560dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895d7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 msgr2=0x55ef89560dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef89560dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2769064993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 msgr2=0x55ef895d7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895d7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2769064993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7017c950 con 0x55ef89562cb0 2022-07-05T12:00:10.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef895a55d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f6d6c00f010 tx=0x7f6d6c012000).ready entity=mon.0 client_cookie=56ea0532604fb7d9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:10.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d4affd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:00:10.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d4affd700 1 -- 172.21.15.90:0/2769064993 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c01c070 con 0x55ef89562cb0 2022-07-05T12:00:10.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d4affd700 1 -- 172.21.15.90:0/2769064993 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6d6c0114f0 con 0x55ef89562cb0 2022-07-05T12:00:10.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.495+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef89560440 con 0x55ef89562cb0 2022-07-05T12:00:10.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d4affd700 1 -- 172.21.15.90:0/2769064993 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d6c00e720 con 0x55ef89562cb0 2022-07-05T12:00:10.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 10 client.5868 fetch_fsmap learned FSMap version 37 2022-07-05T12:00:10.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55ef89359cd0 con 0x55ef89562cb0 2022-07-05T12:00:10.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d4affd700 1 -- 172.21.15.90:0/2769064993 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c02c020 con 0x55ef89562cb0 2022-07-05T12:00:10.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d4affd700 1 -- 172.21.15.90:0/2769064993 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7f6d6c0118c0 con 0x55ef89562cb0 2022-07-05T12:00:10.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 10 client.5868 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T12:00:10.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 10 client.5868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:00:10.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 20 client.5868 populate_metadata read hostname 'smithi090' 2022-07-05T12:00:10.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef89599010 0x55ef895d5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 4 client.5868 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:00:10.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef894ae7f0 con 0x55ef89599010 2022-07-05T12:00:10.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef89599010 0x55ef895d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d4affd700 10 client.5868 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:10.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.496+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef89599010 0x55ef895d5920 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=24c5b324cbd21f11 server_cookie=d2faf331e7004b5b in_seq=0 out_seq=0 2022-07-05T12:00:10.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d4affd700 1 -- 172.21.15.90:0/2769064993 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55ef894ae7f0 con 0x55ef89599010 2022-07-05T12:00:10.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d4affd700 10 client.5868 handle_command_reply: tid=0 2022-07-05T12:00:10.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 client.5868 shutdown 2022-07-05T12:00:10.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 msgr2=0x55ef895a55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef895a55d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f6d6c00f010 tx=0x7f6d6c012000).stop 2022-07-05T12:00:10.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 shutdown_connections 2022-07-05T12:00:10.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef89599010 0x55ef895d5920 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef89560dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef895a55d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2769064993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef895d7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d4affd700 0 client.5868 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:10.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 >> 172.21.15.90:0/2769064993 conn(0x55ef893d11c0 msgr2=0x55ef89565a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:10.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.497+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 shutdown_connections 2022-07-05T12:00:10.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.498+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2769064993 wait complete. 2022-07-05T12:00:10.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.498+0000 7f6d8881cb80 20 client.5868 trim_cache size 0 max 16384 2022-07-05T12:00:10.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.513+0000 7f6d8881cb80 1 Processor -- start 2022-07-05T12:00:10.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.513+0000 7f6d8881cb80 1 -- start start 2022-07-05T12:00:10.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef89565ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef89566900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef8955c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef8956dbd0 con 0x55ef89562cb0 2022-07-05T12:00:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef895d8790 con 0x55ef895a63c0 2022-07-05T12:00:10.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef895a6020 con 0x55ef895a67a0 2022-07-05T12:00:10.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef89565ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef89565ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59872/0 (socket says 172.21.15.90:59872) 2022-07-05T12:00:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 -- 172.21.15.90:0/1987528704 learned_addr learned my addr 172.21.15.90:0/1987528704 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d7542d700 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef8955c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 -- 172.21.15.90:0/1987528704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 msgr2=0x55ef8955c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d67fff700 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef89566900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef8955c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 -- 172.21.15.90:0/1987528704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 msgr2=0x55ef89566900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef89566900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 -- 172.21.15.90:0/1987528704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef89327fd0 con 0x55ef89562cb0 2022-07-05T12:00:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d7542d700 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef8955c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:00:10.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.514+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef89565ed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f6d6c0014a0 tx=0x7f6d6c014000).ready entity=mon.0 client_cookie=1f859ead7cd308a3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:10.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d567fc700 1 -- 172.21.15.90:0/1987528704 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c00ece0 con 0x55ef89562cb0 2022-07-05T12:00:10.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d567fc700 1 -- 172.21.15.90:0/1987528704 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef89560440 con 0x55ef89562cb0 2022-07-05T12:00:10.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d567fc700 1 -- 172.21.15.90:0/1987528704 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0169e0 con 0x55ef89562cb0 2022-07-05T12:00:10.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 -- 172.21.15.90:0/1987528704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 msgr2=0x55ef89565ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef89565ed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f6d6c0014a0 tx=0x7f6d6c014000).stop 2022-07-05T12:00:10.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 -- 172.21.15.90:0/1987528704 shutdown_connections 2022-07-05T12:00:10.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a67a0 0x55ef8955c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef89565ed0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/1987528704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a63c0 0x55ef89566900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 -- 172.21.15.90:0/1987528704 >> 172.21.15.90:0/1987528704 conn(0x55ef893d11c0 msgr2=0x55ef895d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:10.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 -- 172.21.15.90:0/1987528704 shutdown_connections 2022-07-05T12:00:10.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.515+0000 7f6d8881cb80 1 -- 172.21.15.90:0/1987528704 wait complete. 2022-07-05T12:00:10.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.516+0000 7f6d8881cb80 1 -- start start 2022-07-05T12:00:10.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.516+0000 7f6d8881cb80 1 Processor -- start 2022-07-05T12:00:10.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef8956d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a63c0 0x55ef895d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d8881cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a67a0 0x55ef8963e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef8955d170 con 0x55ef89562cb0 2022-07-05T12:00:10.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef895e5950 con 0x55ef895a67a0 2022-07-05T12:00:10.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d8881cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef8963ed00 con 0x55ef895a63c0 2022-07-05T12:00:10.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d8881cb80 10 client.0 ll_register_callbacks cb 0x55ef895261b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:00:10.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef8956d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef8956d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59878/0 (socket says 172.21.15.90:59878) 2022-07-05T12:00:10.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2628874101 learned_addr learned my addr 172.21.15.90:0/2628874101 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:10.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a63c0 0x55ef895d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a63c0 msgr2=0x55ef895d71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a63c0 0x55ef895d71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2628874101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a67a0 msgr2=0x55ef8963e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:10.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a67a0 0x55ef8963e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:00:10.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 -- 172.21.15.90:0/2628874101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef89359cd0 con 0x55ef89562cb0 2022-07-05T12:00:10.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d74c2c700 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef8956d5d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f6d6c00e7d0 tx=0x7f6d6c030000).ready entity=mon.0 client_cookie=b433bcbf908d53e3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:10.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.517+0000 7f6d4affd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:00:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d4affd700 1 -- 172.21.15.90:0/2628874101 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c014e90 con 0x55ef89562cb0 2022-07-05T12:00:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d4affd700 1 -- 172.21.15.90:0/2628874101 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6d6c02d080 con 0x55ef89562cb0 2022-07-05T12:00:10.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d68006240 con 0x55ef89562cb0 2022-07-05T12:00:10.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d4affd700 1 -- 172.21.15.90:0/2628874101 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d6c0169e0 con 0x55ef89562cb0 2022-07-05T12:00:10.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 10 client.5874 fetch_fsmap learned FSMap version 37 2022-07-05T12:00:10.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55ef8955cbb0 con 0x55ef89562cb0 2022-07-05T12:00:10.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d4affd700 1 -- 172.21.15.90:0/2628874101 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68006240 con 0x55ef89562cb0 2022-07-05T12:00:10.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d4affd700 1 -- 172.21.15.90:0/2628874101 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7f6d6c02f040 con 0x55ef89562cb0 2022-07-05T12:00:10.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 10 client.5874 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T12:00:10.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 10 client.5874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:00:10.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 20 client.5874 populate_metadata read hostname 'smithi090' 2022-07-05T12:00:10.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef895d4500 0x55ef895d8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:10.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 4 client.5874 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:00:10.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ef894a5690 con 0x55ef895d4500 2022-07-05T12:00:10.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.518+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef895d4500 0x55ef895d8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:10.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d4affd700 10 client.5874 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:10.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d67fff700 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef895d4500 0x55ef895d8ca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=69f01b977d883534 server_cookie=4ddd13b5a2fee96e in_seq=0 out_seq=0 2022-07-05T12:00:10.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d4affd700 1 -- 172.21.15.90:0/2628874101 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ef894a5690 con 0x55ef895d4500 2022-07-05T12:00:10.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d4affd700 10 client.5874 handle_command_reply: tid=0 2022-07-05T12:00:10.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 client.5874 shutdown 2022-07-05T12:00:10.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 msgr2=0x55ef8956d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef8956d5d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f6d6c00e7d0 tx=0x7f6d6c030000).stop 2022-07-05T12:00:10.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 shutdown_connections 2022-07-05T12:00:10.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ef895d4500 0x55ef895d8ca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef895a67a0 0x55ef8963e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:00:10.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d4affd700 0 client.5874 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:10.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ef89562cb0 0x55ef8956d5d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 --2- 172.21.15.90:0/2628874101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef895a63c0 0x55ef895d71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 >> 172.21.15.90:0/2628874101 conn(0x55ef893d11c0 msgr2=0x55ef89598200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:10.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 shutdown_connections 2022-07-05T12:00:10.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 1 -- 172.21.15.90:0/2628874101 wait complete. 2022-07-05T12:00:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d8881cb80 20 client.5874 trim_cache size 0 max 16384 2022-07-05T12:00:10.603 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:00:10.603 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:00:10.603 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:00:10.604 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:00:10.604 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:00:10.604 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:00:10.604 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:00:10.604 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:00:10.605 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:00:10.605 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:00:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6d5008ba40 msgr2=0x7f6d5008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.519+0000 7f6d76e90700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6d5008ba40 0x7f6d5008df00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f6d6c007fd0 tx=0x7f6d6c009040).stop 2022-07-05T12:00:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d70178610 msgr2=0x7f6d700ebd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d70178610 0x7f6d700ebd40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f6d60001ed0 tx=0x7f6d60007c70).stop 2022-07-05T12:00:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 shutdown_connections 2022-07-05T12:00:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6d5008ba40 0x7f6d5008df00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d701789f0 0x7f6d700ec230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d70062f20 0x7f6d70171180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 --2- 172.21.15.90:0/2873138642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d70178610 0x7f6d700ebd40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:10.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 >> 172.21.15.90:0/2873138642 conn(0x7f6d700f2210 msgr2=0x7f6d700633f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:10.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 shutdown_connections 2022-07-05T12:00:10.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:10.520+0000 7f6d76e90700 1 -- 172.21.15.90:0/2873138642 wait complete. 2022-07-05T12:00:10.611 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:00:10.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~85s 2022-07-05T12:00:10.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~85s 2022-07-05T12:00:10.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~93s 2022-07-05T12:00:18.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~93s 2022-07-05T12:00:18.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~93s 2022-07-05T12:00:18.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~101s 2022-07-05T12:00:20.334 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:00:20.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:00:20.345 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:00:20.405 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:00:20.404+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42280) UID: 0 2022-07-05T12:00:20.406 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:00:20.405+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42280) UID: 0 2022-07-05T12:00:20.406 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:00:20.405+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42280) UID: 0 2022-07-05T12:00:26.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~100s 2022-07-05T12:00:26.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~100s 2022-07-05T12:00:26.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~108s 2022-07-05T12:00:34.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~108s 2022-07-05T12:00:34.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~108s 2022-07-05T12:00:34.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~116s 2022-07-05T12:00:40.612 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:00:40.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.741+0000 7f25d6d13700 1 Processor -- start 2022-07-05T12:00:40.742 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.741+0000 7f25d6d13700 1 -- start start 2022-07-05T12:00:40.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.742+0000 7f25d6d13700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25d017dcd0 0x7f25d0063200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.742+0000 7f25d6d13700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25d00636f0 0x7f25d0063b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.742+0000 7f25d6d13700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25d017e4b0 0x7f25d017e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.742+0000 7f25d6d13700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d0061f10 con 0x7f25d017e4b0 2022-07-05T12:00:40.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.742+0000 7f25d6d13700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d0062d70 con 0x7f25d00636f0 2022-07-05T12:00:40.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.742+0000 7f25d6d13700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d0062160 con 0x7f25d017dcd0 2022-07-05T12:00:40.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.742+0000 7f25d6512700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25d017e4b0 0x7f25d017e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25d017e4b0 0x7f25d017e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59888/0 (socket says 172.21.15.90:59888) 2022-07-05T12:00:40.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 -- 172.21.15.90:0/2693984803 learned_addr learned my addr 172.21.15.90:0/2693984803 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:40.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d5d11700 1 --2- 172.21.15.90:0/2693984803 >> v2:172.21.15.149:3300/0 conn(0x7f25d017dcd0 0x7f25d0063200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d5510700 1 --2- 172.21.15.90:0/2693984803 >> v2:172.21.15.110:3300/0 conn(0x7f25d00636f0 0x7f25d0063b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 -- 172.21.15.90:0/2693984803 >> v2:172.21.15.149:3300/0 conn(0x7f25d017dcd0 msgr2=0x7f25d0063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 --2- 172.21.15.90:0/2693984803 >> v2:172.21.15.149:3300/0 conn(0x7f25d017dcd0 0x7f25d0063200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 -- 172.21.15.90:0/2693984803 >> v2:172.21.15.110:3300/0 conn(0x7f25d00636f0 msgr2=0x7f25d0063b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 --2- 172.21.15.90:0/2693984803 >> v2:172.21.15.110:3300/0 conn(0x7f25d00636f0 0x7f25d0063b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 -- 172.21.15.90:0/2693984803 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0062440 con 0x7f25d017e4b0 2022-07-05T12:00:40.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6512700 1 --2- 172.21.15.90:0/2693984803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d017e940 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f25d0088fb0 tx=0x7f25c80090f0).ready entity=mon.0 client_cookie=a802b40e72ee3138 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:40.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d4d0f700 1 -- 172.21.15.90:0/2693984803 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800b520 con 0x7f25d017e4b0 2022-07-05T12:00:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d4d0f700 1 -- 172.21.15.90:0/2693984803 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c800b680 con 0x7f25d017e4b0 2022-07-05T12:00:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d4d0f700 1 -- 172.21.15.90:0/2693984803 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800ba20 con 0x7f25d017e4b0 2022-07-05T12:00:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6d13700 1 -- 172.21.15.90:0/2693984803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 msgr2=0x7f25d017e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.743+0000 7f25d6d13700 1 --2- 172.21.15.90:0/2693984803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d017e940 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f25d0088fb0 tx=0x7f25c80090f0).stop 2022-07-05T12:00:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.744+0000 7f25d6d13700 1 -- 172.21.15.90:0/2693984803 shutdown_connections 2022-07-05T12:00:40.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.744+0000 7f25d6d13700 1 --2- 172.21.15.90:0/2693984803 >> v2:172.21.15.149:3300/0 conn(0x7f25d017dcd0 0x7f25d0063200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.744+0000 7f25d6d13700 1 --2- 172.21.15.90:0/2693984803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d017e940 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.744+0000 7f25d6d13700 1 --2- 172.21.15.90:0/2693984803 >> v2:172.21.15.110:3300/0 conn(0x7f25d00636f0 0x7f25d0063b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.744+0000 7f25d6d13700 1 -- 172.21.15.90:0/2693984803 >> 172.21.15.90:0/2693984803 conn(0x7f25d00f5470 msgr2=0x7f25d00f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.744+0000 7f25d6d13700 1 -- 172.21.15.90:0/2693984803 shutdown_connections 2022-07-05T12:00:40.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.744+0000 7f25d6d13700 1 -- 172.21.15.90:0/2693984803 wait complete. 2022-07-05T12:00:40.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.745+0000 7f25d6d13700 1 Processor -- start 2022-07-05T12:00:40.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.745+0000 7f25d6d13700 1 -- start start 2022-07-05T12:00:40.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6d13700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25d00636f0 0x7f25d00c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6d13700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d017dcd0 0x7f25d0176c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6d13700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d0191c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6d13700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0177110 con 0x7f25d017e4b0 2022-07-05T12:00:40.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6d13700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d017a120 con 0x7f25d017dcd0 2022-07-05T12:00:40.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6d13700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0192610 con 0x7f25d00636f0 2022-07-05T12:00:40.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d0191c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d5d11700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25d00636f0 0x7f25d00c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d5d11700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25d00636f0 0x7f25d00c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41288/0 (socket says 172.21.15.90:41288) 2022-07-05T12:00:40.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d5d11700 1 -- 172.21.15.90:0/3704963958 learned_addr learned my addr 172.21.15.90:0/3704963958 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:40.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d0191c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59894/0 (socket says 172.21.15.90:59894) 2022-07-05T12:00:40.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d5510700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d017dcd0 0x7f25d0176c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6512700 1 -- 172.21.15.90:0/3704963958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25d00636f0 msgr2=0x7f25d00c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6512700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25d00636f0 0x7f25d00c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6512700 1 -- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d017dcd0 msgr2=0x7f25d0176c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.746+0000 7f25d6512700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d017dcd0 0x7f25d0176c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25d6512700 1 -- 172.21.15.90:0/3704963958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8009370 con 0x7f25d017e4b0 2022-07-05T12:00:40.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25d5d11700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25d00636f0 0x7f25d00c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:00:40.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25d6512700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d0191c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f25d0062ce0 tx=0x7f25c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:40.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25cdffb700 1 -- 172.21.15.90:0/3704963958 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800b520 con 0x7f25d017e4b0 2022-07-05T12:00:40.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25cdffb700 1 -- 172.21.15.90:0/3704963958 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8006970 con 0x7f25d017e4b0 2022-07-05T12:00:40.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d01928f0 con 0x7f25d017e4b0 2022-07-05T12:00:40.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25cdffb700 1 -- 172.21.15.90:0/3704963958 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8006d90 con 0x7f25d017e4b0 2022-07-05T12:00:40.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.747+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d0179db0 con 0x7f25d017e4b0 2022-07-05T12:00:40.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.749+0000 7f25cdffb700 1 -- 172.21.15.90:0/3704963958 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f25c802c070 con 0x7f25d017e4b0 2022-07-05T12:00:40.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.749+0000 7f25cdffb700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f25b008ba10 0x7f25b008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.749+0000 7f25cdffb700 1 -- 172.21.15.90:0/3704963958 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f25c80b2360 con 0x7f25d017e4b0 2022-07-05T12:00:40.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.750+0000 7f25d5d11700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f25b008ba10 0x7f25b008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.750+0000 7f25d5d11700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f25b008ba10 0x7f25b008ded0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f25c0009fd0 tx=0x7f25c000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:40.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.751+0000 7f25e9901b80 1 Processor -- start 2022-07-05T12:00:40.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.751+0000 7f25e9901b80 1 -- start start 2022-07-05T12:00:40.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a47c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25e9901b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a4462d0 con 0x55810a4c0890 2022-07-05T12:00:40.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25e9901b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a3bdaa0 con 0x55810a4c04b0 2022-07-05T12:00:40.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25e9901b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a3d2950 con 0x55810a47cda0 2022-07-05T12:00:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59902/0 (socket says 172.21.15.90:59902) 2022-07-05T12:00:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 -- 172.21.15.90:0/623164643 learned_addr learned my addr 172.21.15.90:0/623164643 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:40.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d5510700 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d5d11700 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a47c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 -- 172.21.15.90:0/623164643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 msgr2=0x55810a4caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 -- 172.21.15.90:0/623164643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 msgr2=0x55810a47c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a47c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 -- 172.21.15.90:0/623164643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55810a2049e0 con 0x55810a4c0890 2022-07-05T12:00:40.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.752+0000 7f25d6512700 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4c0d10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f25c8086870 tx=0x7f25c8082fc0).ready entity=mon.0 client_cookie=3178ae8c0e34ce83 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:40.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25b6ffd700 1 -- 172.21.15.90:0/623164643 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80b2040 con 0x55810a4c0890 2022-07-05T12:00:40.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25b6ffd700 1 -- 172.21.15.90:0/623164643 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c80b21d0 con 0x55810a4c0890 2022-07-05T12:00:40.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25b6ffd700 1 -- 172.21.15.90:0/623164643 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8086c80 con 0x55810a4c0890 2022-07-05T12:00:40.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 -- 172.21.15.90:0/623164643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 msgr2=0x55810a4c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4c0d10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f25c8086870 tx=0x7f25c8082fc0).stop 2022-07-05T12:00:40.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 -- 172.21.15.90:0/623164643 shutdown_connections 2022-07-05T12:00:40.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4c0d10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a47c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 --2- 172.21.15.90:0/623164643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 -- 172.21.15.90:0/623164643 >> 172.21.15.90:0/623164643 conn(0x55810a2eb1c0 msgr2=0x55810a47fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:40.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 -- 172.21.15.90:0/623164643 shutdown_connections 2022-07-05T12:00:40.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.753+0000 7f25e9901b80 1 -- 172.21.15.90:0/623164643 wait complete. 2022-07-05T12:00:40.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.754+0000 7f25e9901b80 1 -- start start 2022-07-05T12:00:40.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.754+0000 7f25e9901b80 1 Processor -- start 2022-07-05T12:00:40.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a501940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 0x55810a5021f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25e9901b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a39a120 con 0x55810a47cda0 2022-07-05T12:00:40.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25e9901b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a4f1860 con 0x55810a4c0890 2022-07-05T12:00:40.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25e9901b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a4c9b00 con 0x55810a4c04b0 2022-07-05T12:00:40.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25e9901b80 10 client.0 ll_register_callbacks cb 0x55810a440380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:00:40.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25d5d11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a501940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25d5d11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a501940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59906/0 (socket says 172.21.15.90:59906) 2022-07-05T12:00:40.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25d5d11700 1 -- 172.21.15.90:0/2311854737 learned_addr learned my addr 172.21.15.90:0/2311854737 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:40.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.755+0000 7f25d5510700 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d5d11700 1 -- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 msgr2=0x55810a4f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d5d11700 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d6512700 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 0x55810a5021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d5d11700 1 -- 172.21.15.90:0/2311854737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 msgr2=0x55810a5021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d5d11700 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 0x55810a5021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d5d11700 1 -- 172.21.15.90:0/2311854737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d0179db0 con 0x55810a47cda0 2022-07-05T12:00:40.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d5d11700 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a501940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f25c0015790 tx=0x7f25c0017000).ready entity=mon.0 client_cookie=b45ee227312a5c20 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:40.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25abfff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:00:40.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25abfff700 1 -- 172.21.15.90:0/2311854737 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0014690 con 0x55810a47cda0 2022-07-05T12:00:40.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55810a47a690 con 0x55810a47cda0 2022-07-05T12:00:40.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25abfff700 1 -- 172.21.15.90:0/2311854737 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f25c001a040 con 0x55810a47cda0 2022-07-05T12:00:40.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25abfff700 1 -- 172.21.15.90:0/2311854737 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c0014a00 con 0x55810a47cda0 2022-07-05T12:00:40.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 10 client.5886 fetch_fsmap learned FSMap version 37 2022-07-05T12:00:40.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55810a273cd0 con 0x55810a47cda0 2022-07-05T12:00:40.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25abfff700 1 -- 172.21.15.90:0/2311854737 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55810a47a690 con 0x55810a47cda0 2022-07-05T12:00:40.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25abfff700 1 -- 172.21.15.90:0/2311854737 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7f25c0014b60 con 0x55810a47cda0 2022-07-05T12:00:40.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 10 client.5886 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T12:00:40.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 10 client.5886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:00:40.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 20 client.5886 populate_metadata read hostname 'smithi090' 2022-07-05T12:00:40.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4b2bb0 0x55810a4f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 4 client.5886 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:00:40.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55810a3c87f0 con 0x55810a4b2bb0 2022-07-05T12:00:40.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.756+0000 7f25d5510700 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4b2bb0 0x55810a4f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.757+0000 7f25abfff700 10 client.5886 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:40.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.757+0000 7f25d5510700 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4b2bb0 0x55810a4f1080 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9f8fde40be53f101 server_cookie=aca70a8762af1ff5 in_seq=0 out_seq=0 2022-07-05T12:00:40.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25abfff700 1 -- 172.21.15.90:0/2311854737 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55810a3c87f0 con 0x55810a4b2bb0 2022-07-05T12:00:40.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25abfff700 10 client.5886 handle_command_reply: tid=0 2022-07-05T12:00:40.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 client.5886 shutdown 2022-07-05T12:00:40.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 msgr2=0x55810a501940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a501940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f25c0015790 tx=0x7f25c0017000).stop 2022-07-05T12:00:40.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 shutdown_connections 2022-07-05T12:00:40.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4b2bb0 0x55810a4f1080 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 0x55810a5021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a501940 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 --2- 172.21.15.90:0/2311854737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 >> 172.21.15.90:0/2311854737 conn(0x55810a2eb1c0 msgr2=0x55810a47fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:40.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25abfff700 0 client.5886 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:40.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 shutdown_connections 2022-07-05T12:00:40.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 1 -- 172.21.15.90:0/2311854737 wait complete. 2022-07-05T12:00:40.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.758+0000 7f25e9901b80 20 client.5886 trim_cache size 0 max 16384 2022-07-05T12:00:40.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.773+0000 7f25e9901b80 1 Processor -- start 2022-07-05T12:00:40.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.773+0000 7f25e9901b80 1 -- start start 2022-07-05T12:00:40.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.774+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a5021f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.774+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.774+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 0x55810a4c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.774+0000 7f25e9901b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a4f31a0 con 0x55810a47cda0 2022-07-05T12:00:40.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.774+0000 7f25e9901b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a4f1470 con 0x55810a4c0890 2022-07-05T12:00:40.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.774+0000 7f25e9901b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a4c7cf0 con 0x55810a4c04b0 2022-07-05T12:00:40.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a5021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a5021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59914/0 (socket says 172.21.15.90:59914) 2022-07-05T12:00:40.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 -- 172.21.15.90:0/182362117 learned_addr learned my addr 172.21.15.90:0/182362117 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:40.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5510700 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 -- 172.21.15.90:0/182362117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 msgr2=0x55810a4878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4878b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 -- 172.21.15.90:0/182362117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 msgr2=0x55810a4c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 0x55810a4c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:00:40.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 -- 172.21.15.90:0/182362117 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55810a241fd0 con 0x55810a47cda0 2022-07-05T12:00:40.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25d5d11700 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a5021f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f25c0009850 tx=0x7f25c0023000).ready entity=mon.0 client_cookie=ad3d272e5ebcddd5 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:40.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25b77fe700 1 -- 172.21.15.90:0/182362117 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0014690 con 0x55810a47cda0 2022-07-05T12:00:40.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25b77fe700 1 -- 172.21.15.90:0/182362117 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000f040 con 0x55810a47cda0 2022-07-05T12:00:40.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25b77fe700 1 -- 172.21.15.90:0/182362117 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000e620 con 0x55810a47cda0 2022-07-05T12:00:40.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25e9901b80 1 -- 172.21.15.90:0/182362117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 msgr2=0x55810a5021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25e9901b80 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a5021f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f25c0009850 tx=0x7f25c0023000).stop 2022-07-05T12:00:40.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25e9901b80 1 -- 172.21.15.90:0/182362117 shutdown_connections 2022-07-05T12:00:40.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25e9901b80 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c0890 0x55810a4c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:00:40.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25e9901b80 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a47cda0 0x55810a5021f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25e9901b80 1 --2- 172.21.15.90:0/182362117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a4c04b0 0x55810a4878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.775+0000 7f25e9901b80 1 -- 172.21.15.90:0/182362117 >> 172.21.15.90:0/182362117 conn(0x55810a2eb1c0 msgr2=0x55810a4efbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:40.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.776+0000 7f25e9901b80 1 -- 172.21.15.90:0/182362117 shutdown_connections 2022-07-05T12:00:40.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.776+0000 7f25e9901b80 1 -- 172.21.15.90:0/182362117 wait complete. 2022-07-05T12:00:40.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.776+0000 7f25e9901b80 1 -- start start 2022-07-05T12:00:40.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.776+0000 7f25e9901b80 1 Processor -- start 2022-07-05T12:00:40.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.777+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.777+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a5496e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.777+0000 7f25e9901b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.777+0000 7f25e9901b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a5573a0 con 0x55810a4c0890 2022-07-05T12:00:40.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.777+0000 7f25e9901b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a557800 con 0x55810a4c04b0 2022-07-05T12:00:40.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.777+0000 7f25e9901b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810a4b8a20 con 0x55810a47cda0 2022-07-05T12:00:40.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.777+0000 7f25e9901b80 10 client.0 ll_register_callbacks cb 0x55810a4cb360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:00:40.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4b9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59924/0 (socket says 172.21.15.90:59924) 2022-07-05T12:00:40.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d5d11700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 -- 172.21.15.90:0/1799319674 learned_addr learned my addr 172.21.15.90:0/1799319674 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:00:40.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d5510700 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a5496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 -- 172.21.15.90:0/1799319674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 msgr2=0x55810a4caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 -- 172.21.15.90:0/1799319674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 msgr2=0x55810a5496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:00:40.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a5496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 -- 172.21.15.90:0/1799319674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55810a273cd0 con 0x55810a4c0890 2022-07-05T12:00:40.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d5510700 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a5496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:00:40.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25d6512700 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4b9190 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f25c8086870 tx=0x55810a4cb930).ready entity=mon.0 client_cookie=b90f7c886b36a3f9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:00:40.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25abfff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:00:40.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25abfff700 1 -- 172.21.15.90:0/1799319674 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8091070 con 0x55810a4c0890 2022-07-05T12:00:40.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25abfff700 1 -- 172.21.15.90:0/1799319674 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f25c8057020 con 0x55810a4c0890 2022-07-05T12:00:40.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25c80b21d0 con 0x55810a4c0890 2022-07-05T12:00:40.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25abfff700 1 -- 172.21.15.90:0/1799319674 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c80b2040 con 0x55810a4c0890 2022-07-05T12:00:40.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 10 client.5892 fetch_fsmap learned FSMap version 37 2022-07-05T12:00:40.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55810a5018f0 con 0x55810a4c0890 2022-07-05T12:00:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25abfff700 1 -- 172.21.15.90:0/1799319674 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c80b21d0 con 0x55810a4c0890 2022-07-05T12:00:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25abfff700 1 -- 172.21.15.90:0/1799319674 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 37) v1 ==== 5837+0+0 (secure 0 0 0) 0x7f25c808c0d0 con 0x55810a4c0890 2022-07-05T12:00:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 10 client.5892 fetch_fsmap finished waiting for FSMap version 37 2022-07-05T12:00:40.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 10 client.5892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:00:40.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 20 client.5892 populate_metadata read hostname 'smithi090' 2022-07-05T12:00:40.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4c1460 0x55810a4bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:00:40.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 4 client.5892 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:00:40.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.778+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55810a3bf690 con 0x55810a4c1460 2022-07-05T12:00:40.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25d5d11700 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4c1460 0x55810a4bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:00:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25abfff700 10 client.5892 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25d5d11700 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4c1460 0x55810a4bf880 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=45d53dddce4d88c1 server_cookie=30db321dca028c16 in_seq=0 out_seq=0 2022-07-05T12:00:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25abfff700 1 -- 172.21.15.90:0/1799319674 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55810a3bf690 con 0x55810a4c1460 2022-07-05T12:00:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25abfff700 10 client.5892 handle_command_reply: tid=0 2022-07-05T12:00:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25e9901b80 1 client.5892 shutdown 2022-07-05T12:00:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 msgr2=0x55810a4b9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25e9901b80 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4b9190 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f25c8086870 tx=0x55810a4cb930).stop 2022-07-05T12:00:40.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 shutdown_connections 2022-07-05T12:00:40.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25e9901b80 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55810a4c1460 0x55810a4bf880 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25abfff700 0 client.5892 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:00:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.779+0000 7f25e9901b80 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55810a4c0890 0x55810a4b9190 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25e9901b80 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55810a47cda0 0x55810a4caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25e9901b80 1 --2- 172.21.15.90:0/1799319674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55810a4c04b0 0x55810a5496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 >> 172.21.15.90:0/1799319674 conn(0x55810a2eb1c0 msgr2=0x55810a4f32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:40.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 shutdown_connections 2022-07-05T12:00:40.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25e9901b80 1 -- 172.21.15.90:0/1799319674 wait complete. 2022-07-05T12:00:40.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25e9901b80 20 client.5892 trim_cache size 0 max 16384 2022-07-05T12:00:40.891 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:00:40.891 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:00:40.892 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:00:40.892 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:00:40.893 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:00:40.893 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:00:40.893 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:00:40.894 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:00:40.894 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:00:40.895 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:00:40.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f25b008ba10 msgr2=0x7f25b008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f25b008ba10 0x7f25b008ded0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f25c0009fd0 tx=0x7f25c000b040).stop 2022-07-05T12:00:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 msgr2=0x7f25d0191c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:00:40.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d0191c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f25d0062ce0 tx=0x7f25c8017000).stop 2022-07-05T12:00:40.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 shutdown_connections 2022-07-05T12:00:40.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f25b008ba10 0x7f25b008ded0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25d017e4b0 0x7f25d0191c40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25d00636f0 0x7f25d00c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 --2- 172.21.15.90:0/3704963958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25d017dcd0 0x7f25d0176c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:00:40.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 >> 172.21.15.90:0/3704963958 conn(0x7f25d00f5470 msgr2=0x7f25d017edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:00:40.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 shutdown_connections 2022-07-05T12:00:40.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:00:40.780+0000 7f25d6d13700 1 -- 172.21.15.90:0/3704963958 wait complete. 2022-07-05T12:00:40.904 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:00:41.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~116s 2022-07-05T12:00:41.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~116s 2022-07-05T12:00:41.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~124s 2022-07-05T12:00:49.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~124s 2022-07-05T12:00:49.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~124s 2022-07-05T12:00:49.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~132s 2022-07-05T12:00:57.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~131s 2022-07-05T12:00:57.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~131s 2022-07-05T12:00:57.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~139s 2022-07-05T12:01:05.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~139s 2022-07-05T12:01:05.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~139s 2022-07-05T12:01:05.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~147s 2022-07-05T12:01:10.906 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:01:11.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.036+0000 7fb90d83a700 1 Processor -- start 2022-07-05T12:01:11.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.037+0000 7fb90d83a700 1 -- start start 2022-07-05T12:01:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb90d83a700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb908178610 0x7fb9081789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb90d83a700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90817d560 con 0x7fb90817f3b0 2022-07-05T12:01:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb90d83a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90817f830 con 0x7fb90817e100 2022-07-05T12:01:11.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb90d83a700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90817c670 con 0x7fb908178610 2022-07-05T12:01:11.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb906ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb908178610 0x7fb9081789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb9067fc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb90817f3b0 0x7fb90817d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52884/0 (socket says 172.21.15.90:52884) 2022-07-05T12:01:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb9067fc700 1 -- 172.21.15.90:0/1713978455 learned_addr learned my addr 172.21.15.90:0/1713978455 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:01:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb906ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb908178610 0x7fb9081789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59940/0 (socket says 172.21.15.90:59940) 2022-07-05T12:01:11.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb906ffd700 1 -- 172.21.15.90:0/1713978455 >> v1:172.21.15.149:6789/0 conn(0x7fb90817e100 legacy=0x7fb908063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb906ffd700 1 -- 172.21.15.90:0/1713978455 >> v1:172.21.15.90:6789/0 conn(0x7fb90817f3b0 legacy=0x7fb90817d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb905ffb700 1 -- 172.21.15.90:0/1713978455 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985831795 0 0) 0x7fb90817d560 con 0x7fb90817f3b0 2022-07-05T12:01:11.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb906ffd700 1 -- 172.21.15.90:0/1713978455 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90817c950 con 0x7fb908178610 2022-07-05T12:01:11.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb906ffd700 1 --2- 172.21.15.90:0/1713978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb908178610 0x7fb9081789f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fb8f8009e60 tx=0x7fb8f8009780).ready entity=mon.0 client_cookie=274c0b5bc5cbc68e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:11.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb905ffb700 1 -- 172.21.15.90:0/1713978455 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800e070 con 0x7fb908178610 2022-07-05T12:01:11.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb905ffb700 1 -- 172.21.15.90:0/1713978455 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f800bc30 con 0x7fb908178610 2022-07-05T12:01:11.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.038+0000 7fb905ffb700 1 -- 172.21.15.90:0/1713978455 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8012410 con 0x7fb908178610 2022-07-05T12:01:11.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.039+0000 7fb90d83a700 1 -- 172.21.15.90:0/1713978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb908178610 msgr2=0x7fb9081789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.039+0000 7fb90d83a700 1 --2- 172.21.15.90:0/1713978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb908178610 0x7fb9081789f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fb8f8009e60 tx=0x7fb8f8009780).stop 2022-07-05T12:01:11.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.039+0000 7fb90d83a700 1 -- 172.21.15.90:0/1713978455 shutdown_connections 2022-07-05T12:01:11.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.039+0000 7fb90d83a700 1 --2- 172.21.15.90:0/1713978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb908178610 0x7fb9081789f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.039+0000 7fb90d83a700 1 -- 172.21.15.90:0/1713978455 >> 172.21.15.90:0/1713978455 conn(0x7fb9080f2210 msgr2=0x7fb908069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:11.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.039+0000 7fb90d83a700 1 -- 172.21.15.90:0/1713978455 shutdown_connections 2022-07-05T12:01:11.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.039+0000 7fb90d83a700 1 -- 172.21.15.90:0/1713978455 wait complete. 2022-07-05T12:01:11.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.040+0000 7fb90d83a700 1 Processor -- start 2022-07-05T12:01:11.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.040+0000 7fb90d83a700 1 -- start start 2022-07-05T12:01:11.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.041+0000 7fb90d83a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb908178610 0x7fb908190920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.041+0000 7fb90d83a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb90817e100 0x7fb908190e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.041+0000 7fb90d83a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90817f3b0 0x7fb908152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.041+0000 7fb90d83a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb908192800 con 0x7fb90817f3b0 2022-07-05T12:01:11.054 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.041+0000 7fb90d83a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb908192370 con 0x7fb908178610 2022-07-05T12:01:11.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.041+0000 7fb90d83a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb908182b90 con 0x7fb90817e100 2022-07-05T12:01:11.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90817f3b0 0x7fb908152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.055 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90817f3b0 0x7fb908152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59950/0 (socket says 172.21.15.90:59950) 2022-07-05T12:01:11.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9067fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb90817e100 0x7fb908190e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 -- 172.21.15.90:0/3036459664 learned_addr learned my addr 172.21.15.90:0/3036459664 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:11.056 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb906ffd700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb908178610 0x7fb908190920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 -- 172.21.15.90:0/3036459664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb90817e100 msgr2=0x7fb908190e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb90817e100 0x7fb908190e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.057 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 -- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb908178610 msgr2=0x7fb908190920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb908178610 0x7fb908190920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 -- 172.21.15.90:0/3036459664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8009a20 con 0x7fb90817f3b0 2022-07-05T12:01:11.058 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb9077fe700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90817f3b0 0x7fb908152b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fb90000c440 tx=0x7fb900007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:11.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb8feffd700 1 -- 172.21.15.90:0/3036459664 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900012400 con 0x7fb90817f3b0 2022-07-05T12:01:11.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb8feffd700 1 -- 172.21.15.90:0/3036459664 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900012560 con 0x7fb90817f3b0 2022-07-05T12:01:11.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb908191480 con 0x7fb90817f3b0 2022-07-05T12:01:11.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb8feffd700 1 -- 172.21.15.90:0/3036459664 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000128e0 con 0x7fb90817f3b0 2022-07-05T12:01:11.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.042+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb908191a40 con 0x7fb90817f3b0 2022-07-05T12:01:11.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.044+0000 7fb8feffd700 1 -- 172.21.15.90:0/3036459664 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb900010070 con 0x7fb90817f3b0 2022-07-05T12:01:11.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.045+0000 7fb8feffd700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb8ec08ba40 0x7fb8ec08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.045+0000 7fb8feffd700 1 -- 172.21.15.90:0/3036459664 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fb9000afc40 con 0x7fb90817f3b0 2022-07-05T12:01:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.045+0000 7fb906ffd700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb8ec08ba40 0x7fb8ec08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.045+0000 7fb906ffd700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb8ec08ba40 0x7fb8ec08df00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fb8f80094d0 tx=0x7fb90817d4d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.046+0000 7fb91f1c6b80 1 Processor -- start 2022-07-05T12:01:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.046+0000 7fb91f1c6b80 1 -- start start 2022-07-05T12:01:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624105fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624105fecb0 0x56241064c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106427a0 0x562410642c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624105c82d0 con 0x5624106427a0 2022-07-05T12:01:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241053faa0 con 0x5624105fecb0 2022-07-05T12:01:11.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562410554950 con 0x5624106423c0 2022-07-05T12:01:11.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb9077fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106427a0 0x562410642c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb9077fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106427a0 0x562410642c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59956/0 (socket says 172.21.15.90:59956) 2022-07-05T12:01:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb9077fe700 1 -- 172.21.15.90:0/2195110767 learned_addr learned my addr 172.21.15.90:0/2195110767 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.047+0000 7fb906ffd700 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624105fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb9077fe700 1 -- 172.21.15.90:0/2195110767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 msgr2=0x5624105fe7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb9077fe700 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624105fe7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb9077fe700 1 -- 172.21.15.90:0/2195110767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624105fecb0 msgr2=0x56241064c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb9077fe700 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624105fecb0 0x56241064c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:01:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb9077fe700 1 -- 172.21.15.90:0/2195110767 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624103869e0 con 0x5624106427a0 2022-07-05T12:01:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb9077fe700 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106427a0 0x562410642c20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fb9000845e0 tx=0x7fb9000843c0).ready entity=mon.0 client_cookie=c019f3c8cf4366fe server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb8e7fff700 1 -- 172.21.15.90:0/2195110767 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900082900 con 0x5624106427a0 2022-07-05T12:01:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb8e7fff700 1 -- 172.21.15.90:0/2195110767 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900080c70 con 0x5624106427a0 2022-07-05T12:01:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb8e7fff700 1 -- 172.21.15.90:0/2195110767 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900080de0 con 0x5624106427a0 2022-07-05T12:01:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2195110767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106427a0 msgr2=0x562410642c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.048+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106427a0 0x562410642c20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fb9000845e0 tx=0x7fb9000843c0).stop 2022-07-05T12:01:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2195110767 shutdown_connections 2022-07-05T12:01:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106427a0 0x562410642c20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624105fe7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2195110767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624105fecb0 0x56241064c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:01:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2195110767 >> 172.21.15.90:0/2195110767 conn(0x56241046d1c0 msgr2=0x562410601ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2195110767 shutdown_connections 2022-07-05T12:01:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2195110767 wait complete. 2022-07-05T12:01:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 -- start start 2022-07-05T12:01:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.049+0000 7fb91f1c6b80 1 Processor -- start 2022-07-05T12:01:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410637540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410673c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410680e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241051c120 con 0x5624106423c0 2022-07-05T12:01:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562410637a30 con 0x5624106427a0 2022-07-05T12:01:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624106726c0 con 0x5624105fecb0 2022-07-05T12:01:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 10 client.0 ll_register_callbacks cb 0x5624105c21b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:01:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410673c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410673c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59962/0 (socket says 172.21.15.90:59962) 2022-07-05T12:01:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 -- 172.21.15.90:0/618170922 learned_addr learned my addr 172.21.15.90:0/618170922 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb906ffd700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410637540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9077fe700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410680e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 -- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 msgr2=0x562410637540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410637540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 -- 172.21.15.90:0/618170922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 msgr2=0x562410680e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410680e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 -- 172.21.15.90:0/618170922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb908191a40 con 0x5624106423c0 2022-07-05T12:01:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9077fe700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410680e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:01:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb9067fc700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410673c50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fb8f0006ee0 tx=0x7fb8f0007db0).ready entity=mon.0 client_cookie=3d35c93e3787e9a7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb8e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:01:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb8e57fa700 1 -- 172.21.15.90:0/618170922 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0007190 con 0x5624106423c0 2022-07-05T12:01:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb8e57fa700 1 -- 172.21.15.90:0/618170922 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fb8f000fc60 con 0x5624106423c0 2022-07-05T12:01:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624105fc440 con 0x5624106423c0 2022-07-05T12:01:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb8e57fa700 1 -- 172.21.15.90:0/618170922 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8f0014450 con 0x5624106423c0 2022-07-05T12:01:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 10 client.5907 fetch_fsmap learned FSMap version 38 2022-07-05T12:01:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5624103f5cd0 con 0x5624106423c0 2022-07-05T12:01:11.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.051+0000 7fb8e57fa700 1 -- 172.21.15.90:0/618170922 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624105fc440 con 0x5624106423c0 2022-07-05T12:01:11.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb8e57fa700 1 -- 172.21.15.90:0/618170922 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 38) v1 ==== 5833+0+0 (secure 0 0 0) 0x7fb8f0012070 con 0x5624106423c0 2022-07-05T12:01:11.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb91f1c6b80 10 client.5907 fetch_fsmap finished waiting for FSMap version 38 2022-07-05T12:01:11.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb91f1c6b80 10 client.5907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:01:11.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb91f1c6b80 20 client.5907 populate_metadata read hostname 'smithi090' 2022-07-05T12:01:11.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562410609180 0x562410609560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb91f1c6b80 4 client.5907 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:01:11.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56241054a7f0 con 0x562410609180 2022-07-05T12:01:11.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb906ffd700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562410609180 0x562410609560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb8e57fa700 10 client.5907 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:11.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.052+0000 7fb906ffd700 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562410609180 0x562410609560 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=357c35368522ff6a server_cookie=4f72dc7ebe09d028 in_seq=0 out_seq=0 2022-07-05T12:01:11.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb8e57fa700 1 -- 172.21.15.90:0/618170922 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x56241054a7f0 con 0x562410609180 2022-07-05T12:01:11.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb8e57fa700 10 client.5907 handle_command_reply: tid=0 2022-07-05T12:01:11.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 client.5907 shutdown 2022-07-05T12:01:11.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 msgr2=0x562410673c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410673c50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fb8f0006ee0 tx=0x7fb8f0007db0).stop 2022-07-05T12:01:11.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 shutdown_connections 2022-07-05T12:01:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562410609180 0x562410609560 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410680e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410637540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/618170922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410673c50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb8e57fa700 0 client.5907 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 >> 172.21.15.90:0/618170922 conn(0x56241046d1c0 msgr2=0x562410601a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 shutdown_connections 2022-07-05T12:01:11.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/618170922 wait complete. 2022-07-05T12:01:11.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.053+0000 7fb91f1c6b80 20 client.5907 trim_cache size 0 max 16384 2022-07-05T12:01:11.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.069+0000 7fb91f1c6b80 1 Processor -- start 2022-07-05T12:01:11.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.069+0000 7fb91f1c6b80 1 -- start start 2022-07-05T12:01:11.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410601a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410637370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410609560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x562410637860 con 0x5624106423c0 2022-07-05T12:01:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562410601fd0 con 0x5624106427a0 2022-07-05T12:01:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562410672290 con 0x5624105fecb0 2022-07-05T12:01:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410637370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410637370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59972/0 (socket says 172.21.15.90:59972) 2022-07-05T12:01:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 -- 172.21.15.90:0/3084859099 learned_addr learned my addr 172.21.15.90:0/3084859099 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb906ffd700 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410601a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 -- 172.21.15.90:0/3084859099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 msgr2=0x562410601a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410601a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 -- 172.21.15.90:0/3084859099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 msgr2=0x562410609560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9077fe700 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410609560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410609560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 -- 172.21.15.90:0/3084859099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624103c3fd0 con 0x5624106423c0 2022-07-05T12:01:11.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.070+0000 7fb9067fc700 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410637370 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fb8f0013430 tx=0x7fb8f0017000).ready entity=mon.0 client_cookie=164957c5f91e09bf server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:11.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb8fcff9700 1 -- 172.21.15.90:0/3084859099 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f000fc60 con 0x5624106423c0 2022-07-05T12:01:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb8fcff9700 1 -- 172.21.15.90:0/3084859099 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0007a20 con 0x5624106423c0 2022-07-05T12:01:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb8fcff9700 1 -- 172.21.15.90:0/3084859099 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0000bc0 con 0x5624106423c0 2022-07-05T12:01:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/3084859099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 msgr2=0x562410637370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410637370 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fb8f0013430 tx=0x7fb8f0017000).stop 2022-07-05T12:01:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/3084859099 shutdown_connections 2022-07-05T12:01:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x562410609560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624105fecb0 0x562410601a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/3084859099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624106423c0 0x562410637370 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/3084859099 >> 172.21.15.90:0/3084859099 conn(0x56241046d1c0 msgr2=0x56241063e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/3084859099 shutdown_connections 2022-07-05T12:01:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.071+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/3084859099 wait complete. 2022-07-05T12:01:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.072+0000 7fb91f1c6b80 1 -- start start 2022-07-05T12:01:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.072+0000 7fb91f1c6b80 1 Processor -- start 2022-07-05T12:01:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624105fecb0 0x5624106c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624106c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb91f1c6b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x5624106c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624106cbe10 con 0x5624105fecb0 2022-07-05T12:01:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624106cbfb0 con 0x5624106427a0 2022-07-05T12:01:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb91f1c6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624106c5f00 con 0x5624106423c0 2022-07-05T12:01:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb91f1c6b80 10 client.0 ll_register_callbacks cb 0x5624105c21b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:01:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624105fecb0 0x5624106c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624105fecb0 0x5624106c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59974/0 (socket says 172.21.15.90:59974) 2022-07-05T12:01:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 -- 172.21.15.90:0/2393405659 learned_addr learned my addr 172.21.15.90:0/2393405659 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb9067fc700 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624106c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 -- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 msgr2=0x5624106c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624106c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 -- 172.21.15.90:0/2393405659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 msgr2=0x5624106c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x5624106c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:01:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.073+0000 7fb906ffd700 1 -- 172.21.15.90:0/2393405659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f000f040 con 0x5624105fecb0 2022-07-05T12:01:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb906ffd700 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624105fecb0 0x5624106c5a10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb8f800b6c0 tx=0x7fb8f8030280).ready entity=mon.0 client_cookie=88208a6b003f1b1b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb8e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:01:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb8e57fa700 1 -- 172.21.15.90:0/2393405659 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f802f040 con 0x5624105fecb0 2022-07-05T12:01:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb8e57fa700 1 -- 172.21.15.90:0/2393405659 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fb8f802a810 con 0x5624105fecb0 2022-07-05T12:01:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb900080c70 con 0x5624105fecb0 2022-07-05T12:01:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb8e57fa700 1 -- 172.21.15.90:0/2393405659 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8f802abe0 con 0x5624105fecb0 2022-07-05T12:01:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 10 client.5913 fetch_fsmap learned FSMap version 38 2022-07-05T12:01:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5624106d9cb0 con 0x5624105fecb0 2022-07-05T12:01:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb8e57fa700 1 -- 172.21.15.90:0/2393405659 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900080c70 con 0x5624105fecb0 2022-07-05T12:01:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb8e57fa700 1 -- 172.21.15.90:0/2393405659 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 38) v1 ==== 5833+0+0 (secure 0 0 0) 0x7fb8f8034b60 con 0x5624105fecb0 2022-07-05T12:01:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 10 client.5913 fetch_fsmap finished waiting for FSMap version 38 2022-07-05T12:01:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 10 client.5913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:01:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 20 client.5913 populate_metadata read hostname 'smithi090' 2022-07-05T12:01:11.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5624106d6ad0 0x562410636b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:11.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 4 client.5913 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:01:11.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562410541690 con 0x5624106d6ad0 2022-07-05T12:01:11.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.074+0000 7fb9067fc700 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5624106d6ad0 0x562410636b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:11.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb8e57fa700 10 client.5913 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:11.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb9067fc700 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5624106d6ad0 0x562410636b40 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6793d8cc18aec175 server_cookie=74e035c184534e90 in_seq=0 out_seq=0 2022-07-05T12:01:11.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb8e57fa700 1 -- 172.21.15.90:0/2393405659 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562410541690 con 0x5624106d6ad0 2022-07-05T12:01:11.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb8e57fa700 10 client.5913 handle_command_reply: tid=0 2022-07-05T12:01:11.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 client.5913 shutdown 2022-07-05T12:01:11.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624105fecb0 msgr2=0x5624106c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624105fecb0 0x5624106c5a10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb8f800b6c0 tx=0x7fb8f8030280).stop 2022-07-05T12:01:11.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 shutdown_connections 2022-07-05T12:01:11.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5624106d6ad0 0x562410636b40 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624106427a0 0x5624106c1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:01:11.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb8e57fa700 0 client.5913 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:11.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5624105fecb0 0x5624106c5a10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 --2- 172.21.15.90:0/2393405659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5624106423c0 0x5624106c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 >> 172.21.15.90:0/2393405659 conn(0x56241046d1c0 msgr2=0x56241067fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 shutdown_connections 2022-07-05T12:01:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 1 -- 172.21.15.90:0/2393405659 wait complete. 2022-07-05T12:01:11.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.075+0000 7fb91f1c6b80 20 client.5913 trim_cache size 0 max 16384 2022-07-05T12:01:11.153 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:01:11.154 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:01:11.154 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:01:11.154 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:01:11.155 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:01:11.155 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:01:11.155 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:01:11.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:01:11.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:01:11.156 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:01:11.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb8ec08ba40 msgr2=0x7fb8ec08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb8ec08ba40 0x7fb8ec08df00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fb8f80094d0 tx=0x7fb90817d4d0).stop 2022-07-05T12:01:11.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90817f3b0 msgr2=0x7fb908152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:11.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90817f3b0 0x7fb908152b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fb90000c440 tx=0x7fb900007d70).stop 2022-07-05T12:01:11.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 shutdown_connections 2022-07-05T12:01:11.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb8ec08ba40 0x7fb8ec08df00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90817f3b0 0x7fb908152b50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb908178610 0x7fb908190920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 --2- 172.21.15.90:0/3036459664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb90817e100 0x7fb908190e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:11.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 >> 172.21.15.90:0/3036459664 conn(0x7fb9080f2210 msgr2=0x7fb9080ebfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:11.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 shutdown_connections 2022-07-05T12:01:11.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:11.076+0000 7fb90d83a700 1 -- 172.21.15.90:0/3036459664 wait complete. 2022-07-05T12:01:11.164 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:01:12.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~147s 2022-07-05T12:01:12.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~147s 2022-07-05T12:01:12.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~155s 2022-07-05T12:01:20.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~155s 2022-07-05T12:01:20.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~155s 2022-07-05T12:01:20.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~163s 2022-07-05T12:01:28.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~162s 2022-07-05T12:01:28.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~162s 2022-07-05T12:01:28.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~170s 2022-07-05T12:01:35.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~170s 2022-07-05T12:01:35.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~170s 2022-07-05T12:01:35.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~178s 2022-07-05T12:01:41.166 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:01:41.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.291+0000 7f71a7cb0700 1 Processor -- start 2022-07-05T12:01:41.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.291+0000 7f71a7cb0700 1 -- start start 2022-07-05T12:01:41.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a7cb0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f71a0178610 0x7f71a01789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a7cb0700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71a017e100 0x7f71a0063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a7cb0700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a017d560 con 0x7f71a017f3b0 2022-07-05T12:01:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a7cb0700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a017f830 con 0x7f71a0178610 2022-07-05T12:01:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a7cb0700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a017c670 con 0x7f71a017e100 2022-07-05T12:01:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a5a4c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f71a0178610 0x7f71a01789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a524b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f71a017f3b0 0x7f71a017d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52922/0 (socket says 172.21.15.90:52922) 2022-07-05T12:01:41.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.292+0000 7f71a524b700 1 -- 172.21.15.90:0/4156001010 learned_addr learned my addr 172.21.15.90:0/4156001010 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:01:41.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a624d700 1 --2- 172.21.15.90:0/4156001010 >> v2:172.21.15.110:3300/0 conn(0x7f71a017e100 0x7f71a0063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a5a4c700 1 -- 172.21.15.90:0/4156001010 >> v2:172.21.15.110:3300/0 conn(0x7f71a017e100 msgr2=0x7f71a0063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/4156001010 >> v2:172.21.15.110:3300/0 conn(0x7f71a017e100 0x7f71a0063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a5a4c700 1 -- 172.21.15.90:0/4156001010 >> v1:172.21.15.90:6789/0 conn(0x7f71a017f3b0 legacy=0x7f71a017d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a5a4c700 1 -- 172.21.15.90:0/4156001010 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a017c950 con 0x7f71a0178610 2022-07-05T12:01:41.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a4a4a700 1 -- 172.21.15.90:0/4156001010 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248168867 0 0) 0x7f71a017d560 con 0x7f71a017f3b0 2022-07-05T12:01:41.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/4156001010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a0178610 0x7f71a01789f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f71a017c480 tx=0x7f719c009060).ready entity=mon.0 client_cookie=780441abded7c312 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:41.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a4a4a700 1 -- 172.21.15.90:0/4156001010 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0090d0 con 0x7f71a0178610 2022-07-05T12:01:41.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a4a4a700 1 -- 172.21.15.90:0/4156001010 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00b580 con 0x7f71a0178610 2022-07-05T12:01:41.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a4a4a700 1 -- 172.21.15.90:0/4156001010 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00b900 con 0x7f71a0178610 2022-07-05T12:01:41.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a7cb0700 1 -- 172.21.15.90:0/4156001010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a0178610 msgr2=0x7f71a01789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.293+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/4156001010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a0178610 0x7f71a01789f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f71a017c480 tx=0x7f719c009060).stop 2022-07-05T12:01:41.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.294+0000 7f71a7cb0700 1 -- 172.21.15.90:0/4156001010 shutdown_connections 2022-07-05T12:01:41.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.294+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/4156001010 >> v2:172.21.15.110:3300/0 conn(0x7f71a017e100 0x7f71a0063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.294+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/4156001010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a0178610 0x7f71a01789f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.294+0000 7f71a7cb0700 1 -- 172.21.15.90:0/4156001010 >> 172.21.15.90:0/4156001010 conn(0x7f71a00f2210 msgr2=0x7f71a0069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:41.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.294+0000 7f71a7cb0700 1 -- 172.21.15.90:0/4156001010 shutdown_connections 2022-07-05T12:01:41.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.294+0000 7f71a7cb0700 1 -- 172.21.15.90:0/4156001010 wait complete. 2022-07-05T12:01:41.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.295+0000 7f71a7cb0700 1 Processor -- start 2022-07-05T12:01:41.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.295+0000 7f71a7cb0700 1 -- start start 2022-07-05T12:01:41.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a7cb0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71a0178610 0x7f71a0171640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a7cb0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a017e100 0x7f71a0192820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a7cb0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a017f3b0 0x7f71a0192d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a7cb0700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0179fe0 con 0x7f71a017e100 2022-07-05T12:01:41.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a7cb0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0181980 con 0x7f71a0178610 2022-07-05T12:01:41.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a7cb0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0193200 con 0x7f71a017f3b0 2022-07-05T12:01:41.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a524b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a017e100 0x7f71a0192820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a524b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a017e100 0x7f71a0192820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59984/0 (socket says 172.21.15.90:59984) 2022-07-05T12:01:41.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a524b700 1 -- 172.21.15.90:0/1916145898 learned_addr learned my addr 172.21.15.90:0/1916145898 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:41.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a624d700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a017f3b0 0x7f71a0192d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.296+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71a0178610 0x7f71a0171640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a524b700 1 -- 172.21.15.90:0/1916145898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a017f3b0 msgr2=0x7f71a0192d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a524b700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a017f3b0 0x7f71a0192d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a524b700 1 -- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71a0178610 msgr2=0x7f71a0171640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a524b700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71a0178610 0x7f71a0171640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a524b700 1 -- 172.21.15.90:0/1916145898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0092a0 con 0x7f71a017e100 2022-07-05T12:01:41.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a624d700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a017f3b0 0x7f71a0192d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:01:41.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a524b700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a017e100 0x7f71a0192820 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f719000c490 tx=0x7f7190007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:41.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f718dffb700 1 -- 172.21.15.90:0/1916145898 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900072e0 con 0x7f71a017e100 2022-07-05T12:01:41.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f718dffb700 1 -- 172.21.15.90:0/1916145898 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190007460 con 0x7f71a017e100 2022-07-05T12:01:41.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a01790f0 con 0x7f71a017e100 2022-07-05T12:01:41.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f718dffb700 1 -- 172.21.15.90:0/1916145898 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900059f0 con 0x7f71a017e100 2022-07-05T12:01:41.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.297+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a01796b0 con 0x7f71a017e100 2022-07-05T12:01:41.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.299+0000 7f718dffb700 1 -- 172.21.15.90:0/1916145898 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f719001a060 con 0x7f71a017e100 2022-07-05T12:01:41.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.299+0000 7f718dffb700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f718008ba40 0x7f718008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.300+0000 7f718dffb700 1 -- 172.21.15.90:0/1916145898 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f71900affc0 con 0x7f71a017e100 2022-07-05T12:01:41.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.300+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f718008ba40 0x7f718008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.300+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f718008ba40 0x7f718008df00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f719c00b340 tx=0x7f719c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:41.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.301+0000 7f71b963cb80 1 Processor -- start 2022-07-05T12:01:41.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.301+0000 7f71b963cb80 1 -- start start 2022-07-05T12:01:41.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1f7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed7a0 0x55a36a1edc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71b963cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a1732d0 con 0x55a36a1ed7a0 2022-07-05T12:01:41.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71b963cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a0eaaa0 con 0x55a36a1ed3c0 2022-07-05T12:01:41.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71b963cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a0ff950 con 0x55a36a1a9cb0 2022-07-05T12:01:41.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71a624d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed7a0 0x55a36a1edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71a624d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed7a0 0x55a36a1edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59996/0 (socket says 172.21.15.90:59996) 2022-07-05T12:01:41.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71a624d700 1 -- 172.21.15.90:0/1820041492 learned_addr learned my addr 172.21.15.90:0/1820041492 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:41.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.302+0000 7f71a524b700 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71a624d700 1 -- 172.21.15.90:0/1820041492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 msgr2=0x55a36a1f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71a624d700 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71a624d700 1 -- 172.21.15.90:0/1820041492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 msgr2=0x55a36a1a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71a624d700 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71a624d700 1 -- 172.21.15.90:0/1820041492 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a369f319e0 con 0x55a36a1ed7a0 2022-07-05T12:01:41.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71a624d700 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed7a0 0x55a36a1edc20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f71980074a0 tx=0x7f719800b040).ready entity=mon.0 client_cookie=fe71a905365c8339 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:41.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f7186ffd700 1 -- 172.21.15.90:0/1820041492 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980124e0 con 0x55a36a1ed7a0 2022-07-05T12:01:41.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f7186ffd700 1 -- 172.21.15.90:0/1820041492 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719800f030 con 0x55a36a1ed7a0 2022-07-05T12:01:41.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f7186ffd700 1 -- 172.21.15.90:0/1820041492 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198012850 con 0x55a36a1ed7a0 2022-07-05T12:01:41.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71b963cb80 1 -- 172.21.15.90:0/1820041492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed7a0 msgr2=0x55a36a1edc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.303+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed7a0 0x55a36a1edc20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f71980074a0 tx=0x7f719800b040).stop 2022-07-05T12:01:41.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 -- 172.21.15.90:0/1820041492 shutdown_connections 2022-07-05T12:01:41.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed7a0 0x55a36a1edc20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1820041492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 -- 172.21.15.90:0/1820041492 >> 172.21.15.90:0/1820041492 conn(0x55a36a0181c0 msgr2=0x55a36a1acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 -- 172.21.15.90:0/1820041492 shutdown_connections 2022-07-05T12:01:41.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 -- 172.21.15.90:0/1820041492 wait complete. 2022-07-05T12:01:41.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 -- start start 2022-07-05T12:01:41.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.304+0000 7f71b963cb80 1 Processor -- start 2022-07-05T12:01:41.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1a9cb0 0x55a36a1e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed3c0 0x55a36a1e2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed7a0 0x55a36a1ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a0c7120 con 0x55a36a1ed3c0 2022-07-05T12:01:41.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a1e8e50 con 0x55a36a1a9cb0 2022-07-05T12:01:41.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a1e7cf0 con 0x55a36a1ed7a0 2022-07-05T12:01:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 10 client.0 ll_register_callbacks cb 0x55a36a16d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:01:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed3c0 0x55a36a1e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed3c0 0x55a36a1e2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60000/0 (socket says 172.21.15.90:60000) 2022-07-05T12:01:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 -- 172.21.15.90:0/3442047378 learned_addr learned my addr 172.21.15.90:0/3442047378 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a624d700 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed7a0 0x55a36a1ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1a9cb0 0x55a36a1e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 -- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed7a0 msgr2=0x55a36a1ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed7a0 0x55a36a1ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 -- 172.21.15.90:0/3442047378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1a9cb0 msgr2=0x55a36a1e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1a9cb0 0x55a36a1e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 -- 172.21.15.90:0/3442047378 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7198009d30 con 0x55a36a1ed3c0 2022-07-05T12:01:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71a524b700 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed3c0 0x55a36a1e2570 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7190080de0 tx=0x7f719000cef0).ready entity=mon.0 client_cookie=3e0cfa0113afcbe2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:41.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f717bfff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:01:41.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f717bfff700 1 -- 172.21.15.90:0/3442047378 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719008e070 con 0x55a36a1ed3c0 2022-07-05T12:01:41.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f717bfff700 1 -- 172.21.15.90:0/3442047378 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f7190005e20 con 0x55a36a1ed3c0 2022-07-05T12:01:41.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a36a1a7440 con 0x55a36a1ed3c0 2022-07-05T12:01:41.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f717bfff700 1 -- 172.21.15.90:0/3442047378 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f719008a1c0 con 0x55a36a1ed3c0 2022-07-05T12:01:41.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 10 client.5928 fetch_fsmap learned FSMap version 38 2022-07-05T12:01:41.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.306+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55a369fa0cd0 con 0x55a36a1ed3c0 2022-07-05T12:01:41.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f717bfff700 1 -- 172.21.15.90:0/3442047378 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a36a1a7440 con 0x55a36a1ed3c0 2022-07-05T12:01:41.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f717bfff700 1 -- 172.21.15.90:0/3442047378 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 38) v1 ==== 5833+0+0 (secure 0 0 0) 0x7f7190091030 con 0x55a36a1ed3c0 2022-07-05T12:01:41.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71b963cb80 10 client.5928 fetch_fsmap finished waiting for FSMap version 38 2022-07-05T12:01:41.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71b963cb80 10 client.5928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:01:41.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71b963cb80 20 client.5928 populate_metadata read hostname 'smithi090' 2022-07-05T12:01:41.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71b963cb80 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71b963cb80 4 client.5928 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:01:41.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a36a0f57f0 con 0x55a36a1eb670 2022-07-05T12:01:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f717bfff700 10 client.5928 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.307+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1eb670 0x55a36a220190 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=dda0450113a72ac2 server_cookie=7d9921d42a954e01 in_seq=0 out_seq=0 2022-07-05T12:01:41.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f717bfff700 1 -- 172.21.15.90:0/3442047378 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55a36a0f57f0 con 0x55a36a1eb670 2022-07-05T12:01:41.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f717bfff700 10 client.5928 handle_command_reply: tid=0 2022-07-05T12:01:41.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 client.5928 shutdown 2022-07-05T12:01:41.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed3c0 msgr2=0x55a36a1e2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed3c0 0x55a36a1e2570 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7190080de0 tx=0x7f719000cef0).stop 2022-07-05T12:01:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 shutdown_connections 2022-07-05T12:01:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1eb670 0x55a36a220190 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed7a0 0x55a36a1ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f717bfff700 0 client.5928 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1a9cb0 0x55a36a1e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 --2- 172.21.15.90:0/3442047378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1ed3c0 0x55a36a1e2570 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 >> 172.21.15.90:0/3442047378 conn(0x55a36a0181c0 msgr2=0x55a36a21a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:41.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 shutdown_connections 2022-07-05T12:01:41.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.308+0000 7f71b963cb80 1 -- 172.21.15.90:0/3442047378 wait complete. 2022-07-05T12:01:41.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.309+0000 7f71b963cb80 20 client.5928 trim_cache size 0 max 16384 2022-07-05T12:01:41.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.324+0000 7f71b963cb80 1 Processor -- start 2022-07-05T12:01:41.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.324+0000 7f71b963cb80 1 -- start start 2022-07-05T12:01:41.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1f4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71b963cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a21ef90 con 0x55a36a1eb670 2022-07-05T12:01:41.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71b963cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a1eae70 con 0x55a36a1ed3c0 2022-07-05T12:01:41.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71b963cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a1a1730 con 0x55a36a1a9cb0 2022-07-05T12:01:41.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60010/0 (socket says 172.21.15.90:60010) 2022-07-05T12:01:41.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 -- 172.21.15.90:0/1712496577 learned_addr learned my addr 172.21.15.90:0/1712496577 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:41.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 -- 172.21.15.90:0/1712496577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 msgr2=0x55a36a1ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a624d700 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 -- 172.21.15.90:0/1712496577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 msgr2=0x55a36a1f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.325+0000 7f71a524b700 1 -- 172.21.15.90:0/1712496577 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a369f6efd0 con 0x55a36a1eb670 2022-07-05T12:01:41.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:01:41.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71a624d700 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:01:41.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71a524b700 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1eb670 0x55a36a220190 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f71900b0260 tx=0x7f719008e000).ready entity=mon.0 client_cookie=f6ae9c47a875d3fc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:41.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71877fe700 1 -- 172.21.15.90:0/1712496577 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719008a1c0 con 0x55a36a1eb670 2022-07-05T12:01:41.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71877fe700 1 -- 172.21.15.90:0/1712496577 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71900075d0 con 0x55a36a1eb670 2022-07-05T12:01:41.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71877fe700 1 -- 172.21.15.90:0/1712496577 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190005bf0 con 0x55a36a1eb670 2022-07-05T12:01:41.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 -- 172.21.15.90:0/1712496577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1eb670 msgr2=0x55a36a220190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1eb670 0x55a36a220190 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f71900b0260 tx=0x7f719008e000).stop 2022-07-05T12:01:41.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 -- 172.21.15.90:0/1712496577 shutdown_connections 2022-07-05T12:01:41.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1ed3c0 0x55a36a1f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1a9cb0 0x55a36a1ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1712496577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 -- 172.21.15.90:0/1712496577 >> 172.21.15.90:0/1712496577 conn(0x55a36a0181c0 msgr2=0x55a36a1f7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:41.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 -- 172.21.15.90:0/1712496577 shutdown_connections 2022-07-05T12:01:41.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.326+0000 7f71b963cb80 1 -- 172.21.15.90:0/1712496577 wait complete. 2022-07-05T12:01:41.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.327+0000 7f71b963cb80 1 -- start start 2022-07-05T12:01:41.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.327+0000 7f71b963cb80 1 Processor -- start 2022-07-05T12:01:41.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1a9cb0 0x55a36a1b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71b963cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed3c0 0x55a36a1ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71b963cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a1ea810 con 0x55a36a1a9cb0 2022-07-05T12:01:41.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71b963cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a2817c0 con 0x55a36a1eb670 2022-07-05T12:01:41.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71b963cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a36a284c50 con 0x55a36a1ed3c0 2022-07-05T12:01:41.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71b963cb80 10 client.0 ll_register_callbacks cb 0x55a36a16d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:01:41.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1a9cb0 0x55a36a1b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1a9cb0 0x55a36a1b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60012/0 (socket says 172.21.15.90:60012) 2022-07-05T12:01:41.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 -- 172.21.15.90:0/1144048890 learned_addr learned my addr 172.21.15.90:0/1144048890 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:01:41.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a624d700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed3c0 0x55a36a1ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a524b700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 -- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed3c0 msgr2=0x55a36a1ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed3c0 0x55a36a1ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 -- 172.21.15.90:0/1144048890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1eb670 msgr2=0x55a36a220190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:01:41.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.328+0000 7f71a5a4c700 1 -- 172.21.15.90:0/1144048890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a369fa0cd0 con 0x55a36a1a9cb0 2022-07-05T12:01:41.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71a524b700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:01:41.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71a624d700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed3c0 0x55a36a1ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:01:41.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71a5a4c700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1a9cb0 0x55a36a1b42a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f719c011000 tx=0x7f719c02f280).ready entity=mon.0 client_cookie=24ab637f4d75689f server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:01:41.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f717bfff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:01:41.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f717bfff700 1 -- 172.21.15.90:0/1144048890 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c02e070 con 0x55a36a1a9cb0 2022-07-05T12:01:41.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f717bfff700 1 -- 172.21.15.90:0/1144048890 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f719c006ad0 con 0x55a36a1a9cb0 2022-07-05T12:01:41.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f719800f030 con 0x55a36a1a9cb0 2022-07-05T12:01:41.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f717bfff700 1 -- 172.21.15.90:0/1144048890 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f719c01c630 con 0x55a36a1a9cb0 2022-07-05T12:01:41.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 10 client.5934 fetch_fsmap learned FSMap version 38 2022-07-05T12:01:41.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55a36a284320 con 0x55a36a1a9cb0 2022-07-05T12:01:41.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f717bfff700 1 -- 172.21.15.90:0/1144048890 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719800f030 con 0x55a36a1a9cb0 2022-07-05T12:01:41.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f717bfff700 1 -- 172.21.15.90:0/1144048890 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 38) v1 ==== 5833+0+0 (secure 0 0 0) 0x7f719c01c790 con 0x55a36a1a9cb0 2022-07-05T12:01:41.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 10 client.5934 fetch_fsmap finished waiting for FSMap version 38 2022-07-05T12:01:41.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 10 client.5934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:01:41.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 20 client.5934 populate_metadata read hostname 'smithi090' 2022-07-05T12:01:41.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1ed7a0 0x55a36a1f7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:01:41.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 4 client.5934 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:01:41.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a36a0ec690 con 0x55a36a1ed7a0 2022-07-05T12:01:41.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.329+0000 7f71a524b700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1ed7a0 0x55a36a1f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:01:41.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f717bfff700 10 client.5934 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:41.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71a524b700 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1ed7a0 0x55a36a1f7940 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f0d1ffa61289a124 server_cookie=980502d381e7731d in_seq=0 out_seq=0 2022-07-05T12:01:41.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f717bfff700 1 -- 172.21.15.90:0/1144048890 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a36a0ec690 con 0x55a36a1ed7a0 2022-07-05T12:01:41.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f717bfff700 10 client.5934 handle_command_reply: tid=0 2022-07-05T12:01:41.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 client.5934 shutdown 2022-07-05T12:01:41.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1a9cb0 msgr2=0x55a36a1b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1a9cb0 0x55a36a1b42a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f719c011000 tx=0x7f719c02f280).stop 2022-07-05T12:01:41.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 shutdown_connections 2022-07-05T12:01:41.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a36a1ed7a0 0x55a36a1f7940 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a36a1ed3c0 0x55a36a1ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a36a1a9cb0 0x55a36a1b42a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f717bfff700 0 client.5934 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:01:41.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 --2- 172.21.15.90:0/1144048890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a36a1eb670 0x55a36a220190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 >> 172.21.15.90:0/1144048890 conn(0x55a36a0181c0 msgr2=0x55a36a1f4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:41.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 shutdown_connections 2022-07-05T12:01:41.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 1 -- 172.21.15.90:0/1144048890 wait complete. 2022-07-05T12:01:41.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.330+0000 7f71b963cb80 20 client.5934 trim_cache size 0 max 16384 2022-07-05T12:01:41.394 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:01:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:01:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:01:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:01:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:01:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:01:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:01:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:01:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:01:41.397 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:01:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f718008ba40 msgr2=0x7f718008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f718008ba40 0x7f718008df00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f719c00b340 tx=0x7f719c017000).stop 2022-07-05T12:01:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a017e100 msgr2=0x7f71a0192820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:01:41.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a017e100 0x7f71a0192820 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f719000c490 tx=0x7f7190007e40).stop 2022-07-05T12:01:41.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 shutdown_connections 2022-07-05T12:01:41.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f718008ba40 0x7f718008df00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a017f3b0 0x7f71a0192d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71a0178610 0x7f71a0171640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 --2- 172.21.15.90:0/1916145898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a017e100 0x7f71a0192820 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:01:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 >> 172.21.15.90:0/1916145898 conn(0x7f71a00f2210 msgr2=0x7f71a0061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:01:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 shutdown_connections 2022-07-05T12:01:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:01:41.331+0000 7f71a7cb0700 1 -- 172.21.15.90:0/1916145898 wait complete. 2022-07-05T12:01:41.407 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:01:43.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~178s 2022-07-05T12:01:43.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~178s 2022-07-05T12:01:43.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~186s 2022-07-05T12:01:51.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~186s 2022-07-05T12:01:51.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~186s 2022-07-05T12:01:51.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~194s 2022-07-05T12:01:59.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~193s 2022-07-05T12:01:59.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~193s 2022-07-05T12:01:59.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~201s 2022-07-05T12:02:06.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~201s 2022-07-05T12:02:06.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~201s 2022-07-05T12:02:06.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~209s 2022-07-05T12:02:11.409 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:02:11.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.539+0000 7f6ea20ae700 1 Processor -- start 2022-07-05T12:02:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.539+0000 7f6ea20ae700 1 -- start start 2022-07-05T12:02:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6ea20ae700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e9c1789f0 0x7f6e9c17f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6ea20ae700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6e9c17e100 0x7f6e9c063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6ea20ae700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c17d560 con 0x7f6e9c178610 2022-07-05T12:02:11.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6ea20ae700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c17f8a0 con 0x7f6e9c17e100 2022-07-05T12:02:11.549 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6ea20ae700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c17c670 con 0x7f6e9c1789f0 2022-07-05T12:02:11.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6e9b7fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6e9c178610 0x7f6e9c17d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52960/0 (socket says 172.21.15.90:52960) 2022-07-05T12:02:11.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/597132018 learned_addr learned my addr 172.21.15.90:0/597132018 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:02:11.550 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/597132018 >> v2:172.21.15.149:3300/0 conn(0x7f6e9c1789f0 0x7f6e9c17f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6e9bfff700 1 --2- 172.21.15.90:0/597132018 >> v2:172.21.15.110:3300/0 conn(0x7f6e9c17e100 0x7f6e9c063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6e9affd700 1 -- 172.21.15.90:0/597132018 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184135398 0 0) 0x7f6e9c17d560 con 0x7f6e9c178610 2022-07-05T12:02:11.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.540+0000 7f6e9affd700 1 -- 172.21.15.90:0/597132018 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e7c0033f0 con 0x7f6e9c178610 2022-07-05T12:02:11.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e92ffd700 1 -- 172.21.15.90:0/597132018 >> v2:172.21.15.110:3300/0 conn(0x7f6e9c17e100 msgr2=0x7f6e9c063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/597132018 >> v2:172.21.15.110:3300/0 conn(0x7f6e9c17e100 0x7f6e9c063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e9affd700 1 -- 172.21.15.90:0/597132018 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921396510 0 0) 0x7f6e7c0033f0 con 0x7f6e9c178610 2022-07-05T12:02:11.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e92ffd700 1 -- 172.21.15.90:0/597132018 >> v1:172.21.15.90:6789/0 conn(0x7f6e9c178610 legacy=0x7f6e9c17d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e92ffd700 1 -- 172.21.15.90:0/597132018 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c17c950 con 0x7f6e9c1789f0 2022-07-05T12:02:11.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/597132018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 0x7f6e9c17f3b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6e9c05ff10 tx=0x7f6e84009060).ready entity=mon.2 client_cookie=aec0b89da230b678 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:11.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e9affd700 1 -- 172.21.15.90:0/597132018 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c001470 con 0x7f6e9c1789f0 2022-07-05T12:02:11.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e9affd700 1 -- 172.21.15.90:0/597132018 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84011400 con 0x7f6e9c1789f0 2022-07-05T12:02:11.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6e9affd700 1 -- 172.21.15.90:0/597132018 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84011780 con 0x7f6e9c1789f0 2022-07-05T12:02:11.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6ea20ae700 1 -- 172.21.15.90:0/597132018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 msgr2=0x7f6e9c17f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/597132018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 0x7f6e9c17f3b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6e9c05ff10 tx=0x7f6e84009060).stop 2022-07-05T12:02:11.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6ea20ae700 1 -- 172.21.15.90:0/597132018 shutdown_connections 2022-07-05T12:02:11.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/597132018 >> v2:172.21.15.110:3300/0 conn(0x7f6e9c17e100 0x7f6e9c063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/597132018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 0x7f6e9c17f3b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.541+0000 7f6ea20ae700 1 -- 172.21.15.90:0/597132018 >> 172.21.15.90:0/597132018 conn(0x7f6e9c0f2210 msgr2=0x7f6e9c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:11.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.542+0000 7f6ea20ae700 1 -- 172.21.15.90:0/597132018 shutdown_connections 2022-07-05T12:02:11.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.542+0000 7f6ea20ae700 1 -- 172.21.15.90:0/597132018 wait complete. 2022-07-05T12:02:11.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.543+0000 7f6ea20ae700 1 Processor -- start 2022-07-05T12:02:11.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.543+0000 7f6ea20ae700 1 -- start start 2022-07-05T12:02:11.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6ea20ae700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c178610 0x7f6e9c163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6ea20ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 0x7f6e9c17fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6ea20ae700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e9c17e100 0x7f6e9c1706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6ea20ae700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c168450 con 0x7f6e9c178610 2022-07-05T12:02:11.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6ea20ae700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c1670d0 con 0x7f6e9c17e100 2022-07-05T12:02:11.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6ea20ae700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c1673b0 con 0x7f6e9c1789f0 2022-07-05T12:02:11.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c178610 0x7f6e9c163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c178610 0x7f6e9c163270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60026/0 (socket says 172.21.15.90:60026) 2022-07-05T12:02:11.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/591386653 learned_addr learned my addr 172.21.15.90:0/591386653 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:11.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 0x7f6e9c17fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.544+0000 7f6e9bfff700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e9c17e100 0x7f6e9c1706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/591386653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 msgr2=0x7f6e9c17fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 0x7f6e9c17fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e9c17e100 msgr2=0x7f6e9c1706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e9c17e100 0x7f6e9c1706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/591386653 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840092a0 con 0x7f6e9c178610 2022-07-05T12:02:11.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c178610 0x7f6e9c163270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6e8c00c5e0 tx=0x7f6e8c001970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:11.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e93fff700 1 -- 172.21.15.90:0/591386653 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c007170 con 0x7f6e9c178610 2022-07-05T12:02:11.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e93fff700 1 -- 172.21.15.90:0/591386653 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c007310 con 0x7f6e9c178610 2022-07-05T12:02:11.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c167690 con 0x7f6e9c178610 2022-07-05T12:02:11.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6e93fff700 1 -- 172.21.15.90:0/591386653 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0048c0 con 0x7f6e9c178610 2022-07-05T12:02:11.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.545+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c167c50 con 0x7f6e9c178610 2022-07-05T12:02:11.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.547+0000 7f6e93fff700 1 -- 172.21.15.90:0/591386653 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6e8c004c70 con 0x7f6e9c178610 2022-07-05T12:02:11.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.547+0000 7f6e93fff700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6e8008ba40 0x7f6e8008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.547+0000 7f6e93fff700 1 -- 172.21.15.90:0/591386653 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6e8c0b0450 con 0x7f6e9c178610 2022-07-05T12:02:11.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.547+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6e8008ba40 0x7f6e8008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.548+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6e8008ba40 0x7f6e8008df00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f6e84006e00 tx=0x7f6e84016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:11.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.549+0000 7f6eb3a3ab80 1 Processor -- start 2022-07-05T12:02:11.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.549+0000 7f6eb3a3ab80 1 -- start start 2022-07-05T12:02:11.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a83148d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.581 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314db990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a8314d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8314572d0 con 0x55a8314d13c0 2022-07-05T12:02:11.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8313ceaa0 con 0x55a83148dcb0 2022-07-05T12:02:11.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8313e3950 con 0x55a8314d17a0 2022-07-05T12:02:11.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a83148d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a83148d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60034/0 (socket says 172.21.15.90:60034) 2022-07-05T12:02:11.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/2544766988 learned_addr learned my addr 172.21.15.90:0/2544766988 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:11.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9bfff700 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a8314d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/2544766988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 msgr2=0x55a8314d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a8314d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/2544766988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 msgr2=0x55a8314db990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314db990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/2544766988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8312159e0 con 0x55a8314d13c0 2022-07-05T12:02:11.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:02:11.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a83148d7c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f6e8c0849e0 tx=0x7f6e8c0810b0).ready entity=mon.0 client_cookie=19065603f9d9447a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:11.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e90ff9700 1 -- 172.21.15.90:0/2544766988 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0b0280 con 0x55a8314d13c0 2022-07-05T12:02:11.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e90ff9700 1 -- 172.21.15.90:0/2544766988 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c057410 con 0x55a8314d13c0 2022-07-05T12:02:11.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.550+0000 7f6e90ff9700 1 -- 172.21.15.90:0/2544766988 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c08a650 con 0x55a8314d13c0 2022-07-05T12:02:11.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/2544766988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 msgr2=0x55a83148d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a83148d7c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f6e8c0849e0 tx=0x7f6e8c0810b0).stop 2022-07-05T12:02:11.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/2544766988 shutdown_connections 2022-07-05T12:02:11.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a8314d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a83148d7c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/2544766988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/2544766988 >> 172.21.15.90:0/2544766988 conn(0x55a8312fc1c0 msgr2=0x55a831490ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:11.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/2544766988 shutdown_connections 2022-07-05T12:02:11.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.551+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/2544766988 wait complete. 2022-07-05T12:02:11.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.552+0000 7f6eb3a3ab80 1 -- start start 2022-07-05T12:02:11.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.552+0000 7f6eb3a3ab80 1 Processor -- start 2022-07-05T12:02:11.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a8315113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831510260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8313ab120 con 0x55a8314d13c0 2022-07-05T12:02:11.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8314c79f0 con 0x55a83148dcb0 2022-07-05T12:02:11.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8315120c0 con 0x55a8314d17a0 2022-07-05T12:02:11.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6eb3a3ab80 10 client.0 ll_register_callbacks cb 0x55a8314511b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:02:11.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a8315113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a8315113f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60040/0 (socket says 172.21.15.90:60040) 2022-07-05T12:02:11.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 -- 172.21.15.90:0/1266557946 learned_addr learned my addr 172.21.15.90:0/1266557946 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:11.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e9bfff700 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831510260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 -- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 msgr2=0x55a831510260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831510260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 -- 172.21.15.90:0/1266557946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 msgr2=0x55a8314c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.553+0000 7f6e92ffd700 1 -- 172.21.15.90:0/1266557946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c167c50 con 0x55a8314d13c0 2022-07-05T12:02:11.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a8315113f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f6e84010000 tx=0x7f6e84020070).ready entity=mon.0 client_cookie=7a732402d0b7b7b7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:11.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:02:11.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e79ffb700 1 -- 172.21.15.90:0/1266557946 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8401ed80 con 0x55a8314d13c0 2022-07-05T12:02:11.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e79ffb700 1 -- 172.21.15.90:0/1266557946 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6e84029410 con 0x55a8314d13c0 2022-07-05T12:02:11.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a83148b440 con 0x55a8314d13c0 2022-07-05T12:02:11.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e79ffb700 1 -- 172.21.15.90:0/1266557946 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e840297e0 con 0x55a8314d13c0 2022-07-05T12:02:11.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 10 client.5946 fetch_fsmap learned FSMap version 40 2022-07-05T12:02:11.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55a831284cd0 con 0x55a8314d13c0 2022-07-05T12:02:11.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e79ffb700 1 -- 172.21.15.90:0/1266557946 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a83148b440 con 0x55a8314d13c0 2022-07-05T12:02:11.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e79ffb700 1 -- 172.21.15.90:0/1266557946 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 40) v1 ==== 5825+0+0 (secure 0 0 0) 0x7f6e84033b30 con 0x55a8314d13c0 2022-07-05T12:02:11.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 10 client.5946 fetch_fsmap finished waiting for FSMap version 40 2022-07-05T12:02:11.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 10 client.5946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:02:11.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 20 client.5946 populate_metadata read hostname 'smithi090' 2022-07-05T12:02:11.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a8314d0610 0x55a831512e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 4 client.5946 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:02:11.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8313d97f0 con 0x55a8314d0610 2022-07-05T12:02:11.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.554+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a8314d0610 0x55a831512e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6e79ffb700 10 client.5946 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:11.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a8314d0610 0x55a831512e30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f9c8c25f6f82e075 server_cookie=94b6c2cf0286a0ec in_seq=0 out_seq=0 2022-07-05T12:02:11.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6e79ffb700 1 -- 172.21.15.90:0/1266557946 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55a8313d97f0 con 0x55a8314d0610 2022-07-05T12:02:11.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6e79ffb700 10 client.5946 handle_command_reply: tid=0 2022-07-05T12:02:11.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 client.5946 shutdown 2022-07-05T12:02:11.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 msgr2=0x55a8315113f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a8315113f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f6e84010000 tx=0x7f6e84020070).stop 2022-07-05T12:02:11.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 shutdown_connections 2022-07-05T12:02:11.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a8314d0610 0x55a831512e30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831510260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6e79ffb700 0 client.5946 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a83148dcb0 0x55a8314c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.555+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/1266557946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8314d13c0 0x55a8315113f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.556+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 >> 172.21.15.90:0/1266557946 conn(0x55a8312fc1c0 msgr2=0x55a8314fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:11.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.556+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 shutdown_connections 2022-07-05T12:02:11.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.556+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/1266557946 wait complete. 2022-07-05T12:02:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.556+0000 7f6eb3a3ab80 20 client.5946 trim_cache size 0 max 16384 2022-07-05T12:02:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.571+0000 7f6eb3a3ab80 1 Processor -- start 2022-07-05T12:02:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.571+0000 7f6eb3a3ab80 1 -- start start 2022-07-05T12:02:11.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a8314d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d13c0 0x55a831559190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831559680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83155a070 con 0x55a83148dcb0 2022-07-05T12:02:11.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a831487af0 con 0x55a8314d13c0 2022-07-05T12:02:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8314cdd70 con 0x55a8314d17a0 2022-07-05T12:02:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a8314d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a8314d9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60046/0 (socket says 172.21.15.90:60046) 2022-07-05T12:02:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/3337943261 learned_addr learned my addr 172.21.15.90:0/3337943261 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9bfff700 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831559680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d13c0 0x55a831559190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/3337943261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 msgr2=0x55a831559680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831559680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/3337943261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d13c0 msgr2=0x55a831559190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d13c0 0x55a831559190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/3337943261 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a831252fd0 con 0x55a83148dcb0 2022-07-05T12:02:11.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d13c0 0x55a831559190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:02:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.572+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a8314d9b60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f6e8c00cc80 tx=0x7f6e8c08b000).ready entity=mon.0 client_cookie=eb712bc0781deac9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6e917fa700 1 -- 172.21.15.90:0/3337943261 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0848b0 con 0x55a83148dcb0 2022-07-05T12:02:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6e917fa700 1 -- 172.21.15.90:0/3337943261 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c08a650 con 0x55a83148dcb0 2022-07-05T12:02:11.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6e917fa700 1 -- 172.21.15.90:0/3337943261 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c082eb0 con 0x55a83148dcb0 2022-07-05T12:02:11.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/3337943261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 msgr2=0x55a8314d9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a8314d9b60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f6e8c00cc80 tx=0x7f6e8c08b000).stop 2022-07-05T12:02:11.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/3337943261 shutdown_connections 2022-07-05T12:02:11.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d17a0 0x55a831559680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a8314d9b60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/3337943261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d13c0 0x55a831559190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/3337943261 >> 172.21.15.90:0/3337943261 conn(0x55a8312fc1c0 msgr2=0x55a831491b70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:11.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/3337943261 shutdown_connections 2022-07-05T12:02:11.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.573+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/3337943261 wait complete. 2022-07-05T12:02:11.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.574+0000 7f6eb3a3ab80 1 -- start start 2022-07-05T12:02:11.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.574+0000 7f6eb3a3ab80 1 Processor -- start 2022-07-05T12:02:11.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a83148c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d13c0 0x55a831498180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d17a0 0x55a831497b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8314d8320 con 0x55a83148dcb0 2022-07-05T12:02:11.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83148c550 con 0x55a8314d17a0 2022-07-05T12:02:11.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a831503d10 con 0x55a8314d13c0 2022-07-05T12:02:11.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 10 client.0 ll_register_callbacks cb 0x55a8314511b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:02:11.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a83148c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a83148c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60052/0 (socket says 172.21.15.90:60052) 2022-07-05T12:02:11.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/4047977357 learned_addr learned my addr 172.21.15.90:0/4047977357 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:11.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d13c0 0x55a831498180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9bfff700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d17a0 0x55a831497b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d13c0 msgr2=0x55a831498180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d13c0 0x55a831498180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/4047977357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d17a0 msgr2=0x55a831497b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:11.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d17a0 0x55a831497b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 -- 172.21.15.90:0/4047977357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c08e040 con 0x55a83148dcb0 2022-07-05T12:02:11.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9bfff700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d17a0 0x55a831497b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:02:11.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e9b7fe700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a83148c9e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f6e8c084d00 tx=0x7f6e8c09e000).ready entity=mon.0 client_cookie=f1e22bf727e3e4a5 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:11.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:02:11.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e79ffb700 1 -- 172.21.15.90:0/4047977357 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c083110 con 0x55a83148dcb0 2022-07-05T12:02:11.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e79ffb700 1 -- 172.21.15.90:0/4047977357 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6e8c081480 con 0x55a83148dcb0 2022-07-05T12:02:11.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e8c057410 con 0x55a83148dcb0 2022-07-05T12:02:11.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.575+0000 7f6e79ffb700 1 -- 172.21.15.90:0/4047977357 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e8c081640 con 0x55a83148dcb0 2022-07-05T12:02:11.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 10 client.5952 fetch_fsmap learned FSMap version 40 2022-07-05T12:02:11.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55a83148c1e0 con 0x55a83148dcb0 2022-07-05T12:02:11.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6e79ffb700 1 -- 172.21.15.90:0/4047977357 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c0a9070 con 0x55a83148dcb0 2022-07-05T12:02:11.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6e79ffb700 1 -- 172.21.15.90:0/4047977357 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 40) v1 ==== 5825+0+0 (secure 0 0 0) 0x7f6e8c08a1c0 con 0x55a83148dcb0 2022-07-05T12:02:11.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 10 client.5952 fetch_fsmap finished waiting for FSMap version 40 2022-07-05T12:02:11.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 10 client.5952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:02:11.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 20 client.5952 populate_metadata read hostname 'smithi090' 2022-07-05T12:02:11.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a831500d20 0x55a831501190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:11.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 4 client.5952 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:02:11.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a8313d0690 con 0x55a831500d20 2022-07-05T12:02:11.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a831500d20 0x55a831501190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:11.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6e79ffb700 10 client.5952 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:11.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.576+0000 7f6e92ffd700 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a831500d20 0x55a831501190 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=439191dc05b90980 server_cookie=ed98c308d9f9c174 in_seq=0 out_seq=0 2022-07-05T12:02:11.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6e79ffb700 1 -- 172.21.15.90:0/4047977357 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a8313d0690 con 0x55a831500d20 2022-07-05T12:02:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6e79ffb700 10 client.5952 handle_command_reply: tid=0 2022-07-05T12:02:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 client.5952 shutdown 2022-07-05T12:02:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 msgr2=0x55a83148c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a83148c9e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f6e8c084d00 tx=0x7f6e8c09e000).stop 2022-07-05T12:02:11.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 shutdown_connections 2022-07-05T12:02:11.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55a831500d20 0x55a831501190 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a8314d17a0 0x55a831497b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6e79ffb700 0 client.5952 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:11.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a83148dcb0 0x55a83148c9e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 --2- 172.21.15.90:0/4047977357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a8314d13c0 0x55a831498180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 >> 172.21.15.90:0/4047977357 conn(0x55a8312fc1c0 msgr2=0x55a8314c7120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:11.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 shutdown_connections 2022-07-05T12:02:11.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 1 -- 172.21.15.90:0/4047977357 wait complete. 2022-07-05T12:02:11.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6eb3a3ab80 20 client.5952 trim_cache size 0 max 16384 2022-07-05T12:02:11.633 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:02:11.633 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:02:11.633 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:02:11.633 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:02:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:02:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:02:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:02:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:02:11.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:02:11.635 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:02:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6e8008ba40 msgr2=0x7f6e8008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6e8008ba40 0x7f6e8008df00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f6e84006e00 tx=0x7f6e84016000).stop 2022-07-05T12:02:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c178610 msgr2=0x7f6e9c163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:11.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c178610 0x7f6e9c163270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6e8c00c5e0 tx=0x7f6e8c001970).stop 2022-07-05T12:02:11.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 shutdown_connections 2022-07-05T12:02:11.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6e8008ba40 0x7f6e8008df00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e9c17e100 0x7f6e9c1706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c178610 0x7f6e9c163270 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 --2- 172.21.15.90:0/591386653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e9c1789f0 0x7f6e9c17fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:11.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 >> 172.21.15.90:0/591386653 conn(0x7f6e9c0f2210 msgr2=0x7f6e9c0ed1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:11.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 shutdown_connections 2022-07-05T12:02:11.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:11.577+0000 7f6ea20ae700 1 -- 172.21.15.90:0/591386653 wait complete. 2022-07-05T12:02:11.640 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:02:14.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~209s 2022-07-05T12:02:14.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~209s 2022-07-05T12:02:14.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~217s 2022-07-05T12:02:22.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~216s 2022-07-05T12:02:22.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~216s 2022-07-05T12:02:22.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~224s 2022-07-05T12:02:30.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~224s 2022-07-05T12:02:30.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~224s 2022-07-05T12:02:30.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~232s 2022-07-05T12:02:37.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~232s 2022-07-05T12:02:37.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~232s 2022-07-05T12:02:37.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~240s 2022-07-05T12:02:41.642 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:02:41.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.777+0000 7f733417f700 1 Processor -- start 2022-07-05T12:02:41.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.778+0000 7f733417f700 1 -- start start 2022-07-05T12:02:41.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733417f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f732c178610 0x7f732c1789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733417f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f732c17f3b0 0x7f732c17d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733417f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f732c17dee0 0x7f732c181e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733417f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c17d560 con 0x7f732c178610 2022-07-05T12:02:41.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733417f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c17f830 con 0x7f732c17f3b0 2022-07-05T12:02:41.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733417f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c17c670 con 0x7f732c17dee0 2022-07-05T12:02:41.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f732c178610 0x7f732c1789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f732c178610 0x7f732c1789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60060/0 (socket says 172.21.15.90:60060) 2022-07-05T12:02:41.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 -- 172.21.15.90:0/2944146736 learned_addr learned my addr 172.21.15.90:0/2944146736 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:41.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733271c700 1 --2- 172.21.15.90:0/2944146736 >> v2:172.21.15.149:3300/0 conn(0x7f732c17dee0 0x7f732c181e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f733171a700 1 --2- 172.21.15.90:0/2944146736 >> v2:172.21.15.110:3300/0 conn(0x7f732c17f3b0 0x7f732c17d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 -- 172.21.15.90:0/2944146736 >> v2:172.21.15.149:3300/0 conn(0x7f732c17dee0 msgr2=0x7f732c181e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 --2- 172.21.15.90:0/2944146736 >> v2:172.21.15.149:3300/0 conn(0x7f732c17dee0 0x7f732c181e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 -- 172.21.15.90:0/2944146736 >> v2:172.21.15.110:3300/0 conn(0x7f732c17f3b0 msgr2=0x7f732c17d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 --2- 172.21.15.90:0/2944146736 >> v2:172.21.15.110:3300/0 conn(0x7f732c17f3b0 0x7f732c17d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 -- 172.21.15.90:0/2944146736 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c17c950 con 0x7f732c178610 2022-07-05T12:02:41.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7331f1b700 1 --2- 172.21.15.90:0/2944146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c178610 0x7f732c1789f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f732c05ff10 tx=0x7f731c009840).ready entity=mon.0 client_cookie=a0987b787344ca9b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:41.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7330f19700 1 -- 172.21.15.90:0/2944146736 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00e070 con 0x7f732c178610 2022-07-05T12:02:41.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7330f19700 1 -- 172.21.15.90:0/2944146736 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c00b9f0 con 0x7f732c178610 2022-07-05T12:02:41.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.779+0000 7f7330f19700 1 -- 172.21.15.90:0/2944146736 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00bd70 con 0x7f732c178610 2022-07-05T12:02:41.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 -- 172.21.15.90:0/2944146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c178610 msgr2=0x7f732c1789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 --2- 172.21.15.90:0/2944146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c178610 0x7f732c1789f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f732c05ff10 tx=0x7f731c009840).stop 2022-07-05T12:02:41.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 -- 172.21.15.90:0/2944146736 shutdown_connections 2022-07-05T12:02:41.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 --2- 172.21.15.90:0/2944146736 >> v2:172.21.15.149:3300/0 conn(0x7f732c17dee0 0x7f732c181e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 --2- 172.21.15.90:0/2944146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c178610 0x7f732c1789f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 --2- 172.21.15.90:0/2944146736 >> v2:172.21.15.110:3300/0 conn(0x7f732c17f3b0 0x7f732c17d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 -- 172.21.15.90:0/2944146736 >> 172.21.15.90:0/2944146736 conn(0x7f732c0f2210 msgr2=0x7f732c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:41.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 -- 172.21.15.90:0/2944146736 shutdown_connections 2022-07-05T12:02:41.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.780+0000 7f733417f700 1 -- 172.21.15.90:0/2944146736 wait complete. 2022-07-05T12:02:41.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.781+0000 7f733417f700 1 Processor -- start 2022-07-05T12:02:41.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.781+0000 7f733417f700 1 -- start start 2022-07-05T12:02:41.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733417f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732c178610 0x7f732c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733417f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c17dee0 0x7f732c17a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733417f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f732c17f3b0 0x7f732c17a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733417f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c178f70 con 0x7f732c17dee0 2022-07-05T12:02:41.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733417f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c179dd0 con 0x7f732c178610 2022-07-05T12:02:41.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733417f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c1791c0 con 0x7f732c17f3b0 2022-07-05T12:02:41.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733171a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c17dee0 0x7f732c17a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733171a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c17dee0 0x7f732c17a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60068/0 (socket says 172.21.15.90:60068) 2022-07-05T12:02:41.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733171a700 1 -- 172.21.15.90:0/3148771364 learned_addr learned my addr 172.21.15.90:0/3148771364 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:41.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.782+0000 7f733271c700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f732c17f3b0 0x7f732c17a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f7331f1b700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732c178610 0x7f732c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733171a700 1 -- 172.21.15.90:0/3148771364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f732c17f3b0 msgr2=0x7f732c17a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733171a700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f732c17f3b0 0x7f732c17a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733171a700 1 -- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732c178610 msgr2=0x7f732c159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733171a700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732c178610 0x7f732c159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733171a700 1 -- 172.21.15.90:0/3148771364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c009ae0 con 0x7f732c17dee0 2022-07-05T12:02:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733171a700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c17dee0 0x7f732c17a260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f732000d890 tx=0x7f7320008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f7329ffb700 1 -- 172.21.15.90:0/3148771364 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011590 con 0x7f732c17dee0 2022-07-05T12:02:41.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f7329ffb700 1 -- 172.21.15.90:0/3148771364 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73200116f0 con 0x7f732c17dee0 2022-07-05T12:02:41.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f7329ffb700 1 -- 172.21.15.90:0/3148771364 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011a70 con 0x7f732c17dee0 2022-07-05T12:02:41.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c1794a0 con 0x7f732c17dee0 2022-07-05T12:02:41.838 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.783+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c179a60 con 0x7f732c17dee0 2022-07-05T12:02:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.785+0000 7f7329ffb700 1 -- 172.21.15.90:0/3148771364 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7320012420 con 0x7f732c17dee0 2022-07-05T12:02:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.785+0000 7f7329ffb700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f730c08ba40 0x7f730c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.786+0000 7f7329ffb700 1 -- 172.21.15.90:0/3148771364 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f73200b03a0 con 0x7f732c17dee0 2022-07-05T12:02:41.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.786+0000 7f7331f1b700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f730c08ba40 0x7f730c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.786+0000 7f7331f1b700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f730c08ba40 0x7f730c08df00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f731c0070b0 tx=0x7f732c17d4d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:41.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.787+0000 7f7345b0bb80 1 Processor -- start 2022-07-05T12:02:41.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.787+0000 7f7345b0bb80 1 -- start start 2022-07-05T12:02:41.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134307c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557013430cb0 0x55701347e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013474c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570133fa2d0 con 0x5570134747a0 2022-07-05T12:02:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557013371aa0 con 0x557013430cb0 2022-07-05T12:02:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557013386950 con 0x5570134743c0 2022-07-05T12:02:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f733271c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013474c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f7331f1b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f733271c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013474c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60078/0 (socket says 172.21.15.90:60078) 2022-07-05T12:02:41.847 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f733271c700 1 -- 172.21.15.90:0/243377244 learned_addr learned my addr 172.21.15.90:0/243377244 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:41.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.788+0000 7f733171a700 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557013430cb0 0x55701347e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.848 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f733271c700 1 -- 172.21.15.90:0/243377244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 msgr2=0x5570134307c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f733271c700 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134307c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.849 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f733271c700 1 -- 172.21.15.90:0/243377244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557013430cb0 msgr2=0x55701347e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f733271c700 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557013430cb0 0x55701347e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f733271c700 1 -- 172.21.15.90:0/243377244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570131b89e0 con 0x5570134747a0 2022-07-05T12:02:41.850 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f733271c700 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013474c20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f7324009ab0 tx=0x7f7324006f90).ready entity=mon.0 client_cookie=1bc9fb19e3e141ac server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:41.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f730affd700 1 -- 172.21.15.90:0/243377244 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324009620 con 0x5570134747a0 2022-07-05T12:02:41.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f730affd700 1 -- 172.21.15.90:0/243377244 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7324005ae0 con 0x5570134747a0 2022-07-05T12:02:41.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f730affd700 1 -- 172.21.15.90:0/243377244 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324005e80 con 0x5570134747a0 2022-07-05T12:02:41.851 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f7345b0bb80 1 -- 172.21.15.90:0/243377244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 msgr2=0x557013474c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.789+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013474c20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f7324009ab0 tx=0x7f7324006f90).stop 2022-07-05T12:02:41.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 -- 172.21.15.90:0/243377244 shutdown_connections 2022-07-05T12:02:41.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013474c20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.852 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134307c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/243377244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557013430cb0 0x55701347e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 -- 172.21.15.90:0/243377244 >> 172.21.15.90:0/243377244 conn(0x55701329f1c0 msgr2=0x557013433ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:41.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 -- 172.21.15.90:0/243377244 shutdown_connections 2022-07-05T12:02:41.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 -- 172.21.15.90:0/243377244 wait complete. 2022-07-05T12:02:41.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 -- start start 2022-07-05T12:02:41.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.790+0000 7f7345b0bb80 1 Processor -- start 2022-07-05T12:02:41.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x5570134b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x557013471fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013469220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55701334e120 con 0x5570134747a0 2022-07-05T12:02:41.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570134b5800 con 0x5570134743c0 2022-07-05T12:02:41.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570134b46a0 con 0x557013430cb0 2022-07-05T12:02:41.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 10 client.0 ll_register_callbacks cb 0x5570133f41b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:02:41.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013469220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013469220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60084/0 (socket says 172.21.15.90:60084) 2022-07-05T12:02:41.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 -- 172.21.15.90:0/765252742 learned_addr learned my addr 172.21.15.90:0/765252742 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:41.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7331f1b700 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x5570134b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733171a700 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x557013471fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 -- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 msgr2=0x5570134b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x5570134b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 -- 172.21.15.90:0/765252742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 msgr2=0x557013471fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x557013471fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 -- 172.21.15.90:0/765252742 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73240097b0 con 0x5570134747a0 2022-07-05T12:02:41.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f733271c700 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013469220 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x5570134a6c70 tx=0x7f732401c000).ready entity=mon.0 client_cookie=4cd01074ac92799 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:41.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7303fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:02:41.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7303fff700 1 -- 172.21.15.90:0/765252742 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324020730 con 0x5570134747a0 2022-07-05T12:02:41.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7303fff700 1 -- 172.21.15.90:0/765252742 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f7324020890 con 0x5570134747a0 2022-07-05T12:02:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55701342e440 con 0x5570134747a0 2022-07-05T12:02:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7303fff700 1 -- 172.21.15.90:0/765252742 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7324020ca0 con 0x5570134747a0 2022-07-05T12:02:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 10 client.5964 fetch_fsmap learned FSMap version 41 2022-07-05T12:02:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.792+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x557013227cd0 con 0x5570134747a0 2022-07-05T12:02:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7303fff700 1 -- 172.21.15.90:0/765252742 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55701342e440 con 0x5570134747a0 2022-07-05T12:02:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7303fff700 1 -- 172.21.15.90:0/765252742 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f732401d450 con 0x5570134747a0 2022-07-05T12:02:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7345b0bb80 10 client.5964 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:02:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7345b0bb80 10 client.5964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:02:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7345b0bb80 20 client.5964 populate_metadata read hostname 'smithi090' 2022-07-05T12:02:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134b5df0 0x5570134b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7345b0bb80 4 client.5964 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:02:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55701337c7f0 con 0x5570134b5df0 2022-07-05T12:02:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7331f1b700 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134b5df0 0x5570134b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7303fff700 10 client.5964 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.793+0000 7f7331f1b700 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134b5df0 0x5570134b61d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=61d6fdc54c03184 server_cookie=9c7018d0951c8b6d in_seq=0 out_seq=0 2022-07-05T12:02:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7303fff700 1 -- 172.21.15.90:0/765252742 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55701337c7f0 con 0x5570134b5df0 2022-07-05T12:02:41.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7303fff700 10 client.5964 handle_command_reply: tid=0 2022-07-05T12:02:41.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 client.5964 shutdown 2022-07-05T12:02:41.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 msgr2=0x557013469220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.864 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013469220 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x5570134a6c70 tx=0x7f732401c000).stop 2022-07-05T12:02:41.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 shutdown_connections 2022-07-05T12:02:41.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134b5df0 0x5570134b61d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x557013469220 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x5570134b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7303fff700 0 client.5964 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/765252742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x557013471fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 >> 172.21.15.90:0/765252742 conn(0x55701329f1c0 msgr2=0x5570134a1150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 shutdown_connections 2022-07-05T12:02:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.794+0000 7f7345b0bb80 1 -- 172.21.15.90:0/765252742 wait complete. 2022-07-05T12:02:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.795+0000 7f7345b0bb80 20 client.5964 trim_cache size 0 max 16384 2022-07-05T12:02:41.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.810+0000 7f7345b0bb80 1 Processor -- start 2022-07-05T12:02:41.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.810+0000 7f7345b0bb80 1 -- start start 2022-07-05T12:02:41.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557013430cb0 0x557013474b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134747a0 0x557013470160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570134a7000 con 0x557013430cb0 2022-07-05T12:02:41.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557013435370 con 0x5570134747a0 2022-07-05T12:02:41.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570134a63c0 con 0x5570134743c0 2022-07-05T12:02:41.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557013430cb0 0x557013474b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557013430cb0 0x557013474b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60088/0 (socket says 172.21.15.90:60088) 2022-07-05T12:02:41.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 -- 172.21.15.90:0/1887841584 learned_addr learned my addr 172.21.15.90:0/1887841584 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:41.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f733171a700 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f733271c700 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134747a0 0x557013470160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 -- 172.21.15.90:0/1887841584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 msgr2=0x5570134b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 -- 172.21.15.90:0/1887841584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134747a0 msgr2=0x557013470160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134747a0 0x557013470160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.811+0000 7f7331f1b700 1 -- 172.21.15.90:0/1887841584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570131f5fd0 con 0x557013430cb0 2022-07-05T12:02:41.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f733171a700 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:02:41.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7331f1b700 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557013430cb0 0x557013474b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f732c088a70 tx=0x7f731c031280).ready entity=mon.0 client_cookie=4188f591074178bc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:41.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f730b7fe700 1 -- 172.21.15.90:0/1887841584 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c02f070 con 0x557013430cb0 2022-07-05T12:02:41.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f730b7fe700 1 -- 172.21.15.90:0/1887841584 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c013e80 con 0x557013430cb0 2022-07-05T12:02:41.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f730b7fe700 1 -- 172.21.15.90:0/1887841584 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c01e450 con 0x557013430cb0 2022-07-05T12:02:41.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1887841584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557013430cb0 msgr2=0x557013474b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557013430cb0 0x557013474b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f732c088a70 tx=0x7f731c031280).stop 2022-07-05T12:02:41.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1887841584 shutdown_connections 2022-07-05T12:02:41.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134747a0 0x557013470160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557013430cb0 0x557013474b80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1887841584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5570134743c0 0x5570134b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1887841584 >> 172.21.15.90:0/1887841584 conn(0x55701329f1c0 msgr2=0x557013434870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:41.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1887841584 shutdown_connections 2022-07-05T12:02:41.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.812+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1887841584 wait complete. 2022-07-05T12:02:41.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.813+0000 7f7345b0bb80 1 -- start start 2022-07-05T12:02:41.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.813+0000 7f7345b0bb80 1 Processor -- start 2022-07-05T12:02:41.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.814+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x55701347ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.814+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x5570134fb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.814+0000 7f7345b0bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x5570134396f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.814+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557013508cd0 con 0x5570134747a0 2022-07-05T12:02:41.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.814+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570134fcc00 con 0x5570134743c0 2022-07-05T12:02:41.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.814+0000 7f7345b0bb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557013433a10 con 0x557013430cb0 2022-07-05T12:02:41.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.814+0000 7f7345b0bb80 10 client.0 ll_register_callbacks cb 0x5570133f41b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:02:41.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x5570134396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x5570134396f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60098/0 (socket says 172.21.15.90:60098) 2022-07-05T12:02:41.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 -- 172.21.15.90:0/1617113986 learned_addr learned my addr 172.21.15.90:0/1617113986 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:02:41.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7331f1b700 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x55701347ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733171a700 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x5570134fb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 -- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 msgr2=0x55701347ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x55701347ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 -- 172.21.15.90:0/1617113986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 msgr2=0x5570134fb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:02:41.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x5570134fb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 -- 172.21.15.90:0/1617113986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c017040 con 0x5570134747a0 2022-07-05T12:02:41.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f733271c700 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x5570134396f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x5570134a6c70 tx=0x7f7324022040).ready entity=mon.0 client_cookie=ec434adf3ac785f1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:02:41.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7303fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:02:41.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7303fff700 1 -- 172.21.15.90:0/1617113986 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324009e20 con 0x5570134747a0 2022-07-05T12:02:41.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7303fff700 1 -- 172.21.15.90:0/1617113986 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f7324000e40 con 0x5570134747a0 2022-07-05T12:02:41.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557013373690 con 0x5570134747a0 2022-07-05T12:02:41.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7303fff700 1 -- 172.21.15.90:0/1617113986 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7324011cd0 con 0x5570134747a0 2022-07-05T12:02:41.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7345b0bb80 10 client.5970 fetch_fsmap learned FSMap version 41 2022-07-05T12:02:41.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55701350ba30 con 0x5570134747a0 2022-07-05T12:02:41.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.815+0000 7f7303fff700 1 -- 172.21.15.90:0/1617113986 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557013373690 con 0x5570134747a0 2022-07-05T12:02:41.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7303fff700 1 -- 172.21.15.90:0/1617113986 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f732401dba0 con 0x5570134747a0 2022-07-05T12:02:41.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 10 client.5970 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:02:41.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 10 client.5970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:02:41.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 20 client.5970 populate_metadata read hostname 'smithi090' 2022-07-05T12:02:41.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134fc1c0 0x557013439be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:02:41.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 4 client.5970 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:02:41.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5570131da3e0 con 0x5570134fc1c0 2022-07-05T12:02:41.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7331f1b700 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134fc1c0 0x557013439be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:02:41.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7303fff700 10 client.5970 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:41.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7331f1b700 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134fc1c0 0x557013439be0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=574637fda8f4898b server_cookie=11cfe04385d9b1ef in_seq=0 out_seq=0 2022-07-05T12:02:41.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7303fff700 1 -- 172.21.15.90:0/1617113986 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5570131da3e0 con 0x5570134fc1c0 2022-07-05T12:02:41.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7303fff700 10 client.5970 handle_command_reply: tid=0 2022-07-05T12:02:41.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 client.5970 shutdown 2022-07-05T12:02:41.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 msgr2=0x5570134396f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x5570134396f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x5570134a6c70 tx=0x7f7324022040).stop 2022-07-05T12:02:41.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 shutdown_connections 2022-07-05T12:02:41.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5570134fc1c0 0x557013439be0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5570134747a0 0x5570134396f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557013430cb0 0x55701347ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 --2- 172.21.15.90:0/1617113986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570134743c0 0x5570134fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7303fff700 0 client.5970 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:02:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.816+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 >> 172.21.15.90:0/1617113986 conn(0x55701329f1c0 msgr2=0x557013434870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:41.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 shutdown_connections 2022-07-05T12:02:41.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f7345b0bb80 1 -- 172.21.15.90:0/1617113986 wait complete. 2022-07-05T12:02:41.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f7345b0bb80 20 client.5970 trim_cache size 0 max 16384 2022-07-05T12:02:41.897 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:02:41.897 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:02:41.897 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:02:41.897 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:02:41.898 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:02:41.898 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:02:41.898 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:02:41.899 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:02:41.899 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:02:41.899 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:02:41.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f730c08ba40 msgr2=0x7f730c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f730c08ba40 0x7f730c08df00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f731c0070b0 tx=0x7f732c17d4d0).stop 2022-07-05T12:02:41.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c17dee0 msgr2=0x7f732c17a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:02:41.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c17dee0 0x7f732c17a260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f732000d890 tx=0x7f7320008040).stop 2022-07-05T12:02:41.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 shutdown_connections 2022-07-05T12:02:41.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f730c08ba40 0x7f730c08df00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f732c17f3b0 0x7f732c17a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732c178610 0x7f732c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 --2- 172.21.15.90:0/3148771364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f732c17dee0 0x7f732c17a260 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:02:41.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 >> 172.21.15.90:0/3148771364 conn(0x7f732c0f2210 msgr2=0x7f732c0c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:02:41.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 shutdown_connections 2022-07-05T12:02:41.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:02:41.817+0000 7f733417f700 1 -- 172.21.15.90:0/3148771364 wait complete. 2022-07-05T12:02:41.905 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:02:45.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~240s 2022-07-05T12:02:45.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~240s 2022-07-05T12:02:45.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~248s 2022-07-05T12:02:53.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~247s 2022-07-05T12:02:53.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~247s 2022-07-05T12:02:53.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~255s 2022-07-05T12:03:01.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~255s 2022-07-05T12:03:01.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~255s 2022-07-05T12:03:01.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~263s 2022-07-05T12:03:08.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~263s 2022-07-05T12:03:08.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~263s 2022-07-05T12:03:08.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~271s 2022-07-05T12:03:11.907 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:03:12.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.037+0000 7f2211af6700 1 Processor -- start 2022-07-05T12:03:12.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.038+0000 7f2211af6700 1 -- start start 2022-07-05T12:03:12.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f2211af6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f220c17eff0 0x7f220c174ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f2211af6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c1753c0 con 0x7f220c174af0 2022-07-05T12:03:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f2211af6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0850b0 con 0x7f220c0ed530 2022-07-05T12:03:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f2211af6700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c17f440 con 0x7f220c17eff0 2022-07-05T12:03:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f220c0ed530 0x7f220c1801b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:49286/0 (socket says 172.21.15.90:49286) 2022-07-05T12:03:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220affd700 1 -- 172.21.15.90:0/530766924 learned_addr learned my addr 172.21.15.90:0/530766924 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:03:12.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220bfff700 1 --2- 172.21.15.90:0/530766924 >> v2:172.21.15.110:3300/0 conn(0x7f220c17eff0 0x7f220c174ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220a7fc700 1 -- 172.21.15.90:0/530766924 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492473326 0 0) 0x7f220c0850b0 con 0x7f220c0ed530 2022-07-05T12:03:12.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220a7fc700 1 -- 172.21.15.90:0/530766924 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f80033f0 con 0x7f220c0ed530 2022-07-05T12:03:12.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220bfff700 1 -- 172.21.15.90:0/530766924 >> v1:172.21.15.149:6789/0 conn(0x7f220c0ed530 legacy=0x7f220c1801b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220bfff700 1 -- 172.21.15.90:0/530766924 >> v1:172.21.15.110:6789/0 conn(0x7f220c174af0 legacy=0x7f220c17faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220bfff700 1 -- 172.21.15.90:0/530766924 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0edb50 con 0x7f220c17eff0 2022-07-05T12:03:12.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220bfff700 1 --2- 172.21.15.90:0/530766924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 0x7f220c174ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2204009760 tx=0x7f2204009060).ready entity=mon.1 client_cookie=85f79b10edeedae0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.039+0000 7f220a7fc700 1 -- 172.21.15.90:0/530766924 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400f510 con 0x7f220c17eff0 2022-07-05T12:03:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f220a7fc700 1 -- 172.21.15.90:0/530766924 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400f670 con 0x7f220c17eff0 2022-07-05T12:03:12.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f220a7fc700 1 -- 172.21.15.90:0/530766924 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400f9f0 con 0x7f220c17eff0 2022-07-05T12:03:12.049 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f2211af6700 1 -- 172.21.15.90:0/530766924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 msgr2=0x7f220c174ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f2211af6700 1 --2- 172.21.15.90:0/530766924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 0x7f220c174ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2204009760 tx=0x7f2204009060).stop 2022-07-05T12:03:12.050 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f2211af6700 1 -- 172.21.15.90:0/530766924 shutdown_connections 2022-07-05T12:03:12.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f2211af6700 1 --2- 172.21.15.90:0/530766924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 0x7f220c174ed0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f2211af6700 1 -- 172.21.15.90:0/530766924 >> 172.21.15.90:0/530766924 conn(0x7f220c05d9a0 msgr2=0x7f220c05ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:12.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f2211af6700 1 -- 172.21.15.90:0/530766924 shutdown_connections 2022-07-05T12:03:12.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.040+0000 7f2211af6700 1 -- 172.21.15.90:0/530766924 wait complete. 2022-07-05T12:03:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.042+0000 7f2211af6700 1 Processor -- start 2022-07-05T12:03:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.042+0000 7f2211af6700 1 -- start start 2022-07-05T12:03:12.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f2211af6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c0ed530 0x7f220c18eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f2211af6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c174af0 0x7f220c18f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f2211af6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 0x7f220c176a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f2211af6700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1765d0 con 0x7f220c0ed530 2022-07-05T12:03:12.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f2211af6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c18f8d0 con 0x7f220c17eff0 2022-07-05T12:03:12.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f2211af6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c068040 con 0x7f220c174af0 2022-07-05T12:03:12.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c0ed530 0x7f220c18eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c0ed530 0x7f220c18eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60108/0 (socket says 172.21.15.90:60108) 2022-07-05T12:03:12.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 -- 172.21.15.90:0/1758872474 learned_addr learned my addr 172.21.15.90:0/1758872474 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:12.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c174af0 0x7f220c18f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220bfff700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 0x7f220c176a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 -- 172.21.15.90:0/1758872474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c174af0 msgr2=0x7f220c18f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c174af0 0x7f220c18f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 -- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 msgr2=0x7f220c176a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 0x7f220c176a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 -- 172.21.15.90:0/1758872474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040092a0 con 0x7f220c0ed530 2022-07-05T12:03:12.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c0ed530 0x7f220c18eef0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f21fc00c7c0 tx=0x7f21fc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:12.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f21f37fe700 1 -- 172.21.15.90:0/1758872474 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc010510 con 0x7f220c0ed530 2022-07-05T12:03:12.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f21f37fe700 1 -- 172.21.15.90:0/1758872474 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc010670 con 0x7f220c0ed530 2022-07-05T12:03:12.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f21f37fe700 1 -- 172.21.15.90:0/1758872474 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc010a10 con 0x7f220c0ed530 2022-07-05T12:03:12.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.043+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c068320 con 0x7f220c0ed530 2022-07-05T12:03:12.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.044+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0688e0 con 0x7f220c0ed530 2022-07-05T12:03:12.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.045+0000 7f21f37fe700 1 -- 172.21.15.90:0/1758872474 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f21fc010070 con 0x7f220c0ed530 2022-07-05T12:03:12.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.046+0000 7f21f37fe700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f21ec08ba40 0x7f21ec08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.046+0000 7f21f37fe700 1 -- 172.21.15.90:0/1758872474 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f21fc0b05e0 con 0x7f220c0ed530 2022-07-05T12:03:12.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.046+0000 7f220affd700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f21ec08ba40 0x7f21ec08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.047+0000 7f220affd700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f21ec08ba40 0x7f21ec08df00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f220c0c37b0 tx=0x7f2200009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:12.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.047+0000 7f2223482b80 1 Processor -- start 2022-07-05T12:03:12.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.048+0000 7f2223482b80 1 -- start start 2022-07-05T12:03:12.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.048+0000 7f2223482b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.048+0000 7f2223482b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac476990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.048+0000 7f2223482b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac46cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f2223482b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac3f22d0 con 0x55bdac46c3c0 2022-07-05T12:03:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f2223482b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac369aa0 con 0x55bdac428cb0 2022-07-05T12:03:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f2223482b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac37e950 con 0x55bdac46c7a0 2022-07-05T12:03:12.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4287c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60116/0 (socket says 172.21.15.90:60116) 2022-07-05T12:03:12.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 -- 172.21.15.90:0/398803065 learned_addr learned my addr 172.21.15.90:0/398803065 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:12.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220bfff700 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac46cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 -- 172.21.15.90:0/398803065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 msgr2=0x55bdac46cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac46cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220affd700 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac476990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 -- 172.21.15.90:0/398803065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 msgr2=0x55bdac476990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac476990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 -- 172.21.15.90:0/398803065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdac1b09e0 con 0x55bdac46c3c0 2022-07-05T12:03:12.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f220b7fe700 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4287c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f21fc084b20 tx=0x7f21fc084c50).ready entity=mon.0 client_cookie=1803fdb6fbfc562f server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:12.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f21f0ff9700 1 -- 172.21.15.90:0/398803065 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0b0390 con 0x55bdac46c3c0 2022-07-05T12:03:12.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f21f0ff9700 1 -- 172.21.15.90:0/398803065 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc010e00 con 0x55bdac46c3c0 2022-07-05T12:03:12.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.049+0000 7f21f0ff9700 1 -- 172.21.15.90:0/398803065 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0adcb0 con 0x55bdac46c3c0 2022-07-05T12:03:12.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 -- 172.21.15.90:0/398803065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 msgr2=0x55bdac4287c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4287c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f21fc084b20 tx=0x7f21fc084c50).stop 2022-07-05T12:03:12.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 -- 172.21.15.90:0/398803065 shutdown_connections 2022-07-05T12:03:12.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac46cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4287c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 --2- 172.21.15.90:0/398803065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac476990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 -- 172.21.15.90:0/398803065 >> 172.21.15.90:0/398803065 conn(0x55bdac2971c0 msgr2=0x55bdac42bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:12.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 -- 172.21.15.90:0/398803065 shutdown_connections 2022-07-05T12:03:12.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.050+0000 7f2223482b80 1 -- 172.21.15.90:0/398803065 wait complete. 2022-07-05T12:03:12.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.051+0000 7f2223482b80 1 -- start start 2022-07-05T12:03:12.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.051+0000 7f2223482b80 1 Processor -- start 2022-07-05T12:03:12.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac466650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac461390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac346120 con 0x55bdac46c3c0 2022-07-05T12:03:12.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac467320 con 0x55bdac428cb0 2022-07-05T12:03:12.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac49e900 con 0x55bdac46c7a0 2022-07-05T12:03:12.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 10 client.0 ll_register_callbacks cb 0x55bdac3ec1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:03:12.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60124/0 (socket says 172.21.15.90:60124) 2022-07-05T12:03:12.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 -- 172.21.15.90:0/1382260437 learned_addr learned my addr 172.21.15.90:0/1382260437 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:12.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac466650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220bfff700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac461390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 -- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 msgr2=0x55bdac461390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac461390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 -- 172.21.15.90:0/1382260437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 msgr2=0x55bdac466650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac466650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 -- 172.21.15.90:0/1382260437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0688e0 con 0x55bdac46c3c0 2022-07-05T12:03:12.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac466650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:03:12.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f220affd700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4ab1a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f220c069140 tx=0x7f2200016040).ready entity=mon.0 client_cookie=e8c25176b7e0fde server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:12.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f21e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:03:12.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f21e5ffb700 1 -- 172.21.15.90:0/1382260437 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200014b40 con 0x55bdac46c3c0 2022-07-05T12:03:12.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f21e5ffb700 1 -- 172.21.15.90:0/1382260437 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f2200014ca0 con 0x55bdac46c3c0 2022-07-05T12:03:12.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdac426440 con 0x55bdac46c3c0 2022-07-05T12:03:12.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.052+0000 7f21e5ffb700 1 -- 172.21.15.90:0/1382260437 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2200014e60 con 0x55bdac46c3c0 2022-07-05T12:03:12.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 10 client.5979 fetch_fsmap learned FSMap version 41 2022-07-05T12:03:12.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55bdac21fcd0 con 0x55bdac46c3c0 2022-07-05T12:03:12.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f21e5ffb700 1 -- 172.21.15.90:0/1382260437 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220002a020 con 0x55bdac46c3c0 2022-07-05T12:03:12.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f21e5ffb700 1 -- 172.21.15.90:0/1382260437 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f2200005240 con 0x55bdac46c3c0 2022-07-05T12:03:12.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 10 client.5979 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:03:12.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 10 client.5979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:03:12.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 20 client.5979 populate_metadata read hostname 'smithi090' 2022-07-05T12:03:12.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac49f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 4 client.5979 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:03:12.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdac3747f0 con 0x55bdac4aad20 2022-07-05T12:03:12.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac49f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f21e5ffb700 10 client.5979 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:12.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.053+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac49f000 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f2bba3112eb2a108 server_cookie=61f441144de9b880 in_seq=0 out_seq=0 2022-07-05T12:03:12.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f21e5ffb700 1 -- 172.21.15.90:0/1382260437 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55bdac3747f0 con 0x55bdac4aad20 2022-07-05T12:03:12.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f21e5ffb700 10 client.5979 handle_command_reply: tid=0 2022-07-05T12:03:12.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 client.5979 shutdown 2022-07-05T12:03:12.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 msgr2=0x55bdac4ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4ab1a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f220c069140 tx=0x7f2200016040).stop 2022-07-05T12:03:12.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 shutdown_connections 2022-07-05T12:03:12.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac49f000 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c7a0 0x55bdac461390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac428cb0 0x55bdac466650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f21e5ffb700 0 client.5979 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:12.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 --2- 172.21.15.90:0/1382260437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c3c0 0x55bdac4ab1a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 >> 172.21.15.90:0/1382260437 conn(0x55bdac2971c0 msgr2=0x55bdac499150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:12.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 shutdown_connections 2022-07-05T12:03:12.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 1 -- 172.21.15.90:0/1382260437 wait complete. 2022-07-05T12:03:12.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.054+0000 7f2223482b80 20 client.5979 trim_cache size 0 max 16384 2022-07-05T12:03:12.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.070+0000 7f2223482b80 1 Processor -- start 2022-07-05T12:03:12.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.070+0000 7f2223482b80 1 -- start start 2022-07-05T12:03:12.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f2223482b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac428cb0 0x55bdac494370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f2223482b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c3c0 0x55bdac46d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f2223482b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c7a0 0x55bdac422750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f2223482b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac46cc10 con 0x55bdac46c7a0 2022-07-05T12:03:12.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f2223482b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac422c40 con 0x55bdac46c3c0 2022-07-05T12:03:12.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f2223482b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac4aa640 con 0x55bdac428cb0 2022-07-05T12:03:12.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c7a0 0x55bdac422750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c7a0 0x55bdac422750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60134/0 (socket says 172.21.15.90:60134) 2022-07-05T12:03:12.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 -- 172.21.15.90:0/1122602654 learned_addr learned my addr 172.21.15.90:0/1122602654 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:12.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac428cb0 0x55bdac494370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220affd700 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c3c0 0x55bdac46d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 -- 172.21.15.90:0/1122602654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac428cb0 msgr2=0x55bdac494370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac428cb0 0x55bdac494370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 -- 172.21.15.90:0/1122602654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c3c0 msgr2=0x55bdac46d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c3c0 0x55bdac46d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 -- 172.21.15.90:0/1122602654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdac1edfd0 con 0x55bdac46c7a0 2022-07-05T12:03:12.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f220bfff700 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c7a0 0x55bdac422750 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f220400f640 tx=0x7f2204017000).ready entity=mon.0 client_cookie=ddc3f8d662ff2578 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:12.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f21f17fa700 1 -- 172.21.15.90:0/1122602654 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204021030 con 0x55bdac46c7a0 2022-07-05T12:03:12.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f21f17fa700 1 -- 172.21.15.90:0/1122602654 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204022040 con 0x55bdac46c7a0 2022-07-05T12:03:12.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.071+0000 7f21f17fa700 1 -- 172.21.15.90:0/1122602654 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220401c420 con 0x55bdac46c7a0 2022-07-05T12:03:12.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 -- 172.21.15.90:0/1122602654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c7a0 msgr2=0x55bdac422750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c7a0 0x55bdac422750 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f220400f640 tx=0x7f2204017000).stop 2022-07-05T12:03:12.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 -- 172.21.15.90:0/1122602654 shutdown_connections 2022-07-05T12:03:12.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac46c7a0 0x55bdac422750 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac428cb0 0x55bdac494370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 --2- 172.21.15.90:0/1122602654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c3c0 0x55bdac46d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 -- 172.21.15.90:0/1122602654 >> 172.21.15.90:0/1122602654 conn(0x55bdac2971c0 msgr2=0x55bdac42ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:12.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 -- 172.21.15.90:0/1122602654 shutdown_connections 2022-07-05T12:03:12.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.072+0000 7f2223482b80 1 -- 172.21.15.90:0/1122602654 wait complete. 2022-07-05T12:03:12.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.073+0000 7f2223482b80 1 -- start start 2022-07-05T12:03:12.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.073+0000 7f2223482b80 1 Processor -- start 2022-07-05T12:03:12.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac428cb0 0x55bdac49f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c3c0 0x55bdac465130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c7a0 0x55bdac49c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac4aec10 con 0x55bdac428cb0 2022-07-05T12:03:12.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac475430 con 0x55bdac46c7a0 2022-07-05T12:03:12.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdac49d490 con 0x55bdac46c3c0 2022-07-05T12:03:12.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 10 client.0 ll_register_callbacks cb 0x55bdac3ec1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:03:12.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac428cb0 0x55bdac49f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac428cb0 0x55bdac49f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60136/0 (socket says 172.21.15.90:60136) 2022-07-05T12:03:12.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 -- 172.21.15.90:0/632740587 learned_addr learned my addr 172.21.15.90:0/632740587 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:12.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220affd700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c3c0 0x55bdac465130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220bfff700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c7a0 0x55bdac49c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 -- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c3c0 msgr2=0x55bdac465130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c3c0 0x55bdac465130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 -- 172.21.15.90:0/632740587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c7a0 msgr2=0x55bdac49c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:12.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c7a0 0x55bdac49c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 -- 172.21.15.90:0/632740587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0edb50 con 0x55bdac428cb0 2022-07-05T12:03:12.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220bfff700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c7a0 0x55bdac49c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:03:12.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f220b7fe700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac428cb0 0x55bdac49f080 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f21fc00cdb0 tx=0x7f21fc08d040).ready entity=mon.0 client_cookie=3c4b8bcd966194b2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:12.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f21e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:03:12.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f21e5ffb700 1 -- 172.21.15.90:0/632740587 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc091040 con 0x55bdac428cb0 2022-07-05T12:03:12.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f21e5ffb700 1 -- 172.21.15.90:0/632740587 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f21fc0b0390 con 0x55bdac428cb0 2022-07-05T12:03:12.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21fc010e00 con 0x55bdac428cb0 2022-07-05T12:03:12.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f21e5ffb700 1 -- 172.21.15.90:0/632740587 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21fc095280 con 0x55bdac428cb0 2022-07-05T12:03:12.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 10 client.5985 fetch_fsmap learned FSMap version 41 2022-07-05T12:03:12.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.074+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55bdac429e10 con 0x55bdac428cb0 2022-07-05T12:03:12.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f21e5ffb700 1 -- 172.21.15.90:0/632740587 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc010e00 con 0x55bdac428cb0 2022-07-05T12:03:12.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f21e5ffb700 1 -- 172.21.15.90:0/632740587 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f21fc0182b0 con 0x55bdac428cb0 2022-07-05T12:03:12.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 10 client.5985 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:03:12.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 10 client.5985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:03:12.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 20 client.5985 populate_metadata read hostname 'smithi090' 2022-07-05T12:03:12.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac4ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:12.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 4 client.5985 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:03:12.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bdac36b690 con 0x55bdac4aad20 2022-07-05T12:03:12.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f220affd700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac4ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:12.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f21e5ffb700 10 client.5985 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:12.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f220affd700 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac4ae2d0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=64b2d6961f8278e5 server_cookie=e4df8a580c6cc257 in_seq=0 out_seq=0 2022-07-05T12:03:12.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f21e5ffb700 1 -- 172.21.15.90:0/632740587 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bdac36b690 con 0x55bdac4aad20 2022-07-05T12:03:12.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f21e5ffb700 10 client.5985 handle_command_reply: tid=0 2022-07-05T12:03:12.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 1 client.5985 shutdown 2022-07-05T12:03:12.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac428cb0 msgr2=0x55bdac49f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac428cb0 0x55bdac49f080 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f21fc00cdb0 tx=0x7f21fc08d040).stop 2022-07-05T12:03:12.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 shutdown_connections 2022-07-05T12:03:12.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.075+0000 7f2223482b80 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55bdac4aad20 0x55bdac4ae2d0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2223482b80 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdac46c7a0 0x55bdac49c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f21e5ffb700 0 client.5985 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2223482b80 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bdac428cb0 0x55bdac49f080 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2223482b80 1 --2- 172.21.15.90:0/632740587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bdac46c3c0 0x55bdac465130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 >> 172.21.15.90:0/632740587 conn(0x55bdac2971c0 msgr2=0x55bdac473af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:12.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 shutdown_connections 2022-07-05T12:03:12.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2223482b80 1 -- 172.21.15.90:0/632740587 wait complete. 2022-07-05T12:03:12.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2223482b80 20 client.5985 trim_cache size 0 max 16384 2022-07-05T12:03:12.185 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:03:12.185 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:03:12.186 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:03:12.186 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:03:12.187 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:03:12.187 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:03:12.188 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:03:12.188 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:03:12.188 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:03:12.189 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:03:12.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f21ec08ba40 msgr2=0x7f21ec08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f21ec08ba40 0x7f21ec08df00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f220c0c37b0 tx=0x7f2200009040).stop 2022-07-05T12:03:12.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c0ed530 msgr2=0x7f220c18eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:12.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c0ed530 0x7f220c18eef0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f21fc00c7c0 tx=0x7f21fc0015e0).stop 2022-07-05T12:03:12.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 shutdown_connections 2022-07-05T12:03:12.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f21ec08ba40 0x7f21ec08df00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f220c17eff0 0x7f220c176a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c0ed530 0x7f220c18eef0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 --2- 172.21.15.90:0/1758872474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c174af0 0x7f220c18f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:12.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 >> 172.21.15.90:0/1758872474 conn(0x7f220c05d9a0 msgr2=0x7f220c169cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:12.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 shutdown_connections 2022-07-05T12:03:12.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:12.076+0000 7f2211af6700 1 -- 172.21.15.90:0/1758872474 wait complete. 2022-07-05T12:03:12.196 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:03:16.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~271s 2022-07-05T12:03:16.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~271s 2022-07-05T12:03:16.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~279s 2022-07-05T12:03:24.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~278s 2022-07-05T12:03:24.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~278s 2022-07-05T12:03:24.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~286s 2022-07-05T12:03:31.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~286s 2022-07-05T12:03:31.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~286s 2022-07-05T12:03:31.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~294s 2022-07-05T12:03:39.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~294s 2022-07-05T12:03:39.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~294s 2022-07-05T12:03:39.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.i is failed for ~302s 2022-07-05T12:03:39.703 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2022-07-05T12:03:39.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2022-07-05T12:03:39.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-07-05T12:03:39.704 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2022-07-05T12:03:42.198 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:03:42.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.324+0000 7fcad74a8700 1 Processor -- start 2022-07-05T12:03:42.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.324+0000 7fcad74a8700 1 -- start start 2022-07-05T12:03:42.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.325+0000 7fcad74a8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcad0063910 0x7fcad00ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.325+0000 7fcad74a8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad0061f10 con 0x7fcad00ef830 2022-07-05T12:03:42.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.325+0000 7fcad74a8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad0062d70 con 0x7fcad017dcd0 2022-07-05T12:03:42.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.325+0000 7fcad74a8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad0062160 con 0x7fcad0063910 2022-07-05T12:03:42.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.325+0000 7fcad64a6700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcad017dcd0 0x7fcad0063200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:49326/0 (socket says 172.21.15.90:49326) 2022-07-05T12:03:42.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.325+0000 7fcad64a6700 1 -- 172.21.15.90:0/650919733 learned_addr learned my addr 172.21.15.90:0/650919733 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:03:42.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.325+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/650919733 >> v2:172.21.15.110:3300/0 conn(0x7fcad0063910 0x7fcad00ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad54a4700 1 -- 172.21.15.90:0/650919733 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151776151 0 0) 0x7fcad0062d70 con 0x7fcad017dcd0 2022-07-05T12:03:42.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad54a4700 1 -- 172.21.15.90:0/650919733 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab80033f0 con 0x7fcad017dcd0 2022-07-05T12:03:42.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad5ca5700 1 -- 172.21.15.90:0/650919733 >> v1:172.21.15.149:6789/0 conn(0x7fcad017dcd0 legacy=0x7fcad0063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad54a4700 1 -- 172.21.15.90:0/650919733 <== mon.2 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821987327 0 0) 0x7fcab80033f0 con 0x7fcad017dcd0 2022-07-05T12:03:42.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad5ca5700 1 -- 172.21.15.90:0/650919733 >> v1:172.21.15.110:6789/0 conn(0x7fcad00ef830 legacy=0x7fcad00efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad5ca5700 1 -- 172.21.15.90:0/650919733 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0062440 con 0x7fcad0063910 2022-07-05T12:03:42.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/650919733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 0x7fcad00ef340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fcac0009760 tx=0x7fcac0009060).ready entity=mon.1 client_cookie=947e4d268dff647d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:42.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad54a4700 1 -- 172.21.15.90:0/650919733 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac80017f0 con 0x7fcad0063910 2022-07-05T12:03:42.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad54a4700 1 -- 172.21.15.90:0/650919733 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac00090d0 con 0x7fcad0063910 2022-07-05T12:03:42.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.326+0000 7fcad54a4700 1 -- 172.21.15.90:0/650919733 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0012620 con 0x7fcad0063910 2022-07-05T12:03:42.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.327+0000 7fcad74a8700 1 -- 172.21.15.90:0/650919733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 msgr2=0x7fcad00ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.327+0000 7fcad74a8700 1 --2- 172.21.15.90:0/650919733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 0x7fcad00ef340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fcac0009760 tx=0x7fcac0009060).stop 2022-07-05T12:03:42.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.327+0000 7fcad74a8700 1 -- 172.21.15.90:0/650919733 shutdown_connections 2022-07-05T12:03:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.327+0000 7fcad74a8700 1 --2- 172.21.15.90:0/650919733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 0x7fcad00ef340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.327+0000 7fcad74a8700 1 -- 172.21.15.90:0/650919733 >> 172.21.15.90:0/650919733 conn(0x7fcad00f5470 msgr2=0x7fcad00f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:42.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.327+0000 7fcad74a8700 1 -- 172.21.15.90:0/650919733 shutdown_connections 2022-07-05T12:03:42.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.327+0000 7fcad74a8700 1 -- 172.21.15.90:0/650919733 wait complete. 2022-07-05T12:03:42.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.328+0000 7fcad74a8700 1 Processor -- start 2022-07-05T12:03:42.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.328+0000 7fcad74a8700 1 -- start start 2022-07-05T12:03:42.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad74a8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 0x7fcad0176f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad74a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad00ef830 0x7fcad0177420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad74a8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad017dcd0 0x7fcad00eba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad74a8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00ccb90 con 0x7fcad017dcd0 2022-07-05T12:03:42.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad74a8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00cc700 con 0x7fcad0063910 2022-07-05T12:03:42.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad74a8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00cb810 con 0x7fcad00ef830 2022-07-05T12:03:42.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad6ca7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad017dcd0 0x7fcad00eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad5ca5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad00ef830 0x7fcad0177420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad6ca7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad017dcd0 0x7fcad00eba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60154/0 (socket says 172.21.15.90:60154) 2022-07-05T12:03:42.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.329+0000 7fcad6ca7700 1 -- 172.21.15.90:0/3814193174 learned_addr learned my addr 172.21.15.90:0/3814193174 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:42.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad64a6700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 0x7fcad0176f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad6ca7700 1 -- 172.21.15.90:0/3814193174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad00ef830 msgr2=0x7fcad0177420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad00ef830 0x7fcad0177420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad6ca7700 1 -- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 msgr2=0x7fcad0176f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 0x7fcad0176f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad6ca7700 1 -- 172.21.15.90:0/3814193174 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00092a0 con 0x7fcad017dcd0 2022-07-05T12:03:42.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad00ef830 0x7fcad0177420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:03:42.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad017dcd0 0x7fcad00eba40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fcacc00c510 tx=0x7fcacc007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcabe7fc700 1 -- 172.21.15.90:0/3814193174 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00f470 con 0x7fcad017dcd0 2022-07-05T12:03:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcabe7fc700 1 -- 172.21.15.90:0/3814193174 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00f5f0 con 0x7fcad017dcd0 2022-07-05T12:03:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad00cbaf0 con 0x7fcad017dcd0 2022-07-05T12:03:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcabe7fc700 1 -- 172.21.15.90:0/3814193174 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00f9b0 con 0x7fcad017dcd0 2022-07-05T12:03:42.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.330+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad00cc0b0 con 0x7fcad017dcd0 2022-07-05T12:03:42.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.332+0000 7fcabe7fc700 1 -- 172.21.15.90:0/3814193174 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fcacc019030 con 0x7fcad017dcd0 2022-07-05T12:03:42.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.332+0000 7fcabe7fc700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcab008ba40 0x7fcab008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.332+0000 7fcabe7fc700 1 -- 172.21.15.90:0/3814193174 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fcacc0afe50 con 0x7fcad017dcd0 2022-07-05T12:03:42.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.333+0000 7fcad64a6700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcab008ba40 0x7fcab008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.333+0000 7fcad64a6700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcab008ba40 0x7fcab008df00 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fcac8001a60 tx=0x7fcac8001880).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:42.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.334+0000 7fcaea096b80 1 Processor -- start 2022-07-05T12:03:42.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.334+0000 7fcaea096b80 1 -- start start 2022-07-05T12:03:42.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb374b0 0x55ce1baf38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1baf3da0 0x55ce1bb41a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1bb37d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcaea096b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1babd2d0 con 0x55ce1baf3da0 2022-07-05T12:03:42.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcaea096b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1ba34aa0 con 0x55ce1bb37890 2022-07-05T12:03:42.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcaea096b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1ba49950 con 0x55ce1bb374b0 2022-07-05T12:03:42.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcad5ca5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1baf3da0 0x55ce1bb41a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcad64a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb374b0 0x55ce1baf38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcad5ca5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1baf3da0 0x55ce1bb41a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60160/0 (socket says 172.21.15.90:60160) 2022-07-05T12:03:42.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.335+0000 7fcad5ca5700 1 -- 172.21.15.90:0/2751816007 learned_addr learned my addr 172.21.15.90:0/2751816007 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:42.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1bb37d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad5ca5700 1 -- 172.21.15.90:0/2751816007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb374b0 msgr2=0x55ce1baf38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb374b0 0x55ce1baf38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad5ca5700 1 -- 172.21.15.90:0/2751816007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 msgr2=0x55ce1bb37d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1bb37d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad5ca5700 1 -- 172.21.15.90:0/2751816007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce1b87b9e0 con 0x55ce1baf3da0 2022-07-05T12:03:42.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1bb37d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:03:42.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1baf3da0 0x55ce1bb41a80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fcac0012ec0 tx=0x7fcac0015000).ready entity=mon.0 client_cookie=4cf5e26f11f396a0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:42.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcaaf7fe700 1 -- 172.21.15.90:0/2751816007 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0012410 con 0x55ce1baf3da0 2022-07-05T12:03:42.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcaaf7fe700 1 -- 172.21.15.90:0/2751816007 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0012570 con 0x55ce1baf3da0 2022-07-05T12:03:42.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcaaf7fe700 1 -- 172.21.15.90:0/2751816007 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac001f650 con 0x55ce1baf3da0 2022-07-05T12:03:42.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcaea096b80 1 -- 172.21.15.90:0/2751816007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1baf3da0 msgr2=0x55ce1bb41a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcaea096b80 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1baf3da0 0x55ce1bb41a80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fcac0012ec0 tx=0x7fcac0015000).stop 2022-07-05T12:03:42.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcaea096b80 1 -- 172.21.15.90:0/2751816007 shutdown_connections 2022-07-05T12:03:42.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.336+0000 7fcaea096b80 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1bb37d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.337+0000 7fcaea096b80 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb374b0 0x55ce1baf38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.337+0000 7fcaea096b80 1 --2- 172.21.15.90:0/2751816007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1baf3da0 0x55ce1bb41a80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.337+0000 7fcaea096b80 1 -- 172.21.15.90:0/2751816007 >> 172.21.15.90:0/2751816007 conn(0x55ce1b9621c0 msgr2=0x55ce1baf6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:42.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.337+0000 7fcaea096b80 1 -- 172.21.15.90:0/2751816007 shutdown_connections 2022-07-05T12:03:42.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.337+0000 7fcaea096b80 1 -- 172.21.15.90:0/2751816007 wait complete. 2022-07-05T12:03:42.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.337+0000 7fcaea096b80 1 -- start start 2022-07-05T12:03:42.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.337+0000 7fcaea096b80 1 Processor -- start 2022-07-05T12:03:42.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1bb26c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb374b0 0x55ce1bb75920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb37890 0x55ce1bb40fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1ba11120 con 0x55ce1bb37890 2022-07-05T12:03:42.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1bb270f0 con 0x55ce1bb374b0 2022-07-05T12:03:42.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1bb765f0 con 0x55ce1baf3da0 2022-07-05T12:03:42.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 10 client.0 ll_register_callbacks cb 0x55ce1bab7380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:03:42.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb37890 0x55ce1bb40fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb37890 0x55ce1bb40fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60168/0 (socket says 172.21.15.90:60168) 2022-07-05T12:03:42.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 -- 172.21.15.90:0/695503061 learned_addr learned my addr 172.21.15.90:0/695503061 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:42.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad64a6700 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1bb26c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb374b0 0x55ce1bb75920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 -- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 msgr2=0x55ce1bb26c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1bb26c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 -- 172.21.15.90:0/695503061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb374b0 msgr2=0x55ce1bb75920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb374b0 0x55ce1bb75920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 -- 172.21.15.90:0/695503061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0016040 con 0x55ce1bb37890 2022-07-05T12:03:42.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb37890 0x55ce1bb40fb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fcacc00c4e0 tx=0x7fcacc084540).ready entity=mon.0 client_cookie=8f87669746a58d10 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:42.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaacff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:03:42.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaacff9700 1 -- 172.21.15.90:0/695503061 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc082c10 con 0x55ce1bb37890 2022-07-05T12:03:42.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaacff9700 1 -- 172.21.15.90:0/695503061 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fcacc051be0 con 0x55ce1bb37890 2022-07-05T12:03:42.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce1baf1690 con 0x55ce1bb37890 2022-07-05T12:03:42.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaacff9700 1 -- 172.21.15.90:0/695503061 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcacc083c60 con 0x55ce1bb37890 2022-07-05T12:03:42.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 10 client.5994 fetch_fsmap learned FSMap version 41 2022-07-05T12:03:42.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55ce1b8eacd0 con 0x55ce1bb37890 2022-07-05T12:03:42.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.339+0000 7fcaacff9700 1 -- 172.21.15.90:0/695503061 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc091020 con 0x55ce1bb37890 2022-07-05T12:03:42.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaacff9700 1 -- 172.21.15.90:0/695503061 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fcacc089bc0 con 0x55ce1bb37890 2022-07-05T12:03:42.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaea096b80 10 client.5994 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:03:42.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaea096b80 10 client.5994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:03:42.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaea096b80 20 client.5994 populate_metadata read hostname 'smithi090' 2022-07-05T12:03:42.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaea096b80 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bafe9a0 0x55ce1bb66d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaea096b80 4 client.5994 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:03:42.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce1ba3f7f0 con 0x55ce1bafe9a0 2022-07-05T12:03:42.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcad64a6700 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bafe9a0 0x55ce1bb66d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcaacff9700 10 client.5994 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:42.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.340+0000 7fcad64a6700 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bafe9a0 0x55ce1bb66d20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=488dd71d8e15d9c server_cookie=4af48683cb857ffe in_seq=0 out_seq=0 2022-07-05T12:03:42.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaacff9700 1 -- 172.21.15.90:0/695503061 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55ce1ba3f7f0 con 0x55ce1bafe9a0 2022-07-05T12:03:42.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaacff9700 10 client.5994 handle_command_reply: tid=0 2022-07-05T12:03:42.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 client.5994 shutdown 2022-07-05T12:03:42.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb37890 msgr2=0x55ce1bb40fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb37890 0x55ce1bb40fb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fcacc00c4e0 tx=0x7fcacc084540).stop 2022-07-05T12:03:42.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 shutdown_connections 2022-07-05T12:03:42.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bafe9a0 0x55ce1bb66d20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb37890 0x55ce1bb40fb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1bb26c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 --2- 172.21.15.90:0/695503061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb374b0 0x55ce1bb75920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaacff9700 0 client.5994 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:42.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 >> 172.21.15.90:0/695503061 conn(0x55ce1b9621c0 msgr2=0x55ce1bb64390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:42.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 shutdown_connections 2022-07-05T12:03:42.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 1 -- 172.21.15.90:0/695503061 wait complete. 2022-07-05T12:03:42.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.341+0000 7fcaea096b80 20 client.5994 trim_cache size 0 max 16384 2022-07-05T12:03:42.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.357+0000 7fcaea096b80 1 Processor -- start 2022-07-05T12:03:42.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.357+0000 7fcaea096b80 1 -- start start 2022-07-05T12:03:42.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1baf3da0 0x55ce1bb694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1baed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb37890 0x55ce1bb65a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaea096b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1baf3c40 con 0x55ce1bb374b0 2022-07-05T12:03:42.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaea096b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1baf3510 con 0x55ce1baf3da0 2022-07-05T12:03:42.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaea096b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1baf37b0 con 0x55ce1bb37890 2022-07-05T12:03:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1baed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1baed5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60174/0 (socket says 172.21.15.90:60174) 2022-07-05T12:03:42.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 -- 172.21.15.90:0/344578822 learned_addr learned my addr 172.21.15.90:0/344578822 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb37890 0x55ce1bb65a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad64a6700 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1baf3da0 0x55ce1bb694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 -- 172.21.15.90:0/344578822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb37890 msgr2=0x55ce1bb65a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb37890 0x55ce1bb65a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 -- 172.21.15.90:0/344578822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1baf3da0 msgr2=0x55ce1bb694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1baf3da0 0x55ce1bb694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 -- 172.21.15.90:0/344578822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce1b8b8fd0 con 0x55ce1bb374b0 2022-07-05T12:03:42.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb37890 0x55ce1bb65a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:03:42.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad64a6700 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1baf3da0 0x55ce1bb694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:03:42.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1baed5b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fcac0012fd0 tx=0x7fcac0020000).ready entity=mon.0 client_cookie=be6d0adcd8170b67 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:42.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaaffff700 1 -- 172.21.15.90:0/344578822 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac002e070 con 0x55ce1bb374b0 2022-07-05T12:03:42.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaaffff700 1 -- 172.21.15.90:0/344578822 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac001f440 con 0x55ce1bb374b0 2022-07-05T12:03:42.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.358+0000 7fcaaffff700 1 -- 172.21.15.90:0/344578822 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac001fa80 con 0x55ce1bb374b0 2022-07-05T12:03:42.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 -- 172.21.15.90:0/344578822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 msgr2=0x55ce1baed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1baed5b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fcac0012fd0 tx=0x7fcac0020000).stop 2022-07-05T12:03:42.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 -- 172.21.15.90:0/344578822 shutdown_connections 2022-07-05T12:03:42.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1bb37890 0x55ce1bb65a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1baf3da0 0x55ce1bb694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 --2- 172.21.15.90:0/344578822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1baed5b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 -- 172.21.15.90:0/344578822 >> 172.21.15.90:0/344578822 conn(0x55ce1b9621c0 msgr2=0x55ce1bb3e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:42.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 -- 172.21.15.90:0/344578822 shutdown_connections 2022-07-05T12:03:42.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.359+0000 7fcaea096b80 1 -- 172.21.15.90:0/344578822 wait complete. 2022-07-05T12:03:42.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.360+0000 7fcaea096b80 1 -- start start 2022-07-05T12:03:42.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.360+0000 7fcaea096b80 1 Processor -- start 2022-07-05T12:03:42.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1baf4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1bb72540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1baf4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1bbceda0 con 0x55ce1bb374b0 2022-07-05T12:03:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1bb71dd0 con 0x55ce1bb37890 2022-07-05T12:03:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce1bb720b0 con 0x55ce1baf3da0 2022-07-05T12:03:42.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 10 client.0 ll_register_callbacks cb 0x55ce1bab7380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:03:42.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1bb72540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.435 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1bb72540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60180/0 (socket says 172.21.15.90:60180) 2022-07-05T12:03:42.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 -- 172.21.15.90:0/87764214 learned_addr learned my addr 172.21.15.90:0/87764214 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:03:42.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad64a6700 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1baf4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad6ca7700 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1baf4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.436 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 -- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 msgr2=0x55ce1baf4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1baf4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 -- 172.21.15.90:0/87764214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 msgr2=0x55ce1baf4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:03:42.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1baf4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.437 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 -- 172.21.15.90:0/87764214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce1b87b9e0 con 0x55ce1bb374b0 2022-07-05T12:03:42.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcad5ca5700 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1bb72540 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fcac0021000 tx=0x7fcac002e000).ready entity=mon.0 client_cookie=d81db57a2c779315 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:03:42.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaacff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:03:42.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaacff9700 1 -- 172.21.15.90:0/87764214 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0033460 con 0x55ce1bb374b0 2022-07-05T12:03:42.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaacff9700 1 -- 172.21.15.90:0/87764214 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fcac00335c0 con 0x55ce1bb374b0 2022-07-05T12:03:42.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.361+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcac0012570 con 0x55ce1bb374b0 2022-07-05T12:03:42.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaacff9700 1 -- 172.21.15.90:0/87764214 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac0033990 con 0x55ce1bb374b0 2022-07-05T12:03:42.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 10 client.6000 fetch_fsmap learned FSMap version 41 2022-07-05T12:03:42.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55ce1bb7d590 con 0x55ce1bb374b0 2022-07-05T12:03:42.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaacff9700 1 -- 172.21.15.90:0/87764214 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0012570 con 0x55ce1bb374b0 2022-07-05T12:03:42.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaacff9700 1 -- 172.21.15.90:0/87764214 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fcac0033af0 con 0x55ce1bb374b0 2022-07-05T12:03:42.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 10 client.6000 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:03:42.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 10 client.6000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:03:42.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 20 client.6000 populate_metadata read hostname 'smithi090' 2022-07-05T12:03:42.442 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bb798f0 0x55ce1bbb3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:03:42.442 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 4 client.6000 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:03:42.442 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ce1ba36690 con 0x55ce1bb798f0 2022-07-05T12:03:42.443 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcad64a6700 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bb798f0 0x55ce1bbb3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:03:42.443 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcaacff9700 10 client.6000 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:42.443 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.362+0000 7fcad64a6700 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bb798f0 0x55ce1bbb3930 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=412a43a976d8534a server_cookie=5b92cdd697c980d in_seq=0 out_seq=0 2022-07-05T12:03:42.443 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaacff9700 1 -- 172.21.15.90:0/87764214 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ce1ba36690 con 0x55ce1bb798f0 2022-07-05T12:03:42.444 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaacff9700 10 client.6000 handle_command_reply: tid=0 2022-07-05T12:03:42.444 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 client.6000 shutdown 2022-07-05T12:03:42.444 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 msgr2=0x55ce1bb72540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.444 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1bb72540 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fcac0021000 tx=0x7fcac002e000).stop 2022-07-05T12:03:42.445 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 shutdown_connections 2022-07-05T12:03:42.445 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ce1bb798f0 0x55ce1bbb3930 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.445 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ce1bb37890 0x55ce1baf4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.445 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ce1baf3da0 0x55ce1baf4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.446 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaacff9700 0 client.6000 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:03:42.446 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 --2- 172.21.15.90:0/87764214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce1bb374b0 0x55ce1bb72540 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 >> 172.21.15.90:0/87764214 conn(0x55ce1b9621c0 msgr2=0x55ce1bbbf740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:42.447 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 shutdown_connections 2022-07-05T12:03:42.448 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 1 -- 172.21.15.90:0/87764214 wait complete. 2022-07-05T12:03:42.448 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcaea096b80 20 client.6000 trim_cache size 0 max 16384 2022-07-05T12:03:42.449 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:03:42.451 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:03:42.451 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:03:42.452 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:03:42.452 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:03:42.452 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:03:42.453 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:03:42.453 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:03:42.454 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:03:42.454 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:03:42.458 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcab008ba40 msgr2=0x7fcab008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.459 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcab008ba40 0x7fcab008df00 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fcac8001a60 tx=0x7fcac8001880).stop 2022-07-05T12:03:42.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad017dcd0 msgr2=0x7fcad00eba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:03:42.460 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad017dcd0 0x7fcad00eba40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fcacc00c510 tx=0x7fcacc007d00).stop 2022-07-05T12:03:42.461 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 shutdown_connections 2022-07-05T12:03:42.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fcab008ba40 0x7fcab008df00 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcad017dcd0 0x7fcad00eba40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.462 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad0063910 0x7fcad0176f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 --2- 172.21.15.90:0/3814193174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad00ef830 0x7fcad0177420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:03:42.463 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 >> 172.21.15.90:0/3814193174 conn(0x7fcad00f5470 msgr2=0x7fcad00c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:03:42.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.363+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 shutdown_connections 2022-07-05T12:03:42.464 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:03:42.364+0000 7fcad74a8700 1 -- 172.21.15.90:0/3814193174 wait complete. 2022-07-05T12:03:42.465 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:04:12.476 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:04:12.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.604+0000 7f6fe0eb7700 1 Processor -- start 2022-07-05T12:04:12.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.604+0000 7f6fe0eb7700 1 -- start start 2022-07-05T12:04:12.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fe0eb7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6fdc17aa40 0x7f6fdc0c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fe0eb7700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6fdc0c6530 0x7f6fdc0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fe0eb7700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc0c4f80 con 0x7f6fdc0c6ea0 2022-07-05T12:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fe0eb7700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0c5e70 con 0x7f6fdc17aa40 2022-07-05T12:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fe0eb7700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0c5260 con 0x7f6fdc0c6530 2022-07-05T12:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6fdc17aa40 0x7f6fdc0c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6fdc17aa40 0x7f6fdc0c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60186/0 (socket says 172.21.15.90:60186) 2022-07-05T12:04:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 -- 172.21.15.90:0/443854826 learned_addr learned my addr 172.21.15.90:0/443854826 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:12.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/443854826 >> v2:172.21.15.110:3300/0 conn(0x7f6fdc0c6530 0x7f6fdc0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 -- 172.21.15.90:0/443854826 >> v2:172.21.15.110:3300/0 conn(0x7f6fdc0c6530 msgr2=0x7f6fdc0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 --2- 172.21.15.90:0/443854826 >> v2:172.21.15.110:3300/0 conn(0x7f6fdc0c6530 0x7f6fdc0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 -- 172.21.15.90:0/443854826 >> v1:172.21.15.110:6789/0 conn(0x7f6fdc0c6ea0 legacy=0x7f6fdc17ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 -- 172.21.15.90:0/443854826 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0c5540 con 0x7f6fdc17aa40 2022-07-05T12:04:12.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/443854826 >> v2:172.21.15.110:3300/0 conn(0x7f6fdc0c6530 0x7f6fdc0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:04:12.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fda59c700 1 --2- 172.21.15.90:0/443854826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0c46e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f6fdc06a750 tx=0x7f6fcc009840).ready entity=mon.0 client_cookie=75060c16ebf103ee server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:12.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fd959a700 1 -- 172.21.15.90:0/443854826 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00e070 con 0x7f6fdc17aa40 2022-07-05T12:04:12.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fd959a700 1 -- 172.21.15.90:0/443854826 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00ba10 con 0x7f6fdc17aa40 2022-07-05T12:04:12.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.606+0000 7f6fd959a700 1 -- 172.21.15.90:0/443854826 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00bd90 con 0x7f6fdc17aa40 2022-07-05T12:04:12.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/443854826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 msgr2=0x7f6fdc0c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/443854826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0c46e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f6fdc06a750 tx=0x7f6fcc009840).stop 2022-07-05T12:04:12.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/443854826 shutdown_connections 2022-07-05T12:04:12.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/443854826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0c46e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/443854826 >> v2:172.21.15.110:3300/0 conn(0x7f6fdc0c6530 0x7f6fdc0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/443854826 >> 172.21.15.90:0/443854826 conn(0x7f6fdc0edd30 msgr2=0x7f6fdc05d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:12.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/443854826 shutdown_connections 2022-07-05T12:04:12.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.607+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/443854826 wait complete. 2022-07-05T12:04:12.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.608+0000 7f6fe0eb7700 1 Processor -- start 2022-07-05T12:04:12.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.609+0000 7f6fe0eb7700 1 -- start start 2022-07-05T12:04:12.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.609+0000 7f6fe0eb7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc0c6530 0x7f6fdc0ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.609+0000 7f6fe0eb7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fdc0c6ea0 0x7f6fdc165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.609+0000 7f6fe0eb7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.609+0000 7f6fe0eb7700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc184810 con 0x7f6fdc17aa40 2022-07-05T12:04:12.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fe0eb7700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc184380 con 0x7f6fdc0c6ea0 2022-07-05T12:04:12.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fe0eb7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc183490 con 0x7f6fdc0c6530 2022-07-05T12:04:12.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0eb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60192/0 (socket says 172.21.15.90:60192) 2022-07-05T12:04:12.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 -- 172.21.15.90:0/3435199559 learned_addr learned my addr 172.21.15.90:0/3435199559 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:12.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fdc0c6ea0 0x7f6fdc165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc0c6530 0x7f6fdc0ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 -- 172.21.15.90:0/3435199559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc0c6530 msgr2=0x7f6fdc0ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc0c6530 0x7f6fdc0ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 -- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fdc0c6ea0 msgr2=0x7f6fdc165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fdc0c6ea0 0x7f6fdc165ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 -- 172.21.15.90:0/3435199559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc009ae0 con 0x7f6fdc17aa40 2022-07-05T12:04:12.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0eb0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f6fd400c490 tx=0x7f6fd4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:12.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fca7fc700 1 -- 172.21.15.90:0/3435199559 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4002ea0 con 0x7f6fdc17aa40 2022-07-05T12:04:12.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fca7fc700 1 -- 172.21.15.90:0/3435199559 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd40123f0 con 0x7f6fdc17aa40 2022-07-05T12:04:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc183770 con 0x7f6fdc17aa40 2022-07-05T12:04:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fca7fc700 1 -- 172.21.15.90:0/3435199559 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4012790 con 0x7f6fdc17aa40 2022-07-05T12:04:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.610+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc183d30 con 0x7f6fdc17aa40 2022-07-05T12:04:12.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.612+0000 7f6fca7fc700 1 -- 172.21.15.90:0/3435199559 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6fd4010070 con 0x7f6fdc17aa40 2022-07-05T12:04:12.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.612+0000 7f6fca7fc700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fb808ba40 0x7f6fb808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.613+0000 7f6fca7fc700 1 -- 172.21.15.90:0/3435199559 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6fd40afdc0 con 0x7f6fdc17aa40 2022-07-05T12:04:12.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.613+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fb808ba40 0x7f6fb808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.613+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fb808ba40 0x7f6fb808df00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f6fcc009df0 tx=0x7f6fcc009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:12.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.614+0000 7f6ff2843b80 1 Processor -- start 2022-07-05T12:04:12.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.614+0000 7f6ff2843b80 1 -- start start 2022-07-05T12:04:12.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c03c0 0x55fc1697c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c07a0 0x55fc169c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc169462d0 con 0x55fc1697ccb0 2022-07-05T12:04:12.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc168bdaa0 con 0x55fc169c07a0 2022-07-05T12:04:12.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc168d2950 con 0x55fc169c03c0 2022-07-05T12:04:12.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6fd9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c03c0 0x55fc1697c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c03c0 0x55fc1697c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41592/0 (socket says 172.21.15.90:41592) 2022-07-05T12:04:12.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6fd9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60198/0 (socket says 172.21.15.90:60198) 2022-07-05T12:04:12.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6fda59c700 1 -- 172.21.15.90:0/2940649513 learned_addr learned my addr 172.21.15.90:0/2940649513 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:12.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.615+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c07a0 0x55fc169c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fd9d9b700 1 -- 172.21.15.90:0/2940649513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c03c0 msgr2=0x55fc1697c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c03c0 0x55fc1697c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fd9d9b700 1 -- 172.21.15.90:0/2940649513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c07a0 msgr2=0x55fc169c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c07a0 0x55fc169c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fd9d9b700 1 -- 172.21.15.90:0/2940649513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc167049e0 con 0x55fc1697ccb0 2022-07-05T12:04:12.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fda59c700 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c03c0 0x55fc1697c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:04:12.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169ca990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f6fd000aa80 tx=0x7f6fd0008040).ready entity=mon.0 client_cookie=91a3bf7be4542ec7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:12.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fb77fe700 1 -- 172.21.15.90:0/2940649513 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000a510 con 0x55fc1697ccb0 2022-07-05T12:04:12.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fb77fe700 1 -- 172.21.15.90:0/2940649513 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000c040 con 0x55fc1697ccb0 2022-07-05T12:04:12.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.616+0000 7f6fb77fe700 1 -- 172.21.15.90:0/2940649513 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000fb50 con 0x55fc1697ccb0 2022-07-05T12:04:12.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2940649513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 msgr2=0x55fc169ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169ca990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f6fd000aa80 tx=0x7f6fd0008040).stop 2022-07-05T12:04:12.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2940649513 shutdown_connections 2022-07-05T12:04:12.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c07a0 0x55fc169c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c03c0 0x55fc1697c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2940649513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169ca990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2940649513 >> 172.21.15.90:0/2940649513 conn(0x55fc167eb1c0 msgr2=0x55fc1697fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:12.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2940649513 shutdown_connections 2022-07-05T12:04:12.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2940649513 wait complete. 2022-07-05T12:04:12.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 -- start start 2022-07-05T12:04:12.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.617+0000 7f6ff2843b80 1 Processor -- start 2022-07-05T12:04:12.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc1697ccb0 0x55fc169bf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169bb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c07a0 0x55fc169ba950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1689a120 con 0x55fc169c07a0 2022-07-05T12:04:12.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc169f0a10 con 0x55fc169c03c0 2022-07-05T12:04:12.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc169befd0 con 0x55fc1697ccb0 2022-07-05T12:04:12.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 10 client.0 ll_register_callbacks cb 0x55fc169401b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:04:12.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c07a0 0x55fc169ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc1697ccb0 0x55fc169bf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c07a0 0x55fc169ba950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60206/0 (socket says 172.21.15.90:60206) 2022-07-05T12:04:12.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 -- 172.21.15.90:0/2479394522 learned_addr learned my addr 172.21.15.90:0/2479394522 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:12.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc1697ccb0 0x55fc169bf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41598/0 (socket says 172.21.15.90:41598) 2022-07-05T12:04:12.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169bb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 -- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc1697ccb0 msgr2=0x55fc169bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc1697ccb0 0x55fc169bf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 -- 172.21.15.90:0/2479394522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 msgr2=0x55fc169bb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169bb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 -- 172.21.15.90:0/2479394522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc017040 con 0x55fc169c07a0 2022-07-05T12:04:12.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fda59c700 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc1697ccb0 0x55fc169bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:04:12.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c07a0 0x55fc169ba950 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f6fd4084810 tx=0x7f6fd4014040).ready entity=mon.0 client_cookie=8b660eb68509fec9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:12.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:04:12.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/2479394522 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4083d60 con 0x55fc169c07a0 2022-07-05T12:04:12.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/2479394522 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6fd408b060 con 0x55fc169c07a0 2022-07-05T12:04:12.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc1697a440 con 0x55fc169c07a0 2022-07-05T12:04:12.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.619+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/2479394522 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fd4089cc0 con 0x55fc169c07a0 2022-07-05T12:04:12.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 10 client.6030 fetch_fsmap learned FSMap version 41 2022-07-05T12:04:12.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x7f6fd000a6e0 con 0x55fc169c07a0 2022-07-05T12:04:12.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/2479394522 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc1697a440 con 0x55fc169c07a0 2022-07-05T12:04:12.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/2479394522 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f6fd4080450 con 0x55fc169c07a0 2022-07-05T12:04:12.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 10 client.6030 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:04:12.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 10 client.6030 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:04:12.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 20 client.6030 populate_metadata read hostname 'smithi090' 2022-07-05T12:04:12.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16980d40 0x55fc169b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 4 client.6030 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:04:12.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc168c87f0 con 0x55fc16980d40 2022-07-05T12:04:12.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6fda59c700 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16980d40 0x55fc169b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6fda59c700 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16980d40 0x55fc169b53d0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f1fab1b1bb693dcd server_cookie=98a613a51c1184d1 in_seq=0 out_seq=0 2022-07-05T12:04:12.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.620+0000 7f6fb4ff9700 10 client.6030 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:12.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/2479394522 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55fc168c87f0 con 0x55fc16980d40 2022-07-05T12:04:12.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6fb4ff9700 10 client.6030 handle_command_reply: tid=0 2022-07-05T12:04:12.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 client.6030 shutdown 2022-07-05T12:04:12.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c07a0 msgr2=0x55fc169ba950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c07a0 0x55fc169ba950 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f6fd4084810 tx=0x7f6fd4014040).stop 2022-07-05T12:04:12.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 shutdown_connections 2022-07-05T12:04:12.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16980d40 0x55fc169b53d0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c07a0 0x55fc169ba950 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc1697ccb0 0x55fc169bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/2479394522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169bb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6fb4ff9700 0 client.6030 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:12.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 >> 172.21.15.90:0/2479394522 conn(0x55fc167eb1c0 msgr2=0x55fc1697fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:12.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 shutdown_connections 2022-07-05T12:04:12.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 1 -- 172.21.15.90:0/2479394522 wait complete. 2022-07-05T12:04:12.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.621+0000 7f6ff2843b80 20 client.6030 trim_cache size 0 max 16384 2022-07-05T12:04:12.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.637+0000 7f6ff2843b80 1 Processor -- start 2022-07-05T12:04:12.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.638+0000 7f6ff2843b80 1 -- start start 2022-07-05T12:04:12.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.638+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.638+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.638+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc169bf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.638+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc169c00b0 con 0x55fc1697ccb0 2022-07-05T12:04:12.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.638+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc16976750 con 0x55fc169c03c0 2022-07-05T12:04:12.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.638+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc16a01de0 con 0x55fc169c07a0 2022-07-05T12:04:12.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60210/0 (socket says 172.21.15.90:60210) 2022-07-05T12:04:12.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 -- 172.21.15.90:0/3386896403 learned_addr learned my addr 172.21.15.90:0/3386896403 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:12.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc169bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 -- 172.21.15.90:0/3386896403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 msgr2=0x55fc169bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc169bf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 -- 172.21.15.90:0/3386896403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 msgr2=0x55fc169b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.682 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 -- 172.21.15.90:0/3386896403 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc16773cd0 con 0x55fc1697ccb0 2022-07-05T12:04:12.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:04:12.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169c7640 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x55fc169bee70 tx=0x7f6fcc020040).ready entity=mon.0 client_cookie=7879e692343b61ac server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:12.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fb7fff700 1 -- 172.21.15.90:0/3386896403 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc030070 con 0x55fc1697ccb0 2022-07-05T12:04:12.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fb7fff700 1 -- 172.21.15.90:0/3386896403 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc01e7b0 con 0x55fc1697ccb0 2022-07-05T12:04:12.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.639+0000 7f6fb7fff700 1 -- 172.21.15.90:0/3386896403 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc01e920 con 0x55fc1697ccb0 2022-07-05T12:04:12.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3386896403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 msgr2=0x55fc169c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169c7640 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x55fc169bee70 tx=0x7f6fcc020040).stop 2022-07-05T12:04:12.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3386896403 shutdown_connections 2022-07-05T12:04:12.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc169bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc1697ccb0 0x55fc169c7640 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3386896403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc169c03c0 0x55fc169b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3386896403 >> 172.21.15.90:0/3386896403 conn(0x55fc167eb1c0 msgr2=0x55fc1697d710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:12.686 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3386896403 shutdown_connections 2022-07-05T12:04:12.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3386896403 wait complete. 2022-07-05T12:04:12.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.640+0000 7f6ff2843b80 1 -- start start 2022-07-05T12:04:12.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.641+0000 7f6ff2843b80 1 Processor -- start 2022-07-05T12:04:12.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc1697ccb0 0x55fc16a58320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.687 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c03c0 0x55fc16a46be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc16a4c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc16987af0 con 0x55fc169c03c0 2022-07-05T12:04:12.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc16a4b470 con 0x55fc1697ccb0 2022-07-05T12:04:12.688 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc169ff140 con 0x55fc169c07a0 2022-07-05T12:04:12.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 10 client.0 ll_register_callbacks cb 0x55fc169401b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:04:12.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c03c0 0x55fc16a46be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c03c0 0x55fc16a46be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60216/0 (socket says 172.21.15.90:60216) 2022-07-05T12:04:12.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 -- 172.21.15.90:0/3212494395 learned_addr learned my addr 172.21.15.90:0/3212494395 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:12.689 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fdad9d700 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc16a4c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc1697ccb0 0x55fc16a58320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 -- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 msgr2=0x55fc16a4c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc16a4c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.690 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 -- 172.21.15.90:0/3212494395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc1697ccb0 msgr2=0x55fc16a58320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:12.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc1697ccb0 0x55fc16a58320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 -- 172.21.15.90:0/3212494395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0c5540 con 0x55fc169c03c0 2022-07-05T12:04:12.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fd9d9b700 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c03c0 0x55fc16a46be0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f6fd000f520 tx=0x55fc169cb840).ready entity=mon.0 client_cookie=2bf8be2b7f37eb7a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:12.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:04:12.691 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/3212494395 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0013460 con 0x55fc169c03c0 2022-07-05T12:04:12.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/3212494395 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6fd00135c0 con 0x55fc169c03c0 2022-07-05T12:04:12.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fd000c040 con 0x55fc169c03c0 2022-07-05T12:04:12.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/3212494395 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fd0013990 con 0x55fc169c03c0 2022-07-05T12:04:12.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 10 client.6036 fetch_fsmap learned FSMap version 41 2022-07-05T12:04:12.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.642+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55fc16741fd0 con 0x55fc169c03c0 2022-07-05T12:04:12.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/3212494395 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000c040 con 0x55fc169c03c0 2022-07-05T12:04:12.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/3212494395 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f6fd0026070 con 0x55fc169c03c0 2022-07-05T12:04:12.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6ff2843b80 10 client.6036 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:04:12.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6ff2843b80 10 client.6036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:04:12.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6ff2843b80 20 client.6036 populate_metadata read hostname 'smithi090' 2022-07-05T12:04:12.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16986dd0 0x55fc169bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:12.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6ff2843b80 4 client.6036 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:04:12.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc168bf690 con 0x55fc16986dd0 2022-07-05T12:04:12.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16986dd0 0x55fc169bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:12.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6fb4ff9700 10 client.6036 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:12.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6fda59c700 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16986dd0 0x55fc169bf3b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d5cbde2e9fa370bb server_cookie=aac6fa20af85ab42 in_seq=0 out_seq=0 2022-07-05T12:04:12.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6fb4ff9700 1 -- 172.21.15.90:0/3212494395 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fc168bf690 con 0x55fc16986dd0 2022-07-05T12:04:12.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6fb4ff9700 10 client.6036 handle_command_reply: tid=0 2022-07-05T12:04:12.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.643+0000 7f6ff2843b80 1 client.6036 shutdown 2022-07-05T12:04:12.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c03c0 msgr2=0x55fc16a46be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c03c0 0x55fc16a46be0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f6fd000f520 tx=0x55fc169cb840).stop 2022-07-05T12:04:12.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 shutdown_connections 2022-07-05T12:04:12.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fc16986dd0 0x55fc169bf3b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc169c07a0 0x55fc16a4c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fb4ff9700 0 client.6036 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:12.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fc1697ccb0 0x55fc16a58320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 --2- 172.21.15.90:0/3212494395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fc169c03c0 0x55fc16a46be0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 >> 172.21.15.90:0/3212494395 conn(0x55fc167eb1c0 msgr2=0x55fc169c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:12.700 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 shutdown_connections 2022-07-05T12:04:12.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 1 -- 172.21.15.90:0/3212494395 wait complete. 2022-07-05T12:04:12.701 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6ff2843b80 20 client.6036 trim_cache size 0 max 16384 2022-07-05T12:04:12.702 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:04:12.702 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:04:12.702 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:04:12.702 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:04:12.703 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:04:12.703 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:04:12.703 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:04:12.703 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:04:12.703 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:04:12.704 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:04:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fb808ba40 msgr2=0x7f6fb808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fb808ba40 0x7f6fb808df00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f6fcc009df0 tx=0x7f6fcc009840).stop 2022-07-05T12:04:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 msgr2=0x7f6fdc0eb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0eb0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f6fd400c490 tx=0x7f6fd4007de0).stop 2022-07-05T12:04:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 shutdown_connections 2022-07-05T12:04:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fb808ba40 0x7f6fb808df00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc17aa40 0x7f6fdc0eb0a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc0c6530 0x7f6fdc0ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 --2- 172.21.15.90:0/3435199559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fdc0c6ea0 0x7f6fdc165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:12.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 >> 172.21.15.90:0/3435199559 conn(0x7f6fdc0edd30 msgr2=0x7f6fdc064690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:12.708 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 shutdown_connections 2022-07-05T12:04:12.709 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:12.644+0000 7f6fe0eb7700 1 -- 172.21.15.90:0/3435199559 wait complete. 2022-07-05T12:04:12.713 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:04:23.076 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:04:23.081 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:04:23.086 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:04:24.310 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:04:24.307+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42399) UID: 0 2022-07-05T12:04:24.312 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:04:24.307+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42399) UID: 0 2022-07-05T12:04:24.312 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:04:24.307+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42399) UID: 0 2022-07-05T12:04:42.714 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:04:42.840 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.839+0000 7f9799596700 1 Processor -- start 2022-07-05T12:04:42.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.839+0000 7f9799596700 1 -- start start 2022-07-05T12:04:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.840+0000 7f9799596700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9794178610 0x7f97941789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.840+0000 7f9799596700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f979417f3b0 0x7f979417d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.840+0000 7f9799596700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979417d560 con 0x7f979417dee0 2022-07-05T12:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.840+0000 7f9799596700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9794064bd0 con 0x7f979417f3b0 2022-07-05T12:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.840+0000 7f9799596700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979417f830 con 0x7f9794178610 2022-07-05T12:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f979417f3b0 0x7f979417d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f979417f3b0 0x7f979417d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60224/0 (socket says 172.21.15.90:60224) 2022-07-05T12:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 -- 172.21.15.90:0/3348110341 learned_addr learned my addr 172.21.15.90:0/3348110341 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3348110341 >> v2:172.21.15.149:3300/0 conn(0x7f9794178610 0x7f97941789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 -- 172.21.15.90:0/3348110341 >> v2:172.21.15.149:3300/0 conn(0x7f9794178610 msgr2=0x7f97941789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 --2- 172.21.15.90:0/3348110341 >> v2:172.21.15.149:3300/0 conn(0x7f9794178610 0x7f97941789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 -- 172.21.15.90:0/3348110341 >> v1:172.21.15.149:6789/0 conn(0x7f979417dee0 legacy=0x7f9794181e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 -- 172.21.15.90:0/3348110341 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979417c670 con 0x7f979417f3b0 2022-07-05T12:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3348110341 >> v2:172.21.15.149:3300/0 conn(0x7f9794178610 0x7f97941789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:04:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f97927fc700 1 --2- 172.21.15.90:0/3348110341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979417f3b0 0x7f979417d9f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f97940ebfe0 tx=0x7f977c0090f0).ready entity=mon.0 client_cookie=f800827172e999d5 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f9791ffb700 1 -- 172.21.15.90:0/3348110341 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00b600 con 0x7f979417f3b0 2022-07-05T12:04:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f9791ffb700 1 -- 172.21.15.90:0/3348110341 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c00b760 con 0x7f979417f3b0 2022-07-05T12:04:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.841+0000 7f9791ffb700 1 -- 172.21.15.90:0/3348110341 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00bb00 con 0x7f979417f3b0 2022-07-05T12:04:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 -- 172.21.15.90:0/3348110341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979417f3b0 msgr2=0x7f979417d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 --2- 172.21.15.90:0/3348110341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979417f3b0 0x7f979417d9f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f97940ebfe0 tx=0x7f977c0090f0).stop 2022-07-05T12:04:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 -- 172.21.15.90:0/3348110341 shutdown_connections 2022-07-05T12:04:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 --2- 172.21.15.90:0/3348110341 >> v2:172.21.15.149:3300/0 conn(0x7f9794178610 0x7f97941789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 --2- 172.21.15.90:0/3348110341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979417f3b0 0x7f979417d9f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 -- 172.21.15.90:0/3348110341 >> 172.21.15.90:0/3348110341 conn(0x7f97940f2210 msgr2=0x7f9794069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 -- 172.21.15.90:0/3348110341 shutdown_connections 2022-07-05T12:04:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.842+0000 7f9799596700 1 -- 172.21.15.90:0/3348110341 wait complete. 2022-07-05T12:04:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.843+0000 7f9799596700 1 Processor -- start 2022-07-05T12:04:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.843+0000 7f9799596700 1 -- start start 2022-07-05T12:04:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9799596700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9794178610 0x7f9794173730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9799596700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f979417dee0 0x7f9794178f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9799596700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979417f3b0 0x7f9794169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9799596700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979417b930 con 0x7f9794178610 2022-07-05T12:04:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9799596700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979417b370 con 0x7f979417dee0 2022-07-05T12:04:42.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9799596700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979417b650 con 0x7f979417f3b0 2022-07-05T12:04:42.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9792ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9794178610 0x7f9794173730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9792ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9794178610 0x7f9794173730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60230/0 (socket says 172.21.15.90:60230) 2022-07-05T12:04:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f9792ffd700 1 -- 172.21.15.90:0/3627124799 learned_addr learned my addr 172.21.15.90:0/3627124799 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.844+0000 7f97937fe700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979417f3b0 0x7f9794169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f97927fc700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f979417dee0 0x7f9794178f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9792ffd700 1 -- 172.21.15.90:0/3627124799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979417f3b0 msgr2=0x7f9794169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979417f3b0 0x7f9794169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9792ffd700 1 -- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f979417dee0 msgr2=0x7f9794178f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f979417dee0 0x7f9794178f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9792ffd700 1 -- 172.21.15.90:0/3627124799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c009370 con 0x7f9794178610 2022-07-05T12:04:42.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f97927fc700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f979417dee0 0x7f9794178f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:04:42.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9794178610 0x7f9794173730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f978400d180 tx=0x7f97840099f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f978affd700 1 -- 172.21.15.90:0/3627124799 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400dd70 con 0x7f9794178610 2022-07-05T12:04:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f978affd700 1 -- 172.21.15.90:0/3627124799 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978400f040 con 0x7f9794178610 2022-07-05T12:04:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f978affd700 1 -- 172.21.15.90:0/3627124799 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784013600 con 0x7f9794178610 2022-07-05T12:04:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97940cb700 con 0x7f9794178610 2022-07-05T12:04:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.845+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97940cbcc0 con 0x7f9794178610 2022-07-05T12:04:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.847+0000 7f978affd700 1 -- 172.21.15.90:0/3627124799 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f97840139f0 con 0x7f9794178610 2022-07-05T12:04:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.847+0000 7f978affd700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f977808ba70 0x7f977808df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.847+0000 7f978affd700 1 -- 172.21.15.90:0/3627124799 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f97840b0d90 con 0x7f9794178610 2022-07-05T12:04:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.847+0000 7f97927fc700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f977808ba70 0x7f977808df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.848+0000 7f97927fc700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f977808ba70 0x7f977808df30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f97940cd7b0 tx=0x7f977c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.849+0000 7f97aaf22b80 1 Processor -- start 2022-07-05T12:04:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.849+0000 7f97aaf22b80 1 -- start start 2022-07-05T12:04:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5213c0 0x55d1ca4dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca52b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca521c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca4a72d0 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca41eaa0 con 0x55d1ca5213c0 2022-07-05T12:04:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca433950 con 0x55d1ca5217a0 2022-07-05T12:04:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca52b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca52b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60238/0 (socket says 172.21.15.90:60238) 2022-07-05T12:04:42.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 -- 172.21.15.90:0/333306966 learned_addr learned my addr 172.21.15.90:0/333306966 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:42.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97937fe700 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca521c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f9792ffd700 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5213c0 0x55d1ca4dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 -- 172.21.15.90:0/333306966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 msgr2=0x55d1ca521c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca521c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 -- 172.21.15.90:0/333306966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5213c0 msgr2=0x55d1ca4dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5213c0 0x55d1ca4dd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.850+0000 7f97927fc700 1 -- 172.21.15.90:0/333306966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1ca2659e0 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97927fc700 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca52b990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f977c006fd0 tx=0x7f977c01d040).ready entity=mon.0 client_cookie=ebe6bcf9c36a10bb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:42.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f9773fff700 1 -- 172.21.15.90:0/333306966 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c000d10 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f9773fff700 1 -- 172.21.15.90:0/333306966 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c02e420 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f9773fff700 1 -- 172.21.15.90:0/333306966 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c02e590 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 -- 172.21.15.90:0/333306966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 msgr2=0x55d1ca52b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca52b990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f977c006fd0 tx=0x7f977c01d040).stop 2022-07-05T12:04:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 -- 172.21.15.90:0/333306966 shutdown_connections 2022-07-05T12:04:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca521c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5213c0 0x55d1ca4dd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/333306966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca52b990 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 -- 172.21.15.90:0/333306966 >> 172.21.15.90:0/333306966 conn(0x55d1ca34c1c0 msgr2=0x55d1ca4e0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 -- 172.21.15.90:0/333306966 shutdown_connections 2022-07-05T12:04:42.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.851+0000 7f97aaf22b80 1 -- 172.21.15.90:0/333306966 wait complete. 2022-07-05T12:04:42.900 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.852+0000 7f97aaf22b80 1 -- start start 2022-07-05T12:04:42.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.852+0000 7f97aaf22b80 1 Processor -- start 2022-07-05T12:04:42.901 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.853+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca562910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.853+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca515f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.853+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5217a0 0x55d1ca524610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.853+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca3fb120 con 0x55d1ca5217a0 2022-07-05T12:04:42.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.853+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca5252e0 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.853+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca55f450 con 0x55d1ca5213c0 2022-07-05T12:04:42.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97aaf22b80 10 client.0 ll_register_callbacks cb 0x55d1ca4a11b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:04:42.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5217a0 0x55d1ca524610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5217a0 0x55d1ca524610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60246/0 (socket says 172.21.15.90:60246) 2022-07-05T12:04:42.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 -- 172.21.15.90:0/3460476202 learned_addr learned my addr 172.21.15.90:0/3460476202 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:42.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97927fc700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca515f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca562910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 -- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 msgr2=0x55d1ca515f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca515f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 -- 172.21.15.90:0/3460476202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 msgr2=0x55d1ca562910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca562910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 -- 172.21.15.90:0/3460476202 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979417c670 con 0x55d1ca5217a0 2022-07-05T12:04:42.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca562910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:04:42.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97937fe700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5217a0 0x55d1ca524610 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f978c012340 tx=0x7f978c007cb0).ready entity=mon.0 client_cookie=c3a70cc989d827ed server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:42.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97717fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:04:42.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97717fa700 1 -- 172.21.15.90:0/3460476202 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c012ed0 con 0x55d1ca5217a0 2022-07-05T12:04:42.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97717fa700 1 -- 172.21.15.90:0/3460476202 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f978c010390 con 0x55d1ca5217a0 2022-07-05T12:04:42.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1ca4db440 con 0x55d1ca5217a0 2022-07-05T12:04:42.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97717fa700 1 -- 172.21.15.90:0/3460476202 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f978c015650 con 0x55d1ca5217a0 2022-07-05T12:04:42.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97aaf22b80 10 client.6048 fetch_fsmap learned FSMap version 41 2022-07-05T12:04:42.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55d1ca2d4cd0 con 0x55d1ca5217a0 2022-07-05T12:04:42.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.854+0000 7f97717fa700 1 -- 172.21.15.90:0/3460476202 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1ca4db440 con 0x55d1ca5217a0 2022-07-05T12:04:42.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97717fa700 1 -- 172.21.15.90:0/3460476202 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f978c0157b0 con 0x55d1ca5217a0 2022-07-05T12:04:42.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97aaf22b80 10 client.6048 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:04:42.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97aaf22b80 10 client.6048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:04:42.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97aaf22b80 20 client.6048 populate_metadata read hostname 'smithi090' 2022-07-05T12:04:42.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca524b00 0x55d1ca553f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97aaf22b80 4 client.6048 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:04:42.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1ca4297f0 con 0x55d1ca524b00 2022-07-05T12:04:42.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca524b00 0x55d1ca553f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f97717fa700 10 client.6048 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:42.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.855+0000 7f9792ffd700 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca524b00 0x55d1ca553f30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8bacec735cfdceb4 server_cookie=73dc599fbf908757 in_seq=0 out_seq=0 2022-07-05T12:04:42.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97717fa700 1 -- 172.21.15.90:0/3460476202 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55d1ca4297f0 con 0x55d1ca524b00 2022-07-05T12:04:42.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97717fa700 10 client.6048 handle_command_reply: tid=0 2022-07-05T12:04:42.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 client.6048 shutdown 2022-07-05T12:04:42.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5217a0 msgr2=0x55d1ca524610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5217a0 0x55d1ca524610 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f978c012340 tx=0x7f978c007cb0).stop 2022-07-05T12:04:42.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 shutdown_connections 2022-07-05T12:04:42.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca524b00 0x55d1ca553f30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5217a0 0x55d1ca524610 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca562910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/3460476202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca515f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97717fa700 0 client.6048 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:42.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 >> 172.21.15.90:0/3460476202 conn(0x55d1ca34c1c0 msgr2=0x55d1ca54e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:42.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 shutdown_connections 2022-07-05T12:04:42.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 1 -- 172.21.15.90:0/3460476202 wait complete. 2022-07-05T12:04:42.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.856+0000 7f97aaf22b80 20 client.6048 trim_cache size 0 max 16384 2022-07-05T12:04:42.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.872+0000 7f97aaf22b80 1 Processor -- start 2022-07-05T12:04:42.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.872+0000 7f97aaf22b80 1 -- start start 2022-07-05T12:04:42.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca4df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5213c0 0x55d1ca5a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca5a6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca515750 con 0x55d1ca5213c0 2022-07-05T12:04:42.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca522900 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca560170 con 0x55d1ca5217a0 2022-07-05T12:04:42.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5213c0 0x55d1ca5a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5213c0 0x55d1ca5a5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60252/0 (socket says 172.21.15.90:60252) 2022-07-05T12:04:42.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 -- 172.21.15.90:0/2633620384 learned_addr learned my addr 172.21.15.90:0/2633620384 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:42.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f9792ffd700 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca4df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97937fe700 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca5a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 -- 172.21.15.90:0/2633620384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 msgr2=0x55d1ca5a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca5a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 -- 172.21.15.90:0/2633620384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 msgr2=0x55d1ca4df080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca4df080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 -- 172.21.15.90:0/2633620384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1ca2a2fd0 con 0x55d1ca5213c0 2022-07-05T12:04:42.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97937fe700 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca5a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:04:42.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f97927fc700 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5213c0 0x55d1ca5a5e80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f977c006ba0 tx=0x7f977c027070).ready entity=mon.0 client_cookie=a627ddde6e1487a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:42.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f9788ff9700 1 -- 172.21.15.90:0/2633620384 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c000c40 con 0x55d1ca5213c0 2022-07-05T12:04:42.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f9788ff9700 1 -- 172.21.15.90:0/2633620384 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c00bc60 con 0x55d1ca5213c0 2022-07-05T12:04:42.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.873+0000 7f9788ff9700 1 -- 172.21.15.90:0/2633620384 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00be10 con 0x55d1ca5213c0 2022-07-05T12:04:42.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 -- 172.21.15.90:0/2633620384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5213c0 msgr2=0x55d1ca5a5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5213c0 0x55d1ca5a5e80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f977c006ba0 tx=0x7f977c027070).stop 2022-07-05T12:04:42.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 -- 172.21.15.90:0/2633620384 shutdown_connections 2022-07-05T12:04:42.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5217a0 0x55d1ca5a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca4df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/2633620384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca5213c0 0x55d1ca5a5e80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 -- 172.21.15.90:0/2633620384 >> 172.21.15.90:0/2633620384 conn(0x55d1ca34c1c0 msgr2=0x55d1ca5298b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:42.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 -- 172.21.15.90:0/2633620384 shutdown_connections 2022-07-05T12:04:42.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 -- 172.21.15.90:0/2633620384 wait complete. 2022-07-05T12:04:42.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.874+0000 7f97aaf22b80 1 -- start start 2022-07-05T12:04:42.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.875+0000 7f97aaf22b80 1 Processor -- start 2022-07-05T12:04:42.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca520470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca4d7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5217a0 0x55d1ca5b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca5b65b0 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca528810 con 0x55d1ca5217a0 2022-07-05T12:04:42.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca5b9b00 con 0x55d1ca5213c0 2022-07-05T12:04:42.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 10 client.0 ll_register_callbacks cb 0x7f978c010950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:04:42.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca520470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca520470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60256/0 (socket says 172.21.15.90:60256) 2022-07-05T12:04:42.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 -- 172.21.15.90:0/457956523 learned_addr learned my addr 172.21.15.90:0/457956523 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:04:42.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97927fc700 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca4d7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97937fe700 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5217a0 0x55d1ca5b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 -- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 msgr2=0x55d1ca4d7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca4d7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 -- 172.21.15.90:0/457956523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5217a0 msgr2=0x55d1ca5b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:04:42.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5217a0 0x55d1ca5b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 -- 172.21.15.90:0/457956523 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1ca2659e0 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f9792ffd700 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca520470 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f97840853b0 tx=0x7f978401e040).ready entity=mon.0 client_cookie=ec7d72c10dffb381 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:04:42.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97717fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:04:42.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97717fa700 1 -- 172.21.15.90:0/457956523 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784081dc0 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f977c02e420 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97717fa700 1 -- 172.21.15.90:0/457956523 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f9784081f20 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97717fa700 1 -- 172.21.15.90:0/457956523 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9784013e90 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.876+0000 7f97aaf22b80 10 client.6054 fetch_fsmap learned FSMap version 41 2022-07-05T12:04:42.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55d1ca527f40 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97717fa700 1 -- 172.21.15.90:0/457956523 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c02e420 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97717fa700 1 -- 172.21.15.90:0/457956523 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f97840192b0 con 0x55d1ca4ddcb0 2022-07-05T12:04:42.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 10 client.6054 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:04:42.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 10 client.6054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:04:42.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 20 client.6054 populate_metadata read hostname 'smithi090' 2022-07-05T12:04:42.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca528eb0 0x55d1ca5b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:04:42.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 4 client.6054 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:04:42.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d1ca420690 con 0x55d1ca528eb0 2022-07-05T12:04:42.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97927fc700 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca528eb0 0x55d1ca5b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:04:42.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97927fc700 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca528eb0 0x55d1ca5b91c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=435635799449ed4a server_cookie=9cb62d7105ec61f4 in_seq=0 out_seq=0 2022-07-05T12:04:42.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97717fa700 10 client.6054 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:42.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97717fa700 1 -- 172.21.15.90:0/457956523 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d1ca420690 con 0x55d1ca528eb0 2022-07-05T12:04:42.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97717fa700 10 client.6054 handle_command_reply: tid=0 2022-07-05T12:04:42.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.877+0000 7f97aaf22b80 1 client.6054 shutdown 2022-07-05T12:04:42.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 msgr2=0x55d1ca520470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca520470 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f97840853b0 tx=0x7f978401e040).stop 2022-07-05T12:04:42.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 shutdown_connections 2022-07-05T12:04:42.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d1ca528eb0 0x55d1ca5b91c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1ca5217a0 0x55d1ca5b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97717fa700 0 client.6054 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:04:42.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d1ca4ddcb0 0x55d1ca520470 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 --2- 172.21.15.90:0/457956523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d1ca5213c0 0x55d1ca4d7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 >> 172.21.15.90:0/457956523 conn(0x55d1ca34c1c0 msgr2=0x55d1ca552ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:42.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 shutdown_connections 2022-07-05T12:04:42.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 1 -- 172.21.15.90:0/457956523 wait complete. 2022-07-05T12:04:42.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f97aaf22b80 20 client.6054 trim_cache size 0 max 16384 2022-07-05T12:04:42.948 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:04:42.949 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:04:42.949 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:04:42.949 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:04:42.949 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:04:42.950 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:04:42.950 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:04:42.950 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:04:42.950 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:04:42.951 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:04:42.952 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f977808ba70 msgr2=0x7f977808df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f977808ba70 0x7f977808df30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f97940cd7b0 tx=0x7f977c017000).stop 2022-07-05T12:04:42.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9794178610 msgr2=0x7f9794173730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:04:42.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9794178610 0x7f9794173730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f978400d180 tx=0x7f97840099f0).stop 2022-07-05T12:04:42.953 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 shutdown_connections 2022-07-05T12:04:42.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f977808ba70 0x7f977808df30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979417f3b0 0x7f9794169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9794178610 0x7f9794173730 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 --2- 172.21.15.90:0/3627124799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f979417dee0 0x7f9794178f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:04:42.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 >> 172.21.15.90:0/3627124799 conn(0x7f97940f2210 msgr2=0x7f9794062030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:04:42.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 shutdown_connections 2022-07-05T12:04:42.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:04:42.878+0000 7f9799596700 1 -- 172.21.15.90:0/3627124799 wait complete. 2022-07-05T12:04:42.960 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:05:12.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:05:13.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.103+0000 7f6cc3a28700 1 Processor -- start 2022-07-05T12:05:13.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.103+0000 7f6cc3a28700 1 -- start start 2022-07-05T12:05:13.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.104+0000 7f6cc3a28700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6cbc17b630 0x7f6cbc17ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.104+0000 7f6cc3a28700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6cbc17bf80 0x7f6cbc182d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.104+0000 7f6cc3a28700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc17a060 con 0x7f6cbc172e20 2022-07-05T12:05:13.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.104+0000 7f6cc3a28700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc0c4ab0 con 0x7f6cbc17b630 2022-07-05T12:05:13.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.104+0000 7f6cc3a28700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc17a2b0 con 0x7f6cbc17bf80 2022-07-05T12:05:13.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc17c4700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6cbc172e20 0x7f6cbc0c43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53204/0 (socket says 172.21.15.90:53204) 2022-07-05T12:05:13.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc0fc3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6cbc17b630 0x7f6cbc17ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc17c4700 1 -- 172.21.15.90:0/4118972886 learned_addr learned my addr 172.21.15.90:0/4118972886 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:05:13.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/4118972886 >> v2:172.21.15.149:3300/0 conn(0x7f6cbc17bf80 0x7f6cbc182d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/4118972886 >> v2:172.21.15.149:3300/0 conn(0x7f6cbc17bf80 msgr2=0x7f6cbc182d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/4118972886 >> v2:172.21.15.149:3300/0 conn(0x7f6cbc17bf80 0x7f6cbc182d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/4118972886 >> v1:172.21.15.90:6789/0 conn(0x7f6cbc172e20 legacy=0x7f6cbc0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cbbfff700 1 -- 172.21.15.90:0/4118972886 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922776528 0 0) 0x7f6cbc17a060 con 0x7f6cbc172e20 2022-07-05T12:05:13.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/4118972886 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc17a590 con 0x7f6cbc17b630 2022-07-05T12:05:13.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/4118972886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc17b630 0x7f6cbc17ba90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f6cbc0874b0 tx=0x7f6cb0009060).ready entity=mon.0 client_cookie=ae61a3285eb9a345 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:13.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cbbfff700 1 -- 172.21.15.90:0/4118972886 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00090d0 con 0x7f6cbc17b630 2022-07-05T12:05:13.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cbbfff700 1 -- 172.21.15.90:0/4118972886 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000f510 con 0x7f6cbc17b630 2022-07-05T12:05:13.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.105+0000 7f6cbbfff700 1 -- 172.21.15.90:0/4118972886 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000f890 con 0x7f6cbc17b630 2022-07-05T12:05:13.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 -- 172.21.15.90:0/4118972886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc17b630 msgr2=0x7f6cbc17ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/4118972886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc17b630 0x7f6cbc17ba90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f6cbc0874b0 tx=0x7f6cb0009060).stop 2022-07-05T12:05:13.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 -- 172.21.15.90:0/4118972886 shutdown_connections 2022-07-05T12:05:13.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/4118972886 >> v2:172.21.15.149:3300/0 conn(0x7f6cbc17bf80 0x7f6cbc182d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/4118972886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc17b630 0x7f6cbc17ba90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 -- 172.21.15.90:0/4118972886 >> 172.21.15.90:0/4118972886 conn(0x7f6cbc0f0030 msgr2=0x7f6cbc061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:13.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 -- 172.21.15.90:0/4118972886 shutdown_connections 2022-07-05T12:05:13.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.106+0000 7f6cc3a28700 1 -- 172.21.15.90:0/4118972886 wait complete. 2022-07-05T12:05:13.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.107+0000 7f6cc3a28700 1 Processor -- start 2022-07-05T12:05:13.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.107+0000 7f6cc3a28700 1 -- start start 2022-07-05T12:05:13.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc3a28700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc172e20 0x7f6cbc1672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc3a28700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc17b630 0x7f6cbc171720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc3a28700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc17bf80 0x7f6cbc171c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc3a28700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc084670 con 0x7f6cbc172e20 2022-07-05T12:05:13.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc3a28700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc178450 con 0x7f6cbc17b630 2022-07-05T12:05:13.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc3a28700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc178730 con 0x7f6cbc17bf80 2022-07-05T12:05:13.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc17c4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc172e20 0x7f6cbc1672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc17c4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc172e20 0x7f6cbc1672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60270/0 (socket says 172.21.15.90:60270) 2022-07-05T12:05:13.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc17c4700 1 -- 172.21.15.90:0/2897811458 learned_addr learned my addr 172.21.15.90:0/2897811458 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:13.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.108+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc17bf80 0x7f6cbc171c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc17b630 0x7f6cbc171720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc17c4700 1 -- 172.21.15.90:0/2897811458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc17bf80 msgr2=0x7f6cbc171c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc17bf80 0x7f6cbc171c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc17c4700 1 -- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc17b630 msgr2=0x7f6cbc171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc17b630 0x7f6cbc171720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc17c4700 1 -- 172.21.15.90:0/2897811458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00092a0 con 0x7f6cbc172e20 2022-07-05T12:05:13.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc172e20 0x7f6cbc1672e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f6cac00c810 tx=0x7f6cac001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:13.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cb97fa700 1 -- 172.21.15.90:0/2897811458 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac005d30 con 0x7f6cbc172e20 2022-07-05T12:05:13.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cb97fa700 1 -- 172.21.15.90:0/2897811458 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac005e90 con 0x7f6cbc172e20 2022-07-05T12:05:13.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc178a10 con 0x7f6cbc172e20 2022-07-05T12:05:13.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cb97fa700 1 -- 172.21.15.90:0/2897811458 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac007320 con 0x7f6cbc172e20 2022-07-05T12:05:13.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.109+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc178fd0 con 0x7f6cbc172e20 2022-07-05T12:05:13.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.111+0000 7f6cb97fa700 1 -- 172.21.15.90:0/2897811458 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6cac010030 con 0x7f6cbc172e20 2022-07-05T12:05:13.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.111+0000 7f6cb97fa700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6c9c08ba40 0x7f6c9c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.112+0000 7f6cb97fa700 1 -- 172.21.15.90:0/2897811458 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6cac0b0840 con 0x7f6cbc172e20 2022-07-05T12:05:13.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.112+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6c9c08ba40 0x7f6c9c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.112+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6c9c08ba40 0x7f6c9c08df00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f6cbc176950 tx=0x7f6cb0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:13.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.113+0000 7f6cd53b4b80 1 Processor -- start 2022-07-05T12:05:13.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.113+0000 7f6cd53b4b80 1 -- start start 2022-07-05T12:05:13.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x5621775d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x56217761e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776147a0 0x562177614c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217759a2d0 con 0x5621776147a0 2022-07-05T12:05:13.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562177511aa0 con 0x5621775d0cb0 2022-07-05T12:05:13.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562177526950 con 0x5621776143c0 2022-07-05T12:05:13.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cc1fc5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776147a0 0x562177614c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cc1fc5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776147a0 0x562177614c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60282/0 (socket says 172.21.15.90:60282) 2022-07-05T12:05:13.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cc1fc5700 1 -- 172.21.15.90:0/1152508334 learned_addr learned my addr 172.21.15.90:0/1152508334 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:13.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x5621775d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.114+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x56217761e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cc1fc5700 1 -- 172.21.15.90:0/1152508334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 msgr2=0x5621775d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x5621775d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cc1fc5700 1 -- 172.21.15.90:0/1152508334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 msgr2=0x56217761e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x56217761e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cc1fc5700 1 -- 172.21.15.90:0/1152508334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621773589e0 con 0x5621776147a0 2022-07-05T12:05:13.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776147a0 0x562177614c20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f6cb4009b00 tx=0x7f6cb4009060).ready entity=mon.0 client_cookie=96d560af4a2a277e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:13.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6ca27fc700 1 -- 172.21.15.90:0/1152508334 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40119c0 con 0x5621776147a0 2022-07-05T12:05:13.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6ca27fc700 1 -- 172.21.15.90:0/1152508334 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb4011b20 con 0x5621776147a0 2022-07-05T12:05:13.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6ca27fc700 1 -- 172.21.15.90:0/1152508334 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4011ea0 con 0x5621776147a0 2022-07-05T12:05:13.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/1152508334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776147a0 msgr2=0x562177614c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776147a0 0x562177614c20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f6cb4009b00 tx=0x7f6cb4009060).stop 2022-07-05T12:05:13.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/1152508334 shutdown_connections 2022-07-05T12:05:13.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776147a0 0x562177614c20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x5621775d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/1152508334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x56217761e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.115+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/1152508334 >> 172.21.15.90:0/1152508334 conn(0x56217743f1c0 msgr2=0x5621775d3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:13.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.116+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/1152508334 shutdown_connections 2022-07-05T12:05:13.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.116+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/1152508334 wait complete. 2022-07-05T12:05:13.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.116+0000 7f6cd53b4b80 1 -- start start 2022-07-05T12:05:13.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.116+0000 7f6cd53b4b80 1 Processor -- start 2022-07-05T12:05:13.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.117+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x562177613640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.117+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217761dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.117+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776147a0 0x562177609230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.117+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621774ee120 con 0x5621776143c0 2022-07-05T12:05:13.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.117+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217760e9e0 con 0x5621775d0cb0 2022-07-05T12:05:13.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.117+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621776131b0 con 0x5621776147a0 2022-07-05T12:05:13.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cd53b4b80 10 client.0 ll_register_callbacks cb 0x5621775941b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:05:13.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217761dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217761dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60286/0 (socket says 172.21.15.90:60286) 2022-07-05T12:05:13.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3292780327 learned_addr learned my addr 172.21.15.90:0/3292780327 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:13.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776147a0 0x562177609230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x562177613640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776147a0 msgr2=0x562177609230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776147a0 0x562177609230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3292780327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 msgr2=0x562177613640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x562177613640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3292780327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb4009800 con 0x5621776143c0 2022-07-05T12:05:13.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217761dfe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f6cbc0869e0 tx=0x7f6cb001d000).ready entity=mon.0 client_cookie=38751216ba19bcdc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:13.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6c977fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:05:13.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6c977fe700 1 -- 172.21.15.90:0/3292780327 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb001ce00 con 0x5621776143c0 2022-07-05T12:05:13.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6c977fe700 1 -- 172.21.15.90:0/3292780327 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6cb0027410 con 0x5621776143c0 2022-07-05T12:05:13.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621775ce440 con 0x5621776143c0 2022-07-05T12:05:13.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6c977fe700 1 -- 172.21.15.90:0/3292780327 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cb00277e0 con 0x5621776143c0 2022-07-05T12:05:13.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cd53b4b80 10 client.6069 fetch_fsmap learned FSMap version 41 2022-07-05T12:05:13.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5621773c7cd0 con 0x5621776143c0 2022-07-05T12:05:13.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.118+0000 7f6c977fe700 1 -- 172.21.15.90:0/3292780327 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621775ce440 con 0x5621776143c0 2022-07-05T12:05:13.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6c977fe700 1 -- 172.21.15.90:0/3292780327 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f6cb0031b20 con 0x5621776143c0 2022-07-05T12:05:13.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cd53b4b80 10 client.6069 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:05:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cd53b4b80 10 client.6069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:05:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cd53b4b80 20 client.6069 populate_metadata read hostname 'smithi090' 2022-07-05T12:05:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562177609720 0x562177655ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cd53b4b80 4 client.6069 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:05:13.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56217751c7f0 con 0x562177609720 2022-07-05T12:05:13.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562177609720 0x562177655ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6c977fe700 10 client.6069 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:13.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.119+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562177609720 0x562177655ea0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=aca1d2ccb5a852e1 server_cookie=e1a7cfe519e800cc in_seq=0 out_seq=0 2022-07-05T12:05:13.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6c977fe700 1 -- 172.21.15.90:0/3292780327 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x56217751c7f0 con 0x562177609720 2022-07-05T12:05:13.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6c977fe700 10 client.6069 handle_command_reply: tid=0 2022-07-05T12:05:13.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 client.6069 shutdown 2022-07-05T12:05:13.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 msgr2=0x56217761dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217761dfe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f6cbc0869e0 tx=0x7f6cb001d000).stop 2022-07-05T12:05:13.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 shutdown_connections 2022-07-05T12:05:13.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x562177609720 0x562177655ea0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776147a0 0x562177609230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6c977fe700 0 client.6069 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:13.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621775d0cb0 0x562177613640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3292780327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217761dfe0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 >> 172.21.15.90:0/3292780327 conn(0x56217743f1c0 msgr2=0x562177641150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:13.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 shutdown_connections 2022-07-05T12:05:13.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.120+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3292780327 wait complete. 2022-07-05T12:05:13.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.121+0000 7f6cd53b4b80 20 client.6069 trim_cache size 0 max 16384 2022-07-05T12:05:13.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.136+0000 7f6cd53b4b80 1 Processor -- start 2022-07-05T12:05:13.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.136+0000 7f6cd53b4b80 1 -- start start 2022-07-05T12:05:13.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621775d0cb0 0x56217761cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x56217761d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x5621776a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217761d5d0 con 0x5621775d0cb0 2022-07-05T12:05:13.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621775d25f0 con 0x5621776147a0 2022-07-05T12:05:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562177610f50 con 0x5621776143c0 2022-07-05T12:05:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cc17c4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621775d0cb0 0x56217761cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cc17c4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621775d0cb0 0x56217761cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60292/0 (socket says 172.21.15.90:60292) 2022-07-05T12:05:13.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cc17c4700 1 -- 172.21.15.90:0/3459734924 learned_addr learned my addr 172.21.15.90:0/3459734924 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x56217761d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x5621776a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.137+0000 7f6cc17c4700 1 -- 172.21.15.90:0/3459734924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 msgr2=0x56217761d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x56217761d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cc17c4700 1 -- 172.21.15.90:0/3459734924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 msgr2=0x5621776a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x5621776a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cc17c4700 1 -- 172.21.15.90:0/3459734924 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562177395fd0 con 0x5621775d0cb0 2022-07-05T12:05:13.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x5621776a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:05:13.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621775d0cb0 0x56217761cbf0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6cac00ceb0 tx=0x7f6cac054040).ready entity=mon.0 client_cookie=d0a1e4a2a6cea4f7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:13.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6ca2ffd700 1 -- 172.21.15.90:0/3459734924 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac057040 con 0x5621775d0cb0 2022-07-05T12:05:13.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6ca2ffd700 1 -- 172.21.15.90:0/3459734924 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac083500 con 0x5621775d0cb0 2022-07-05T12:05:13.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6ca2ffd700 1 -- 172.21.15.90:0/3459734924 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac081870 con 0x5621775d0cb0 2022-07-05T12:05:13.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3459734924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621775d0cb0 msgr2=0x56217761cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621775d0cb0 0x56217761cbf0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6cac00ceb0 tx=0x7f6cac054040).stop 2022-07-05T12:05:13.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3459734924 shutdown_connections 2022-07-05T12:05:13.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x5621776a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621775d0cb0 0x56217761cbf0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3459734924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621776143c0 0x56217761d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3459734924 >> 172.21.15.90:0/3459734924 conn(0x56217743f1c0 msgr2=0x562177641150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:13.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3459734924 shutdown_connections 2022-07-05T12:05:13.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.138+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3459734924 wait complete. 2022-07-05T12:05:13.169 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.139+0000 7f6cd53b4b80 1 -- start start 2022-07-05T12:05:13.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.139+0000 7f6cd53b4b80 1 Processor -- start 2022-07-05T12:05:13.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621775d0cb0 0x56217769fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217769f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.170 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cd53b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x56217761ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621776aca20 con 0x5621776143c0 2022-07-05T12:05:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621776107a0 con 0x5621776147a0 2022-07-05T12:05:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cd53b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217761b780 con 0x5621775d0cb0 2022-07-05T12:05:13.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cd53b4b80 10 client.0 ll_register_callbacks cb 0x5621775941b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:05:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cc0fc3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217769f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cc17c4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621775d0cb0 0x56217769fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cc0fc3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217769f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60300/0 (socket says 172.21.15.90:60300) 2022-07-05T12:05:13.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.140+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3535558398 learned_addr learned my addr 172.21.15.90:0/3535558398 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x56217761ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3535558398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621775d0cb0 msgr2=0x56217769fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621775d0cb0 0x56217769fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3535558398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 msgr2=0x56217761ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:13.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x56217761ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc0fc3700 1 -- 172.21.15.90:0/3535558398 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc178fd0 con 0x5621776143c0 2022-07-05T12:05:13.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc1fc5700 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x56217761ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:05:13.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cc0fc3700 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217769f470 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f6cbc0869e0 tx=0x7f6cb0028000).ready entity=mon.0 client_cookie=28180f87e6e7c1bd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:13.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6c977fe700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:05:13.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6c977fe700 1 -- 172.21.15.90:0/3535558398 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000f940 con 0x5621776143c0 2022-07-05T12:05:13.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6c977fe700 1 -- 172.21.15.90:0/3535558398 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6cb0005880 con 0x5621776143c0 2022-07-05T12:05:13.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6cb4011b20 con 0x5621776143c0 2022-07-05T12:05:13.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6c977fe700 1 -- 172.21.15.90:0/3535558398 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cb000faa0 con 0x5621776143c0 2022-07-05T12:05:13.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 10 client.6075 fetch_fsmap learned FSMap version 41 2022-07-05T12:05:13.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5621776101b0 con 0x5621776143c0 2022-07-05T12:05:13.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6c977fe700 1 -- 172.21.15.90:0/3535558398 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb4011b20 con 0x5621776143c0 2022-07-05T12:05:13.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6c977fe700 1 -- 172.21.15.90:0/3535558398 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f6cb0005c50 con 0x5621776143c0 2022-07-05T12:05:13.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 10 client.6075 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:05:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 10 client.6075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:05:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 20 client.6075 populate_metadata read hostname 'smithi090' 2022-07-05T12:05:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5621775db260 0x5621776abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 4 client.6075 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:05:13.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.141+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562177513690 con 0x5621775db260 2022-07-05T12:05:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5621775db260 0x5621776abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6c977fe700 10 client.6075 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cc17c4700 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5621775db260 0x5621776abe10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b6ccdc0babd4882b server_cookie=213f65ad0d5c971 in_seq=0 out_seq=0 2022-07-05T12:05:13.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6c977fe700 1 -- 172.21.15.90:0/3535558398 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562177513690 con 0x5621775db260 2022-07-05T12:05:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6c977fe700 10 client.6075 handle_command_reply: tid=0 2022-07-05T12:05:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 client.6075 shutdown 2022-07-05T12:05:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 msgr2=0x56217769f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217769f470 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f6cbc0869e0 tx=0x7f6cb0028000).stop 2022-07-05T12:05:13.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 shutdown_connections 2022-07-05T12:05:13.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5621775db260 0x5621776abe10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621776147a0 0x56217761ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621775d0cb0 0x56217769fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 --2- 172.21.15.90:0/3535558398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621776143c0 0x56217769f470 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 >> 172.21.15.90:0/3535558398 conn(0x56217743f1c0 msgr2=0x5621775d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:13.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6c977fe700 0 client.6075 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:13.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 shutdown_connections 2022-07-05T12:05:13.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 1 -- 172.21.15.90:0/3535558398 wait complete. 2022-07-05T12:05:13.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.142+0000 7f6cd53b4b80 20 client.6075 trim_cache size 0 max 16384 2022-07-05T12:05:13.182 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:05:13.183 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:05:13.183 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:05:13.183 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:05:13.183 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:05:13.184 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:05:13.184 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:05:13.184 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:05:13.184 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:05:13.184 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:05:13.186 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6c9c08ba40 msgr2=0x7f6c9c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6c9c08ba40 0x7f6c9c08df00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f6cbc176950 tx=0x7f6cb0017000).stop 2022-07-05T12:05:13.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc172e20 msgr2=0x7f6cbc1672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:13.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc172e20 0x7f6cbc1672e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f6cac00c810 tx=0x7f6cac001570).stop 2022-07-05T12:05:13.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 shutdown_connections 2022-07-05T12:05:13.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6c9c08ba40 0x7f6c9c08df00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc17bf80 0x7f6cbc171c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cbc172e20 0x7f6cbc1672e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 --2- 172.21.15.90:0/2897811458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc17b630 0x7f6cbc171720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:13.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 >> 172.21.15.90:0/2897811458 conn(0x7f6cbc0f0030 msgr2=0x7f6cbc16ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:13.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 shutdown_connections 2022-07-05T12:05:13.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:13.143+0000 7f6cc3a28700 1 -- 172.21.15.90:0/2897811458 wait complete. 2022-07-05T12:05:13.189 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:05:43.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:05:43.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.317+0000 7f16e4109700 1 Processor -- start 2022-07-05T12:05:43.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.318+0000 7f16e4109700 1 -- start start 2022-07-05T12:05:43.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e4109700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16dc17a560 0x7f16dc0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e4109700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16dc0c77b0 0x7f16dc0c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e4109700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc17a9e0 con 0x7f16dc17a180 2022-07-05T12:05:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e4109700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0c8d20 con 0x7f16dc0c77b0 2022-07-05T12:05:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e4109700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0c9000 con 0x7f16dc17a560 2022-07-05T12:05:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e16a4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16dc17a560 0x7f16dc0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e26a6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16dc0c77b0 0x7f16dc0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e16a4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16dc17a560 0x7f16dc0c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41706/0 (socket says 172.21.15.90:41706) 2022-07-05T12:05:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e16a4700 1 -- 172.21.15.90:0/132154114 learned_addr learned my addr 172.21.15.90:0/132154114 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e26a6700 1 -- 172.21.15.90:0/132154114 >> v2:172.21.15.149:3300/0 conn(0x7f16dc17a560 msgr2=0x7f16dc0c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e26a6700 1 --2- 172.21.15.90:0/132154114 >> v2:172.21.15.149:3300/0 conn(0x7f16dc17a560 0x7f16dc0c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e26a6700 1 -- 172.21.15.90:0/132154114 >> v1:172.21.15.110:6789/0 conn(0x7f16dc17a180 legacy=0x7f16dc0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e26a6700 1 -- 172.21.15.90:0/132154114 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0c92e0 con 0x7f16dc0c77b0 2022-07-05T12:05:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.319+0000 7f16e26a6700 1 --2- 172.21.15.90:0/132154114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc0c77b0 0x7f16dc0c7c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f16dc085b00 tx=0x7f16d8009060).ready entity=mon.1 client_cookie=be5c9e86ebe7b87a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e0ea3700 1 -- 172.21.15.90:0/132154114 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d800f510 con 0x7f16dc0c77b0 2022-07-05T12:05:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e0ea3700 1 -- 172.21.15.90:0/132154114 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d800f670 con 0x7f16dc0c77b0 2022-07-05T12:05:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e0ea3700 1 -- 172.21.15.90:0/132154114 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d800f9f0 con 0x7f16dc0c77b0 2022-07-05T12:05:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 -- 172.21.15.90:0/132154114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc0c77b0 msgr2=0x7f16dc0c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 --2- 172.21.15.90:0/132154114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc0c77b0 0x7f16dc0c7c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f16dc085b00 tx=0x7f16d8009060).stop 2022-07-05T12:05:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 -- 172.21.15.90:0/132154114 shutdown_connections 2022-07-05T12:05:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 --2- 172.21.15.90:0/132154114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc0c77b0 0x7f16dc0c7c20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 --2- 172.21.15.90:0/132154114 >> v2:172.21.15.149:3300/0 conn(0x7f16dc17a560 0x7f16dc0c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 -- 172.21.15.90:0/132154114 >> 172.21.15.90:0/132154114 conn(0x7f16dc083570 msgr2=0x7f16dc083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 -- 172.21.15.90:0/132154114 shutdown_connections 2022-07-05T12:05:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.320+0000 7f16e4109700 1 -- 172.21.15.90:0/132154114 wait complete. 2022-07-05T12:05:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.322+0000 7f16e4109700 1 Processor -- start 2022-07-05T12:05:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.322+0000 7f16e4109700 1 -- start start 2022-07-05T12:05:43.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e4109700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16dc0c77b0 0x7f16dc0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e4109700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc17a180 0x7f16dc1737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e4109700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16dc17a560 0x7f16dc171c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e4109700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc172420 con 0x7f16dc17a560 2022-07-05T12:05:43.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e4109700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc172700 con 0x7f16dc17a180 2022-07-05T12:05:43.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e4109700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc1729e0 con 0x7f16dc0c77b0 2022-07-05T12:05:43.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16dc17a560 0x7f16dc171c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16dc17a560 0x7f16dc171c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60316/0 (socket says 172.21.15.90:60316) 2022-07-05T12:05:43.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e1ea5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16dc0c77b0 0x7f16dc0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 -- 172.21.15.90:0/2215836881 learned_addr learned my addr 172.21.15.90:0/2215836881 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:43.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e16a4700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc17a180 0x7f16dc1737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 -- 172.21.15.90:0/2215836881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16dc0c77b0 msgr2=0x7f16dc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16dc0c77b0 0x7f16dc0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 -- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc17a180 msgr2=0x7f16dc1737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc17a180 0x7f16dc1737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 -- 172.21.15.90:0/2215836881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d80092a0 con 0x7f16dc17a560 2022-07-05T12:05:43.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e26a6700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16dc17a560 0x7f16dc171c50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f16d8009dd0 tx=0x7f16d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:43.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16c9ffb700 1 -- 172.21.15.90:0/2215836881 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d800f510 con 0x7f16dc17a560 2022-07-05T12:05:43.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16c9ffb700 1 -- 172.21.15.90:0/2215836881 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d800f9f0 con 0x7f16dc17a560 2022-07-05T12:05:43.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc172cc0 con 0x7f16dc17a560 2022-07-05T12:05:43.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.323+0000 7f16c9ffb700 1 -- 172.21.15.90:0/2215836881 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d801b660 con 0x7f16dc17a560 2022-07-05T12:05:43.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.324+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc173280 con 0x7f16dc17a560 2022-07-05T12:05:43.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.326+0000 7f16c9ffb700 1 -- 172.21.15.90:0/2215836881 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f16d8021030 con 0x7f16dc17a560 2022-07-05T12:05:43.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.326+0000 7f16c9ffb700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16bc08ba40 0x7f16bc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.326+0000 7f16c9ffb700 1 -- 172.21.15.90:0/2215836881 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f16d80b24d0 con 0x7f16dc17a560 2022-07-05T12:05:43.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.327+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16bc08ba40 0x7f16bc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.327+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16bc08ba40 0x7f16bc08df00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f16dc0e8890 tx=0x7f16d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:43.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.328+0000 7f16f5a95b80 1 Processor -- start 2022-07-05T12:05:43.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.328+0000 7f16f5a95b80 1 -- start start 2022-07-05T12:05:43.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc633c0 0x561c5dc1f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc6d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc637a0 0x561c5dc63c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dbe92d0 con 0x561c5dc637a0 2022-07-05T12:05:43.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5db60aa0 con 0x561c5dc633c0 2022-07-05T12:05:43.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5db75950 con 0x561c5dc1fcb0 2022-07-05T12:05:43.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc637a0 0x561c5dc63c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc637a0 0x561c5dc63c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60324/0 (socket says 172.21.15.90:60324) 2022-07-05T12:05:43.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 -- 172.21.15.90:0/589046272 learned_addr learned my addr 172.21.15.90:0/589046272 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:43.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e16a4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc6d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc633c0 0x561c5dc1f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 -- 172.21.15.90:0/589046272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 msgr2=0x561c5dc6d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc6d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 -- 172.21.15.90:0/589046272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc633c0 msgr2=0x561c5dc1f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc633c0 0x561c5dc1f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 -- 172.21.15.90:0/589046272 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c5d9a79e0 con 0x561c5dc637a0 2022-07-05T12:05:43.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16e26a6700 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc637a0 0x561c5dc63c20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f16d8086cc0 tx=0x7f16d8006b70).ready entity=mon.0 client_cookie=c499e7ff96382882 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:43.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16c2ffd700 1 -- 172.21.15.90:0/589046272 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80b2340 con 0x561c5dc637a0 2022-07-05T12:05:43.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16c2ffd700 1 -- 172.21.15.90:0/589046272 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8086df0 con 0x561c5dc637a0 2022-07-05T12:05:43.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.329+0000 7f16c2ffd700 1 -- 172.21.15.90:0/589046272 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d808c6d0 con 0x561c5dc637a0 2022-07-05T12:05:43.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 -- 172.21.15.90:0/589046272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc637a0 msgr2=0x561c5dc63c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc637a0 0x561c5dc63c20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f16d8086cc0 tx=0x7f16d8006b70).stop 2022-07-05T12:05:43.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 -- 172.21.15.90:0/589046272 shutdown_connections 2022-07-05T12:05:43.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc637a0 0x561c5dc63c20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc633c0 0x561c5dc1f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/589046272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc6d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 -- 172.21.15.90:0/589046272 >> 172.21.15.90:0/589046272 conn(0x561c5da8e1c0 msgr2=0x561c5dc22ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:43.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 -- 172.21.15.90:0/589046272 shutdown_connections 2022-07-05T12:05:43.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.330+0000 7f16f5a95b80 1 -- 172.21.15.90:0/589046272 wait complete. 2022-07-05T12:05:43.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.331+0000 7f16f5a95b80 1 -- start start 2022-07-05T12:05:43.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.331+0000 7f16f5a95b80 1 Processor -- start 2022-07-05T12:05:43.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc93b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dc55cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5db3d120 con 0x561c5dc633c0 2022-07-05T12:05:43.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dc94740 con 0x561c5dc637a0 2022-07-05T12:05:43.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dc6c870 con 0x561c5dc1fcb0 2022-07-05T12:05:43.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16f5a95b80 10 client.0 ll_register_callbacks cb 0x561c5dbe31b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:05:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dc55cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dc55cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60328/0 (socket says 172.21.15.90:60328) 2022-07-05T12:05:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 -- 172.21.15.90:0/3358382394 learned_addr learned my addr 172.21.15.90:0/3358382394 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc93b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e26a6700 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 -- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 msgr2=0x561c5dc93b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc93b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 -- 172.21.15.90:0/3358382394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 msgr2=0x561c5dca4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.332+0000 7f16e16a4700 1 -- 172.21.15.90:0/3358382394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc173280 con 0x561c5dc633c0 2022-07-05T12:05:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16e16a4700 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dc55cd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f16cc0147e0 tx=0x7f16cc0090f0).ready entity=mon.0 client_cookie=645e79115b46b00 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:05:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16b7fff700 1 -- 172.21.15.90:0/3358382394 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc009720 con 0x561c5dc633c0 2022-07-05T12:05:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16b7fff700 1 -- 172.21.15.90:0/3358382394 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f16cc015420 con 0x561c5dc633c0 2022-07-05T12:05:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c5dc1d440 con 0x561c5dc633c0 2022-07-05T12:05:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16b7fff700 1 -- 172.21.15.90:0/3358382394 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16cc0155e0 con 0x561c5dc633c0 2022-07-05T12:05:43.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 10 client.6084 fetch_fsmap learned FSMap version 41 2022-07-05T12:05:43.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x561c5da16cd0 con 0x561c5dc633c0 2022-07-05T12:05:43.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16b7fff700 1 -- 172.21.15.90:0/3358382394 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c5dc1d440 con 0x561c5dc633c0 2022-07-05T12:05:43.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16b7fff700 1 -- 172.21.15.90:0/3358382394 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f16cc015990 con 0x561c5dc633c0 2022-07-05T12:05:43.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 10 client.6084 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:05:43.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 10 client.6084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:05:43.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 20 client.6084 populate_metadata read hostname 'smithi090' 2022-07-05T12:05:43.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc23b40 0x561c5dc91fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 4 client.6084 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:05:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c5db6b7f0 con 0x561c5dc23b40 2022-07-05T12:05:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.333+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc23b40 0x561c5dc91fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.334+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc23b40 0x561c5dc91fb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6e5ebc94e1e47b87 server_cookie=a90feb3a83fba904 in_seq=0 out_seq=0 2022-07-05T12:05:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.334+0000 7f16b7fff700 10 client.6084 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.334+0000 7f16b7fff700 1 -- 172.21.15.90:0/3358382394 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x561c5db6b7f0 con 0x561c5dc23b40 2022-07-05T12:05:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.334+0000 7f16b7fff700 10 client.6084 handle_command_reply: tid=0 2022-07-05T12:05:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.334+0000 7f16f5a95b80 1 client.6084 shutdown 2022-07-05T12:05:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 msgr2=0x561c5dc55cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dc55cd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f16cc0147e0 tx=0x7f16cc0090f0).stop 2022-07-05T12:05:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 shutdown_connections 2022-07-05T12:05:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc23b40 0x561c5dc91fb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc1fcb0 0x561c5dc93b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/3358382394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dc55cd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16b7fff700 0 client.6084 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 >> 172.21.15.90:0/3358382394 conn(0x561c5da8e1c0 msgr2=0x561c5dc90150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:43.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 shutdown_connections 2022-07-05T12:05:43.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 1 -- 172.21.15.90:0/3358382394 wait complete. 2022-07-05T12:05:43.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.335+0000 7f16f5a95b80 20 client.6084 trim_cache size 0 max 16384 2022-07-05T12:05:43.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.350+0000 7f16f5a95b80 1 Processor -- start 2022-07-05T12:05:43.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.350+0000 7f16f5a95b80 1 -- start start 2022-07-05T12:05:43.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc1fcb0 0x561c5dc235a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc633c0 0x561c5dc21360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dc554e0 con 0x561c5dc1fcb0 2022-07-05T12:05:43.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dc21850 con 0x561c5dc637a0 2022-07-05T12:05:43.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dca51f0 con 0x561c5dc633c0 2022-07-05T12:05:43.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16e1ea5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc1fcb0 0x561c5dc235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16e1ea5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc1fcb0 0x561c5dc235a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60336/0 (socket says 172.21.15.90:60336) 2022-07-05T12:05:43.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16e1ea5700 1 -- 172.21.15.90:0/2923340256 learned_addr learned my addr 172.21.15.90:0/2923340256 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:43.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.351+0000 7f16e16a4700 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc633c0 0x561c5dc21360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16e1ea5700 1 -- 172.21.15.90:0/2923340256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc633c0 msgr2=0x561c5dc21360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc633c0 0x561c5dc21360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16e1ea5700 1 -- 172.21.15.90:0/2923340256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 msgr2=0x561c5dca4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16e26a6700 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16e1ea5700 1 -- 172.21.15.90:0/2923340256 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c5d9e4fd0 con 0x561c5dc1fcb0 2022-07-05T12:05:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc1fcb0 0x561c5dc235a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f16d400fca0 tx=0x7f16d4016040).ready entity=mon.0 client_cookie=7c53fbb06a13da4b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16c37fe700 1 -- 172.21.15.90:0/2923340256 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40260d0 con 0x561c5dc1fcb0 2022-07-05T12:05:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16c37fe700 1 -- 172.21.15.90:0/2923340256 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4026b00 con 0x561c5dc1fcb0 2022-07-05T12:05:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16c37fe700 1 -- 172.21.15.90:0/2923340256 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4026e80 con 0x561c5dc1fcb0 2022-07-05T12:05:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 -- 172.21.15.90:0/2923340256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc1fcb0 msgr2=0x561c5dc235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc1fcb0 0x561c5dc235a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f16d400fca0 tx=0x7f16d4016040).stop 2022-07-05T12:05:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 -- 172.21.15.90:0/2923340256 shutdown_connections 2022-07-05T12:05:43.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc637a0 0x561c5dca4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc1fcb0 0x561c5dc235a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/2923340256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc633c0 0x561c5dc21360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 -- 172.21.15.90:0/2923340256 >> 172.21.15.90:0/2923340256 conn(0x561c5da8e1c0 msgr2=0x561c5dc64200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:43.405 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 -- 172.21.15.90:0/2923340256 shutdown_connections 2022-07-05T12:05:43.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.352+0000 7f16f5a95b80 1 -- 172.21.15.90:0/2923340256 wait complete. 2022-07-05T12:05:43.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.353+0000 7f16f5a95b80 1 -- start start 2022-07-05T12:05:43.406 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.353+0000 7f16f5a95b80 1 Processor -- start 2022-07-05T12:05:43.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc1fcb0 0x561c5dc61650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dcf4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16f5a95b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc637a0 0x561c5dcf7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.407 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dc61b40 con 0x561c5dc633c0 2022-07-05T12:05:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dcfbad0 con 0x561c5dc1fcb0 2022-07-05T12:05:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16f5a95b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5dcf52c0 con 0x561c5dc637a0 2022-07-05T12:05:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16f5a95b80 10 client.0 ll_register_callbacks cb 0x561c5dbe31b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:05:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16e16a4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dcf4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16e16a4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dcf4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60342/0 (socket says 172.21.15.90:60342) 2022-07-05T12:05:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16e16a4700 1 -- 172.21.15.90:0/1999104909 learned_addr learned my addr 172.21.15.90:0/1999104909 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:05:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.354+0000 7f16e26a6700 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc637a0 0x561c5dcf7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc1fcb0 0x561c5dc61650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16e16a4700 1 -- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc637a0 msgr2=0x561c5dcf7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16e16a4700 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc637a0 0x561c5dcf7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16e16a4700 1 -- 172.21.15.90:0/1999104909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc1fcb0 msgr2=0x561c5dc61650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:05:43.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16e16a4700 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc1fcb0 0x561c5dc61650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16e16a4700 1 -- 172.21.15.90:0/1999104909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc17a9e0 con 0x561c5dc633c0 2022-07-05T12:05:43.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16e16a4700 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dcf4dd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x561c5dc6e490 tx=0x7f16cc01c000).ready entity=mon.0 client_cookie=fc94d201aa7f8fcd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:05:43.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:05:43.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16b7fff700 1 -- 172.21.15.90:0/1999104909 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc015990 con 0x561c5dc633c0 2022-07-05T12:05:43.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16b7fff700 1 -- 172.21.15.90:0/1999104909 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f16cc015420 con 0x561c5dc633c0 2022-07-05T12:05:43.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16d8086df0 con 0x561c5dc633c0 2022-07-05T12:05:43.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16b7fff700 1 -- 172.21.15.90:0/1999104909 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16cc015af0 con 0x561c5dc633c0 2022-07-05T12:05:43.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 10 client.6090 fetch_fsmap learned FSMap version 41 2022-07-05T12:05:43.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x561c5dcfaec0 con 0x561c5dc633c0 2022-07-05T12:05:43.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16b7fff700 1 -- 172.21.15.90:0/1999104909 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8086df0 con 0x561c5dc633c0 2022-07-05T12:05:43.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16b7fff700 1 -- 172.21.15.90:0/1999104909 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f16cc02ab30 con 0x561c5dc633c0 2022-07-05T12:05:43.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 10 client.6090 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:05:43.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 10 client.6090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:05:43.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 20 client.6090 populate_metadata read hostname 'smithi090' 2022-07-05T12:05:43.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc90150 0x561c5dc55620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:05:43.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 4 client.6090 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:05:43.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.355+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561c5db62690 con 0x561c5dc90150 2022-07-05T12:05:43.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc90150 0x561c5dc55620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:05:43.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16b7fff700 10 client.6090 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:43.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16e1ea5700 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc90150 0x561c5dc55620 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6712adff5a717aae server_cookie=d9f86f71a2dafd07 in_seq=0 out_seq=0 2022-07-05T12:05:43.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16b7fff700 1 -- 172.21.15.90:0/1999104909 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561c5db62690 con 0x561c5dc90150 2022-07-05T12:05:43.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16b7fff700 10 client.6090 handle_command_reply: tid=0 2022-07-05T12:05:43.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 client.6090 shutdown 2022-07-05T12:05:43.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 msgr2=0x561c5dcf4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dcf4dd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x561c5dc6e490 tx=0x7f16cc01c000).stop 2022-07-05T12:05:43.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 shutdown_connections 2022-07-05T12:05:43.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x561c5dc90150 0x561c5dc55620 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561c5dc637a0 0x561c5dcf7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16b7fff700 0 client.6090 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:05:43.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561c5dc1fcb0 0x561c5dc61650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 --2- 172.21.15.90:0/1999104909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561c5dc633c0 0x561c5dcf4dd0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 >> 172.21.15.90:0/1999104909 conn(0x561c5da8e1c0 msgr2=0x561c5dc4f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 shutdown_connections 2022-07-05T12:05:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.356+0000 7f16f5a95b80 1 -- 172.21.15.90:0/1999104909 wait complete. 2022-07-05T12:05:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16f5a95b80 20 client.6090 trim_cache size 0 max 16384 2022-07-05T12:05:43.420 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:05:43.420 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:05:43.421 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:05:43.421 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:05:43.421 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:05:43.421 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:05:43.422 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:05:43.422 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:05:43.422 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:05:43.422 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:05:43.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16bc08ba40 msgr2=0x7f16bc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16bc08ba40 0x7f16bc08df00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f16dc0e8890 tx=0x7f16d4009040).stop 2022-07-05T12:05:43.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16dc17a560 msgr2=0x7f16dc171c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:05:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16dc17a560 0x7f16dc171c50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f16d8009dd0 tx=0x7f16d8017000).stop 2022-07-05T12:05:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 shutdown_connections 2022-07-05T12:05:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f16bc08ba40 0x7f16bc08df00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16dc17a560 0x7f16dc171c50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16dc0c77b0 0x7f16dc0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 --2- 172.21.15.90:0/2215836881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16dc17a180 0x7f16dc1737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:05:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 >> 172.21.15.90:0/2215836881 conn(0x7f16dc083570 msgr2=0x7f16dc17ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:05:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 shutdown_connections 2022-07-05T12:05:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:05:43.357+0000 7f16e4109700 1 -- 172.21.15.90:0/2215836881 wait complete. 2022-07-05T12:05:43.428 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:06:13.430 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:06:13.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.561+0000 7f45c56ad700 1 Processor -- start 2022-07-05T12:06:13.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.561+0000 7f45c56ad700 1 -- start start 2022-07-05T12:06:13.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.562+0000 7f45c56ad700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45c01789f0 0x7f45c017f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.562+0000 7f45c56ad700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f45c017e100 0x7f45c0063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.562+0000 7f45c56ad700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c017d560 con 0x7f45c0178610 2022-07-05T12:06:13.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.562+0000 7f45c56ad700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c017f8a0 con 0x7f45c01789f0 2022-07-05T12:06:13.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.562+0000 7f45c56ad700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c017c670 con 0x7f45c017e100 2022-07-05T12:06:13.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.562+0000 7f45be7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45c01789f0 0x7f45c017f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.562+0000 7f45be7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45c01789f0 0x7f45c017f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60352/0 (socket says 172.21.15.90:60352) 2022-07-05T12:06:13.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45be7fc700 1 -- 172.21.15.90:0/2741509828 learned_addr learned my addr 172.21.15.90:0/2741509828 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:13.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45be7fc700 1 -- 172.21.15.90:0/2741509828 >> v2:172.21.15.110:3300/0 conn(0x7f45c017e100 msgr2=0x7f45c0063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45bf7fe700 1 --2- 172.21.15.90:0/2741509828 >> v2:172.21.15.110:3300/0 conn(0x7f45c017e100 0x7f45c0063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45be7fc700 1 --2- 172.21.15.90:0/2741509828 >> v2:172.21.15.110:3300/0 conn(0x7f45c017e100 0x7f45c0063bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45be7fc700 1 -- 172.21.15.90:0/2741509828 >> v1:172.21.15.110:6789/0 conn(0x7f45c0178610 legacy=0x7f45c017d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45be7fc700 1 -- 172.21.15.90:0/2741509828 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c017c950 con 0x7f45c01789f0 2022-07-05T12:06:13.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45be7fc700 1 --2- 172.21.15.90:0/2741509828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017f3b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f45c017c480 tx=0x7f45a80090f0).ready entity=mon.0 client_cookie=a743924b6d67a516 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:13.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45bdffb700 1 -- 172.21.15.90:0/2741509828 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800b5a0 con 0x7f45c01789f0 2022-07-05T12:06:13.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45bdffb700 1 -- 172.21.15.90:0/2741509828 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a800b700 con 0x7f45c01789f0 2022-07-05T12:06:13.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45bdffb700 1 -- 172.21.15.90:0/2741509828 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800ba80 con 0x7f45c01789f0 2022-07-05T12:06:13.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45c56ad700 1 -- 172.21.15.90:0/2741509828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 msgr2=0x7f45c017f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.563+0000 7f45c56ad700 1 --2- 172.21.15.90:0/2741509828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017f3b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f45c017c480 tx=0x7f45a80090f0).stop 2022-07-05T12:06:13.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.564+0000 7f45c56ad700 1 -- 172.21.15.90:0/2741509828 shutdown_connections 2022-07-05T12:06:13.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.564+0000 7f45c56ad700 1 --2- 172.21.15.90:0/2741509828 >> v2:172.21.15.110:3300/0 conn(0x7f45c017e100 0x7f45c0063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.564+0000 7f45c56ad700 1 --2- 172.21.15.90:0/2741509828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017f3b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.564+0000 7f45c56ad700 1 -- 172.21.15.90:0/2741509828 >> 172.21.15.90:0/2741509828 conn(0x7f45c00f2210 msgr2=0x7f45c0069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:13.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.564+0000 7f45c56ad700 1 -- 172.21.15.90:0/2741509828 shutdown_connections 2022-07-05T12:06:13.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.564+0000 7f45c56ad700 1 -- 172.21.15.90:0/2741509828 wait complete. 2022-07-05T12:06:13.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.565+0000 7f45c56ad700 1 Processor -- start 2022-07-05T12:06:13.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.565+0000 7f45c56ad700 1 -- start start 2022-07-05T12:06:13.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45c56ad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c0178610 0x7f45c0168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45c56ad700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.582 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45c56ad700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c017e100 0x7f45c017b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45c56ad700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0190ac0 con 0x7f45c01789f0 2022-07-05T12:06:13.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45c56ad700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0179e80 con 0x7f45c017e100 2022-07-05T12:06:13.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45c56ad700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c017a160 con 0x7f45c0178610 2022-07-05T12:06:13.583 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60358/0 (socket says 172.21.15.90:60358) 2022-07-05T12:06:13.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45be7fc700 1 -- 172.21.15.90:0/3382569323 learned_addr learned my addr 172.21.15.90:0/3382569323 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:13.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.566+0000 7f45beffd700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c0178610 0x7f45c0168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45bf7fe700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c017e100 0x7f45c017b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.584 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45be7fc700 1 -- 172.21.15.90:0/3382569323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c0178610 msgr2=0x7f45c0168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45be7fc700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c0178610 0x7f45c0168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45be7fc700 1 -- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c017e100 msgr2=0x7f45c017b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45be7fc700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c017e100 0x7f45c017b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.585 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45be7fc700 1 -- 172.21.15.90:0/3382569323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8009370 con 0x7f45c01789f0 2022-07-05T12:06:13.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45be7fc700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017b3b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f45a8009130 tx=0x7f45a8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:13.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45b6ffd700 1 -- 172.21.15.90:0/3382569323 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800b870 con 0x7f45c01789f0 2022-07-05T12:06:13.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45b6ffd700 1 -- 172.21.15.90:0/3382569323 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a800b9d0 con 0x7f45c01789f0 2022-07-05T12:06:13.586 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c017a440 con 0x7f45c01789f0 2022-07-05T12:06:13.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45b6ffd700 1 -- 172.21.15.90:0/3382569323 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a801b660 con 0x7f45c01789f0 2022-07-05T12:06:13.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.567+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c0190750 con 0x7f45c01789f0 2022-07-05T12:06:13.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.569+0000 7f45b6ffd700 1 -- 172.21.15.90:0/3382569323 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f45a800f070 con 0x7f45c01789f0 2022-07-05T12:06:13.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.569+0000 7f45b6ffd700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f45a408ba40 0x7f45a408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.587 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.569+0000 7f45b6ffd700 1 -- 172.21.15.90:0/3382569323 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f45a80b1d50 con 0x7f45c01789f0 2022-07-05T12:06:13.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.569+0000 7f45beffd700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f45a408ba40 0x7f45a408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.570+0000 7f45beffd700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f45a408ba40 0x7f45a408df00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f45b0006fd0 tx=0x7f45b0009250).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:13.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.571+0000 7f45d7039b80 1 Processor -- start 2022-07-05T12:06:13.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.571+0000 7f45d7039b80 1 -- start start 2022-07-05T12:06:13.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a1749cb0 0x5590a1797990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d7a0 0x5590a178dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45d7039b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a17132d0 con 0x5590a178d3c0 2022-07-05T12:06:13.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45d7039b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a168aaa0 con 0x5590a178d7a0 2022-07-05T12:06:13.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45d7039b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a169f950 con 0x5590a1749cb0 2022-07-05T12:06:13.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45beffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45beffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60362/0 (socket says 172.21.15.90:60362) 2022-07-05T12:06:13.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45beffd700 1 -- 172.21.15.90:0/4242233039 learned_addr learned my addr 172.21.15.90:0/4242233039 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:13.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45be7fc700 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a1749cb0 0x5590a1797990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.572+0000 7f45bf7fe700 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d7a0 0x5590a178dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45beffd700 1 -- 172.21.15.90:0/4242233039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a1749cb0 msgr2=0x5590a1797990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45beffd700 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a1749cb0 0x5590a1797990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45beffd700 1 -- 172.21.15.90:0/4242233039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d7a0 msgr2=0x5590a178dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45beffd700 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d7a0 0x5590a178dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45beffd700 1 -- 172.21.15.90:0/4242233039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590a14d19e0 con 0x5590a178d3c0 2022-07-05T12:06:13.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45bf7fe700 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d7a0 0x5590a178dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:06:13.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45beffd700 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17497c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f45b0001c60 tx=0x7f45b0013000).ready entity=mon.0 client_cookie=1764a6bf446c8b9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:13.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f459ffff700 1 -- 172.21.15.90:0/4242233039 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0009530 con 0x5590a178d3c0 2022-07-05T12:06:13.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f459ffff700 1 -- 172.21.15.90:0/4242233039 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0018070 con 0x5590a178d3c0 2022-07-05T12:06:13.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f459ffff700 1 -- 172.21.15.90:0/4242233039 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0014a20 con 0x5590a178d3c0 2022-07-05T12:06:13.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45d7039b80 1 -- 172.21.15.90:0/4242233039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 msgr2=0x5590a17497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.573+0000 7f45d7039b80 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17497c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f45b0001c60 tx=0x7f45b0013000).stop 2022-07-05T12:06:13.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 -- 172.21.15.90:0/4242233039 shutdown_connections 2022-07-05T12:06:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d7a0 0x5590a178dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17497c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 --2- 172.21.15.90:0/4242233039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a1749cb0 0x5590a1797990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 -- 172.21.15.90:0/4242233039 >> 172.21.15.90:0/4242233039 conn(0x5590a15b81c0 msgr2=0x5590a174cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:13.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 -- 172.21.15.90:0/4242233039 shutdown_connections 2022-07-05T12:06:13.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 -- 172.21.15.90:0/4242233039 wait complete. 2022-07-05T12:06:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 -- start start 2022-07-05T12:06:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.574+0000 7f45d7039b80 1 Processor -- start 2022-07-05T12:06:13.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17c0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17be9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a1791100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a1667120 con 0x5590a178d3c0 2022-07-05T12:06:13.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a17bf100 con 0x5590a1749cb0 2022-07-05T12:06:13.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a17ccf10 con 0x5590a178d7a0 2022-07-05T12:06:13.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 10 client.0 ll_register_callbacks cb 0x5590a170d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:06:13.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17be9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60370/0 (socket says 172.21.15.90:60370) 2022-07-05T12:06:13.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 -- 172.21.15.90:0/2561402729 learned_addr learned my addr 172.21.15.90:0/2561402729 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:13.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45bf7fe700 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a1791100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45beffd700 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 -- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 msgr2=0x5590a1791100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a1791100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 -- 172.21.15.90:0/2561402729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 msgr2=0x5590a17c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17c0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 -- 172.21.15.90:0/2561402729 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b000e040 con 0x5590a178d3c0 2022-07-05T12:06:13.609 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45be7fc700 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17be9b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f45a8086600 tx=0x7f45a801d040).ready entity=mon.0 client_cookie=752389968baf8967 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:13.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f459d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:06:13.610 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f459d7fa700 1 -- 172.21.15.90:0/2561402729 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a808bf50 con 0x5590a178d3c0 2022-07-05T12:06:13.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f459d7fa700 1 -- 172.21.15.90:0/2561402729 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f45a8082d80 con 0x5590a178d3c0 2022-07-05T12:06:13.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590a1747440 con 0x5590a178d3c0 2022-07-05T12:06:13.611 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f459d7fa700 1 -- 172.21.15.90:0/2561402729 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45a8082f40 con 0x5590a178d3c0 2022-07-05T12:06:13.612 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 10 client.6102 fetch_fsmap learned FSMap version 41 2022-07-05T12:06:13.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5590a1540cd0 con 0x5590a178d3c0 2022-07-05T12:06:13.613 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.576+0000 7f459d7fa700 1 -- 172.21.15.90:0/2561402729 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590a1747440 con 0x5590a178d3c0 2022-07-05T12:06:13.614 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f459d7fa700 1 -- 172.21.15.90:0/2561402729 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f45a808bac0 con 0x5590a178d3c0 2022-07-05T12:06:13.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45d7039b80 10 client.6102 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:06:13.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45d7039b80 10 client.6102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:06:13.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45d7039b80 20 client.6102 populate_metadata read hostname 'smithi090' 2022-07-05T12:06:13.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45d7039b80 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1790800 0x5590a1781ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45d7039b80 4 client.6102 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:06:13.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590a16957f0 con 0x5590a1790800 2022-07-05T12:06:13.622 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45beffd700 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1790800 0x5590a1781ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f459d7fa700 10 client.6102 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:13.623 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.577+0000 7f45beffd700 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1790800 0x5590a1781ee0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7795bae32fec332c server_cookie=6dbe503c1c139e28 in_seq=0 out_seq=0 2022-07-05T12:06:13.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f459d7fa700 1 -- 172.21.15.90:0/2561402729 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5590a16957f0 con 0x5590a1790800 2022-07-05T12:06:13.624 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f459d7fa700 10 client.6102 handle_command_reply: tid=0 2022-07-05T12:06:13.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 client.6102 shutdown 2022-07-05T12:06:13.625 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 msgr2=0x5590a17be9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17be9b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f45a8086600 tx=0x7f45a801d040).stop 2022-07-05T12:06:13.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 shutdown_connections 2022-07-05T12:06:13.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1790800 0x5590a1781ee0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a1791100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 --2- 172.21.15.90:0/2561402729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a17be9b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f459d7fa700 0 client.6102 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:13.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 >> 172.21.15.90:0/2561402729 conn(0x5590a15b81c0 msgr2=0x5590a174a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:13.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 shutdown_connections 2022-07-05T12:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 1 -- 172.21.15.90:0/2561402729 wait complete. 2022-07-05T12:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.578+0000 7f45d7039b80 20 client.6102 trim_cache size 0 max 16384 2022-07-05T12:06:13.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.594+0000 7f45d7039b80 1 Processor -- start 2022-07-05T12:06:13.645 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.594+0000 7f45d7039b80 1 -- start start 2022-07-05T12:06:13.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a1749cb0 0x5590a17cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d3c0 0x5590a174a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45d7039b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a1754b80 con 0x5590a1749cb0 2022-07-05T12:06:13.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45d7039b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a17bfeb0 con 0x5590a178d3c0 2022-07-05T12:06:13.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45d7039b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a17c0430 con 0x5590a178d7a0 2022-07-05T12:06:13.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a1749cb0 0x5590a17cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a1749cb0 0x5590a17cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60378/0 (socket says 172.21.15.90:60378) 2022-07-05T12:06:13.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 -- 172.21.15.90:0/1731025869 learned_addr learned my addr 172.21.15.90:0/1731025869 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:13.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45bf7fe700 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45be7fc700 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d3c0 0x5590a174a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 -- 172.21.15.90:0/1731025869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 msgr2=0x5590a174d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 -- 172.21.15.90:0/1731025869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d3c0 msgr2=0x5590a174a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d3c0 0x5590a174a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 -- 172.21.15.90:0/1731025869 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590a150efd0 con 0x5590a1749cb0 2022-07-05T12:06:13.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45beffd700 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a1749cb0 0x5590a17cb100 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f45b0019000 tx=0x7f45b0021040).ready entity=mon.0 client_cookie=91b507f8416ad856 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:13.654 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.595+0000 7f45b4ff9700 1 -- 172.21.15.90:0/1731025869 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b002a440 con 0x5590a1749cb0 2022-07-05T12:06:13.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45b4ff9700 1 -- 172.21.15.90:0/1731025869 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b002a5a0 con 0x5590a1749cb0 2022-07-05T12:06:13.655 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45b4ff9700 1 -- 172.21.15.90:0/1731025869 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b002a730 con 0x5590a1749cb0 2022-07-05T12:06:13.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 -- 172.21.15.90:0/1731025869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a1749cb0 msgr2=0x5590a17cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.656 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a1749cb0 0x5590a17cb100 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f45b0019000 tx=0x7f45b0021040).stop 2022-07-05T12:06:13.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 -- 172.21.15.90:0/1731025869 shutdown_connections 2022-07-05T12:06:13.657 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a1749cb0 0x5590a17cb100 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.658 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 --2- 172.21.15.90:0/1731025869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a178d3c0 0x5590a174a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 -- 172.21.15.90:0/1731025869 >> 172.21.15.90:0/1731025869 conn(0x5590a15b81c0 msgr2=0x5590a174b330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:13.659 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 -- 172.21.15.90:0/1731025869 shutdown_connections 2022-07-05T12:06:13.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.596+0000 7f45d7039b80 1 -- 172.21.15.90:0/1731025869 wait complete. 2022-07-05T12:06:13.660 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.597+0000 7f45d7039b80 1 -- start start 2022-07-05T12:06:13.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.597+0000 7f45d7039b80 1 Processor -- start 2022-07-05T12:06:13.661 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17837d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a1794000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45d7039b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.662 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45d7039b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a1793bb0 con 0x5590a178d3c0 2022-07-05T12:06:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45d7039b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a17cecc0 con 0x5590a1749cb0 2022-07-05T12:06:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45d7039b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590a1783cc0 con 0x5590a178d7a0 2022-07-05T12:06:13.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45d7039b80 10 client.0 ll_register_callbacks cb 0x5590a170d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:06:13.664 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a1794000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a1794000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60384/0 (socket says 172.21.15.90:60384) 2022-07-05T12:06:13.665 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 -- 172.21.15.90:0/3372329089 learned_addr learned my addr 172.21.15.90:0/3372329089 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:13.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45bf7fe700 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.666 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45beffd700 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 -- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 msgr2=0x5590a174b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.667 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 -- 172.21.15.90:0/3372329089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 msgr2=0x5590a17837d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:13.668 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17837d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 -- 172.21.15.90:0/3372329089 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590a14d19e0 con 0x5590a178d3c0 2022-07-05T12:06:13.669 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.598+0000 7f45be7fc700 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a1794000 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f45a800b360 tx=0x7f45a8054000).ready entity=mon.0 client_cookie=447b61f7eecd8688 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:13.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f459d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:06:13.670 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f459d7fa700 1 -- 172.21.15.90:0/3372329089 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80829b0 con 0x5590a178d3c0 2022-07-05T12:06:13.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f459d7fa700 1 -- 172.21.15.90:0/3372329089 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f45a808bf50 con 0x5590a178d3c0 2022-07-05T12:06:13.671 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45b0018070 con 0x5590a178d3c0 2022-07-05T12:06:13.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f459d7fa700 1 -- 172.21.15.90:0/3372329089 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45a808a1e0 con 0x5590a178d3c0 2022-07-05T12:06:13.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 10 client.6108 fetch_fsmap learned FSMap version 41 2022-07-05T12:06:13.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5590a14d19e0 con 0x5590a178d3c0 2022-07-05T12:06:13.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f459d7fa700 1 -- 172.21.15.90:0/3372329089 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0018070 con 0x5590a178d3c0 2022-07-05T12:06:13.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f459d7fa700 1 -- 172.21.15.90:0/3372329089 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f45a808a340 con 0x5590a178d3c0 2022-07-05T12:06:13.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 10 client.6108 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:06:13.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 10 client.6108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:06:13.675 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 20 client.6108 populate_metadata read hostname 'smithi090' 2022-07-05T12:06:13.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1819110 0x5590a1815f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:13.676 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 4 client.6108 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:06:13.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5590a168c690 con 0x5590a1819110 2022-07-05T12:06:13.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.599+0000 7f45beffd700 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1819110 0x5590a1815f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:13.677 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f459d7fa700 10 client.6108 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:13.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45beffd700 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1819110 0x5590a1815f70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=de0a3c20ebbdb8c9 server_cookie=366fa80d5f46378a in_seq=0 out_seq=0 2022-07-05T12:06:13.678 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f459d7fa700 1 -- 172.21.15.90:0/3372329089 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5590a168c690 con 0x5590a1819110 2022-07-05T12:06:13.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f459d7fa700 10 client.6108 handle_command_reply: tid=0 2022-07-05T12:06:13.679 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 client.6108 shutdown 2022-07-05T12:06:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 msgr2=0x5590a1794000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a1794000 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f45a800b360 tx=0x7f45a8054000).stop 2022-07-05T12:06:13.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 shutdown_connections 2022-07-05T12:06:13.681 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5590a1819110 0x5590a1815f70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590a178d7a0 0x5590a174b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5590a1749cb0 0x5590a17837d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f459d7fa700 0 client.6108 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 --2- 172.21.15.90:0/3372329089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590a178d3c0 0x5590a1794000 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 >> 172.21.15.90:0/3372329089 conn(0x5590a15b81c0 msgr2=0x5590a17970a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 shutdown_connections 2022-07-05T12:06:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 1 -- 172.21.15.90:0/3372329089 wait complete. 2022-07-05T12:06:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.600+0000 7f45d7039b80 20 client.6108 trim_cache size 0 max 16384 2022-07-05T12:06:13.686 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:06:13.687 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:06:13.687 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:06:13.688 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:06:13.688 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:06:13.688 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:06:13.689 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:06:13.689 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:06:13.689 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:06:13.689 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:06:13.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f45a408ba40 msgr2=0x7f45a408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f45a408ba40 0x7f45a408df00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f45b0006fd0 tx=0x7f45b0009250).stop 2022-07-05T12:06:13.692 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 msgr2=0x7f45c017b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:13.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017b3b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f45a8009130 tx=0x7f45a8015000).stop 2022-07-05T12:06:13.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 shutdown_connections 2022-07-05T12:06:13.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f45a408ba40 0x7f45a408df00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.693 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c017e100 0x7f45c017b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c0178610 0x7f45c0168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 --2- 172.21.15.90:0/3382569323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c01789f0 0x7f45c017b3b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:13.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 >> 172.21.15.90:0/3382569323 conn(0x7f45c00f2210 msgr2=0x7f45c017d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:13.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 shutdown_connections 2022-07-05T12:06:13.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:13.601+0000 7f45c56ad700 1 -- 172.21.15.90:0/3382569323 wait complete. 2022-07-05T12:06:13.695 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:06:43.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:06:43.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.824+0000 7f8fdaa5a700 1 Processor -- start 2022-07-05T12:06:43.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.824+0000 7f8fdaa5a700 1 -- start start 2022-07-05T12:06:43.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fdaa5a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fd4063910 0x7f8fd40ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fdaa5a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fd40ef830 0x7f8fd40efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fdaa5a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd4061f10 con 0x7f8fd417dcd0 2022-07-05T12:06:43.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fdaa5a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd4062d70 con 0x7f8fd4063910 2022-07-05T12:06:43.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fdaa5a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd4062160 con 0x7f8fd40ef830 2022-07-05T12:06:43.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fd40ef830 0x7f8fd40efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fd40ef830 0x7f8fd40efcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41790/0 (socket says 172.21.15.90:41790) 2022-07-05T12:06:43.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 -- 172.21.15.90:0/2070210405 learned_addr learned my addr 172.21.15.90:0/2070210405 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:43.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fd9257700 1 --2- 172.21.15.90:0/2070210405 >> v2:172.21.15.110:3300/0 conn(0x7f8fd4063910 0x7f8fd40ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 -- 172.21.15.90:0/2070210405 >> v2:172.21.15.110:3300/0 conn(0x7f8fd4063910 msgr2=0x7f8fd40ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 --2- 172.21.15.90:0/2070210405 >> v2:172.21.15.110:3300/0 conn(0x7f8fd4063910 0x7f8fd40ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 -- 172.21.15.90:0/2070210405 >> v1:172.21.15.110:6789/0 conn(0x7f8fd417dcd0 legacy=0x7f8fd4063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 -- 172.21.15.90:0/2070210405 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4062440 con 0x7f8fd40ef830 2022-07-05T12:06:43.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fda259700 1 --2- 172.21.15.90:0/2070210405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd40ef830 0x7f8fd40efcc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8fd4062ce0 tx=0x7f8fcc0090f0).ready entity=mon.2 client_cookie=894a79a4cbc8af6b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:43.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.826+0000 7f8fd8a56700 1 -- 172.21.15.90:0/2070210405 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00b520 con 0x7f8fd40ef830 2022-07-05T12:06:43.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fd8a56700 1 -- 172.21.15.90:0/2070210405 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00b680 con 0x7f8fd40ef830 2022-07-05T12:06:43.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fd8a56700 1 -- 172.21.15.90:0/2070210405 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00ba20 con 0x7f8fd40ef830 2022-07-05T12:06:43.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/2070210405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd40ef830 msgr2=0x7f8fd40efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/2070210405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd40ef830 0x7f8fd40efcc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8fd4062ce0 tx=0x7f8fcc0090f0).stop 2022-07-05T12:06:43.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/2070210405 shutdown_connections 2022-07-05T12:06:43.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/2070210405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd40ef830 0x7f8fd40efcc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/2070210405 >> v2:172.21.15.110:3300/0 conn(0x7f8fd4063910 0x7f8fd40ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/2070210405 >> 172.21.15.90:0/2070210405 conn(0x7f8fd40f5470 msgr2=0x7f8fd40f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:43.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/2070210405 shutdown_connections 2022-07-05T12:06:43.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.827+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/2070210405 wait complete. 2022-07-05T12:06:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.829+0000 7f8fdaa5a700 1 Processor -- start 2022-07-05T12:06:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.829+0000 7f8fdaa5a700 1 -- start start 2022-07-05T12:06:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fdaa5a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fd4063910 0x7f8fd4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fdaa5a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd40ef830 0x7f8fd40eba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fdaa5a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd417dcd0 0x7f8fd40ebf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fdaa5a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40ed880 con 0x7f8fd40ef830 2022-07-05T12:06:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fdaa5a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40ec920 con 0x7f8fd4063910 2022-07-05T12:06:43.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fdaa5a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40ecc00 con 0x7f8fd417dcd0 2022-07-05T12:06:43.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fd9257700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd40ef830 0x7f8fd40eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fda259700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd417dcd0 0x7f8fd40ebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.857 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fd9257700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd40ef830 0x7f8fd40eba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60398/0 (socket says 172.21.15.90:60398) 2022-07-05T12:06:43.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fd9257700 1 -- 172.21.15.90:0/1224762718 learned_addr learned my addr 172.21.15.90:0/1224762718 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:43.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fd4063910 0x7f8fd4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.858 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fda259700 1 -- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fd4063910 msgr2=0x7f8fd4158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fda259700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fd4063910 0x7f8fd4158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fda259700 1 -- 172.21.15.90:0/1224762718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd40ef830 msgr2=0x7f8fd40eba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.859 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fda259700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd40ef830 0x7f8fd40eba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fda259700 1 -- 172.21.15.90:0/1224762718 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc009370 con 0x7f8fd417dcd0 2022-07-05T12:06:43.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fda259700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd417dcd0 0x7f8fd40ebf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8fcc014000 tx=0x7f8fcc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:43.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fd1ffb700 1 -- 172.21.15.90:0/1224762718 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00b520 con 0x7f8fd417dcd0 2022-07-05T12:06:43.860 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fd1ffb700 1 -- 172.21.15.90:0/1224762718 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc006970 con 0x7f8fd417dcd0 2022-07-05T12:06:43.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd40ecee0 con 0x7f8fd417dcd0 2022-07-05T12:06:43.861 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.830+0000 7f8fd1ffb700 1 -- 172.21.15.90:0/1224762718 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc006d90 con 0x7f8fd417dcd0 2022-07-05T12:06:43.865 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.831+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd40ed4a0 con 0x7f8fd417dcd0 2022-07-05T12:06:43.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.833+0000 7f8fd1ffb700 1 -- 172.21.15.90:0/1224762718 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f8fcc02c070 con 0x7f8fd417dcd0 2022-07-05T12:06:43.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.833+0000 7f8fd1ffb700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8fb408ba40 0x7f8fb408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.866 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.833+0000 7f8fd1ffb700 1 -- 172.21.15.90:0/1224762718 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f8fcc0b2320 con 0x7f8fd417dcd0 2022-07-05T12:06:43.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.833+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8fb408ba40 0x7f8fb408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.834+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8fb408ba40 0x7f8fb408df00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f8fc4002d40 tx=0x7f8fc4000f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:43.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.834+0000 7f8fed648b80 1 Processor -- start 2022-07-05T12:06:43.867 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.835+0000 7f8fed648b80 1 -- start start 2022-07-05T12:06:43.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.835+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effad68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.835+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb24a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.835+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb1ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.868 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.835+0000 7f8fed648b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effaa02d0 con 0x557effb1a890 2022-07-05T12:06:43.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fed648b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effa17aa0 con 0x557effad6da0 2022-07-05T12:06:43.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fed648b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effa2c950 con 0x557effb1a4b0 2022-07-05T12:06:43.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb1ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb1ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60408/0 (socket says 172.21.15.90:60408) 2022-07-05T12:06:43.869 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 -- 172.21.15.90:0/1283677986 learned_addr learned my addr 172.21.15.90:0/1283677986 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:43.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effad68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.870 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fd9257700 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb24a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 -- 172.21.15.90:0/1283677986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 msgr2=0x557effad68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effad68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.871 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 -- 172.21.15.90:0/1283677986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 msgr2=0x557effb24a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb24a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 -- 172.21.15.90:0/1283677986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eff85e9e0 con 0x557effb1a890 2022-07-05T12:06:43.872 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effad68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:06:43.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fda259700 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb1ad10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f8fcc086ac0 tx=0x7f8fcc086af0).ready entity=mon.0 client_cookie=4565d89ead4b0719 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:43.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fbaffd700 1 -- 172.21.15.90:0/1283677986 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0b2160 con 0x557effb1a890 2022-07-05T12:06:43.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fbaffd700 1 -- 172.21.15.90:0/1283677986 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc086c40 con 0x557effb1a890 2022-07-05T12:06:43.873 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.836+0000 7f8fbaffd700 1 -- 172.21.15.90:0/1283677986 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc08c520 con 0x557effb1a890 2022-07-05T12:06:43.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 -- 172.21.15.90:0/1283677986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 msgr2=0x557effb1ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb1ad10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f8fcc086ac0 tx=0x7f8fcc086af0).stop 2022-07-05T12:06:43.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 -- 172.21.15.90:0/1283677986 shutdown_connections 2022-07-05T12:06:43.874 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb1ad10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effad68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.875 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 --2- 172.21.15.90:0/1283677986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb24a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 -- 172.21.15.90:0/1283677986 >> 172.21.15.90:0/1283677986 conn(0x557eff9451c0 msgr2=0x557effad9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 -- 172.21.15.90:0/1283677986 shutdown_connections 2022-07-05T12:06:43.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.837+0000 7f8fed648b80 1 -- 172.21.15.90:0/1283677986 wait complete. 2022-07-05T12:06:43.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.838+0000 7f8fed648b80 1 -- start start 2022-07-05T12:06:43.877 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.838+0000 7f8fed648b80 1 Processor -- start 2022-07-05T12:06:43.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb59d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.878 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effb0f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb18430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fed648b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eff9f4120 con 0x557effb1a890 2022-07-05T12:06:43.879 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fed648b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effb5aa20 con 0x557effad6da0 2022-07-05T12:06:43.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fed648b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effb17f30 con 0x557effb1a4b0 2022-07-05T12:06:43.880 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fed648b80 10 client.0 ll_register_callbacks cb 0x557effa9a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:06:43.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb18430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.881 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb18430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60414/0 (socket says 172.21.15.90:60414) 2022-07-05T12:06:43.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 -- 172.21.15.90:0/3018832558 learned_addr learned my addr 172.21.15.90:0/3018832558 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:43.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fd9257700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effb0f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb59d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 -- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 msgr2=0x557effb0f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.883 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effb0f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 -- 172.21.15.90:0/3018832558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 msgr2=0x557effb59d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.884 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb59d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 -- 172.21.15.90:0/3018832558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc400f040 con 0x557effb1a890 2022-07-05T12:06:43.885 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb59d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:06:43.886 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8fda259700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb18430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f8fcc0092f0 tx=0x557effb25930).ready entity=mon.0 client_cookie=22fee92a0f008b56 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:43.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.839+0000 7f8faffff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:06:43.887 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8faffff700 1 -- 172.21.15.90:0/3018832558 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0591d0 con 0x557effb1a890 2022-07-05T12:06:43.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557effad4690 con 0x557effb1a890 2022-07-05T12:06:43.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8faffff700 1 -- 172.21.15.90:0/3018832558 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f8fcc086130 con 0x557effb1a890 2022-07-05T12:06:43.889 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8faffff700 1 -- 172.21.15.90:0/3018832558 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fcc059330 con 0x557effb1a890 2022-07-05T12:06:43.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 10 client.6117 fetch_fsmap learned FSMap version 41 2022-07-05T12:06:43.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x7f8fd40ed4a0 con 0x557effb1a890 2022-07-05T12:06:43.890 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8faffff700 1 -- 172.21.15.90:0/3018832558 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0a0020 con 0x557effb1a890 2022-07-05T12:06:43.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8faffff700 1 -- 172.21.15.90:0/3018832558 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f8fcc08c090 con 0x557effb1a890 2022-07-05T12:06:43.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 10 client.6117 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:06:43.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 10 client.6117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:06:43.891 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 20 client.6117 populate_metadata read hostname 'smithi090' 2022-07-05T12:06:43.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb5a240 0x557effb5a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 4 client.6117 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:06:43.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557effa227f0 con 0x557effb5a240 2022-07-05T12:06:43.892 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.840+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb5a240 0x557effb5a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8faffff700 10 client.6117 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:43.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb5a240 0x557effb5a650 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4ec6a56cec13efe9 server_cookie=979caae97ec14b0e in_seq=0 out_seq=0 2022-07-05T12:06:43.893 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8faffff700 1 -- 172.21.15.90:0/3018832558 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x557effa227f0 con 0x557effb5a240 2022-07-05T12:06:43.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8faffff700 10 client.6117 handle_command_reply: tid=0 2022-07-05T12:06:43.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 client.6117 shutdown 2022-07-05T12:06:43.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 msgr2=0x557effb18430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb18430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f8fcc0092f0 tx=0x557effb25930).stop 2022-07-05T12:06:43.894 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 shutdown_connections 2022-07-05T12:06:43.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb5a240 0x557effb5a650 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a890 0x557effb18430 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8faffff700 0 client.6117 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:43.895 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb59d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 --2- 172.21.15.90:0/3018832558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a4b0 0x557effb0f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 >> 172.21.15.90:0/3018832558 conn(0x557eff9451c0 msgr2=0x557effb47270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:43.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 shutdown_connections 2022-07-05T12:06:43.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.841+0000 7f8fed648b80 1 -- 172.21.15.90:0/3018832558 wait complete. 2022-07-05T12:06:43.897 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.842+0000 7f8fed648b80 20 client.6117 trim_cache size 0 max 16384 2022-07-05T12:06:43.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.857+0000 7f8fed648b80 1 Processor -- start 2022-07-05T12:06:43.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.857+0000 7f8fed648b80 1 -- start start 2022-07-05T12:06:43.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effad7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effb1a890 0x557effb5b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fed648b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effadb340 con 0x557effb1a4b0 2022-07-05T12:06:43.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fed648b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effadae20 con 0x557effb1a890 2022-07-05T12:06:43.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fed648b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effae0f00 con 0x557effad6da0 2022-07-05T12:06:43.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fd9257700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effad7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fd9257700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effad7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60418/0 (socket says 172.21.15.90:60418) 2022-07-05T12:06:43.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fd9257700 1 -- 172.21.15.90:0/754215759 learned_addr learned my addr 172.21.15.90:0/754215759 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:43.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.858+0000 7f8fda259700 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effb1a890 0x557effb5b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fd9257700 1 -- 172.21.15.90:0/754215759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effad6da0 msgr2=0x557effb5a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fd9257700 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fd9257700 1 -- 172.21.15.90:0/754215759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effb1a890 msgr2=0x557effb5b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fd9257700 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effb1a890 0x557effb5b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fd9257700 1 -- 172.21.15.90:0/754215759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557effb58050 con 0x557effb1a4b0 2022-07-05T12:06:43.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fda259700 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effb1a890 0x557effb5b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:06:43.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fd9257700 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effad7180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f8fc8009d50 tx=0x7f8fc8008040).ready entity=mon.0 client_cookie=10850fe5dd999d15 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:43.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fbb7fe700 1 -- 172.21.15.90:0/754215759 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80098d0 con 0x557effb1a4b0 2022-07-05T12:06:43.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fbb7fe700 1 -- 172.21.15.90:0/754215759 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8017dd0 con 0x557effb1a4b0 2022-07-05T12:06:43.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fbb7fe700 1 -- 172.21.15.90:0/754215759 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8020600 con 0x557effb1a4b0 2022-07-05T12:06:43.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 -- 172.21.15.90:0/754215759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 msgr2=0x557effad7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effad7180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f8fc8009d50 tx=0x7f8fc8008040).stop 2022-07-05T12:06:43.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 -- 172.21.15.90:0/754215759 shutdown_connections 2022-07-05T12:06:43.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effb1a890 0x557effb5b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 --2- 172.21.15.90:0/754215759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effad7180 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 -- 172.21.15.90:0/754215759 >> 172.21.15.90:0/754215759 conn(0x557eff9451c0 msgr2=0x557effb185c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 -- 172.21.15.90:0/754215759 shutdown_connections 2022-07-05T12:06:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.859+0000 7f8fed648b80 1 -- 172.21.15.90:0/754215759 wait complete. 2022-07-05T12:06:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.860+0000 7f8fed648b80 1 -- start start 2022-07-05T12:06:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.860+0000 7f8fed648b80 1 Processor -- start 2022-07-05T12:06:43.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effb5ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fed648b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a890 0x557effb58490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fed648b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effbb21c0 con 0x557effb1a4b0 2022-07-05T12:06:43.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fed648b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effb0fce0 con 0x557effad6da0 2022-07-05T12:06:43.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fed648b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557effb58ca0 con 0x557effb1a890 2022-07-05T12:06:43.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fed648b80 10 client.0 ll_register_callbacks cb 0x557effa9a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:06:43.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fd9257700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effb5ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fd9257700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effb5ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60426/0 (socket says 172.21.15.90:60426) 2022-07-05T12:06:43.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fd9257700 1 -- 172.21.15.90:0/2206997537 learned_addr learned my addr 172.21.15.90:0/2206997537 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:06:43.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.861+0000 7f8fda259700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a890 0x557effb58490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fd9257700 1 -- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a890 msgr2=0x557effb58490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fd9257700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a890 0x557effb58490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fd9257700 1 -- 172.21.15.90:0/2206997537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 msgr2=0x557effb5a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:06:43.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fd9257700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fd9257700 1 -- 172.21.15.90:0/2206997537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc8009a80 con 0x557effb1a4b0 2022-07-05T12:06:43.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fda259700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a890 0x557effb58490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:06:43.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fd9257700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effb5ad50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x557effadb480 tx=0x7f8fc801f000).ready entity=mon.0 client_cookie=5083b3052aaea7a1 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:06:43.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8faffff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:06:43.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8faffff700 1 -- 172.21.15.90:0/2206997537 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8000d10 con 0x557effb1a4b0 2022-07-05T12:06:43.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8faffff700 1 -- 172.21.15.90:0/2206997537 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f8fc8020c00 con 0x557effb1a4b0 2022-07-05T12:06:43.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fcc086c40 con 0x557effb1a4b0 2022-07-05T12:06:43.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8faffff700 1 -- 172.21.15.90:0/2206997537 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fc8029440 con 0x557effb1a4b0 2022-07-05T12:06:43.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 10 client.6123 fetch_fsmap learned FSMap version 41 2022-07-05T12:06:43.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x557eff8cdcd0 con 0x557effb1a4b0 2022-07-05T12:06:43.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8faffff700 1 -- 172.21.15.90:0/2206997537 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc086c40 con 0x557effb1a4b0 2022-07-05T12:06:43.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8faffff700 1 -- 172.21.15.90:0/2206997537 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f8fc8011070 con 0x557effb1a4b0 2022-07-05T12:06:43.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 10 client.6123 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:06:43.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 10 client.6123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:06:43.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 20 client.6123 populate_metadata read hostname 'smithi090' 2022-07-05T12:06:43.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb10170 0x557effba8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:06:43.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 4 client.6123 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:06:43.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.862+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557effa19690 con 0x557effb10170 2022-07-05T12:06:43.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb10170 0x557effba8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:06:43.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8faffff700 10 client.6123 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:43.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fd9a58700 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb10170 0x557effba8300 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9e3cce635b33011e server_cookie=37e1557c75e2281b in_seq=0 out_seq=0 2022-07-05T12:06:43.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8faffff700 1 -- 172.21.15.90:0/2206997537 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557effa19690 con 0x557effb10170 2022-07-05T12:06:43.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8faffff700 10 client.6123 handle_command_reply: tid=0 2022-07-05T12:06:43.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 client.6123 shutdown 2022-07-05T12:06:43.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 msgr2=0x557effb5ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effb5ad50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x557effadb480 tx=0x7f8fc801f000).stop 2022-07-05T12:06:43.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 shutdown_connections 2022-07-05T12:06:43.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557effb10170 0x557effba8300 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557effb1a890 0x557effb58490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557effad6da0 0x557effb5a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8faffff700 0 client.6123 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:06:43.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 --2- 172.21.15.90:0/2206997537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557effb1a4b0 0x557effb5ad50 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 >> 172.21.15.90:0/2206997537 conn(0x557eff9451c0 msgr2=0x557effad9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:43.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 shutdown_connections 2022-07-05T12:06:43.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 1 -- 172.21.15.90:0/2206997537 wait complete. 2022-07-05T12:06:43.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.863+0000 7f8fed648b80 20 client.6123 trim_cache size 0 max 16384 2022-07-05T12:06:43.929 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:06:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:06:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:06:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:06:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:06:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:06:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:06:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:06:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:06:43.931 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:06:43.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8fb408ba40 msgr2=0x7f8fb408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8fb408ba40 0x7f8fb408df00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f8fc4002d40 tx=0x7f8fc4000f40).stop 2022-07-05T12:06:43.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd417dcd0 msgr2=0x7f8fd40ebf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:06:43.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd417dcd0 0x7f8fd40ebf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8fcc014000 tx=0x7f8fcc017000).stop 2022-07-05T12:06:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 shutdown_connections 2022-07-05T12:06:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f8fb408ba40 0x7f8fb408df00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd417dcd0 0x7f8fd40ebf30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fd4063910 0x7f8fd4158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 --2- 172.21.15.90:0/1224762718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fd40ef830 0x7f8fd40eba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:06:43.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 >> 172.21.15.90:0/1224762718 conn(0x7f8fd40f5470 msgr2=0x7f8fd40c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:06:43.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 shutdown_connections 2022-07-05T12:06:43.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:06:43.864+0000 7f8fdaa5a700 1 -- 172.21.15.90:0/1224762718 wait complete. 2022-07-05T12:06:43.937 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:07:13.938 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:07:14.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.065+0000 7f3075129700 1 Processor -- start 2022-07-05T12:07:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.065+0000 7f3075129700 1 -- start start 2022-07-05T12:07:14.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.066+0000 7f3075129700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3070063910 0x7f30700ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.066+0000 7f3075129700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3070061f10 con 0x7f307017dcd0 2022-07-05T12:07:14.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.066+0000 7f3075129700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3070062d70 con 0x7f30700ef830 2022-07-05T12:07:14.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.066+0000 7f3075129700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3070062160 con 0x7f3070063910 2022-07-05T12:07:14.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.066+0000 7f306f7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3070063910 0x7f30700ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.066+0000 7f306ffff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f307017dcd0 0x7f3070063200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53372/0 (socket says 172.21.15.90:53372) 2022-07-05T12:07:14.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.066+0000 7f306ffff700 1 -- 172.21.15.90:0/513074469 learned_addr learned my addr 172.21.15.90:0/513074469 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:07:14.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f306f7fe700 1 -- 172.21.15.90:0/513074469 >> v1:172.21.15.110:6789/0 conn(0x7f30700ef830 legacy=0x7f30700efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f306f7fe700 1 -- 172.21.15.90:0/513074469 >> v1:172.21.15.90:6789/0 conn(0x7f307017dcd0 legacy=0x7f3070063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f306f7fe700 1 -- 172.21.15.90:0/513074469 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070062440 con 0x7f3070063910 2022-07-05T12:07:14.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f306f7fe700 1 --2- 172.21.15.90:0/513074469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3070063910 0x7f30700ef340 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f3064009760 tx=0x7f3064009060).ready entity=mon.0 client_cookie=68a12b9bb7e8e104 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:14.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f306effd700 1 -- 172.21.15.90:0/513074469 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640090d0 con 0x7f3070063910 2022-07-05T12:07:14.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f306effd700 1 -- 172.21.15.90:0/513074469 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306400b520 con 0x7f3070063910 2022-07-05T12:07:14.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f306effd700 1 -- 172.21.15.90:0/513074469 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400b8a0 con 0x7f3070063910 2022-07-05T12:07:14.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f3075129700 1 -- 172.21.15.90:0/513074469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3070063910 msgr2=0x7f30700ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f3075129700 1 --2- 172.21.15.90:0/513074469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3070063910 0x7f30700ef340 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f3064009760 tx=0x7f3064009060).stop 2022-07-05T12:07:14.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f3075129700 1 -- 172.21.15.90:0/513074469 shutdown_connections 2022-07-05T12:07:14.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.067+0000 7f3075129700 1 --2- 172.21.15.90:0/513074469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3070063910 0x7f30700ef340 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.068+0000 7f3075129700 1 -- 172.21.15.90:0/513074469 >> 172.21.15.90:0/513074469 conn(0x7f30700f5470 msgr2=0x7f30700f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:14.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.068+0000 7f3075129700 1 -- 172.21.15.90:0/513074469 shutdown_connections 2022-07-05T12:07:14.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.068+0000 7f3075129700 1 -- 172.21.15.90:0/513074469 wait complete. 2022-07-05T12:07:14.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.069+0000 7f3075129700 1 Processor -- start 2022-07-05T12:07:14.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.069+0000 7f3075129700 1 -- start start 2022-07-05T12:07:14.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3075129700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070063910 0x7f30700edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3075129700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30700ef830 0x7f3070179ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3075129700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f307017dcd0 0x7f3070177c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3075129700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700eda80 con 0x7f307017dcd0 2022-07-05T12:07:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3075129700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700ecb90 con 0x7f3070063910 2022-07-05T12:07:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3075129700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700ece70 con 0x7f30700ef830 2022-07-05T12:07:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3074928700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f307017dcd0 0x7f3070177c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3074928700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f307017dcd0 0x7f3070177c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60440/0 (socket says 172.21.15.90:60440) 2022-07-05T12:07:14.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f3074928700 1 -- 172.21.15.90:0/1461929509 learned_addr learned my addr 172.21.15.90:0/1461929509 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:14.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.070+0000 7f306f7fe700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30700ef830 0x7f3070179ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f306ffff700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070063910 0x7f30700edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3074928700 1 -- 172.21.15.90:0/1461929509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30700ef830 msgr2=0x7f3070179ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3074928700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30700ef830 0x7f3070179ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3074928700 1 -- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070063910 msgr2=0x7f30700edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3074928700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070063910 0x7f30700edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3074928700 1 -- 172.21.15.90:0/1461929509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640092a0 con 0x7f307017dcd0 2022-07-05T12:07:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3074928700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f307017dcd0 0x7f3070177c20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f306800c810 tx=0x7f3068002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:14.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3057fff700 1 -- 172.21.15.90:0/1461929509 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068010510 con 0x7f307017dcd0 2022-07-05T12:07:14.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3057fff700 1 -- 172.21.15.90:0/1461929509 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30680106b0 con 0x7f307017dcd0 2022-07-05T12:07:14.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3057fff700 1 -- 172.21.15.90:0/1461929509 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068010a70 con 0x7f307017dcd0 2022-07-05T12:07:14.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30700ed150 con 0x7f307017dcd0 2022-07-05T12:07:14.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.071+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30700ed710 con 0x7f307017dcd0 2022-07-05T12:07:14.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.073+0000 7f3057fff700 1 -- 172.21.15.90:0/1461929509 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3068019030 con 0x7f307017dcd0 2022-07-05T12:07:14.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.073+0000 7f3057fff700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f305008ba90 0x7f305008df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.073+0000 7f3057fff700 1 -- 172.21.15.90:0/1461929509 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f30680b0170 con 0x7f307017dcd0 2022-07-05T12:07:14.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.074+0000 7f306ffff700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f305008ba90 0x7f305008df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.074+0000 7f306ffff700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f305008ba90 0x7f305008df50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f3060000c00 tx=0x7f3060009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:14.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.075+0000 7f3087d17b80 1 Processor -- start 2022-07-05T12:07:14.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.075+0000 7f3087d17b80 1 -- start start 2022-07-05T12:07:14.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe206a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3087d17b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe1822d0 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3087d17b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe0f9aa0 con 0x55ebbe1fc890 2022-07-05T12:07:14.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3087d17b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe10e950 con 0x55ebbe1b8da0 2022-07-05T12:07:14.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60444/0 (socket says 172.21.15.90:60444) 2022-07-05T12:07:14.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe206a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 -- 172.21.15.90:0/3626203781 learned_addr learned my addr 172.21.15.90:0/3626203781 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:14.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3074928700 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 -- 172.21.15.90:0/3626203781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 msgr2=0x55ebbe206a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe206a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 -- 172.21.15.90:0/3626203781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 msgr2=0x55ebbe1fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f306ffff700 1 -- 172.21.15.90:0/3626203781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebbdf409e0 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.076+0000 7f3074928700 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:07:14.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f306ffff700 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b88b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f30600073c0 tx=0x7f3060007000).ready entity=mon.0 client_cookie=b8743a0acb4f3293 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:14.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f30557fa700 1 -- 172.21.15.90:0/3626203781 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060015410 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f30557fa700 1 -- 172.21.15.90:0/3626203781 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060015570 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f30557fa700 1 -- 172.21.15.90:0/3626203781 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060015910 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 -- 172.21.15.90:0/3626203781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 msgr2=0x55ebbe1b88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b88b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f30600073c0 tx=0x7f3060007000).stop 2022-07-05T12:07:14.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 -- 172.21.15.90:0/3626203781 shutdown_connections 2022-07-05T12:07:14.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b88b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3626203781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe206a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 -- 172.21.15.90:0/3626203781 >> 172.21.15.90:0/3626203781 conn(0x55ebbe0271c0 msgr2=0x55ebbe1bbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:14.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 -- 172.21.15.90:0/3626203781 shutdown_connections 2022-07-05T12:07:14.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.077+0000 7f3087d17b80 1 -- 172.21.15.90:0/3626203781 wait complete. 2022-07-05T12:07:14.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.078+0000 7f3087d17b80 1 -- start start 2022-07-05T12:07:14.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.078+0000 7f3087d17b80 1 Processor -- start 2022-07-05T12:07:14.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1b8da0 0x55ebbe1f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe23ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f3087d17b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe0d6120 con 0x55ebbe1b8da0 2022-07-05T12:07:14.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f3087d17b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe1f7b90 con 0x55ebbe1fc890 2022-07-05T12:07:14.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f3087d17b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe1f6a30 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f3087d17b80 10 client.0 ll_register_callbacks cb 0x55ebbe17c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:07:14.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f306ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1b8da0 0x55ebbe1f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f306ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1b8da0 0x55ebbe1f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60450/0 (socket says 172.21.15.90:60450) 2022-07-05T12:07:14.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f306ffff700 1 -- 172.21.15.90:0/3221932550 learned_addr learned my addr 172.21.15.90:0/3221932550 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:14.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.079+0000 7f306f7fe700 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3074928700 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe23ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f306ffff700 1 -- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1fc4b0 msgr2=0x55ebbe1f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f306ffff700 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f306ffff700 1 -- 172.21.15.90:0/3221932550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 msgr2=0x55ebbe23ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f306ffff700 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe23ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f306ffff700 1 -- 172.21.15.90:0/3221932550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306000f040 con 0x55ebbe1b8da0 2022-07-05T12:07:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f306ffff700 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1b8da0 0x55ebbe1f6ec0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f3060016000 tx=0x7f3060012000).ready entity=mon.0 client_cookie=8fff4736413dd881 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f304a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:07:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f304a7fc700 1 -- 172.21.15.90:0/3221932550 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600158f0 con 0x55ebbe1b8da0 2022-07-05T12:07:14.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f304a7fc700 1 -- 172.21.15.90:0/3221932550 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f3060024450 con 0x55ebbe1b8da0 2022-07-05T12:07:14.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebbe1b6690 con 0x55ebbe1b8da0 2022-07-05T12:07:14.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f304a7fc700 1 -- 172.21.15.90:0/3221932550 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3060024820 con 0x55ebbe1b8da0 2022-07-05T12:07:14.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 10 client.6138 fetch_fsmap learned FSMap version 41 2022-07-05T12:07:14.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55ebbdfafcd0 con 0x55ebbe1b8da0 2022-07-05T12:07:14.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f304a7fc700 1 -- 172.21.15.90:0/3221932550 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306002e020 con 0x55ebbe1b8da0 2022-07-05T12:07:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f304a7fc700 1 -- 172.21.15.90:0/3221932550 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f3060024980 con 0x55ebbe1b8da0 2022-07-05T12:07:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 10 client.6138 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:07:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 10 client.6138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:07:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 20 client.6138 populate_metadata read hostname 'smithi090' 2022-07-05T12:07:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe1f73b0 0x55ebbe23bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 4 client.6138 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:07:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.080+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebbe1047f0 con 0x55ebbe1f73b0 2022-07-05T12:07:14.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.081+0000 7f306f7fe700 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe1f73b0 0x55ebbe23bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.081+0000 7f304a7fc700 10 client.6138 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:14.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.081+0000 7f306f7fe700 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe1f73b0 0x55ebbe23bdf0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e0deb08b74b9e1f9 server_cookie=42a03c0d410d4db2 in_seq=0 out_seq=0 2022-07-05T12:07:14.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f304a7fc700 1 -- 172.21.15.90:0/3221932550 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55ebbe1047f0 con 0x55ebbe1f73b0 2022-07-05T12:07:14.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f304a7fc700 10 client.6138 handle_command_reply: tid=0 2022-07-05T12:07:14.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 client.6138 shutdown 2022-07-05T12:07:14.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1b8da0 msgr2=0x55ebbe1f6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1b8da0 0x55ebbe1f6ec0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f3060016000 tx=0x7f3060012000).stop 2022-07-05T12:07:14.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 shutdown_connections 2022-07-05T12:07:14.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe1f73b0 0x55ebbe23bdf0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe23ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1b8da0 0x55ebbe1f6ec0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f304a7fc700 0 client.6138 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:14.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 --2- 172.21.15.90:0/3221932550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 >> 172.21.15.90:0/3221932550 conn(0x55ebbe0271c0 msgr2=0x55ebbe1b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:14.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 shutdown_connections 2022-07-05T12:07:14.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 1 -- 172.21.15.90:0/3221932550 wait complete. 2022-07-05T12:07:14.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.082+0000 7f3087d17b80 20 client.6138 trim_cache size 0 max 16384 2022-07-05T12:07:14.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.098+0000 7f3087d17b80 1 Processor -- start 2022-07-05T12:07:14.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.098+0000 7f3087d17b80 1 -- start start 2022-07-05T12:07:14.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe2060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc890 0x55ebbe1b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3087d17b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe1ba6f0 con 0x55ebbe1fc890 2022-07-05T12:07:14.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3087d17b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe1b3110 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3087d17b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe1c31b0 con 0x55ebbe1b8da0 2022-07-05T12:07:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc890 0x55ebbe1b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc890 0x55ebbe1b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60458/0 (socket says 172.21.15.90:60458) 2022-07-05T12:07:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 -- 172.21.15.90:0/47683498 learned_addr learned my addr 172.21.15.90:0/47683498 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f306ffff700 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe2060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f306f7fe700 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 -- 172.21.15.90:0/47683498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 msgr2=0x55ebbe2060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe2060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 -- 172.21.15.90:0/47683498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc4b0 msgr2=0x55ebbe1b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f3074928700 1 -- 172.21.15.90:0/47683498 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307017f0a0 con 0x55ebbe1fc890 2022-07-05T12:07:14.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.099+0000 7f306f7fe700 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:07:14.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3074928700 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc890 0x55ebbe1b2c20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f3068080f90 tx=0x7f3068086040).ready entity=mon.0 client_cookie=9e2244e53f2bc897 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:14.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3055ffb700 1 -- 172.21.15.90:0/47683498 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306808e030 con 0x55ebbe1fc890 2022-07-05T12:07:14.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3055ffb700 1 -- 172.21.15.90:0/47683498 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306808a370 con 0x55ebbe1fc890 2022-07-05T12:07:14.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3055ffb700 1 -- 172.21.15.90:0/47683498 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068082e30 con 0x55ebbe1fc890 2022-07-05T12:07:14.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 -- 172.21.15.90:0/47683498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc890 msgr2=0x55ebbe1b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc890 0x55ebbe1b2c20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f3068080f90 tx=0x7f3068086040).stop 2022-07-05T12:07:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 -- 172.21.15.90:0/47683498 shutdown_connections 2022-07-05T12:07:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc890 0x55ebbe1b2c20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe2060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 --2- 172.21.15.90:0/47683498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 -- 172.21.15.90:0/47683498 >> 172.21.15.90:0/47683498 conn(0x55ebbe0271c0 msgr2=0x55ebbe23ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:14.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 -- 172.21.15.90:0/47683498 shutdown_connections 2022-07-05T12:07:14.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.100+0000 7f3087d17b80 1 -- 172.21.15.90:0/47683498 wait complete. 2022-07-05T12:07:14.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.101+0000 7f3087d17b80 1 -- start start 2022-07-05T12:07:14.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.101+0000 7f3087d17b80 1 Processor -- start 2022-07-05T12:07:14.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe229170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3087d17b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3087d17b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe288810 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3087d17b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe291690 con 0x55ebbe1fc890 2022-07-05T12:07:14.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3087d17b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbe294a90 con 0x55ebbe1b8da0 2022-07-05T12:07:14.146 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3087d17b80 10 client.0 ll_register_callbacks cb 0x55ebbe17c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:07:14.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.147 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60464/0 (socket says 172.21.15.90:60464) 2022-07-05T12:07:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 -- 172.21.15.90:0/1752624977 learned_addr learned my addr 172.21.15.90:0/1752624977 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306ffff700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe229170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3074928700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 -- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 msgr2=0x55ebbe229170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.149 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe229170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 -- 172.21.15.90:0/1752624977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 msgr2=0x55ebbe1f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:14.150 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1f98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f306f7fe700 1 -- 172.21.15.90:0/1752624977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30700ed710 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.151 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.102+0000 7f3074928700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:07:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f306f7fe700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b7d50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f3070088dd0 tx=0x7f306401e040).ready entity=mon.0 client_cookie=32f4bf4d78a4ac78 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f304a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:07:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f304a7fc700 1 -- 172.21.15.90:0/1752624977 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064021040 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f304a7fc700 1 -- 172.21.15.90:0/1752624977 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f30640286e0 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3060015570 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f304a7fc700 1 -- 172.21.15.90:0/1752624977 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f306400b910 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 10 client.6144 fetch_fsmap learned FSMap version 41 2022-07-05T12:07:14.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55ebbdf7dfd0 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f304a7fc700 1 -- 172.21.15.90:0/1752624977 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306403b020 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f304a7fc700 1 -- 172.21.15.90:0/1752624977 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f3064009840 con 0x55ebbe1fc4b0 2022-07-05T12:07:14.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 10 client.6144 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:07:14.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 10 client.6144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:07:14.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 20 client.6144 populate_metadata read hostname 'smithi090' 2022-07-05T12:07:14.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe287920 0x55ebbe294f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:14.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 4 client.6144 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:07:14.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ebbe0fb690 con 0x55ebbe287920 2022-07-05T12:07:14.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.103+0000 7f306ffff700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe287920 0x55ebbe294f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:14.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f306ffff700 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe287920 0x55ebbe294f20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c7c261cfb640d1df server_cookie=feab395a3bdbbb06 in_seq=0 out_seq=0 2022-07-05T12:07:14.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f304a7fc700 10 client.6144 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:14.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f304a7fc700 1 -- 172.21.15.90:0/1752624977 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ebbe0fb690 con 0x55ebbe287920 2022-07-05T12:07:14.161 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f304a7fc700 10 client.6144 handle_command_reply: tid=0 2022-07-05T12:07:14.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 client.6144 shutdown 2022-07-05T12:07:14.162 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 msgr2=0x55ebbe1b7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b7d50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f3070088dd0 tx=0x7f306401e040).stop 2022-07-05T12:07:14.163 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 shutdown_connections 2022-07-05T12:07:14.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55ebbe287920 0x55ebbe294f20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.164 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebbe1fc890 0x55ebbe1f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ebbe1b8da0 0x55ebbe229170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.165 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 --2- 172.21.15.90:0/1752624977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ebbe1fc4b0 0x55ebbe1b7d50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f304a7fc700 0 client.6144 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:14.166 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 >> 172.21.15.90:0/1752624977 conn(0x55ebbe0271c0 msgr2=0x55ebbe206040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:14.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 shutdown_connections 2022-07-05T12:07:14.167 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 1 -- 172.21.15.90:0/1752624977 wait complete. 2022-07-05T12:07:14.168 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.104+0000 7f3087d17b80 20 client.6144 trim_cache size 0 max 16384 2022-07-05T12:07:14.169 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:07:14.169 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:07:14.170 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:07:14.170 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:07:14.171 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:07:14.171 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:07:14.171 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:07:14.172 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:07:14.172 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:07:14.172 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:07:14.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f305008ba90 msgr2=0x7f305008df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f305008ba90 0x7f305008df50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f3060000c00 tx=0x7f3060009040).stop 2022-07-05T12:07:14.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f307017dcd0 msgr2=0x7f3070177c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:14.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f307017dcd0 0x7f3070177c20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f306800c810 tx=0x7f3068002560).stop 2022-07-05T12:07:14.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 shutdown_connections 2022-07-05T12:07:14.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f305008ba90 0x7f305008df50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f307017dcd0 0x7f3070177c20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3070063910 0x7f30700edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 --2- 172.21.15.90:0/1461929509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30700ef830 0x7f3070179ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:14.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 >> 172.21.15.90:0/1461929509 conn(0x7f30700f5470 msgr2=0x7f307017cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:14.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 shutdown_connections 2022-07-05T12:07:14.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:14.105+0000 7f3075129700 1 -- 172.21.15.90:0/1461929509 wait complete. 2022-07-05T12:07:14.177 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:07:44.179 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:07:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.306+0000 7f4da5830700 1 Processor -- start 2022-07-05T12:07:44.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.306+0000 7f4da5830700 1 -- start start 2022-07-05T12:07:44.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.307+0000 7f4da5830700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4da017dcd0 0x7f4da0063200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.307+0000 7f4da5830700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da0061f10 con 0x7f4da00636f0 2022-07-05T12:07:44.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.307+0000 7f4da5830700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da0062d70 con 0x7f4da0063b70 2022-07-05T12:07:44.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.307+0000 7f4da5830700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da017f2d0 con 0x7f4da017dcd0 2022-07-05T12:07:44.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.307+0000 7f4da482e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4da017dcd0 0x7f4da0063200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.307+0000 7f4d9ffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4da00636f0 0x7f4da017e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.90:34776/0 (socket says 172.21.15.90:34776) 2022-07-05T12:07:44.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.307+0000 7f4d9ffff700 1 -- 172.21.15.90:0/2905792146 learned_addr learned my addr 172.21.15.90:0/2905792146 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:07:44.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4d9f7fe700 1 -- 172.21.15.90:0/2905792146 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001931072 0 0) 0x7f4da0061f10 con 0x7f4da00636f0 2022-07-05T12:07:44.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4d9f7fe700 1 -- 172.21.15.90:0/2905792146 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d840033f0 con 0x7f4da00636f0 2022-07-05T12:07:44.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4da482e700 1 -- 172.21.15.90:0/2905792146 >> v1:172.21.15.149:6789/0 conn(0x7f4da0063b70 legacy=0x7f4da017ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4d9f7fe700 1 -- 172.21.15.90:0/2905792146 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186320280 0 0) 0x7f4da0062d70 con 0x7f4da0063b70 2022-07-05T12:07:44.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4da482e700 1 -- 172.21.15.90:0/2905792146 >> v1:172.21.15.110:6789/0 conn(0x7f4da00636f0 legacy=0x7f4da017e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4da482e700 1 -- 172.21.15.90:0/2905792146 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0062160 con 0x7f4da017dcd0 2022-07-05T12:07:44.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4da482e700 1 --2- 172.21.15.90:0/2905792146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da017dcd0 0x7f4da0063200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4d94009760 tx=0x7f4d94009060).ready entity=mon.2 client_cookie=30b9a27e13d027b3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:44.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4d9f7fe700 1 -- 172.21.15.90:0/2905792146 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940090d0 con 0x7f4da017dcd0 2022-07-05T12:07:44.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4d9f7fe700 1 -- 172.21.15.90:0/2905792146 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9400f510 con 0x7f4da017dcd0 2022-07-05T12:07:44.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4d9f7fe700 1 -- 172.21.15.90:0/2905792146 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400f890 con 0x7f4da017dcd0 2022-07-05T12:07:44.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4da5830700 1 -- 172.21.15.90:0/2905792146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da017dcd0 msgr2=0x7f4da0063200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.308+0000 7f4da5830700 1 --2- 172.21.15.90:0/2905792146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da017dcd0 0x7f4da0063200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4d94009760 tx=0x7f4d94009060).stop 2022-07-05T12:07:44.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.309+0000 7f4da5830700 1 -- 172.21.15.90:0/2905792146 shutdown_connections 2022-07-05T12:07:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.309+0000 7f4da5830700 1 --2- 172.21.15.90:0/2905792146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da017dcd0 0x7f4da0063200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.309+0000 7f4da5830700 1 -- 172.21.15.90:0/2905792146 >> 172.21.15.90:0/2905792146 conn(0x7f4da00f5470 msgr2=0x7f4da00f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.309+0000 7f4da5830700 1 -- 172.21.15.90:0/2905792146 shutdown_connections 2022-07-05T12:07:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.309+0000 7f4da5830700 1 -- 172.21.15.90:0/2905792146 wait complete. 2022-07-05T12:07:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.310+0000 7f4da5830700 1 Processor -- start 2022-07-05T12:07:44.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.310+0000 7f4da5830700 1 -- start start 2022-07-05T12:07:44.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da5830700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da00636f0 0x7f4da0176a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da5830700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4da0063b70 0x7f4da0176f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da5830700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4da017dcd0 0x7f4da00ec520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da5830700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da017ad30 con 0x7f4da017dcd0 2022-07-05T12:07:44.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da5830700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da01773f0 con 0x7f4da0063b70 2022-07-05T12:07:44.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da5830700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0179e40 con 0x7f4da00636f0 2022-07-05T12:07:44.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da482e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da00636f0 0x7f4da0176a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da482e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da00636f0 0x7f4da0176a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41868/0 (socket says 172.21.15.90:41868) 2022-07-05T12:07:44.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da482e700 1 -- 172.21.15.90:0/807555221 learned_addr learned my addr 172.21.15.90:0/807555221 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:44.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.311+0000 7f4da502f700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4da017dcd0 0x7f4da00ec520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4da0063b70 0x7f4da0176f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da482e700 1 -- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4da0063b70 msgr2=0x7f4da0176f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da482e700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4da0063b70 0x7f4da0176f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da482e700 1 -- 172.21.15.90:0/807555221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4da017dcd0 msgr2=0x7f4da00ec520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da482e700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4da017dcd0 0x7f4da00ec520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da482e700 1 -- 172.21.15.90:0/807555221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d940092a0 con 0x7f4da00636f0 2022-07-05T12:07:44.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da502f700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4da017dcd0 0x7f4da00ec520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:07:44.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da482e700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da00636f0 0x7f4da0176a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4d94009e00 tx=0x7f4d94017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:44.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4d9cff9700 1 -- 172.21.15.90:0/807555221 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400f890 con 0x7f4da00636f0 2022-07-05T12:07:44.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4d9cff9700 1 -- 172.21.15.90:0/807555221 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9400fc50 con 0x7f4da00636f0 2022-07-05T12:07:44.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da017a120 con 0x7f4da00636f0 2022-07-05T12:07:44.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4d9cff9700 1 -- 172.21.15.90:0/807555221 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9401b410 con 0x7f4da00636f0 2022-07-05T12:07:44.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.312+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da017a6e0 con 0x7f4da00636f0 2022-07-05T12:07:44.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.314+0000 7f4d9cff9700 1 -- 172.21.15.90:0/807555221 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4d9400f070 con 0x7f4da00636f0 2022-07-05T12:07:44.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.315+0000 7f4d9cff9700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4d8808ba40 0x7f4d8808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.315+0000 7f4d9cff9700 1 -- 172.21.15.90:0/807555221 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f4d940b2250 con 0x7f4da00636f0 2022-07-05T12:07:44.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.315+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4d8808ba40 0x7f4d8808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.316+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4d8808ba40 0x7f4d8808df00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f4d8c007fd0 tx=0x7f4d8c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:44.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.316+0000 7f4db841eb80 1 Processor -- start 2022-07-05T12:07:44.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.316+0000 7f4db841eb80 1 -- start start 2022-07-05T12:07:44.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57ac98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b17a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b0dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4db841eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57a932d0 con 0x55eb57ac9da0 2022-07-05T12:07:44.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4db841eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57a0aaa0 con 0x55eb57b0d4b0 2022-07-05T12:07:44.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4db841eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57a1f950 con 0x55eb57b0d890 2022-07-05T12:07:44.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4d9ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b17a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4d9ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b17a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60482/0 (socket says 172.21.15.90:60482) 2022-07-05T12:07:44.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4d9ffff700 1 -- 172.21.15.90:0/2837279018 learned_addr learned my addr 172.21.15.90:0/2837279018 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:44.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4da502f700 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b0dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.317+0000 7f4da482e700 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57ac98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d9ffff700 1 -- 172.21.15.90:0/2837279018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 msgr2=0x55eb57b0dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b0dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d9ffff700 1 -- 172.21.15.90:0/2837279018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 msgr2=0x55eb57ac98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57ac98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d9ffff700 1 -- 172.21.15.90:0/2837279018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb578519e0 con 0x55eb57ac9da0 2022-07-05T12:07:44.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b17a80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f4d8c00f7b0 tx=0x7f4d8c013000).ready entity=mon.0 client_cookie=485d2674959cd10 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:44.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d81ffb700 1 -- 172.21.15.90:0/2837279018 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c020400 con 0x55eb57ac9da0 2022-07-05T12:07:44.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d81ffb700 1 -- 172.21.15.90:0/2837279018 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c020560 con 0x55eb57ac9da0 2022-07-05T12:07:44.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4d81ffb700 1 -- 172.21.15.90:0/2837279018 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0206d0 con 0x55eb57ac9da0 2022-07-05T12:07:44.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 -- 172.21.15.90:0/2837279018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 msgr2=0x55eb57b17a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b17a80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f4d8c00f7b0 tx=0x7f4d8c013000).stop 2022-07-05T12:07:44.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 -- 172.21.15.90:0/2837279018 shutdown_connections 2022-07-05T12:07:44.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b0dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57ac98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 --2- 172.21.15.90:0/2837279018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b17a80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 -- 172.21.15.90:0/2837279018 >> 172.21.15.90:0/2837279018 conn(0x55eb579381c0 msgr2=0x55eb57accba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 -- 172.21.15.90:0/2837279018 shutdown_connections 2022-07-05T12:07:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.318+0000 7f4db841eb80 1 -- 172.21.15.90:0/2837279018 wait complete. 2022-07-05T12:07:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.319+0000 7f4db841eb80 1 -- start start 2022-07-05T12:07:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.319+0000 7f4db841eb80 1 Processor -- start 2022-07-05T12:07:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.320+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b4c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.320+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b3c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.320+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b3c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.320+0000 7f4db841eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb579e7120 con 0x55eb57ac9da0 2022-07-05T12:07:44.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.320+0000 7f4db841eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57b4d3e0 con 0x55eb57b0d4b0 2022-07-05T12:07:44.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.320+0000 7f4db841eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57afb830 con 0x55eb57b0d890 2022-07-05T12:07:44.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4db841eb80 10 client.0 ll_register_callbacks cb 0x55eb57a8d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:07:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b4c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b4c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60486/0 (socket says 172.21.15.90:60486) 2022-07-05T12:07:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 -- 172.21.15.90:0/518486171 learned_addr learned my addr 172.21.15.90:0/518486171 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da502f700 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b3c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b3c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 -- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 msgr2=0x55eb57b3c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b3c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.360 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 -- 172.21.15.90:0/518486171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 msgr2=0x55eb57b3c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b3c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 -- 172.21.15.90:0/518486171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d840033f0 con 0x55eb57ac9da0 2022-07-05T12:07:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4da482e700 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b4c940 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f4d94086a80 tx=0x7f4d94009f20).ready entity=mon.0 client_cookie=13fa0faabc4d5e93 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4d7affd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:07:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4d7affd700 1 -- 172.21.15.90:0/518486171 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9408c3d0 con 0x55eb57ac9da0 2022-07-05T12:07:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4d7affd700 1 -- 172.21.15.90:0/518486171 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f4d94083200 con 0x55eb57ac9da0 2022-07-05T12:07:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb57ac7690 con 0x55eb57ac9da0 2022-07-05T12:07:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4d7affd700 1 -- 172.21.15.90:0/518486171 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d940833c0 con 0x55eb57ac9da0 2022-07-05T12:07:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4db841eb80 10 client.6153 fetch_fsmap learned FSMap version 41 2022-07-05T12:07:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55eb578c0cd0 con 0x55eb57ac9da0 2022-07-05T12:07:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4d7affd700 1 -- 172.21.15.90:0/518486171 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eb57ac7690 con 0x55eb57ac9da0 2022-07-05T12:07:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.321+0000 7f4d7affd700 1 -- 172.21.15.90:0/518486171 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f4d94085fe0 con 0x55eb57ac9da0 2022-07-05T12:07:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4db841eb80 10 client.6153 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:07:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4db841eb80 10 client.6153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:07:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4db841eb80 20 client.6153 populate_metadata read hostname 'smithi090' 2022-07-05T12:07:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4db841eb80 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57acdda0 0x55eb57b4ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4db841eb80 4 client.6153 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:07:44.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb57a157f0 con 0x55eb57acdda0 2022-07-05T12:07:44.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57acdda0 0x55eb57b4ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57acdda0 0x55eb57b4ef30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6fd3e74fc2a08814 server_cookie=adbdfe15f1f373c4 in_seq=0 out_seq=0 2022-07-05T12:07:44.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.322+0000 7f4d7affd700 10 client.6153 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:44.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4d7affd700 1 -- 172.21.15.90:0/518486171 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55eb57a157f0 con 0x55eb57acdda0 2022-07-05T12:07:44.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4d7affd700 10 client.6153 handle_command_reply: tid=0 2022-07-05T12:07:44.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 client.6153 shutdown 2022-07-05T12:07:44.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 msgr2=0x55eb57b4c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b4c940 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f4d94086a80 tx=0x7f4d94009f20).stop 2022-07-05T12:07:44.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 shutdown_connections 2022-07-05T12:07:44.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57acdda0 0x55eb57b4ef30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b3c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4d7affd700 0 client.6153 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:44.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57b4c940 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 --2- 172.21.15.90:0/518486171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b3c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 >> 172.21.15.90:0/518486171 conn(0x55eb579381c0 msgr2=0x55eb57acb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:44.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 shutdown_connections 2022-07-05T12:07:44.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 1 -- 172.21.15.90:0/518486171 wait complete. 2022-07-05T12:07:44.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.323+0000 7f4db841eb80 20 client.6153 trim_cache size 0 max 16384 2022-07-05T12:07:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.339+0000 7f4db841eb80 1 Processor -- start 2022-07-05T12:07:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.339+0000 7f4db841eb80 1 -- start start 2022-07-05T12:07:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57ac9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b9c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4db841eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57b14dc0 con 0x55eb57ac9da0 2022-07-05T12:07:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4db841eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57b4b240 con 0x55eb57b0d4b0 2022-07-05T12:07:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4db841eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57b3f660 con 0x55eb57b0d890 2022-07-05T12:07:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57ac9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57ac9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60494/0 (socket says 172.21.15.90:60494) 2022-07-05T12:07:44.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 -- 172.21.15.90:0/1628849512 learned_addr learned my addr 172.21.15.90:0/1628849512 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:44.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 -- 172.21.15.90:0/1628849512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 msgr2=0x55eb57b9c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b9c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:07:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 -- 172.21.15.90:0/1628849512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 msgr2=0x55eb57b4ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 -- 172.21.15.90:0/1628849512 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb5788efd0 con 0x55eb57ac9da0 2022-07-05T12:07:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:07:44.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4da482e700 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57ac9810 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f4d940865c0 tx=0x7f4d94056000).ready entity=mon.0 client_cookie=8ba1d51b2cd6c593 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4d827fc700 1 -- 172.21.15.90:0/1628849512 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94082e30 con 0x55eb57ac9da0 2022-07-05T12:07:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4d827fc700 1 -- 172.21.15.90:0/1628849512 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9408c3d0 con 0x55eb57ac9da0 2022-07-05T12:07:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.340+0000 7f4d827fc700 1 -- 172.21.15.90:0/1628849512 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94018530 con 0x55eb57ac9da0 2022-07-05T12:07:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 -- 172.21.15.90:0/1628849512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 msgr2=0x55eb57ac9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57ac9810 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f4d940865c0 tx=0x7f4d94056000).stop 2022-07-05T12:07:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 -- 172.21.15.90:0/1628849512 shutdown_connections 2022-07-05T12:07:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57b0d890 0x55eb57b9c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:07:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57ac9da0 0x55eb57ac9810 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 --2- 172.21.15.90:0/1628849512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 -- 172.21.15.90:0/1628849512 >> 172.21.15.90:0/1628849512 conn(0x55eb579381c0 msgr2=0x55eb57aca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 -- 172.21.15.90:0/1628849512 shutdown_connections 2022-07-05T12:07:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.341+0000 7f4db841eb80 1 -- 172.21.15.90:0/1628849512 wait complete. 2022-07-05T12:07:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.342+0000 7f4db841eb80 1 -- start start 2022-07-05T12:07:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.342+0000 7f4db841eb80 1 Processor -- start 2022-07-05T12:07:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57ac9da0 0x55eb57ba47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57b0d890 0x55eb57ba1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57ba1270 con 0x55eb57b0d890 2022-07-05T12:07:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57b4d1a0 con 0x55eb57b0d4b0 2022-07-05T12:07:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb57ba56c0 con 0x55eb57ac9da0 2022-07-05T12:07:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 10 client.0 ll_register_callbacks cb 0x55eb57b0e640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:07:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57b0d890 0x55eb57ba1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57b0d890 0x55eb57ba1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60502/0 (socket says 172.21.15.90:60502) 2022-07-05T12:07:44.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 -- 172.21.15.90:0/3442127470 learned_addr learned my addr 172.21.15.90:0/3442127470 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:07:44.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da482e700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57ac9da0 0x55eb57ba47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 -- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57ac9da0 msgr2=0x55eb57ba47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57ac9da0 0x55eb57ba47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 -- 172.21.15.90:0/3442127470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 msgr2=0x55eb57b4ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:07:44.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 -- 172.21.15.90:0/3442127470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb578c0cd0 con 0x55eb57b0d890 2022-07-05T12:07:44.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4d9ffff700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:07:44.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4da502f700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57b0d890 0x55eb57ba1c40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f4d98015e60 tx=0x7f4d98009040).ready entity=mon.0 client_cookie=ae6a7b3a67d94e82 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:07:44.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4d7affd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:07:44.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4d7affd700 1 -- 172.21.15.90:0/3442127470 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98013b50 con 0x55eb57b0d890 2022-07-05T12:07:44.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4d7affd700 1 -- 172.21.15.90:0/3442127470 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f4d98013cb0 con 0x55eb57b0d890 2022-07-05T12:07:44.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d8c020560 con 0x55eb57b0d890 2022-07-05T12:07:44.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.343+0000 7f4d7affd700 1 -- 172.21.15.90:0/3442127470 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d98013ec0 con 0x55eb57b0d890 2022-07-05T12:07:44.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 10 client.6159 fetch_fsmap learned FSMap version 41 2022-07-05T12:07:44.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55eb57ba5100 con 0x55eb57b0d890 2022-07-05T12:07:44.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4d7affd700 1 -- 172.21.15.90:0/3442127470 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c020560 con 0x55eb57b0d890 2022-07-05T12:07:44.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4d7affd700 1 -- 172.21.15.90:0/3442127470 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f4d98012030 con 0x55eb57b0d890 2022-07-05T12:07:44.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 10 client.6159 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:07:44.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 10 client.6159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:07:44.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 20 client.6159 populate_metadata read hostname 'smithi090' 2022-07-05T12:07:44.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57afb3b0 0x55eb57b05fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:07:44.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 4 client.6159 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:07:44.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eb57a0c690 con 0x55eb57afb3b0 2022-07-05T12:07:44.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4da482e700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57afb3b0 0x55eb57b05fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:07:44.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4d7affd700 10 client.6159 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:44.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4da482e700 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57afb3b0 0x55eb57b05fe0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fe8ef4523c5cae99 server_cookie=32aa0a02a846e37d in_seq=0 out_seq=0 2022-07-05T12:07:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4d7affd700 1 -- 172.21.15.90:0/3442127470 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55eb57a0c690 con 0x55eb57afb3b0 2022-07-05T12:07:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4d7affd700 10 client.6159 handle_command_reply: tid=0 2022-07-05T12:07:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.344+0000 7f4db841eb80 1 client.6159 shutdown 2022-07-05T12:07:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57b0d890 msgr2=0x55eb57ba1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57b0d890 0x55eb57ba1c40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f4d98015e60 tx=0x7f4d98009040).stop 2022-07-05T12:07:44.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 shutdown_connections 2022-07-05T12:07:44.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55eb57afb3b0 0x55eb57b05fe0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55eb57b0d890 0x55eb57ba1c40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eb57ac9da0 0x55eb57ba47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 --2- 172.21.15.90:0/3442127470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55eb57b0d4b0 0x55eb57b4ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 >> 172.21.15.90:0/3442127470 conn(0x55eb579381c0 msgr2=0x55eb57b36460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:44.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4d7affd700 0 client.6159 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:07:44.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 shutdown_connections 2022-07-05T12:07:44.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 1 -- 172.21.15.90:0/3442127470 wait complete. 2022-07-05T12:07:44.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4db841eb80 20 client.6159 trim_cache size 0 max 16384 2022-07-05T12:07:44.396 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:07:44.397 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:07:44.397 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:07:44.397 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:07:44.397 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:07:44.398 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:07:44.398 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:07:44.398 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:07:44.398 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:07:44.399 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:07:44.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4d8808ba40 msgr2=0x7f4d8808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4d8808ba40 0x7f4d8808df00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f4d8c007fd0 tx=0x7f4d8c009040).stop 2022-07-05T12:07:44.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da00636f0 msgr2=0x7f4da0176a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:07:44.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da00636f0 0x7f4da0176a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4d94009e00 tx=0x7f4d94017000).stop 2022-07-05T12:07:44.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 shutdown_connections 2022-07-05T12:07:44.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f4d8808ba40 0x7f4d8808df00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4da017dcd0 0x7f4da00ec520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da00636f0 0x7f4da0176a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.402 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 --2- 172.21.15.90:0/807555221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4da0063b70 0x7f4da0176f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:07:44.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 >> 172.21.15.90:0/807555221 conn(0x7f4da00f5470 msgr2=0x7f4da017e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:07:44.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 shutdown_connections 2022-07-05T12:07:44.403 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:07:44.345+0000 7f4da5830700 1 -- 172.21.15.90:0/807555221 wait complete. 2022-07-05T12:07:44.404 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:08:14.405 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:08:14.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.533+0000 7fc17b59e700 1 Processor -- start 2022-07-05T12:08:14.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.533+0000 7fc17b59e700 1 -- start start 2022-07-05T12:08:14.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17b59e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc17c063910 0x7fc17c0ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17b59e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc17c0ef830 0x7fc17c0efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17b59e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c061f10 con 0x7fc17c17dcd0 2022-07-05T12:08:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17b59e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c062d70 con 0x7fc17c0ef830 2022-07-05T12:08:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17b59e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c062160 con 0x7fc17c063910 2022-07-05T12:08:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17ad9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc17c0ef830 0x7fc17c0efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17ad9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc17c0ef830 0x7fc17c0efcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60508/0 (socket says 172.21.15.90:60508) 2022-07-05T12:08:14.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2324662315 learned_addr learned my addr 172.21.15.90:0/2324662315 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:14.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.534+0000 7fc179d9b700 1 --2- 172.21.15.90:0/2324662315 >> v2:172.21.15.149:3300/0 conn(0x7fc17c063910 0x7fc17c0ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2324662315 >> v2:172.21.15.149:3300/0 conn(0x7fc17c063910 msgr2=0x7fc17c0ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/2324662315 >> v2:172.21.15.149:3300/0 conn(0x7fc17c063910 0x7fc17c0ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2324662315 >> v1:172.21.15.110:6789/0 conn(0x7fc17c17dcd0 legacy=0x7fc17c063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2324662315 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c062440 con 0x7fc17c0ef830 2022-07-05T12:08:14.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/2324662315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c0efcc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fc17c088fb0 tx=0x7fc16c009840).ready entity=mon.0 client_cookie=aa4bdee60d03f03 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:14.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17959a700 1 -- 172.21.15.90:0/2324662315 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00e070 con 0x7fc17c0ef830 2022-07-05T12:08:14.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17959a700 1 -- 172.21.15.90:0/2324662315 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00ba20 con 0x7fc17c0ef830 2022-07-05T12:08:14.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17959a700 1 -- 172.21.15.90:0/2324662315 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00bda0 con 0x7fc17c0ef830 2022-07-05T12:08:14.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 -- 172.21.15.90:0/2324662315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 msgr2=0x7fc17c0efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 --2- 172.21.15.90:0/2324662315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c0efcc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fc17c088fb0 tx=0x7fc16c009840).stop 2022-07-05T12:08:14.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 -- 172.21.15.90:0/2324662315 shutdown_connections 2022-07-05T12:08:14.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 --2- 172.21.15.90:0/2324662315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c0efcc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 --2- 172.21.15.90:0/2324662315 >> v2:172.21.15.149:3300/0 conn(0x7fc17c063910 0x7fc17c0ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 -- 172.21.15.90:0/2324662315 >> 172.21.15.90:0/2324662315 conn(0x7fc17c0f5470 msgr2=0x7fc17c0f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:14.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 -- 172.21.15.90:0/2324662315 shutdown_connections 2022-07-05T12:08:14.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.535+0000 7fc17b59e700 1 -- 172.21.15.90:0/2324662315 wait complete. 2022-07-05T12:08:14.551 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.537+0000 7fc17b59e700 1 Processor -- start 2022-07-05T12:08:14.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.537+0000 7fc17b59e700 1 -- start start 2022-07-05T12:08:14.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17b59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c063910 0x7fc17c191550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c16eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.552 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17b59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c17dcd0 0x7fc17c1923b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17b59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1901d0 con 0x7fc17c0ef830 2022-07-05T12:08:14.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17b59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1904b0 con 0x7fc17c17dcd0 2022-07-05T12:08:14.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17b59e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c190790 con 0x7fc17c063910 2022-07-05T12:08:14.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c16eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.553 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c063910 0x7fc17c191550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c16eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60514/0 (socket says 172.21.15.90:60514) 2022-07-05T12:08:14.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 -- 172.21.15.90:0/42920880 learned_addr learned my addr 172.21.15.90:0/42920880 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:14.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17a59c700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c063910 0x7fc17c191550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41908/0 (socket says 172.21.15.90:41908) 2022-07-05T12:08:14.554 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c17dcd0 0x7fc17c1923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 -- 172.21.15.90:0/42920880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c063910 msgr2=0x7fc17c191550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c063910 0x7fc17c191550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 -- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c17dcd0 msgr2=0x7fc17c1923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c17dcd0 0x7fc17c1923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 -- 172.21.15.90:0/42920880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c009ae0 con 0x7fc17c0ef830 2022-07-05T12:08:14.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc179d9b700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c16eb00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fc17000e900 tx=0x7fc170009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:14.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.538+0000 7fc16a7fc700 1 -- 172.21.15.90:0/42920880 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170009390 con 0x7fc17c0ef830 2022-07-05T12:08:14.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.539+0000 7fc16a7fc700 1 -- 172.21.15.90:0/42920880 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc170012600 con 0x7fc17c0ef830 2022-07-05T12:08:14.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.539+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c190a70 con 0x7fc17c0ef830 2022-07-05T12:08:14.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.539+0000 7fc16a7fc700 1 -- 172.21.15.90:0/42920880 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170012980 con 0x7fc17c0ef830 2022-07-05T12:08:14.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.539+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c191030 con 0x7fc17c0ef830 2022-07-05T12:08:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.540+0000 7fc16a7fc700 1 -- 172.21.15.90:0/42920880 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc170022070 con 0x7fc17c0ef830 2022-07-05T12:08:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.541+0000 7fc16a7fc700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc15808ba40 0x7fc15808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.541+0000 7fc16a7fc700 1 -- 172.21.15.90:0/42920880 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fc1700b0a50 con 0x7fc17c0ef830 2022-07-05T12:08:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.541+0000 7fc17a59c700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc15808ba40 0x7fc15808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.541+0000 7fc17a59c700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc15808ba40 0x7fc15808df00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc174003900 tx=0x7fc174000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:14.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.542+0000 7fc19289ab80 1 Processor -- start 2022-07-05T12:08:14.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.543+0000 7fc19289ab80 1 -- start start 2022-07-05T12:08:14.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.543+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f055c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.543+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.543+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 0x55c4f05a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.543+0000 7fc19289ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f05262d0 con 0x55c4f055cda0 2022-07-05T12:08:14.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.543+0000 7fc19289ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f049daa0 con 0x55c4f05a0890 2022-07-05T12:08:14.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.543+0000 7fc19289ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f04b2950 con 0x55c4f05a04b0 2022-07-05T12:08:14.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f055c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f055c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41916/0 (socket says 172.21.15.90:41916) 2022-07-05T12:08:14.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 -- 172.21.15.90:0/4225255735 learned_addr learned my addr 172.21.15.90:0/4225255735 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:14.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc179d9b700 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 0x55c4f05a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 -- 172.21.15.90:0/4225255735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 msgr2=0x55c4f05a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 0x55c4f05a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 -- 172.21.15.90:0/4225255735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 msgr2=0x55c4f05aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 -- 172.21.15.90:0/4225255735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f02e49e0 con 0x55c4f05a04b0 2022-07-05T12:08:14.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc179d9b700 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:08:14.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc17a59c700 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f055c8b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fc17400f7c0 tx=0x7fc17400a000).ready entity=mon.2 client_cookie=ec1cab8dec170560 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:14.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc1577fe700 1 -- 172.21.15.90:0/4225255735 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17401c070 con 0x55c4f05a04b0 2022-07-05T12:08:14.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc1577fe700 1 -- 172.21.15.90:0/4225255735 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174016480 con 0x55c4f05a04b0 2022-07-05T12:08:14.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.544+0000 7fc1577fe700 1 -- 172.21.15.90:0/4225255735 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174003040 con 0x55c4f05a04b0 2022-07-05T12:08:14.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 -- 172.21.15.90:0/4225255735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 msgr2=0x55c4f055c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f055c8b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fc17400f7c0 tx=0x7fc17400a000).stop 2022-07-05T12:08:14.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 -- 172.21.15.90:0/4225255735 shutdown_connections 2022-07-05T12:08:14.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 0x55c4f05a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f055c8b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4225255735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 -- 172.21.15.90:0/4225255735 >> 172.21.15.90:0/4225255735 conn(0x55c4f03cb1c0 msgr2=0x55c4f055fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:14.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 -- 172.21.15.90:0/4225255735 shutdown_connections 2022-07-05T12:08:14.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.545+0000 7fc19289ab80 1 -- 172.21.15.90:0/4225255735 wait complete. 2022-07-05T12:08:14.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.546+0000 7fc19289ab80 1 -- start start 2022-07-05T12:08:14.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.546+0000 7fc19289ab80 1 Processor -- start 2022-07-05T12:08:14.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f0596900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a04b0 0x55c4f05d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a0890 0x55c4f05e0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc19289ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f047a120 con 0x55c4f05a04b0 2022-07-05T12:08:14.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc19289ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f05e0d00 con 0x55c4f055cda0 2022-07-05T12:08:14.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc19289ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f05df8c0 con 0x55c4f05a0890 2022-07-05T12:08:14.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc19289ab80 10 client.0 ll_register_callbacks cb 0x55c4f0520380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:08:14.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc179d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a04b0 0x55c4f05d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc179d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a04b0 0x55c4f05d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60528/0 (socket says 172.21.15.90:60528) 2022-07-05T12:08:14.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc179d9b700 1 -- 172.21.15.90:0/4201002775 learned_addr learned my addr 172.21.15.90:0/4201002775 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:14.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a0890 0x55c4f05e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc17a59c700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f0596900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc179d9b700 1 -- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a0890 msgr2=0x55c4f05e0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.547+0000 7fc179d9b700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a0890 0x55c4f05e0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc179d9b700 1 -- 172.21.15.90:0/4201002775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 msgr2=0x55c4f0596900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc179d9b700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f0596900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc179d9b700 1 -- 172.21.15.90:0/4201002775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c191030 con 0x55c4f05a04b0 2022-07-05T12:08:14.571 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc17a59c700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f0596900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:08:14.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc179d9b700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a04b0 0x55c4f05d07b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fc170000c00 tx=0x7fc1700b0040).ready entity=mon.0 client_cookie=fd5d9b2ea37bbe9d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:14.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc154ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:08:14.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc154ff9700 1 -- 172.21.15.90:0/4201002775 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17008aea0 con 0x55c4f05a04b0 2022-07-05T12:08:14.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc154ff9700 1 -- 172.21.15.90:0/4201002775 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fc170012d30 con 0x55c4f05a04b0 2022-07-05T12:08:14.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4f055a690 con 0x55c4f05a04b0 2022-07-05T12:08:14.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc154ff9700 1 -- 172.21.15.90:0/4201002775 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc170019310 con 0x55c4f05a04b0 2022-07-05T12:08:14.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 10 client.6171 fetch_fsmap learned FSMap version 41 2022-07-05T12:08:14.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x7fc17c061f10 con 0x55c4f05a04b0 2022-07-05T12:08:14.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc154ff9700 1 -- 172.21.15.90:0/4201002775 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4f055a690 con 0x55c4f05a04b0 2022-07-05T12:08:14.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc154ff9700 1 -- 172.21.15.90:0/4201002775 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fc170084860 con 0x55c4f05a04b0 2022-07-05T12:08:14.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 10 client.6171 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:08:14.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 10 client.6171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:08:14.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 20 client.6171 populate_metadata read hostname 'smithi090' 2022-07-05T12:08:14.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f059a8a0 0x55c4f05d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 4 client.6171 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:08:14.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4f04a87f0 con 0x55c4f059a8a0 2022-07-05T12:08:14.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.548+0000 7fc17a59c700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f059a8a0 0x55c4f05d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.549+0000 7fc17a59c700 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f059a8a0 0x55c4f05d22d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fba990a7040d198d server_cookie=4fa591fcbf91c0c8 in_seq=0 out_seq=0 2022-07-05T12:08:14.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.549+0000 7fc154ff9700 10 client.6171 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:14.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc154ff9700 1 -- 172.21.15.90:0/4201002775 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55c4f04a87f0 con 0x55c4f059a8a0 2022-07-05T12:08:14.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc154ff9700 10 client.6171 handle_command_reply: tid=0 2022-07-05T12:08:14.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 client.6171 shutdown 2022-07-05T12:08:14.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a04b0 msgr2=0x55c4f05d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a04b0 0x55c4f05d07b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fc170000c00 tx=0x7fc1700b0040).stop 2022-07-05T12:08:14.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 shutdown_connections 2022-07-05T12:08:14.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f059a8a0 0x55c4f05d22d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a0890 0x55c4f05e0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f0596900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 --2- 172.21.15.90:0/4201002775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a04b0 0x55c4f05d07b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc154ff9700 0 client.6171 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:14.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 >> 172.21.15.90:0/4201002775 conn(0x55c4f03cb1c0 msgr2=0x55c4f055d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:14.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 shutdown_connections 2022-07-05T12:08:14.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 1 -- 172.21.15.90:0/4201002775 wait complete. 2022-07-05T12:08:14.580 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.550+0000 7fc19289ab80 20 client.6171 trim_cache size 0 max 16384 2022-07-05T12:08:14.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.566+0000 7fc19289ab80 1 Processor -- start 2022-07-05T12:08:14.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.566+0000 7fc19289ab80 1 -- start start 2022-07-05T12:08:14.588 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f055bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f05e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a0890 0x55c4f05aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc19289ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f055d600 con 0x55c4f05a0890 2022-07-05T12:08:14.589 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc19289ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f0556930 con 0x55c4f055cda0 2022-07-05T12:08:14.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc19289ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f05e1630 con 0x55c4f05a04b0 2022-07-05T12:08:14.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a0890 0x55c4f05aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a0890 0x55c4f05aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60538/0 (socket says 172.21.15.90:60538) 2022-07-05T12:08:14.590 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2173304669 learned_addr learned my addr 172.21.15.90:0/2173304669 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:14.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc179d9b700 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f05e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2173304669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 msgr2=0x55c4f05e06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f05e06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2173304669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 msgr2=0x55c4f055bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17a59c700 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f055bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f055bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.567+0000 7fc17ad9d700 1 -- 172.21.15.90:0/2173304669 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f0596c60 con 0x55c4f05a0890 2022-07-05T12:08:14.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc17ad9d700 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a0890 0x55c4f05aa960 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fc17c088dd0 tx=0x7fc17c062eb0).ready entity=mon.0 client_cookie=25d3fcefe9b6977a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:14.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc157fff700 1 -- 172.21.15.90:0/2173304669 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c024070 con 0x55c4f05a0890 2022-07-05T12:08:14.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc157fff700 1 -- 172.21.15.90:0/2173304669 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0092e0 con 0x55c4f05a0890 2022-07-05T12:08:14.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc157fff700 1 -- 172.21.15.90:0/2173304669 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00bd90 con 0x55c4f05a0890 2022-07-05T12:08:14.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 -- 172.21.15.90:0/2173304669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a0890 msgr2=0x55c4f05aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a0890 0x55c4f05aa960 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fc17c088dd0 tx=0x7fc17c062eb0).stop 2022-07-05T12:08:14.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 -- 172.21.15.90:0/2173304669 shutdown_connections 2022-07-05T12:08:14.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f05a0890 0x55c4f05aa960 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f055cda0 0x55c4f055bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2173304669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f05e06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 -- 172.21.15.90:0/2173304669 >> 172.21.15.90:0/2173304669 conn(0x55c4f03cb1c0 msgr2=0x55c4f0566ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:14.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 -- 172.21.15.90:0/2173304669 shutdown_connections 2022-07-05T12:08:14.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.568+0000 7fc19289ab80 1 -- 172.21.15.90:0/2173304669 wait complete. 2022-07-05T12:08:14.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.569+0000 7fc19289ab80 1 -- start start 2022-07-05T12:08:14.595 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.569+0000 7fc19289ab80 1 Processor -- start 2022-07-05T12:08:14.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05e1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f0625660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc19289ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 0x55c4f0620050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc19289ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f0638630 con 0x55c4f055cda0 2022-07-05T12:08:14.596 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc19289ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f0625b50 con 0x55c4f05a0890 2022-07-05T12:08:14.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc19289ab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f06251d0 con 0x55c4f05a04b0 2022-07-05T12:08:14.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc19289ab80 10 client.0 ll_register_callbacks cb 0x55c4f0520380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:08:14.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc17a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.597 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc17a59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05e1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60540/0 (socket says 172.21.15.90:60540) 2022-07-05T12:08:14.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc17a59c700 1 -- 172.21.15.90:0/2344325919 learned_addr learned my addr 172.21.15.90:0/2344325919 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:14.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.570+0000 7fc179d9b700 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f0625660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc17a59c700 1 -- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 msgr2=0x55c4f0625660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.598 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc17a59c700 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f0625660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc17a59c700 1 -- 172.21.15.90:0/2344325919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 msgr2=0x55c4f0620050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:14.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc17a59c700 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 0x55c4f0620050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:08:14.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc17a59c700 1 -- 172.21.15.90:0/2344325919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c017040 con 0x55c4f055cda0 2022-07-05T12:08:14.599 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc179d9b700 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f0625660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:08:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc17a59c700 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05e1950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc174013000 tx=0x7fc174016000).ready entity=mon.0 client_cookie=3ad17d8133c84b91 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc154ff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:08:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc154ff9700 1 -- 172.21.15.90:0/2344325919 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174028040 con 0x55c4f055cda0 2022-07-05T12:08:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc154ff9700 1 -- 172.21.15.90:0/2344325919 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fc17402f4d0 con 0x55c4f055cda0 2022-07-05T12:08:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc174016480 con 0x55c4f055cda0 2022-07-05T12:08:14.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc154ff9700 1 -- 172.21.15.90:0/2344325919 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc17402f8a0 con 0x55c4f055cda0 2022-07-05T12:08:14.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 10 client.6177 fetch_fsmap learned FSMap version 41 2022-07-05T12:08:14.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55c4f0353cd0 con 0x55c4f055cda0 2022-07-05T12:08:14.601 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc154ff9700 1 -- 172.21.15.90:0/2344325919 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174016480 con 0x55c4f055cda0 2022-07-05T12:08:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc154ff9700 1 -- 172.21.15.90:0/2344325919 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fc174039b20 con 0x55c4f055cda0 2022-07-05T12:08:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 10 client.6177 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:08:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 10 client.6177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:08:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 20 client.6177 populate_metadata read hostname 'smithi090' 2022-07-05T12:08:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f055ae90 0x55c4f0599110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 4 client.6177 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:08:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c4f049f690 con 0x55c4f055ae90 2022-07-05T12:08:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.571+0000 7fc179d9b700 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f055ae90 0x55c4f0599110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc179d9b700 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f055ae90 0x55c4f0599110 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1016a0403e84c server_cookie=839675d987ceafe4 in_seq=0 out_seq=0 2022-07-05T12:08:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc154ff9700 10 client.6177 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc154ff9700 1 -- 172.21.15.90:0/2344325919 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c4f049f690 con 0x55c4f055ae90 2022-07-05T12:08:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc154ff9700 10 client.6177 handle_command_reply: tid=0 2022-07-05T12:08:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 client.6177 shutdown 2022-07-05T12:08:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 msgr2=0x55c4f05e1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05e1950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc174013000 tx=0x7fc174016000).stop 2022-07-05T12:08:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 shutdown_connections 2022-07-05T12:08:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55c4f055ae90 0x55c4f0599110 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4f05a0890 0x55c4f0620050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:08:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc154ff9700 0 client.6177 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c4f055cda0 0x55c4f05e1950 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 --2- 172.21.15.90:0/2344325919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c4f05a04b0 0x55c4f0625660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 >> 172.21.15.90:0/2344325919 conn(0x55c4f03cb1c0 msgr2=0x55c4f05ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 shutdown_connections 2022-07-05T12:08:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 1 -- 172.21.15.90:0/2344325919 wait complete. 2022-07-05T12:08:14.608 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.572+0000 7fc19289ab80 20 client.6177 trim_cache size 0 max 16384 2022-07-05T12:08:14.609 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:08:14.609 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:08:14.609 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:08:14.610 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:08:14.610 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:08:14.611 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:08:14.611 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:08:14.612 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:08:14.612 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:08:14.613 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:08:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc15808ba40 msgr2=0x7fc15808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc15808ba40 0x7fc15808df00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc174003900 tx=0x7fc174000bc0).stop 2022-07-05T12:08:14.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 msgr2=0x7fc17c16eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:14.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c16eb00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fc17000e900 tx=0x7fc170009060).stop 2022-07-05T12:08:14.617 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 shutdown_connections 2022-07-05T12:08:14.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fc15808ba40 0x7fc15808df00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.618 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c17dcd0 0x7fc17c1923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c063910 0x7fc17c191550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.619 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 --2- 172.21.15.90:0/42920880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc17c0ef830 0x7fc17c16eb00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:14.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 >> 172.21.15.90:0/42920880 conn(0x7fc17c0f5470 msgr2=0x7fc17c063200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:14.620 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 shutdown_connections 2022-07-05T12:08:14.621 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:14.573+0000 7fc17b59e700 1 -- 172.21.15.90:0/42920880 wait complete. 2022-07-05T12:08:14.621 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:08:44.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:08:44.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.752+0000 7f9cddca2700 1 Processor -- start 2022-07-05T12:08:44.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.752+0000 7f9cddca2700 1 -- start start 2022-07-05T12:08:44.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cddca2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9cd8172e20 0x7f9cd80c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cddca2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9cd817bd40 0x7f9cd8182d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cddca2700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd817a060 con 0x7f9cd80c4890 2022-07-05T12:08:44.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cddca2700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd817a2b0 con 0x7f9cd8172e20 2022-07-05T12:08:44.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cddca2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd817a590 con 0x7f9cd817bd40 2022-07-05T12:08:44.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd77fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9cd8172e20 0x7f9cd80c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd6ffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9cd80c4890 0x7f9cd817b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53492/0 (socket says 172.21.15.90:53492) 2022-07-05T12:08:44.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/1967590242 learned_addr learned my addr 172.21.15.90:0/1967590242 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:08:44.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd7fff700 1 --2- 172.21.15.90:0/1967590242 >> v2:172.21.15.149:3300/0 conn(0x7f9cd817bd40 0x7f9cd8182d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd77fe700 1 -- 172.21.15.90:0/1967590242 >> v2:172.21.15.149:3300/0 conn(0x7f9cd817bd40 msgr2=0x7f9cd8182d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/1967590242 >> v2:172.21.15.149:3300/0 conn(0x7f9cd817bd40 0x7f9cd8182d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd77fe700 1 -- 172.21.15.90:0/1967590242 >> v1:172.21.15.90:6789/0 conn(0x7f9cd80c4890 legacy=0x7f9cd817b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd67fc700 1 -- 172.21.15.90:0/1967590242 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508697509 0 0) 0x7f9cd817a060 con 0x7f9cd80c4890 2022-07-05T12:08:44.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd77fe700 1 -- 172.21.15.90:0/1967590242 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd817a870 con 0x7f9cd8172e20 2022-07-05T12:08:44.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/1967590242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd80c43a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f9cd806c0c0 tx=0x7f9cc8009780).ready entity=mon.0 client_cookie=5996343bc2272fd6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:44.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd67fc700 1 -- 172.21.15.90:0/1967590242 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800e070 con 0x7f9cd8172e20 2022-07-05T12:08:44.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd67fc700 1 -- 172.21.15.90:0/1967590242 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc800bb60 con 0x7f9cd8172e20 2022-07-05T12:08:44.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.753+0000 7f9cd67fc700 1 -- 172.21.15.90:0/1967590242 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8012410 con 0x7f9cd8172e20 2022-07-05T12:08:44.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 -- 172.21.15.90:0/1967590242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 msgr2=0x7f9cd80c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 --2- 172.21.15.90:0/1967590242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd80c43a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f9cd806c0c0 tx=0x7f9cc8009780).stop 2022-07-05T12:08:44.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 -- 172.21.15.90:0/1967590242 shutdown_connections 2022-07-05T12:08:44.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 --2- 172.21.15.90:0/1967590242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd80c43a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 --2- 172.21.15.90:0/1967590242 >> v2:172.21.15.149:3300/0 conn(0x7f9cd817bd40 0x7f9cd8182d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 -- 172.21.15.90:0/1967590242 >> 172.21.15.90:0/1967590242 conn(0x7f9cd80f0030 msgr2=0x7f9cd8061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:44.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 -- 172.21.15.90:0/1967590242 shutdown_connections 2022-07-05T12:08:44.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.754+0000 7f9cddca2700 1 -- 172.21.15.90:0/1967590242 wait complete. 2022-07-05T12:08:44.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.756+0000 7f9cddca2700 1 Processor -- start 2022-07-05T12:08:44.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.756+0000 7f9cddca2700 1 -- start start 2022-07-05T12:08:44.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd816c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd817bd40 0x7f9cd816cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8177cd0 0x7f9cd8178130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8191a10 con 0x7f9cd8172e20 2022-07-05T12:08:44.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8176c30 con 0x7f9cd817bd40 2022-07-05T12:08:44.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8176f10 con 0x7f9cd8177cd0 2022-07-05T12:08:44.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd816c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd816c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60554/0 (socket says 172.21.15.90:60554) 2022-07-05T12:08:44.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2524880039 learned_addr learned my addr 172.21.15.90:0/2524880039 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:44.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd7fff700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8177cd0 0x7f9cd8178130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd817bd40 0x7f9cd816cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2524880039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8177cd0 msgr2=0x7f9cd8178130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8177cd0 0x7f9cd8178130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd817bd40 msgr2=0x7f9cd816cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd817bd40 0x7f9cd816cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2524880039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8009a20 con 0x7f9cd8172e20 2022-07-05T12:08:44.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd816c720 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f9cc800b6c0 tx=0x7f9cc8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:44.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cbf7fe700 1 -- 172.21.15.90:0/2524880039 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc801d420 con 0x7f9cd8172e20 2022-07-05T12:08:44.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cbf7fe700 1 -- 172.21.15.90:0/2524880039 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc801d580 con 0x7f9cd8172e20 2022-07-05T12:08:44.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cbf7fe700 1 -- 172.21.15.90:0/2524880039 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc801d920 con 0x7f9cd8172e20 2022-07-05T12:08:44.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd81771f0 con 0x7f9cd8172e20 2022-07-05T12:08:44.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.757+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd81777b0 con 0x7f9cd8172e20 2022-07-05T12:08:44.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.759+0000 7f9cbf7fe700 1 -- 172.21.15.90:0/2524880039 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f9cc801dd10 con 0x7f9cd8172e20 2022-07-05T12:08:44.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.760+0000 7f9cbf7fe700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9cb808ba40 0x7f9cb808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.760+0000 7f9cbf7fe700 1 -- 172.21.15.90:0/2524880039 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f9cc80b2860 con 0x7f9cd8172e20 2022-07-05T12:08:44.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.760+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9cb808ba40 0x7f9cb808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.760+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9cb808ba40 0x7f9cb808df00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f9cd80ecf50 tx=0x7f9ccc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:44.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.761+0000 7f9cef62eb80 1 Processor -- start 2022-07-05T12:08:44.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.762+0000 7f9cef62eb80 1 -- start start 2022-07-05T12:08:44.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.762+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.762+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d327673990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.762+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276697a0 0x55d327669c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.762+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3275ef2d0 con 0x55d3276697a0 2022-07-05T12:08:44.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.762+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327566aa0 con 0x55d327625cb0 2022-07-05T12:08:44.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.762+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32757b950 con 0x55d3276693c0 2022-07-05T12:08:44.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276697a0 0x55d327669c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276697a0 0x55d327669c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60566/0 (socket says 172.21.15.90:60566) 2022-07-05T12:08:44.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 -- 172.21.15.90:0/1681744957 learned_addr learned my addr 172.21.15.90:0/1681744957 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:44.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d327673990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 -- 172.21.15.90:0/1681744957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 msgr2=0x55d3276257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276257c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 -- 172.21.15.90:0/1681744957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 msgr2=0x55d327673990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d327673990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 -- 172.21.15.90:0/1681744957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3273ad9e0 con 0x55d3276697a0 2022-07-05T12:08:44.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cd7fff700 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276697a0 0x55d327669c20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f9cd0009b90 tx=0x7f9cd0009060).ready entity=mon.0 client_cookie=afb7d943df555b17 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:44.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cbcff9700 1 -- 172.21.15.90:0/1681744957 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0011a90 con 0x55d3276697a0 2022-07-05T12:08:44.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cbcff9700 1 -- 172.21.15.90:0/1681744957 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd0011bf0 con 0x55d3276697a0 2022-07-05T12:08:44.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.763+0000 7f9cbcff9700 1 -- 172.21.15.90:0/1681744957 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0014440 con 0x55d3276697a0 2022-07-05T12:08:44.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 -- 172.21.15.90:0/1681744957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276697a0 msgr2=0x55d327669c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276697a0 0x55d327669c20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f9cd0009b90 tx=0x7f9cd0009060).stop 2022-07-05T12:08:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 -- 172.21.15.90:0/1681744957 shutdown_connections 2022-07-05T12:08:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276697a0 0x55d327669c20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/1681744957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d327673990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 -- 172.21.15.90:0/1681744957 >> 172.21.15.90:0/1681744957 conn(0x55d3274941c0 msgr2=0x55d327628ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:44.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 -- 172.21.15.90:0/1681744957 shutdown_connections 2022-07-05T12:08:44.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.764+0000 7f9cef62eb80 1 -- 172.21.15.90:0/1681744957 wait complete. 2022-07-05T12:08:44.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.765+0000 7f9cef62eb80 1 -- start start 2022-07-05T12:08:44.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.765+0000 7f9cef62eb80 1 Processor -- start 2022-07-05T12:08:44.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d327625cb0 0x55d32769a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d3276a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327543120 con 0x55d327625cb0 2022-07-05T12:08:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3276a8510 con 0x55d3276697a0 2022-07-05T12:08:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3276674d0 con 0x55d3276693c0 2022-07-05T12:08:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 10 client.0 ll_register_callbacks cb 0x55d3275e91b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:08:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d327625cb0 0x55d32769a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d327625cb0 0x55d32769a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60568/0 (socket says 172.21.15.90:60568) 2022-07-05T12:08:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2756100711 learned_addr learned my addr 172.21.15.90:0/2756100711 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd7fff700 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d3276a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 msgr2=0x55d3276589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2756100711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 msgr2=0x55d3276a78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d3276a78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 -- 172.21.15.90:0/2756100711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd0009810 con 0x55d327625cb0 2022-07-05T12:08:44.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d327625cb0 0x55d32769a590 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f9cc8086e80 tx=0x7f9cc80097f0).ready entity=mon.0 client_cookie=9cfc0fc5dcf14dce server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:44.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:08:44.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/2756100711 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8010df0 con 0x55d327625cb0 2022-07-05T12:08:44.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/2756100711 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f9cc8086670 con 0x55d327625cb0 2022-07-05T12:08:44.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d327623440 con 0x55d327625cb0 2022-07-05T12:08:44.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.766+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/2756100711 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cc808c5d0 con 0x55d327625cb0 2022-07-05T12:08:44.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 10 client.6192 fetch_fsmap learned FSMap version 41 2022-07-05T12:08:44.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55d32741ccd0 con 0x55d327625cb0 2022-07-05T12:08:44.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/2756100711 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc8096020 con 0x55d327625cb0 2022-07-05T12:08:44.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/2756100711 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f9cc8082f70 con 0x55d327625cb0 2022-07-05T12:08:44.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 10 client.6192 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:08:44.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 10 client.6192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:08:44.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 20 client.6192 populate_metadata read hostname 'smithi090' 2022-07-05T12:08:44.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327667020 0x55d327630360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 4 client.6192 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:08:44.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3275717f0 con 0x55d327667020 2022-07-05T12:08:44.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327667020 0x55d327630360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.806 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cb1ffb700 10 client.6192 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:44.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.767+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327667020 0x55d327630360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f4d7ea1943388528 server_cookie=a6230f83f715bfc3 in_seq=0 out_seq=0 2022-07-05T12:08:44.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/2756100711 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55d3275717f0 con 0x55d327667020 2022-07-05T12:08:44.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cb1ffb700 10 client.6192 handle_command_reply: tid=0 2022-07-05T12:08:44.807 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 client.6192 shutdown 2022-07-05T12:08:44.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d327625cb0 msgr2=0x55d32769a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d327625cb0 0x55d32769a590 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f9cc8086e80 tx=0x7f9cc80097f0).stop 2022-07-05T12:08:44.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 shutdown_connections 2022-07-05T12:08:44.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327667020 0x55d327630360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.808 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d3276a78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cb1ffb700 0 client.6192 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:44.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d327625cb0 0x55d32769a590 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/2756100711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276693c0 0x55d3276589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.809 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 >> 172.21.15.90:0/2756100711 conn(0x55d3274941c0 msgr2=0x55d327696150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:44.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 shutdown_connections 2022-07-05T12:08:44.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 1 -- 172.21.15.90:0/2756100711 wait complete. 2022-07-05T12:08:44.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.768+0000 7f9cef62eb80 20 client.6192 trim_cache size 0 max 16384 2022-07-05T12:08:44.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.784+0000 7f9cef62eb80 1 Processor -- start 2022-07-05T12:08:44.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.784+0000 7f9cef62eb80 1 -- start start 2022-07-05T12:08:44.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d3276a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276697a0 0x55d3276f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327669fb0 con 0x55d3276693c0 2022-07-05T12:08:44.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327626510 con 0x55d327625cb0 2022-07-05T12:08:44.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32769bed0 con 0x55d3276697a0 2022-07-05T12:08:44.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60578/0 (socket says 172.21.15.90:60578) 2022-07-05T12:08:44.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/913661124 learned_addr learned my addr 172.21.15.90:0/913661124 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:44.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276697a0 0x55d3276f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d3276a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.820 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/913661124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276697a0 msgr2=0x55d3276f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276697a0 0x55d3276f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/913661124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 msgr2=0x55d3276a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d3276a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.821 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/913661124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3273eafd0 con 0x55d3276693c0 2022-07-05T12:08:44.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276587f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f9ccc00cef0 tx=0x7f9ccc018040).ready entity=mon.0 client_cookie=c367906f7adc27a8 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:44.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cbd7fa700 1 -- 172.21.15.90:0/913661124 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc028070 con 0x55d3276693c0 2022-07-05T12:08:44.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cbd7fa700 1 -- 172.21.15.90:0/913661124 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc01c040 con 0x55d3276693c0 2022-07-05T12:08:44.822 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.785+0000 7f9cbd7fa700 1 -- 172.21.15.90:0/913661124 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc01b070 con 0x55d3276693c0 2022-07-05T12:08:44.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 -- 172.21.15.90:0/913661124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 msgr2=0x55d3276587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276587f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f9ccc00cef0 tx=0x7f9ccc018040).stop 2022-07-05T12:08:44.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 -- 172.21.15.90:0/913661124 shutdown_connections 2022-07-05T12:08:44.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3276697a0 0x55d3276f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.823 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d327625cb0 0x55d3276a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/913661124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276587f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 -- 172.21.15.90:0/913661124 >> 172.21.15.90:0/913661124 conn(0x55d3274941c0 msgr2=0x55d327630360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:44.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 -- 172.21.15.90:0/913661124 shutdown_connections 2022-07-05T12:08:44.824 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.786+0000 7f9cef62eb80 1 -- 172.21.15.90:0/913661124 wait complete. 2022-07-05T12:08:44.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.787+0000 7f9cef62eb80 1 -- start start 2022-07-05T12:08:44.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.787+0000 7f9cef62eb80 1 Processor -- start 2022-07-05T12:08:44.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d327625cb0 0x55d327673240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.825 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276255e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d32766c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327694ad0 con 0x55d3276693c0 2022-07-05T12:08:44.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327694f30 con 0x55d3276697a0 2022-07-05T12:08:44.826 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32766c210 con 0x55d327625cb0 2022-07-05T12:08:44.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 10 client.0 ll_register_callbacks cb 0x55d3275e91b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:08:44.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276255e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60584/0 (socket says 172.21.15.90:60584) 2022-07-05T12:08:44.827 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/3672798857 learned_addr learned my addr 172.21.15.90:0/3672798857 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:08:44.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d327625cb0 0x55d327673240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd7fff700 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d32766c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d327625cb0 msgr2=0x55d327673240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d327625cb0 0x55d327673240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.828 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/3672798857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 msgr2=0x55d32766c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:08:44.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d32766c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 -- 172.21.15.90:0/3672798857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc00f040 con 0x55d3276693c0 2022-07-05T12:08:44.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cd6ffd700 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276255e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f9ccc007f70 tx=0x7f9ccc016000).ready entity=mon.0 client_cookie=25702e753a33f685 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:08:44.829 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:08:44.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/3672798857 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc028070 con 0x55d3276693c0 2022-07-05T12:08:44.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/3672798857 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f9ccc024760 con 0x55d3276693c0 2022-07-05T12:08:44.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d327673d90 con 0x55d3276693c0 2022-07-05T12:08:44.830 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/3672798857 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ccc024b80 con 0x55d3276693c0 2022-07-05T12:08:44.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.788+0000 7f9cef62eb80 10 client.6198 fetch_fsmap learned FSMap version 41 2022-07-05T12:08:44.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55d32766c4f0 con 0x55d3276693c0 2022-07-05T12:08:44.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/3672798857 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d327673d90 con 0x55d3276693c0 2022-07-05T12:08:44.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/3672798857 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f9ccc024ce0 con 0x55d3276693c0 2022-07-05T12:08:44.831 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cef62eb80 10 client.6198 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:08:44.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cef62eb80 10 client.6198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:08:44.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cef62eb80 20 client.6198 populate_metadata read hostname 'smithi090' 2022-07-05T12:08:44.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327666bb0 0x55d3276729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:08:44.832 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cef62eb80 4 client.6198 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:08:44.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f9cd0011bf0 con 0x55d327666bb0 2022-07-05T12:08:44.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327666bb0 0x55d3276729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:08:44.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cb1ffb700 10 client.6198 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:44.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.789+0000 7f9cd77fe700 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327666bb0 0x55d3276729f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=74c63b51b1a9dbbb server_cookie=f9e83c60940aa7df in_seq=0 out_seq=0 2022-07-05T12:08:44.833 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cb1ffb700 1 -- 172.21.15.90:0/3672798857 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f9cd0011bf0 con 0x55d327666bb0 2022-07-05T12:08:44.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cb1ffb700 10 client.6198 handle_command_reply: tid=0 2022-07-05T12:08:44.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 client.6198 shutdown 2022-07-05T12:08:44.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 msgr2=0x55d3276255e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.834 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276255e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f9ccc007f70 tx=0x7f9ccc016000).stop 2022-07-05T12:08:44.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 shutdown_connections 2022-07-05T12:08:44.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55d327666bb0 0x55d3276729f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d3276697a0 0x55d32766c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cb1ffb700 0 client.6198 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:08:44.835 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d327625cb0 0x55d327673240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 --2- 172.21.15.90:0/3672798857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3276693c0 0x55d3276255e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 >> 172.21.15.90:0/3672798857 conn(0x55d3274941c0 msgr2=0x55d327630360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:44.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 shutdown_connections 2022-07-05T12:08:44.836 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 1 -- 172.21.15.90:0/3672798857 wait complete. 2022-07-05T12:08:44.837 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cef62eb80 20 client.6198 trim_cache size 0 max 16384 2022-07-05T12:08:44.837 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:08:44.837 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:08:44.838 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:08:44.838 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:08:44.838 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:08:44.838 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:08:44.839 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:08:44.839 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:08:44.839 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:08:44.839 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:08:44.841 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9cb808ba40 msgr2=0x7f9cb808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9cb808ba40 0x7f9cb808df00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f9cd80ecf50 tx=0x7f9ccc009040).stop 2022-07-05T12:08:44.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 msgr2=0x7f9cd816c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:08:44.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd816c720 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f9cc800b6c0 tx=0x7f9cc8009780).stop 2022-07-05T12:08:44.842 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 shutdown_connections 2022-07-05T12:08:44.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f9cb808ba40 0x7f9cb808df00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8177cd0 0x7f9cd8178130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd8172e20 0x7f9cd816c720 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 --2- 172.21.15.90:0/2524880039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cd817bd40 0x7f9cd816cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:08:44.843 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 >> 172.21.15.90:0/2524880039 conn(0x7f9cd80f0030 msgr2=0x7f9cd80c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:08:44.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 shutdown_connections 2022-07-05T12:08:44.844 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:08:44.790+0000 7f9cddca2700 1 -- 172.21.15.90:0/2524880039 wait complete. 2022-07-05T12:08:44.844 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:09:14.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:09:14.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b24239700 1 Processor -- start 2022-07-05T12:09:14.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b24239700 1 -- start start 2022-07-05T12:09:14.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b24239700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b1c1789f0 0x7f0b1c17f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b24239700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0b1c17e100 0x7f0b1c063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b24239700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c17d560 con 0x7f0b1c178610 2022-07-05T12:09:15.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b24239700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c17f8a0 con 0x7f0b1c17e100 2022-07-05T12:09:15.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b24239700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c17c670 con 0x7f0b1c1789f0 2022-07-05T12:09:15.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b217d4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b1c1789f0 0x7f0b1c17f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.974+0000 7f0b21fd5700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0b1c178610 0x7f0b1c17d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:49772/0 (socket says 172.21.15.90:49772) 2022-07-05T12:09:15.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b21fd5700 1 -- 172.21.15.90:0/1701271939 learned_addr learned my addr 172.21.15.90:0/1701271939 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:09:15.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b227d6700 1 --2- 172.21.15.90:0/1701271939 >> v2:172.21.15.110:3300/0 conn(0x7f0b1c17e100 0x7f0b1c063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.002 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b217d4700 1 -- 172.21.15.90:0/1701271939 >> v2:172.21.15.110:3300/0 conn(0x7f0b1c17e100 msgr2=0x7f0b1c063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b217d4700 1 --2- 172.21.15.90:0/1701271939 >> v2:172.21.15.110:3300/0 conn(0x7f0b1c17e100 0x7f0b1c063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b217d4700 1 -- 172.21.15.90:0/1701271939 >> v1:172.21.15.149:6789/0 conn(0x7f0b1c178610 legacy=0x7f0b1c17d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b217d4700 1 -- 172.21.15.90:0/1701271939 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c17c950 con 0x7f0b1c1789f0 2022-07-05T12:09:15.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b20fd3700 1 -- 172.21.15.90:0/1701271939 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513877921 0 0) 0x7f0b1c17d560 con 0x7f0b1c178610 2022-07-05T12:09:15.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b217d4700 1 --2- 172.21.15.90:0/1701271939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c17f3b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f0b1c05ff10 tx=0x7f0b10009060).ready entity=mon.2 client_cookie=8005b76a6e849180 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:15.004 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b20fd3700 1 -- 172.21.15.90:0/1701271939 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000f510 con 0x7f0b1c1789f0 2022-07-05T12:09:15.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b20fd3700 1 -- 172.21.15.90:0/1701271939 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000f670 con 0x7f0b1c1789f0 2022-07-05T12:09:15.005 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.975+0000 7f0b20fd3700 1 -- 172.21.15.90:0/1701271939 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000f9f0 con 0x7f0b1c1789f0 2022-07-05T12:09:15.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 -- 172.21.15.90:0/1701271939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c1789f0 msgr2=0x7f0b1c17f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 --2- 172.21.15.90:0/1701271939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c17f3b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f0b1c05ff10 tx=0x7f0b10009060).stop 2022-07-05T12:09:15.006 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 -- 172.21.15.90:0/1701271939 shutdown_connections 2022-07-05T12:09:15.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 --2- 172.21.15.90:0/1701271939 >> v2:172.21.15.110:3300/0 conn(0x7f0b1c17e100 0x7f0b1c063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 --2- 172.21.15.90:0/1701271939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c17f3b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.007 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 -- 172.21.15.90:0/1701271939 >> 172.21.15.90:0/1701271939 conn(0x7f0b1c0f2210 msgr2=0x7f0b1c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:15.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 -- 172.21.15.90:0/1701271939 shutdown_connections 2022-07-05T12:09:15.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.976+0000 7f0b24239700 1 -- 172.21.15.90:0/1701271939 wait complete. 2022-07-05T12:09:15.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.977+0000 7f0b24239700 1 Processor -- start 2022-07-05T12:09:15.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.977+0000 7f0b24239700 1 -- start start 2022-07-05T12:09:15.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b24239700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c178610 0x7f0b1c163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b24239700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b24239700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b1c17e100 0x7f0b1c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b24239700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c71f0 con 0x7f0b1c1789f0 2022-07-05T12:09:15.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b24239700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c7490 con 0x7f0b1c17e100 2022-07-05T12:09:15.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b24239700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c7770 con 0x7f0b1c178610 2022-07-05T12:09:15.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c178610 0x7f0b1c163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b217d4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c178610 0x7f0b1c163160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41992/0 (socket says 172.21.15.90:41992) 2022-07-05T12:09:15.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b217d4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c0c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60598/0 (socket says 172.21.15.90:60598) 2022-07-05T12:09:15.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b21fd5700 1 -- 172.21.15.90:0/114698602 learned_addr learned my addr 172.21.15.90:0/114698602 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:15.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.978+0000 7f0b227d6700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b1c17e100 0x7f0b1c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b21fd5700 1 -- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b1c17e100 msgr2=0x7f0b1c0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b1c17e100 0x7f0b1c0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b21fd5700 1 -- 172.21.15.90:0/114698602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b1c1789f0 msgr2=0x7f0b1c0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c0c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b21fd5700 1 -- 172.21.15.90:0/114698602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100092a0 con 0x7f0b1c178610 2022-07-05T12:09:15.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b217d4700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:09:15.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c178610 0x7f0b1c163160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f0b0c00c760 tx=0x7f0b0c001520).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:15.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b19ffb700 1 -- 172.21.15.90:0/114698602 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c005d30 con 0x7f0b1c178610 2022-07-05T12:09:15.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b19ffb700 1 -- 172.21.15.90:0/114698602 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c005e90 con 0x7f0b1c178610 2022-07-05T12:09:15.016 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c0c7a50 con 0x7f0b1c178610 2022-07-05T12:09:15.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b19ffb700 1 -- 172.21.15.90:0/114698602 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0072e0 con 0x7f0b1c178610 2022-07-05T12:09:15.017 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.979+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c0c8010 con 0x7f0b1c178610 2022-07-05T12:09:15.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.981+0000 7f0b19ffb700 1 -- 172.21.15.90:0/114698602 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f0b0c010070 con 0x7f0b1c178610 2022-07-05T12:09:15.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.982+0000 7f0b19ffb700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0afc08ba40 0x7f0afc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.982+0000 7f0b19ffb700 1 -- 172.21.15.90:0/114698602 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f0b0c0b02a0 con 0x7f0b1c178610 2022-07-05T12:09:15.018 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.982+0000 7f0b217d4700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0afc08ba40 0x7f0afc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.982+0000 7f0b217d4700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0afc08ba40 0x7f0afc08df00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f0b10006d10 tx=0x7f0b10017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:15.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.983+0000 7f0b35bc5b80 1 Processor -- start 2022-07-05T12:09:15.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.983+0000 7f0b35bc5b80 1 -- start start 2022-07-05T12:09:15.019 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35973c0 0x55feb35537c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35a1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb3597c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb351d2d0 con 0x55feb35973c0 2022-07-05T12:09:15.020 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb3494aa0 con 0x55feb35977a0 2022-07-05T12:09:15.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb34a9950 con 0x55feb3553cb0 2022-07-05T12:09:15.021 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35973c0 0x55feb35537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b217d4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.022 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35973c0 0x55feb35537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60606/0 (socket says 172.21.15.90:60606) 2022-07-05T12:09:15.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 -- 172.21.15.90:0/2223735802 learned_addr learned my addr 172.21.15.90:0/2223735802 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:15.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b227d6700 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb3597c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.023 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 -- 172.21.15.90:0/2223735802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 msgr2=0x55feb35a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 -- 172.21.15.90:0/2223735802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 msgr2=0x55feb3597c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.024 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb3597c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b21fd5700 1 -- 172.21.15.90:0/2223735802 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feb32db9e0 con 0x55feb35973c0 2022-07-05T12:09:15.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.984+0000 7f0b227d6700 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb3597c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:09:15.025 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35973c0 0x55feb35537c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f0b0c0847b0 tx=0x7f0b0c080f30).ready entity=mon.0 client_cookie=9e66165406f21ff3 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:15.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b02ffd700 1 -- 172.21.15.90:0/2223735802 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c08a420 con 0x55feb35973c0 2022-07-05T12:09:15.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b02ffd700 1 -- 172.21.15.90:0/2223735802 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c082ee0 con 0x55feb35973c0 2022-07-05T12:09:15.026 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b02ffd700 1 -- 172.21.15.90:0/2223735802 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c01c350 con 0x55feb35973c0 2022-07-05T12:09:15.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/2223735802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35973c0 msgr2=0x55feb35537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35973c0 0x55feb35537c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f0b0c0847b0 tx=0x7f0b0c080f30).stop 2022-07-05T12:09:15.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/2223735802 shutdown_connections 2022-07-05T12:09:15.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb3597c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35973c0 0x55feb35537c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/2223735802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/2223735802 >> 172.21.15.90:0/2223735802 conn(0x55feb33c21c0 msgr2=0x55feb3556ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:15.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/2223735802 shutdown_connections 2022-07-05T12:09:15.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.985+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/2223735802 wait complete. 2022-07-05T12:09:15.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.986+0000 7f0b35bc5b80 1 -- start start 2022-07-05T12:09:15.029 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.986+0000 7f0b35bc5b80 1 Processor -- start 2022-07-05T12:09:15.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb35d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35973c0 0x55feb35d9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.030 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb35bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb3471120 con 0x55feb3553cb0 2022-07-05T12:09:15.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb35d7310 con 0x55feb35977a0 2022-07-05T12:09:15.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb35924d0 con 0x55feb35973c0 2022-07-05T12:09:15.031 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b35bc5b80 10 client.0 ll_register_callbacks cb 0x55feb35171b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:09:15.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb35d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.032 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb35d8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60610/0 (socket says 172.21.15.90:60610) 2022-07-05T12:09:15.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b21fd5700 1 -- 172.21.15.90:0/1268706273 learned_addr learned my addr 172.21.15.90:0/1268706273 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:15.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.987+0000 7f0b217d4700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35973c0 0x55feb35d9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b227d6700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb35bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b21fd5700 1 -- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35973c0 msgr2=0x55feb35d9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35973c0 0x55feb35d9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b21fd5700 1 -- 172.21.15.90:0/1268706273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 msgr2=0x55feb35bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb35bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b21fd5700 1 -- 172.21.15.90:0/1268706273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c0c8010 con 0x55feb3553cb0 2022-07-05T12:09:15.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b227d6700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb35bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:09:15.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb35d8a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f0b0c084ad0 tx=0x7f0b0c054000).ready entity=mon.0 client_cookie=b78735243d49d37f server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:15.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0af7fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:09:15.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0af7fff700 1 -- 172.21.15.90:0/1268706273 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c01c350 con 0x55feb3553cb0 2022-07-05T12:09:15.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0af7fff700 1 -- 172.21.15.90:0/1268706273 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f0b0c08a420 con 0x55feb3553cb0 2022-07-05T12:09:15.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55feb3551440 con 0x55feb3553cb0 2022-07-05T12:09:15.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0af7fff700 1 -- 172.21.15.90:0/1268706273 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b0c080930 con 0x55feb3553cb0 2022-07-05T12:09:15.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 10 client.6207 fetch_fsmap learned FSMap version 41 2022-07-05T12:09:15.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55feb334acd0 con 0x55feb3553cb0 2022-07-05T12:09:15.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0af7fff700 1 -- 172.21.15.90:0/1268706273 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55feb3551440 con 0x55feb3553cb0 2022-07-05T12:09:15.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0af7fff700 1 -- 172.21.15.90:0/1268706273 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f0b0c080a90 con 0x55feb3553cb0 2022-07-05T12:09:15.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 10 client.6207 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:09:15.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 10 client.6207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:09:15.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 20 client.6207 populate_metadata read hostname 'smithi090' 2022-07-05T12:09:15.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb35959e0 0x55feb35d6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 4 client.6207 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:09:15.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.988+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55feb349f7f0 con 0x55feb35959e0 2022-07-05T12:09:15.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.989+0000 7f0b217d4700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb35959e0 0x55feb35d6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.989+0000 7f0af7fff700 10 client.6207 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:15.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.989+0000 7f0b217d4700 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb35959e0 0x55feb35d6950 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6f6cc5ce5eab93bb server_cookie=882e833daa9cbf82 in_seq=0 out_seq=0 2022-07-05T12:09:15.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0af7fff700 1 -- 172.21.15.90:0/1268706273 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55feb349f7f0 con 0x55feb35959e0 2022-07-05T12:09:15.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0af7fff700 10 client.6207 handle_command_reply: tid=0 2022-07-05T12:09:15.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 client.6207 shutdown 2022-07-05T12:09:15.043 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 msgr2=0x55feb35d8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb35d8a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f0b0c084ad0 tx=0x7f0b0c054000).stop 2022-07-05T12:09:15.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 shutdown_connections 2022-07-05T12:09:15.044 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb35959e0 0x55feb35d6950 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35977a0 0x55feb35bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb35d8a50 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/1268706273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35973c0 0x55feb35d9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.045 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0af7fff700 0 client.6207 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:15.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 >> 172.21.15.90:0/1268706273 conn(0x55feb33c21c0 msgr2=0x55feb3556a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:15.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 shutdown_connections 2022-07-05T12:09:15.046 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/1268706273 wait complete. 2022-07-05T12:09:15.047 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:14.990+0000 7f0b35bc5b80 20 client.6207 trim_cache size 0 max 16384 2022-07-05T12:09:15.059 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.005+0000 7f0b35bc5b80 1 Processor -- start 2022-07-05T12:09:15.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.005+0000 7f0b35bc5b80 1 -- start start 2022-07-05T12:09:15.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb35d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35977a0 0x55feb3553510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.062 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb354dbb0 con 0x55feb35977a0 2022-07-05T12:09:15.063 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb35559c0 con 0x55feb35973c0 2022-07-05T12:09:15.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb359fc50 con 0x55feb3553cb0 2022-07-05T12:09:15.064 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b227d6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35977a0 0x55feb3553510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.065 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b227d6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35977a0 0x55feb3553510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60622/0 (socket says 172.21.15.90:60622) 2022-07-05T12:09:15.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:42014/0 (socket says 172.21.15.90:42014) 2022-07-05T12:09:15.066 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.006+0000 7f0b227d6700 1 -- 172.21.15.90:0/3260523623 learned_addr learned my addr 172.21.15.90:0/3260523623 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:15.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b217d4700 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb35d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.067 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b227d6700 1 -- 172.21.15.90:0/3260523623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 msgr2=0x55feb35ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b227d6700 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.068 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b227d6700 1 -- 172.21.15.90:0/3260523623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 msgr2=0x55feb35d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b227d6700 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb35d4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.069 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b227d6700 1 -- 172.21.15.90:0/3260523623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feb3318fd0 con 0x55feb35977a0 2022-07-05T12:09:15.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b217d4700 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb35d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:09:15.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b227d6700 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35977a0 0x55feb3553510 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f0b14009b40 tx=0x7f0b14008040).ready entity=mon.0 client_cookie=64ae7ba763b7e2ca server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:15.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b037fe700 1 -- 172.21.15.90:0/3260523623 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140096c0 con 0x55feb35977a0 2022-07-05T12:09:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b037fe700 1 -- 172.21.15.90:0/3260523623 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b140157e0 con 0x55feb35977a0 2022-07-05T12:09:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b037fe700 1 -- 172.21.15.90:0/3260523623 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14015950 con 0x55feb35977a0 2022-07-05T12:09:15.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/3260523623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35977a0 msgr2=0x55feb3553510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35977a0 0x55feb3553510 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f0b14009b40 tx=0x7f0b14008040).stop 2022-07-05T12:09:15.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/3260523623 shutdown_connections 2022-07-05T12:09:15.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb35977a0 0x55feb3553510 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb3553cb0 0x55feb35ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/3260523623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb35d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/3260523623 >> 172.21.15.90:0/3260523623 conn(0x55feb33c21c0 msgr2=0x55feb3557d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:15.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/3260523623 shutdown_connections 2022-07-05T12:09:15.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.007+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/3260523623 wait complete. 2022-07-05T12:09:15.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.008+0000 7f0b35bc5b80 1 -- start start 2022-07-05T12:09:15.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.008+0000 7f0b35bc5b80 1 Processor -- start 2022-07-05T12:09:15.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb361dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb3557e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b35bc5b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35977a0 0x55feb362e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb361e0c0 con 0x55feb3553cb0 2022-07-05T12:09:15.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb3558310 con 0x55feb35973c0 2022-07-05T12:09:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b35bc5b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feb35928d0 con 0x55feb35977a0 2022-07-05T12:09:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b35bc5b80 10 client.0 ll_register_callbacks cb 0x55feb35545d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:09:15.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb361dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.009+0000 7f0b21fd5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb361dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60624/0 (socket says 172.21.15.90:60624) 2022-07-05T12:09:15.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b21fd5700 1 -- 172.21.15.90:0/745933217 learned_addr learned my addr 172.21.15.90:0/745933217 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:15.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b227d6700 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35977a0 0x55feb362e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b21fd5700 1 -- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35977a0 msgr2=0x55feb362e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35977a0 0x55feb362e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b21fd5700 1 -- 172.21.15.90:0/745933217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 msgr2=0x55feb3557e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb3557e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b21fd5700 1 -- 172.21.15.90:0/745933217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b14009870 con 0x55feb3553cb0 2022-07-05T12:09:15.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b21fd5700 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb361dbd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f0b0c081040 tx=0x7f0b0c092000).ready entity=mon.0 client_cookie=9834c468ffc4e905 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:15.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0af7fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:09:15.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0af7fff700 1 -- 172.21.15.90:0/745933217 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0a5030 con 0x55feb3553cb0 2022-07-05T12:09:15.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0af7fff700 1 -- 172.21.15.90:0/745933217 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f0b0c0a6070 con 0x55feb3553cb0 2022-07-05T12:09:15.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b0c082ee0 con 0x55feb3553cb0 2022-07-05T12:09:15.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0af7fff700 1 -- 172.21.15.90:0/745933217 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b0c01c350 con 0x55feb3553cb0 2022-07-05T12:09:15.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 10 client.6213 fetch_fsmap learned FSMap version 41 2022-07-05T12:09:15.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55feb361cab0 con 0x55feb3553cb0 2022-07-05T12:09:15.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0af7fff700 1 -- 172.21.15.90:0/745933217 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c082ee0 con 0x55feb3553cb0 2022-07-05T12:09:15.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0af7fff700 1 -- 172.21.15.90:0/745933217 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f0b0c088bd0 con 0x55feb3553cb0 2022-07-05T12:09:15.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 10 client.6213 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:09:15.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 10 client.6213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:09:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 20 client.6213 populate_metadata read hostname 'smithi090' 2022-07-05T12:09:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb359ff20 0x55feb3551c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:15.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 4 client.6213 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:09:15.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.010+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55feb3496690 con 0x55feb359ff20 2022-07-05T12:09:15.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b217d4700 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb359ff20 0x55feb3551c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:15.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0af7fff700 10 client.6213 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:15.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b217d4700 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb359ff20 0x55feb3551c40 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=24b4927f0329fea9 server_cookie=49fa3aecee7da1fd in_seq=0 out_seq=0 2022-07-05T12:09:15.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0af7fff700 1 -- 172.21.15.90:0/745933217 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55feb3496690 con 0x55feb359ff20 2022-07-05T12:09:15.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0af7fff700 10 client.6213 handle_command_reply: tid=0 2022-07-05T12:09:15.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 client.6213 shutdown 2022-07-05T12:09:15.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 msgr2=0x55feb361dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb361dbd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f0b0c081040 tx=0x7f0b0c092000).stop 2022-07-05T12:09:15.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 shutdown_connections 2022-07-05T12:09:15.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55feb359ff20 0x55feb3551c40 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55feb35977a0 0x55feb362e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55feb3553cb0 0x55feb361dbd0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 --2- 172.21.15.90:0/745933217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55feb35973c0 0x55feb3557e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:15.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0af7fff700 0 client.6213 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:15.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 >> 172.21.15.90:0/745933217 conn(0x55feb33c21c0 msgr2=0x55feb361c160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:15.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 shutdown_connections 2022-07-05T12:09:15.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 1 -- 172.21.15.90:0/745933217 wait complete. 2022-07-05T12:09:15.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.011+0000 7f0b35bc5b80 20 client.6213 trim_cache size 0 max 16384 2022-07-05T12:09:15.104 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:09:15.104 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:09:15.105 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:09:15.105 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:09:15.105 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:09:15.106 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:09:15.106 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:09:15.106 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:09:15.107 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:09:15.107 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:09:15.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0afc08ba40 msgr2=0x7f0afc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0afc08ba40 0x7f0afc08df00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f0b10006d10 tx=0x7f0b10017000).stop 2022-07-05T12:09:15.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c178610 msgr2=0x7f0b1c163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:15.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c178610 0x7f0b1c163160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f0b0c00c760 tx=0x7f0b0c001520).stop 2022-07-05T12:09:15.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 shutdown_connections 2022-07-05T12:09:15.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f0afc08ba40 0x7f0afc08df00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b1c17e100 0x7f0b1c0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b1c178610 0x7f0b1c163160 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 --2- 172.21.15.90:0/114698602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b1c1789f0 0x7f0b1c0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:15.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 >> 172.21.15.90:0/114698602 conn(0x7f0b1c0f2210 msgr2=0x7f0b1c0ec010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:15.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 shutdown_connections 2022-07-05T12:09:15.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:15.012+0000 7f0b24239700 1 -- 172.21.15.90:0/114698602 wait complete. 2022-07-05T12:09:15.113 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:09:45.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:09:45.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.243+0000 7f3cd65db700 1 Processor -- start 2022-07-05T12:09:45.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.243+0000 7f3cd65db700 1 -- start start 2022-07-05T12:09:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.244+0000 7f3cd65db700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cd00c87c0 0x7f3cd00e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.244+0000 7f3cd65db700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd017a9e0 con 0x7f3cd017a560 2022-07-05T12:09:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.244+0000 7f3cd65db700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00c8d20 con 0x7f3cd017a180 2022-07-05T12:09:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.244+0000 7f3cd65db700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00c9000 con 0x7f3cd00c87c0 2022-07-05T12:09:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cd4b78700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cd00c87c0 0x7f3cd00e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3ccf7fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3cd017a560 0x7f3cd00c3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53572/0 (socket says 172.21.15.90:53572) 2022-07-05T12:09:45.247 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cd4b78700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cd00c87c0 0x7f3cd00e9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60634/0 (socket says 172.21.15.90:60634) 2022-07-05T12:09:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/930601380 learned_addr learned my addr 172.21.15.90:0/930601380 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:09:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cd4b78700 1 -- 172.21.15.90:0/930601380 >> v1:172.21.15.110:6789/0 conn(0x7f3cd017a180 legacy=0x7f3cd00c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cd4b78700 1 -- 172.21.15.90:0/930601380 >> v1:172.21.15.90:6789/0 conn(0x7f3cd017a560 legacy=0x7f3cd00c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cd4b78700 1 -- 172.21.15.90:0/930601380 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00c92e0 con 0x7f3cd00c87c0 2022-07-05T12:09:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cceffd700 1 -- 172.21.15.90:0/930601380 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622785429 0 0) 0x7f3cd017a9e0 con 0x7f3cd017a560 2022-07-05T12:09:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cd4b78700 1 --2- 172.21.15.90:0/930601380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd00c87c0 0x7f3cd00e9e00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f3cc8009e60 tx=0x7f3cc8009780).ready entity=mon.0 client_cookie=9900d61227cbc156 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cceffd700 1 -- 172.21.15.90:0/930601380 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc800e070 con 0x7f3cd00c87c0 2022-07-05T12:09:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cceffd700 1 -- 172.21.15.90:0/930601380 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc800bc30 con 0x7f3cd00c87c0 2022-07-05T12:09:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.245+0000 7f3cceffd700 1 -- 172.21.15.90:0/930601380 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8012410 con 0x7f3cd00c87c0 2022-07-05T12:09:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.246+0000 7f3cd65db700 1 -- 172.21.15.90:0/930601380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd00c87c0 msgr2=0x7f3cd00e9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.246+0000 7f3cd65db700 1 --2- 172.21.15.90:0/930601380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd00c87c0 0x7f3cd00e9e00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f3cc8009e60 tx=0x7f3cc8009780).stop 2022-07-05T12:09:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.246+0000 7f3cd65db700 1 -- 172.21.15.90:0/930601380 shutdown_connections 2022-07-05T12:09:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.246+0000 7f3cd65db700 1 --2- 172.21.15.90:0/930601380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd00c87c0 0x7f3cd00e9e00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.246+0000 7f3cd65db700 1 -- 172.21.15.90:0/930601380 >> 172.21.15.90:0/930601380 conn(0x7f3cd0083570 msgr2=0x7f3cd0083980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.246+0000 7f3cd65db700 1 -- 172.21.15.90:0/930601380 shutdown_connections 2022-07-05T12:09:45.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.246+0000 7f3cd65db700 1 -- 172.21.15.90:0/930601380 wait complete. 2022-07-05T12:09:45.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.247+0000 7f3cd65db700 1 Processor -- start 2022-07-05T12:09:45.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.247+0000 7f3cd65db700 1 -- start start 2022-07-05T12:09:45.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3cd65db700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cd00c87c0 0x7f3cd014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3cd65db700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd017a180 0x7f3cd0191390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3cd65db700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd017a560 0x7f3cd0191880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.266 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3cd65db700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd016dd00 con 0x7f3cd017a180 2022-07-05T12:09:45.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3cd65db700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd016dfe0 con 0x7f3cd017a560 2022-07-05T12:09:45.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3cd65db700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd018ed70 con 0x7f3cd00c87c0 2022-07-05T12:09:45.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3ccf7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd017a180 0x7f3cd0191390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3ccf7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd017a180 0x7f3cd0191390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60636/0 (socket says 172.21.15.90:60636) 2022-07-05T12:09:45.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/2273824210 learned_addr learned my addr 172.21.15.90:0/2273824210 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:45.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.248+0000 7f3ccffff700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cd00c87c0 0x7f3cd014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.268 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/2273824210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cd00c87c0 msgr2=0x7f3cd014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cd00c87c0 0x7f3cd014efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3cd4b78700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd017a560 0x7f3cd0191880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd017a560 msgr2=0x7f3cd0191880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd017a560 0x7f3cd0191880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/2273824210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009a20 con 0x7f3cd017a180 2022-07-05T12:09:45.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3ccffff700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cd00c87c0 0x7f3cd014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:09:45.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd017a180 0x7f3cd0191390 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f3cc4001eb0 tx=0x7f3cc4007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:45.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3cb7fff700 1 -- 172.21.15.90:0/2273824210 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40072e0 con 0x7f3cd017a180 2022-07-05T12:09:45.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3cb7fff700 1 -- 172.21.15.90:0/2273824210 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4007440 con 0x7f3cd017a180 2022-07-05T12:09:45.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd018f050 con 0x7f3cd017a180 2022-07-05T12:09:45.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3cb7fff700 1 -- 172.21.15.90:0/2273824210 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40057a0 con 0x7f3cd017a180 2022-07-05T12:09:45.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.249+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd018f610 con 0x7f3cd017a180 2022-07-05T12:09:45.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.251+0000 7f3cb7fff700 1 -- 172.21.15.90:0/2273824210 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3cc401a060 con 0x7f3cd017a180 2022-07-05T12:09:45.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.252+0000 7f3cb7fff700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3cb008ba40 0x7f3cb008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.252+0000 7f3cb7fff700 1 -- 172.21.15.90:0/2273824210 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f3cc40b0110 con 0x7f3cd017a180 2022-07-05T12:09:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.252+0000 7f3ccffff700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3cb008ba40 0x7f3cb008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.252+0000 7f3ccffff700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3cb008ba40 0x7f3cb008df00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f3cc0001730 tx=0x7f3cc0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.253+0000 7f3ce7f67b80 1 Processor -- start 2022-07-05T12:09:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.253+0000 7f3ce7f67b80 1 -- start start 2022-07-05T12:09:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a5a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3aa8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3a9ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3a242d0 con 0x563be3a5acb0 2022-07-05T12:09:45.275 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be399baa0 con 0x563be3a9e3c0 2022-07-05T12:09:45.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be39b0950 con 0x563be3a9e7a0 2022-07-05T12:09:45.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ccf7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3aa8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ccf7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3aa8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60646/0 (socket says 172.21.15.90:60646) 2022-07-05T12:09:45.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/1184507276 learned_addr learned my addr 172.21.15.90:0/1184507276 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:45.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3ccffff700 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a5a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.254+0000 7f3cd4b78700 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3a9ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/1184507276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 msgr2=0x563be3a9ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3a9ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/1184507276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 msgr2=0x563be3a5a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a5a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3ccf7fe700 1 -- 172.21.15.90:0/1184507276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563be37e29e0 con 0x563be3a5acb0 2022-07-05T12:09:45.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3aa8990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f3cc4084570 tx=0x7f3cc4080d70).ready entity=mon.0 client_cookie=64604aa94a0bbf0e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:45.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3cb57fa700 1 -- 172.21.15.90:0/1184507276 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4051ea0 con 0x563be3a5acb0 2022-07-05T12:09:45.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3cb57fa700 1 -- 172.21.15.90:0/1184507276 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc408a310 con 0x563be3a5acb0 2022-07-05T12:09:45.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.255+0000 7f3cb57fa700 1 -- 172.21.15.90:0/1184507276 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4081140 con 0x563be3a5acb0 2022-07-05T12:09:45.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1184507276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 msgr2=0x563be3aa8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3aa8990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f3cc4084570 tx=0x7f3cc4080d70).stop 2022-07-05T12:09:45.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1184507276 shutdown_connections 2022-07-05T12:09:45.280 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3a9ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a5a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1184507276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3aa8990 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1184507276 >> 172.21.15.90:0/1184507276 conn(0x563be38c91c0 msgr2=0x563be3a5dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:45.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1184507276 shutdown_connections 2022-07-05T12:09:45.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1184507276 wait complete. 2022-07-05T12:09:45.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 -- start start 2022-07-05T12:09:45.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.256+0000 7f3ce7f67b80 1 Processor -- start 2022-07-05T12:09:45.282 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.257+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3add2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.257+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a99b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.257+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3adc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3978120 con 0x563be3a5acb0 2022-07-05T12:09:45.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3ace980 con 0x563be3a9e3c0 2022-07-05T12:09:45.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3a996d0 con 0x563be3a9e7a0 2022-07-05T12:09:45.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ce7f67b80 10 client.0 ll_register_callbacks cb 0x563be3a1e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:09:45.284 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3add2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3add2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60650/0 (socket says 172.21.15.90:60650) 2022-07-05T12:09:45.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 -- 172.21.15.90:0/742742963 learned_addr learned my addr 172.21.15.90:0/742742963 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:45.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3cd4b78700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3adc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a99b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 -- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 msgr2=0x563be3adc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3adc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 -- 172.21.15.90:0/742742963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 msgr2=0x563be3a99b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a99b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 -- 172.21.15.90:0/742742963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd018f610 con 0x563be3a5acb0 2022-07-05T12:09:45.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a99b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:09:45.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ccffff700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3add2d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f3cc0018470 tx=0x7f3cc001a040).ready entity=mon.0 client_cookie=ee833c8519eb543c server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:45.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3caa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:09:45.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3caa7fc700 1 -- 172.21.15.90:0/742742963 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc001d040 con 0x563be3a5acb0 2022-07-05T12:09:45.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3caa7fc700 1 -- 172.21.15.90:0/742742963 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f3cc0013420 con 0x563be3a5acb0 2022-07-05T12:09:45.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563be3a58440 con 0x563be3a5acb0 2022-07-05T12:09:45.288 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3caa7fc700 1 -- 172.21.15.90:0/742742963 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cc00137f0 con 0x563be3a5acb0 2022-07-05T12:09:45.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ce7f67b80 10 client.6228 fetch_fsmap learned FSMap version 41 2022-07-05T12:09:45.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x563be3851cd0 con 0x563be3a5acb0 2022-07-05T12:09:45.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.258+0000 7f3caa7fc700 1 -- 172.21.15.90:0/742742963 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563be3a58440 con 0x563be3a5acb0 2022-07-05T12:09:45.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3caa7fc700 1 -- 172.21.15.90:0/742742963 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f3cc0013950 con 0x563be3a5acb0 2022-07-05T12:09:45.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ce7f67b80 10 client.6228 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:09:45.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ce7f67b80 10 client.6228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:09:45.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ce7f67b80 20 client.6228 populate_metadata read hostname 'smithi090' 2022-07-05T12:09:45.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3a92e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ce7f67b80 4 client.6228 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:09:45.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563be39a67f0 con 0x563be3aa8540 2022-07-05T12:09:45.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3a92e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3caa7fc700 10 client.6228 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:45.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.259+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3a92e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=43b46968e41b0ff server_cookie=4d735c6deba657d7 in_seq=0 out_seq=0 2022-07-05T12:09:45.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3caa7fc700 1 -- 172.21.15.90:0/742742963 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x563be39a67f0 con 0x563be3aa8540 2022-07-05T12:09:45.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3caa7fc700 10 client.6228 handle_command_reply: tid=0 2022-07-05T12:09:45.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 client.6228 shutdown 2022-07-05T12:09:45.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 msgr2=0x563be3add2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3add2d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f3cc0018470 tx=0x7f3cc001a040).stop 2022-07-05T12:09:45.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 shutdown_connections 2022-07-05T12:09:45.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3a92e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3adc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3caa7fc700 0 client.6228 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:45.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3add2d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/742742963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3a99b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 >> 172.21.15.90:0/742742963 conn(0x563be38c91c0 msgr2=0x563be3acb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:45.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 shutdown_connections 2022-07-05T12:09:45.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/742742963 wait complete. 2022-07-05T12:09:45.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.260+0000 7f3ce7f67b80 20 client.6228 trim_cache size 0 max 16384 2022-07-05T12:09:45.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.276+0000 7f3ce7f67b80 1 Processor -- start 2022-07-05T12:09:45.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.276+0000 7f3ce7f67b80 1 -- start start 2022-07-05T12:09:45.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a5acb0 0x563be3a5c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3b26510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a9e7a0 0x563be3a64c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3aa5de0 con 0x563be3a9e7a0 2022-07-05T12:09:45.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3a5e200 con 0x563be3a9e3c0 2022-07-05T12:09:45.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3aa7da0 con 0x563be3a5acb0 2022-07-05T12:09:45.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a9e7a0 0x563be3a64c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a9e7a0 0x563be3a64c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60662/0 (socket says 172.21.15.90:60662) 2022-07-05T12:09:45.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 -- 172.21.15.90:0/616830615 learned_addr learned my addr 172.21.15.90:0/616830615 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:45.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3b26510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 -- 172.21.15.90:0/616830615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a5acb0 msgr2=0x563be3a5c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a5acb0 0x563be3a5c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:45.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 -- 172.21.15.90:0/616830615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 msgr2=0x563be3b26510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3b26510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.277+0000 7f3cd4b78700 1 -- 172.21.15.90:0/616830615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563be381ffd0 con 0x563be3a9e7a0 2022-07-05T12:09:45.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3cd4b78700 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a9e7a0 0x563be3a64c30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f3cd0084f10 tx=0x7f3cd017ab90).ready entity=mon.0 client_cookie=ed952c9802f471c6 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:45.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3cb5ffb700 1 -- 172.21.15.90:0/616830615 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8023070 con 0x563be3a9e7a0 2022-07-05T12:09:45.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3cb5ffb700 1 -- 172.21.15.90:0/616830615 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc8012780 con 0x563be3a9e7a0 2022-07-05T12:09:45.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3cb5ffb700 1 -- 172.21.15.90:0/616830615 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8012b00 con 0x563be3a9e7a0 2022-07-05T12:09:45.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/616830615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a9e7a0 msgr2=0x563be3a64c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a9e7a0 0x563be3a64c30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f3cd0084f10 tx=0x7f3cd017ab90).stop 2022-07-05T12:09:45.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/616830615 shutdown_connections 2022-07-05T12:09:45.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a9e7a0 0x563be3a64c30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a5acb0 0x563be3a5c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:45.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/616830615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3b26510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/616830615 >> 172.21.15.90:0/616830615 conn(0x563be38c91c0 msgr2=0x563be3aa69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:45.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/616830615 shutdown_connections 2022-07-05T12:09:45.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.278+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/616830615 wait complete. 2022-07-05T12:09:45.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.279+0000 7f3ce7f67b80 1 -- start start 2022-07-05T12:09:45.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.279+0000 7f3ce7f67b80 1 Processor -- start 2022-07-05T12:09:45.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3b35e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3b33240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ce7f67b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3b22870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3a63bc0 con 0x563be3a5acb0 2022-07-05T12:09:45.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3b32db0 con 0x563be3a9e3c0 2022-07-05T12:09:45.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ce7f67b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be3a636f0 con 0x563be3a9e7a0 2022-07-05T12:09:45.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ce7f67b80 10 client.0 ll_register_callbacks cb 0x563be3a1e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:09:45.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3b35e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3b35e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60664/0 (socket says 172.21.15.90:60664) 2022-07-05T12:09:45.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ccffff700 1 -- 172.21.15.90:0/1640605162 learned_addr learned my addr 172.21.15.90:0/1640605162 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:09:45.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.280+0000 7f3ccffff700 1 -- 172.21.15.90:0/1640605162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 msgr2=0x563be3b22870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ccffff700 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3b22870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:45.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ccffff700 1 -- 172.21.15.90:0/1640605162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 msgr2=0x563be3b33240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:09:45.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ccffff700 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3b33240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:45.314 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ccffff700 1 -- 172.21.15.90:0/1640605162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00c92e0 con 0x563be3a5acb0 2022-07-05T12:09:45.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ccffff700 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3b35e80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f3cc0007930 tx=0x7f3cc0013000).ready entity=mon.0 client_cookie=5d8db8429042f2ee server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:09:45.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3caa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:09:45.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3caa7fc700 1 -- 172.21.15.90:0/1640605162 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc001d030 con 0x563be3a5acb0 2022-07-05T12:09:45.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3caa7fc700 1 -- 172.21.15.90:0/1640605162 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f3cc00137f0 con 0x563be3a5acb0 2022-07-05T12:09:45.315 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cc408a310 con 0x563be3a5acb0 2022-07-05T12:09:45.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3caa7fc700 1 -- 172.21.15.90:0/1640605162 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cc0023470 con 0x563be3a5acb0 2022-07-05T12:09:45.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 10 client.6234 fetch_fsmap learned FSMap version 41 2022-07-05T12:09:45.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x563be3b36780 con 0x563be3a5acb0 2022-07-05T12:09:45.316 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3caa7fc700 1 -- 172.21.15.90:0/1640605162 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc408a310 con 0x563be3a5acb0 2022-07-05T12:09:45.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3caa7fc700 1 -- 172.21.15.90:0/1640605162 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f3cc0035060 con 0x563be3a5acb0 2022-07-05T12:09:45.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 10 client.6234 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:09:45.317 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 10 client.6234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:09:45.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 20 client.6234 populate_metadata read hostname 'smithi090' 2022-07-05T12:09:45.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3ae4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:09:45.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 4 client.6234 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:09:45.318 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563be399d690 con 0x563be3aa8540 2022-07-05T12:09:45.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.281+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3ae4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:09:45.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3caa7fc700 10 client.6234 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:45.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ccf7fe700 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3ae4060 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=82cfd161a839bc68 server_cookie=b77a43c39a076a67 in_seq=0 out_seq=0 2022-07-05T12:09:45.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3caa7fc700 1 -- 172.21.15.90:0/1640605162 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563be399d690 con 0x563be3aa8540 2022-07-05T12:09:45.319 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3caa7fc700 10 client.6234 handle_command_reply: tid=0 2022-07-05T12:09:45.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 client.6234 shutdown 2022-07-05T12:09:45.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 msgr2=0x563be3b35e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3b35e80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f3cc0007930 tx=0x7f3cc0013000).stop 2022-07-05T12:09:45.320 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 shutdown_connections 2022-07-05T12:09:45.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x563be3aa8540 0x563be3ae4060 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563be3a9e7a0 0x563be3b22870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:45.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563be3a5acb0 0x563be3b35e80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.321 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3caa7fc700 0 client.6234 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:09:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 --2- 172.21.15.90:0/1640605162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563be3a9e3c0 0x563be3b33240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:09:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 >> 172.21.15.90:0/1640605162 conn(0x563be38c91c0 msgr2=0x563be3a5da10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 shutdown_connections 2022-07-05T12:09:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 1 -- 172.21.15.90:0/1640605162 wait complete. 2022-07-05T12:09:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.282+0000 7f3ce7f67b80 20 client.6234 trim_cache size 0 max 16384 2022-07-05T12:09:45.323 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:09:45.324 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:09:45.324 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:09:45.324 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:09:45.324 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:09:45.325 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:09:45.325 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:09:45.325 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:09:45.325 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:09:45.325 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:09:45.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3cb008ba40 msgr2=0x7f3cb008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3cb008ba40 0x7f3cb008df00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f3cc0001730 tx=0x7f3cc0009040).stop 2022-07-05T12:09:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd017a180 msgr2=0x7f3cd0191390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:09:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd017a180 0x7f3cd0191390 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f3cc4001eb0 tx=0x7f3cc4007e90).stop 2022-07-05T12:09:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 shutdown_connections 2022-07-05T12:09:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f3cb008ba40 0x7f3cb008df00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd017a560 0x7f3cd0191880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cd00c87c0 0x7f3cd014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 --2- 172.21.15.90:0/2273824210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cd017a180 0x7f3cd0191390 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:09:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 >> 172.21.15.90:0/2273824210 conn(0x7f3cd0083570 msgr2=0x7f3cd00f05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:09:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 shutdown_connections 2022-07-05T12:09:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:09:45.283+0000 7f3cd65db700 1 -- 172.21.15.90:0/2273824210 wait complete. 2022-07-05T12:09:45.331 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:10:15.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:10:15.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.882+0000 7f395eec2700 1 Processor -- start 2022-07-05T12:10:15.882 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.882+0000 7f395eec2700 1 -- start start 2022-07-05T12:10:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395eec2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3958178610 0x7f39581789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395eec2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f395817e100 0x7f3958063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395eec2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395817d560 con 0x7f395817f3b0 2022-07-05T12:10:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395eec2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395817f830 con 0x7f3958178610 2022-07-05T12:10:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395eec2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395817c670 con 0x7f395817e100 2022-07-05T12:10:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395d45f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f395817e100 0x7f3958063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395d45f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f395817e100 0x7f3958063bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:42070/0 (socket says 172.21.15.90:42070) 2022-07-05T12:10:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f3957fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f395817f3b0 0x7f395817d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.90:49858/0 (socket says 172.21.15.90:49858) 2022-07-05T12:10:15.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395d45f700 1 -- 172.21.15.90:0/13133400 learned_addr learned my addr 172.21.15.90:0/13133400 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:15.906 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395cc5e700 1 --2- 172.21.15.90:0/13133400 >> v2:172.21.15.110:3300/0 conn(0x7f3958178610 0x7f39581789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f39577fe700 1 -- 172.21.15.90:0/13133400 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780924340 0 0) 0x7f395817d560 con 0x7f395817f3b0 2022-07-05T12:10:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f39577fe700 1 -- 172.21.15.90:0/13133400 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39380033f0 con 0x7f395817f3b0 2022-07-05T12:10:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395cc5e700 1 -- 172.21.15.90:0/13133400 >> v2:172.21.15.149:3300/0 conn(0x7f395817e100 msgr2=0x7f3958063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395cc5e700 1 --2- 172.21.15.90:0/13133400 >> v2:172.21.15.149:3300/0 conn(0x7f395817e100 0x7f3958063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.883+0000 7f395cc5e700 1 -- 172.21.15.90:0/13133400 >> v1:172.21.15.149:6789/0 conn(0x7f395817f3b0 legacy=0x7f395817d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395cc5e700 1 -- 172.21.15.90:0/13133400 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395817c950 con 0x7f3958178610 2022-07-05T12:10:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395d45f700 1 --2- 172.21.15.90:0/13133400 >> v2:172.21.15.149:3300/0 conn(0x7f395817e100 0x7f3958063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-07-05T12:10:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395cc5e700 1 --2- 172.21.15.90:0/13133400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3958178610 0x7f39581789f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f395817c480 tx=0x7f3948009060).ready entity=mon.1 client_cookie=70a2fb7b75ce9ffb server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f39577fe700 1 -- 172.21.15.90:0/13133400 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480090d0 con 0x7f3958178610 2022-07-05T12:10:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f39577fe700 1 -- 172.21.15.90:0/13133400 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394800d4a0 con 0x7f3958178610 2022-07-05T12:10:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f39577fe700 1 -- 172.21.15.90:0/13133400 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800d820 con 0x7f3958178610 2022-07-05T12:10:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 -- 172.21.15.90:0/13133400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3958178610 msgr2=0x7f39581789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 --2- 172.21.15.90:0/13133400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3958178610 0x7f39581789f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f395817c480 tx=0x7f3948009060).stop 2022-07-05T12:10:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 -- 172.21.15.90:0/13133400 shutdown_connections 2022-07-05T12:10:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 --2- 172.21.15.90:0/13133400 >> v2:172.21.15.149:3300/0 conn(0x7f395817e100 0x7f3958063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 --2- 172.21.15.90:0/13133400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3958178610 0x7f39581789f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 -- 172.21.15.90:0/13133400 >> 172.21.15.90:0/13133400 conn(0x7f39580f2210 msgr2=0x7f3958069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 -- 172.21.15.90:0/13133400 shutdown_connections 2022-07-05T12:10:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.884+0000 7f395eec2700 1 -- 172.21.15.90:0/13133400 wait complete. 2022-07-05T12:10:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.886+0000 7f395eec2700 1 Processor -- start 2022-07-05T12:10:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.886+0000 7f395eec2700 1 -- start start 2022-07-05T12:10:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395eec2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958178610 0x7f3958159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395eec2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f395817e100 0x7f3958191930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395eec2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f395817f3b0 0x7f3958191e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395eec2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395817f970 con 0x7f395817e100 2022-07-05T12:10:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395eec2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958180a70 con 0x7f395817f3b0 2022-07-05T12:10:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395eec2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958192310 con 0x7f3958178610 2022-07-05T12:10:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f395817e100 0x7f3958191930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f395817e100 0x7f3958191930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60678/0 (socket says 172.21.15.90:60678) 2022-07-05T12:10:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 -- 172.21.15.90:0/821333111 learned_addr learned my addr 172.21.15.90:0/821333111 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395cc5e700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958178610 0x7f3958159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f395d45f700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f395817f3b0 0x7f3958191e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 -- 172.21.15.90:0/821333111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958178610 msgr2=0x7f3958159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.917 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958178610 0x7f3958159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 -- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f395817f3b0 msgr2=0x7f3958191e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.918 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f395817f3b0 0x7f3958191e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.887+0000 7f3957fff700 1 -- 172.21.15.90:0/821333111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950009350 con 0x7f395817e100 2022-07-05T12:10:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.888+0000 7f3957fff700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f395817e100 0x7f3958191930 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f394000c740 tx=0x7f39400015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.888+0000 7f3954ff9700 1 -- 172.21.15.90:0/821333111 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940005c70 con 0x7f395817e100 2022-07-05T12:10:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.888+0000 7f3954ff9700 1 -- 172.21.15.90:0/821333111 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940005df0 con 0x7f395817e100 2022-07-05T12:10:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.888+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39480092a0 con 0x7f395817e100 2022-07-05T12:10:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.888+0000 7f3954ff9700 1 -- 172.21.15.90:0/821333111 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940007320 con 0x7f395817e100 2022-07-05T12:10:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.888+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395817fe60 con 0x7f395817e100 2022-07-05T12:10:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.889+0000 7f3954ff9700 1 -- 172.21.15.90:0/821333111 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3940010070 con 0x7f395817e100 2022-07-05T12:10:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.890+0000 7f3954ff9700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f393c08ba40 0x7f393c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.890+0000 7f3954ff9700 1 -- 172.21.15.90:0/821333111 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f39400b0040 con 0x7f395817e100 2022-07-05T12:10:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.890+0000 7f395cc5e700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f393c08ba40 0x7f393c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.890+0000 7f395cc5e700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f393c08ba40 0x7f393c08df00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f3948009fd0 tx=0x7f3948016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:15.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.891+0000 7f397084eb80 1 Processor -- start 2022-07-05T12:10:15.924 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.891+0000 7f397084eb80 1 -- start start 2022-07-05T12:10:15.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.892+0000 7f397084eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a3c0 0x560abe7c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.925 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.892+0000 7f397084eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe7c6cb0 0x560abe814990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.892+0000 7f397084eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a7a0 0x560abe80ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.892+0000 7f397084eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe7902d0 con 0x560abe80a3c0 2022-07-05T12:10:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.892+0000 7f397084eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe707aa0 con 0x560abe7c6cb0 2022-07-05T12:10:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.892+0000 7f397084eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe71c950 con 0x560abe80a7a0 2022-07-05T12:10:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.892+0000 7f395cc5e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a3c0 0x560abe7c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a3c0 0x560abe7c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60686/0 (socket says 172.21.15.90:60686) 2022-07-05T12:10:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 -- 172.21.15.90:0/97575010 learned_addr learned my addr 172.21.15.90:0/97575010 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395d45f700 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a7a0 0x560abe80ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f3957fff700 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe7c6cb0 0x560abe814990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 -- 172.21.15.90:0/97575010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a7a0 msgr2=0x560abe80ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a7a0 0x560abe80ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 -- 172.21.15.90:0/97575010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe7c6cb0 msgr2=0x560abe814990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe7c6cb0 0x560abe814990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.931 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 -- 172.21.15.90:0/97575010 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560abe54e9e0 con 0x560abe80a3c0 2022-07-05T12:10:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f3957fff700 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe7c6cb0 0x560abe814990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:10:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f395cc5e700 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a3c0 0x560abe7c67c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f3958088a70 tx=0x7f394801f070).ready entity=mon.0 client_cookie=7ff173ef8a211edc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f394dffb700 1 -- 172.21.15.90:0/97575010 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948027430 con 0x560abe80a3c0 2022-07-05T12:10:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f394dffb700 1 -- 172.21.15.90:0/97575010 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948027590 con 0x560abe80a3c0 2022-07-05T12:10:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.893+0000 7f394dffb700 1 -- 172.21.15.90:0/97575010 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948027910 con 0x560abe80a3c0 2022-07-05T12:10:15.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 -- 172.21.15.90:0/97575010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a3c0 msgr2=0x560abe7c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.934 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a3c0 0x560abe7c67c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f3958088a70 tx=0x7f394801f070).stop 2022-07-05T12:10:15.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 -- 172.21.15.90:0/97575010 shutdown_connections 2022-07-05T12:10:15.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a7a0 0x560abe80ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.935 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a3c0 0x560abe7c67c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 --2- 172.21.15.90:0/97575010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe7c6cb0 0x560abe814990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 -- 172.21.15.90:0/97575010 >> 172.21.15.90:0/97575010 conn(0x560abe6351c0 msgr2=0x560abe7c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 -- 172.21.15.90:0/97575010 shutdown_connections 2022-07-05T12:10:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 -- 172.21.15.90:0/97575010 wait complete. 2022-07-05T12:10:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.894+0000 7f397084eb80 1 -- start start 2022-07-05T12:10:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.895+0000 7f397084eb80 1 Processor -- start 2022-07-05T12:10:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe7c6cb0 0x560abe7fc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe84bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe6e4120 con 0x560abe7c6cb0 2022-07-05T12:10:15.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe849ce0 con 0x560abe80a7a0 2022-07-05T12:10:15.938 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe80dc30 con 0x560abe80a3c0 2022-07-05T12:10:15.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 10 client.0 ll_register_callbacks cb 0x560abe78a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:10:15.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe7c6cb0 0x560abe7fc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe7c6cb0 0x560abe7fc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60692/0 (socket says 172.21.15.90:60692) 2022-07-05T12:10:15.939 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 -- 172.21.15.90:0/244014858 learned_addr learned my addr 172.21.15.90:0/244014858 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f3957fff700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395d45f700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe84bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 -- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 msgr2=0x560abe80e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 -- 172.21.15.90:0/244014858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 msgr2=0x560abe84bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe84bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 -- 172.21.15.90:0/244014858 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395817c950 con 0x560abe7c6cb0 2022-07-05T12:10:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395d45f700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe84bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:10:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f395cc5e700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe7c6cb0 0x560abe7fc060 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f394800d260 tx=0x7f3948027000).ready entity=mon.0 client_cookie=eb11c1ca8950674b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f392effd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:10:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f392effd700 1 -- 172.21.15.90:0/244014858 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480116e0 con 0x560abe7c6cb0 2022-07-05T12:10:15.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f392effd700 1 -- 172.21.15.90:0/244014858 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f3948011840 con 0x560abe7c6cb0 2022-07-05T12:10:15.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560abe7c4440 con 0x560abe7c6cb0 2022-07-05T12:10:15.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f392effd700 1 -- 172.21.15.90:0/244014858 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3948011c10 con 0x560abe7c6cb0 2022-07-05T12:10:15.943 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 10 client.6243 fetch_fsmap learned FSMap version 41 2022-07-05T12:10:15.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x560abe5bdcd0 con 0x560abe7c6cb0 2022-07-05T12:10:15.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.896+0000 7f392effd700 1 -- 172.21.15.90:0/244014858 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560abe7c4440 con 0x560abe7c6cb0 2022-07-05T12:10:15.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f392effd700 1 -- 172.21.15.90:0/244014858 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f3948030460 con 0x560abe7c6cb0 2022-07-05T12:10:15.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f397084eb80 10 client.6243 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:10:15.944 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f397084eb80 10 client.6243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:10:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f397084eb80 20 client.6243 populate_metadata read hostname 'smithi090' 2022-07-05T12:10:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f397084eb80 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe848640 0x560abe83c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f397084eb80 4 client.6243 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:10:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560abe7127f0 con 0x560abe848640 2022-07-05T12:10:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f3957fff700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe848640 0x560abe83c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f392effd700 10 client.6243 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.897+0000 7f3957fff700 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe848640 0x560abe83c5b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=da16ca3e3417e1c3 server_cookie=ba6cf97ca72de18d in_seq=0 out_seq=0 2022-07-05T12:10:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f392effd700 1 -- 172.21.15.90:0/244014858 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x560abe7127f0 con 0x560abe848640 2022-07-05T12:10:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f392effd700 10 client.6243 handle_command_reply: tid=0 2022-07-05T12:10:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 client.6243 shutdown 2022-07-05T12:10:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe7c6cb0 msgr2=0x560abe7fc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe7c6cb0 0x560abe7fc060 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f394800d260 tx=0x7f3948027000).stop 2022-07-05T12:10:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 shutdown_connections 2022-07-05T12:10:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe848640 0x560abe83c5b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe84bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe7c6cb0 0x560abe7fc060 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f392effd700 0 client.6243 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 --2- 172.21.15.90:0/244014858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 >> 172.21.15.90:0/244014858 conn(0x560abe6351c0 msgr2=0x560abe7c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 shutdown_connections 2022-07-05T12:10:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 1 -- 172.21.15.90:0/244014858 wait complete. 2022-07-05T12:10:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.898+0000 7f397084eb80 20 client.6243 trim_cache size 0 max 16384 2022-07-05T12:10:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.914+0000 7f397084eb80 1 Processor -- start 2022-07-05T12:10:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.914+0000 7f397084eb80 1 -- start start 2022-07-05T12:10:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f397084eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe7c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f397084eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a7a0 0x560abe7c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f397084eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe814880 0x560abe7d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f397084eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe7c7410 con 0x560abe80a7a0 2022-07-05T12:10:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f397084eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe814120 con 0x560abe814880 2022-07-05T12:10:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f397084eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe80d5f0 con 0x560abe80a3c0 2022-07-05T12:10:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a7a0 0x560abe7c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a7a0 0x560abe7c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60700/0 (socket says 172.21.15.90:60700) 2022-07-05T12:10:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 -- 172.21.15.90:0/3723011491 learned_addr learned my addr 172.21.15.90:0/3723011491 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f395cc5e700 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe7c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 -- 172.21.15.90:0/3723011491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 msgr2=0x560abe7c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe7c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 -- 172.21.15.90:0/3723011491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe814880 msgr2=0x560abe7d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe814880 0x560abe7d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:10:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 -- 172.21.15.90:0/3723011491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560abe58bfd0 con 0x560abe80a7a0 2022-07-05T12:10:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f3957fff700 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a7a0 0x560abe7c7680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f3940084580 tx=0x7f3940054040).ready entity=mon.0 client_cookie=996129cb8e7ba032 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f394e7fc700 1 -- 172.21.15.90:0/3723011491 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940057040 con 0x560abe80a7a0 2022-07-05T12:10:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f394e7fc700 1 -- 172.21.15.90:0/3723011491 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940001640 con 0x560abe80a7a0 2022-07-05T12:10:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.915+0000 7f394e7fc700 1 -- 172.21.15.90:0/3723011491 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940082d00 con 0x560abe80a7a0 2022-07-05T12:10:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 -- 172.21.15.90:0/3723011491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a7a0 msgr2=0x560abe7c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a7a0 0x560abe7c7680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f3940084580 tx=0x7f3940054040).stop 2022-07-05T12:10:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 -- 172.21.15.90:0/3723011491 shutdown_connections 2022-07-05T12:10:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe814880 0x560abe7d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:10:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe7c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 --2- 172.21.15.90:0/3723011491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe80a7a0 0x560abe7c7680 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 -- 172.21.15.90:0/3723011491 >> 172.21.15.90:0/3723011491 conn(0x560abe6351c0 msgr2=0x560abe83b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 -- 172.21.15.90:0/3723011491 shutdown_connections 2022-07-05T12:10:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.916+0000 7f397084eb80 1 -- 172.21.15.90:0/3723011491 wait complete. 2022-07-05T12:10:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.917+0000 7f397084eb80 1 -- start start 2022-07-05T12:10:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.917+0000 7f397084eb80 1 Processor -- start 2022-07-05T12:10:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe808db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe814880 0x560abe83a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe8134e0 con 0x560abe814880 2022-07-05T12:10:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe83b0a0 con 0x560abe80a7a0 2022-07-05T12:10:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560abe8092a0 con 0x560abe80a3c0 2022-07-05T12:10:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 10 client.0 ll_register_callbacks cb 0x560abe78a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:10:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe814880 0x560abe83a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe814880 0x560abe83a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60708/0 (socket says 172.21.15.90:60708) 2022-07-05T12:10:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 -- 172.21.15.90:0/2417212293 learned_addr learned my addr 172.21.15.90:0/2417212293 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395cc5e700 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f3957fff700 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe808db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 -- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 msgr2=0x560abe80d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 -- 172.21.15.90:0/2417212293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 msgr2=0x560abe808db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe808db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 -- 172.21.15.90:0/2417212293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395817fe60 con 0x560abe814880 2022-07-05T12:10:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f395d45f700 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe814880 0x560abe83a3d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f3950006b50 tx=0x7f3950008040).ready entity=mon.0 client_cookie=c78cc5b037dd920d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f392effd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:10:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f392effd700 1 -- 172.21.15.90:0/2417212293 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39500097f0 con 0x560abe814880 2022-07-05T12:10:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f392effd700 1 -- 172.21.15.90:0/2417212293 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f3950017650 con 0x560abe814880 2022-07-05T12:10:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3948027590 con 0x560abe814880 2022-07-05T12:10:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f392effd700 1 -- 172.21.15.90:0/2417212293 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3950017810 con 0x560abe814880 2022-07-05T12:10:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.918+0000 7f397084eb80 10 client.6249 fetch_fsmap learned FSMap version 41 2022-07-05T12:10:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x560abe8a1f50 con 0x560abe814880 2022-07-05T12:10:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f392effd700 1 -- 172.21.15.90:0/2417212293 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948027590 con 0x560abe814880 2022-07-05T12:10:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f392effd700 1 -- 172.21.15.90:0/2417212293 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f3950017970 con 0x560abe814880 2022-07-05T12:10:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 10 client.6249 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:10:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 10 client.6249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:10:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 20 client.6249 populate_metadata read hostname 'smithi090' 2022-07-05T12:10:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe7c0d10 0x560abe88be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:15.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 4 client.6249 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:10:15.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560abe709690 con 0x560abe7c0d10 2022-07-05T12:10:15.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f395cc5e700 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe7c0d10 0x560abe88be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:15.971 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f392effd700 10 client.6249 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:15.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f395cc5e700 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe7c0d10 0x560abe88be90 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=305644661df0ac5d server_cookie=c61668ffba387408 in_seq=0 out_seq=0 2022-07-05T12:10:15.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f392effd700 1 -- 172.21.15.90:0/2417212293 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560abe709690 con 0x560abe7c0d10 2022-07-05T12:10:15.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f392effd700 10 client.6249 handle_command_reply: tid=0 2022-07-05T12:10:15.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.919+0000 7f397084eb80 1 client.6249 shutdown 2022-07-05T12:10:15.972 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe814880 msgr2=0x560abe83a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe814880 0x560abe83a3d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f3950006b50 tx=0x7f3950008040).stop 2022-07-05T12:10:15.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 shutdown_connections 2022-07-05T12:10:15.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x560abe7c0d10 0x560abe88be90 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560abe814880 0x560abe83a3d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560abe80a3c0 0x560abe80d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 --2- 172.21.15.90:0/2417212293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560abe80a7a0 0x560abe808db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f392effd700 0 client.6249 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:15.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 >> 172.21.15.90:0/2417212293 conn(0x560abe6351c0 msgr2=0x560abe833370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:15.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 shutdown_connections 2022-07-05T12:10:15.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 1 -- 172.21.15.90:0/2417212293 wait complete. 2022-07-05T12:10:15.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f397084eb80 20 client.6249 trim_cache size 0 max 16384 2022-07-05T12:10:15.975 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:10:15.976 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:10:15.976 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:10:15.976 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:10:15.976 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:10:15.977 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:10:15.977 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:10:15.977 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:10:15.977 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:10:15.978 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:10:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f393c08ba40 msgr2=0x7f393c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f393c08ba40 0x7f393c08df00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f3948009fd0 tx=0x7f3948016000).stop 2022-07-05T12:10:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f395817e100 msgr2=0x7f3958191930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f395817e100 0x7f3958191930 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f394000c740 tx=0x7f39400015b0).stop 2022-07-05T12:10:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 shutdown_connections 2022-07-05T12:10:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f393c08ba40 0x7f393c08df00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f395817f3b0 0x7f3958191e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958178610 0x7f3958159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 --2- 172.21.15.90:0/821333111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f395817e100 0x7f3958191930 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 >> 172.21.15.90:0/821333111 conn(0x7f39580f2210 msgr2=0x7f3958173390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 shutdown_connections 2022-07-05T12:10:15.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:15.920+0000 7f395eec2700 1 -- 172.21.15.90:0/821333111 wait complete. 2022-07-05T12:10:15.982 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:10:45.983 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:10:46.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.111+0000 7faee2a28700 1 Processor -- start 2022-07-05T12:10:46.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.111+0000 7faee2a28700 1 -- start start 2022-07-05T12:10:46.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faee2a28700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faedc178610 0x7faedc1789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faee2a28700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faedc17e100 0x7faedc063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faee2a28700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc17d560 con 0x7faedc17f3b0 2022-07-05T12:10:46.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faee2a28700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc17f830 con 0x7faedc178610 2022-07-05T12:10:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faee2a28700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc17c670 con 0x7faedc17e100 2022-07-05T12:10:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faedc178610 0x7faedc1789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faedc178610 0x7faedc1789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60712/0 (socket says 172.21.15.90:60712) 2022-07-05T12:10:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 -- 172.21.15.90:0/2624353168 learned_addr learned my addr 172.21.15.90:0/2624353168 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:46.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faee0fc5700 1 --2- 172.21.15.90:0/2624353168 >> v2:172.21.15.149:3300/0 conn(0x7faedc17e100 0x7faedc063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 -- 172.21.15.90:0/2624353168 >> v2:172.21.15.149:3300/0 conn(0x7faedc17e100 msgr2=0x7faedc063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 --2- 172.21.15.90:0/2624353168 >> v2:172.21.15.149:3300/0 conn(0x7faedc17e100 0x7faedc063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 -- 172.21.15.90:0/2624353168 >> v1:172.21.15.110:6789/0 conn(0x7faedc17f3b0 legacy=0x7faedc17d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 -- 172.21.15.90:0/2624353168 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc17c950 con 0x7faedc178610 2022-07-05T12:10:46.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedbfff700 1 --2- 172.21.15.90:0/2624353168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc1789f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7faedc17c480 tx=0x7faecc0090f0).ready entity=mon.0 client_cookie=a183ddec2ab09d15 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:46.228 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedaffd700 1 -- 172.21.15.90:0/2624353168 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00b520 con 0x7faedc178610 2022-07-05T12:10:46.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedaffd700 1 -- 172.21.15.90:0/2624353168 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00b680 con 0x7faedc178610 2022-07-05T12:10:46.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.112+0000 7faedaffd700 1 -- 172.21.15.90:0/2624353168 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00ba20 con 0x7faedc178610 2022-07-05T12:10:46.229 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 -- 172.21.15.90:0/2624353168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 msgr2=0x7faedc1789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.230 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 --2- 172.21.15.90:0/2624353168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc1789f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7faedc17c480 tx=0x7faecc0090f0).stop 2022-07-05T12:10:46.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 -- 172.21.15.90:0/2624353168 shutdown_connections 2022-07-05T12:10:46.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 --2- 172.21.15.90:0/2624353168 >> v2:172.21.15.149:3300/0 conn(0x7faedc17e100 0x7faedc063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.231 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 --2- 172.21.15.90:0/2624353168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc1789f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 -- 172.21.15.90:0/2624353168 >> 172.21.15.90:0/2624353168 conn(0x7faedc0f2210 msgr2=0x7faedc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:46.232 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 -- 172.21.15.90:0/2624353168 shutdown_connections 2022-07-05T12:10:46.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.113+0000 7faee2a28700 1 -- 172.21.15.90:0/2624353168 wait complete. 2022-07-05T12:10:46.233 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.114+0000 7faee2a28700 1 Processor -- start 2022-07-05T12:10:46.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.115+0000 7faee2a28700 1 -- start start 2022-07-05T12:10:46.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc171880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.234 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc17e100 0x7faedc171d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc17f3b0 0x7faedc17a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc179e60 con 0x7faedc178610 2022-07-05T12:10:46.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c8e60 con 0x7faedc17f3b0 2022-07-05T12:10:46.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc178f70 con 0x7faedc17e100 2022-07-05T12:10:46.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc171880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc171880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60718/0 (socket says 172.21.15.90:60718) 2022-07-05T12:10:46.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 -- 172.21.15.90:0/3851254658 learned_addr learned my addr 172.21.15.90:0/3851254658 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:46.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedb7fe700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc17e100 0x7faedc171d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee0fc5700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc17f3b0 0x7faedc17a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 -- 172.21.15.90:0/3851254658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc17e100 msgr2=0x7faedc171d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc17e100 0x7faedc171d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 -- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc17f3b0 msgr2=0x7faedc17a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc17f3b0 0x7faedc17a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 -- 172.21.15.90:0/3851254658 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009370 con 0x7faedc178610 2022-07-05T12:10:46.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faedbfff700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc171880 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7faedc088a70 tx=0x7faecc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:46.242 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faec3fff700 1 -- 172.21.15.90:0/3851254658 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc025070 con 0x7faedc178610 2022-07-05T12:10:46.243 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faec3fff700 1 -- 172.21.15.90:0/3851254658 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00ba00 con 0x7faedc178610 2022-07-05T12:10:46.244 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc179250 con 0x7faedc178610 2022-07-05T12:10:46.246 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faec3fff700 1 -- 172.21.15.90:0/3851254658 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc029660 con 0x7faedc178610 2022-07-05T12:10:46.249 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.116+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc179810 con 0x7faedc178610 2022-07-05T12:10:46.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.118+0000 7faec3fff700 1 -- 172.21.15.90:0/3851254658 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7faecc030030 con 0x7faedc178610 2022-07-05T12:10:46.250 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.119+0000 7faec3fff700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faebc08ba40 0x7faebc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.119+0000 7faec3fff700 1 -- 172.21.15.90:0/3851254658 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7faecc0b9a60 con 0x7faedc178610 2022-07-05T12:10:46.251 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.119+0000 7faedb7fe700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faebc08ba40 0x7faebc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.119+0000 7faedb7fe700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faebc08ba40 0x7faebc08df00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7faedc0c5b80 tx=0x7faed0007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:46.252 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.120+0000 7faef43b4b80 1 Processor -- start 2022-07-05T12:10:46.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.120+0000 7faef43b4b80 1 -- start start 2022-07-05T12:10:46.253 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.121+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909df7d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.121+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909df7dcb0 0x55909dfcb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.254 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.121+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909dfc1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.255 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faef43b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909df472d0 con 0x55909df7dcb0 2022-07-05T12:10:46.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faef43b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909debeaa0 con 0x55909dfc17a0 2022-07-05T12:10:46.257 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faef43b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909ded3950 con 0x55909dfc13c0 2022-07-05T12:10:46.258 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909df7dcb0 0x55909dfcb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.260 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909df7d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.261 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909df7dcb0 0x55909dfcb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60728/0 (socket says 172.21.15.90:60728) 2022-07-05T12:10:46.262 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 -- 172.21.15.90:0/2236641774 learned_addr learned my addr 172.21.15.90:0/2236641774 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:46.264 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909df7d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:42122/0 (socket says 172.21.15.90:42122) 2022-07-05T12:10:46.265 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faee0fc5700 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909dfc1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.267 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 -- 172.21.15.90:0/2236641774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 msgr2=0x55909df7d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.269 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909df7d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 -- 172.21.15.90:0/2236641774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 msgr2=0x55909dfc1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.271 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909dfc1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.272 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 -- 172.21.15.90:0/2236641774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55909dd059e0 con 0x55909df7dcb0 2022-07-05T12:10:46.273 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faee0fc5700 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909dfc1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:10:46.274 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faedb7fe700 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909df7dcb0 0x55909dfcb990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7faed0017580 tx=0x7faed000a000).ready entity=mon.0 client_cookie=135be7cfa03085fd server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:46.276 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faec17fa700 1 -- 172.21.15.90:0/2236641774 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed001c070 con 0x55909df7dcb0 2022-07-05T12:10:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faec17fa700 1 -- 172.21.15.90:0/2236641774 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0017dd0 con 0x55909df7dcb0 2022-07-05T12:10:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.122+0000 7faec17fa700 1 -- 172.21.15.90:0/2236641774 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0014450 con 0x55909df7dcb0 2022-07-05T12:10:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 -- 172.21.15.90:0/2236641774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909df7dcb0 msgr2=0x55909dfcb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909df7dcb0 0x55909dfcb990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7faed0017580 tx=0x7faed000a000).stop 2022-07-05T12:10:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 -- 172.21.15.90:0/2236641774 shutdown_connections 2022-07-05T12:10:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909dfc1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909df7d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 --2- 172.21.15.90:0/2236641774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909df7dcb0 0x55909dfcb990 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 -- 172.21.15.90:0/2236641774 >> 172.21.15.90:0/2236641774 conn(0x55909ddec1c0 msgr2=0x55909df80ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 -- 172.21.15.90:0/2236641774 shutdown_connections 2022-07-05T12:10:46.289 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.123+0000 7faef43b4b80 1 -- 172.21.15.90:0/2236641774 wait complete. 2022-07-05T12:10:46.290 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.124+0000 7faef43b4b80 1 -- start start 2022-07-05T12:10:46.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.124+0000 7faef43b4b80 1 Processor -- start 2022-07-05T12:10:46.291 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfbfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909dfea030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc17a0 0x55909e001d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909de9b120 con 0x55909dfc17a0 2022-07-05T12:10:46.294 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909dfc0b10 con 0x55909df7dcb0 2022-07-05T12:10:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909dfbf9b0 con 0x55909dfc13c0 2022-07-05T12:10:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 10 client.0 ll_register_callbacks cb 0x55909df411b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:10:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc17a0 0x55909e001d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc17a0 0x55909e001d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60736/0 (socket says 172.21.15.90:60736) 2022-07-05T12:10:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 -- 172.21.15.90:0/3746304033 learned_addr learned my addr 172.21.15.90:0/3746304033 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faedb7fe700 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909dfea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faedbfff700 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfbfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.299 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 -- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 msgr2=0x55909dfea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909dfea030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.300 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 -- 172.21.15.90:0/3746304033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 msgr2=0x55909dfbfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfbfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 -- 172.21.15.90:0/3746304033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc17d560 con 0x55909dfc17a0 2022-07-05T12:10:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faee0fc5700 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc17a0 0x55909e001d40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7faed4007f30 tx=0x7faed400b040).ready entity=mon.0 client_cookie=1a28148e121af787 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faeb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:10:46.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faeb67fc700 1 -- 172.21.15.90:0/3746304033 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed400e040 con 0x55909dfc17a0 2022-07-05T12:10:46.303 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55909df7b440 con 0x55909dfc17a0 2022-07-05T12:10:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.125+0000 7faeb67fc700 1 -- 172.21.15.90:0/3746304033 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7faed4013a80 con 0x55909dfc17a0 2022-07-05T12:10:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faeb67fc700 1 -- 172.21.15.90:0/3746304033 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7faed4009e90 con 0x55909dfc17a0 2022-07-05T12:10:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 10 client.6261 fetch_fsmap learned FSMap version 41 2022-07-05T12:10:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55909dd74cd0 con 0x55909dfc17a0 2022-07-05T12:10:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faeb67fc700 1 -- 172.21.15.90:0/3746304033 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55909df7b440 con 0x55909dfc17a0 2022-07-05T12:10:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faeb67fc700 1 -- 172.21.15.90:0/3746304033 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7faed401f440 con 0x55909dfc17a0 2022-07-05T12:10:46.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 10 client.6261 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:10:46.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 10 client.6261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:10:46.307 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 20 client.6261 populate_metadata read hostname 'smithi090' 2022-07-05T12:10:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfc0390 0x55909dfff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 4 client.6261 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:10:46.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55909dec97f0 con 0x55909dfc0390 2022-07-05T12:10:46.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faedbfff700 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfc0390 0x55909dfff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.309 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faeb67fc700 10 client.6261 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.126+0000 7faedbfff700 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfc0390 0x55909dfff8f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ae99faa243c6191d server_cookie=d1d8e41f257135b3 in_seq=0 out_seq=0 2022-07-05T12:10:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faeb67fc700 1 -- 172.21.15.90:0/3746304033 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55909dec97f0 con 0x55909dfc0390 2022-07-05T12:10:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faeb67fc700 10 client.6261 handle_command_reply: tid=0 2022-07-05T12:10:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 client.6261 shutdown 2022-07-05T12:10:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc17a0 msgr2=0x55909e001d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc17a0 0x55909e001d40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7faed4007f30 tx=0x7faed400b040).stop 2022-07-05T12:10:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 shutdown_connections 2022-07-05T12:10:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfc0390 0x55909dfff8f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc17a0 0x55909e001d40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfbfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3746304033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc13c0 0x55909dfea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faeb67fc700 0 client.6261 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.127+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 >> 172.21.15.90:0/3746304033 conn(0x55909ddec1c0 msgr2=0x55909df7e710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.128+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 shutdown_connections 2022-07-05T12:10:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.128+0000 7faef43b4b80 1 -- 172.21.15.90:0/3746304033 wait complete. 2022-07-05T12:10:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.128+0000 7faef43b4b80 20 client.6261 trim_cache size 0 max 16384 2022-07-05T12:10:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.143+0000 7faef43b4b80 1 Processor -- start 2022-07-05T12:10:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.143+0000 7faef43b4b80 1 -- start start 2022-07-05T12:10:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfc9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909e04fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc17a0 0x55909e050180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faef43b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909dff3750 con 0x55909dfc13c0 2022-07-05T12:10:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faef43b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909dff3220 con 0x55909df7dcb0 2022-07-05T12:10:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faef43b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909df7f430 con 0x55909dfc17a0 2022-07-05T12:10:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909e04fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909e04fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60742/0 (socket says 172.21.15.90:60742) 2022-07-05T12:10:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faedb7fe700 1 -- 172.21.15.90:0/3497609678 learned_addr learned my addr 172.21.15.90:0/3497609678 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faee0fc5700 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc17a0 0x55909e050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.144+0000 7faedbfff700 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfc9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faedb7fe700 1 -- 172.21.15.90:0/3497609678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc17a0 msgr2=0x55909e050180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faedb7fe700 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc17a0 0x55909e050180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faedb7fe700 1 -- 172.21.15.90:0/3497609678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 msgr2=0x55909dfc9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faedb7fe700 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfc9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faedb7fe700 1 -- 172.21.15.90:0/3497609678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55909dd42fd0 con 0x55909dfc13c0 2022-07-05T12:10:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faee0fc5700 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc17a0 0x55909e050180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:10:46.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faedbfff700 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfc9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:10:46.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faedb7fe700 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909e04fc90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x55909dff3c70 tx=0x7faed0014000).ready entity=mon.0 client_cookie=1381bd1d0746d70b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:46.328 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faec1ffb700 1 -- 172.21.15.90:0/3497609678 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0029030 con 0x55909dfc13c0 2022-07-05T12:10:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faec1ffb700 1 -- 172.21.15.90:0/3497609678 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed002a040 con 0x55909dfc13c0 2022-07-05T12:10:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faec1ffb700 1 -- 172.21.15.90:0/3497609678 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0007a50 con 0x55909dfc13c0 2022-07-05T12:10:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 -- 172.21.15.90:0/3497609678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 msgr2=0x55909e04fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909e04fc90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x55909dff3c70 tx=0x7faed0014000).stop 2022-07-05T12:10:46.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 -- 172.21.15.90:0/3497609678 shutdown_connections 2022-07-05T12:10:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909dfc17a0 0x55909e050180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909df7dcb0 0x55909dfc9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 --2- 172.21.15.90:0/3497609678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909e04fc90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 -- 172.21.15.90:0/3497609678 >> 172.21.15.90:0/3497609678 conn(0x55909ddec1c0 msgr2=0x55909dfee150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 -- 172.21.15.90:0/3497609678 shutdown_connections 2022-07-05T12:10:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.145+0000 7faef43b4b80 1 -- 172.21.15.90:0/3497609678 wait complete. 2022-07-05T12:10:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.146+0000 7faef43b4b80 1 -- start start 2022-07-05T12:10:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.146+0000 7faef43b4b80 1 Processor -- start 2022-07-05T12:10:46.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909df7dcb0 0x55909e0593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909df7eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faef43b4b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909e0031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faef43b4b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909df84bb0 con 0x55909dfc13c0 2022-07-05T12:10:46.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faef43b4b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909e05a2e0 con 0x55909dfc17a0 2022-07-05T12:10:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faef43b4b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909e002d50 con 0x55909df7dcb0 2022-07-05T12:10:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faef43b4b80 10 client.0 ll_register_callbacks cb 0x55909df411b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:10:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909df7eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909df7eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60748/0 (socket says 172.21.15.90:60748) 2022-07-05T12:10:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 -- 172.21.15.90:0/314489911 learned_addr learned my addr 172.21.15.90:0/314489911 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:10:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedbfff700 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909df7dcb0 0x55909e0593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 -- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909df7dcb0 msgr2=0x55909e0593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faee0fc5700 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909e0031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909df7dcb0 0x55909e0593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 -- 172.21.15.90:0/314489911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 msgr2=0x55909e0031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:10:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909e0031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.147+0000 7faedb7fe700 1 -- 172.21.15.90:0/314489911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55909dd059e0 con 0x55909dfc13c0 2022-07-05T12:10:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faedb7fe700 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909df7eac0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7faed0017520 tx=0x7faed002c000).ready entity=mon.0 client_cookie=949bf48e433c00ac server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:10:46.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faeb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:10:46.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faeb67fc700 1 -- 172.21.15.90:0/314489911 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0014450 con 0x55909dfc13c0 2022-07-05T12:10:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faeb67fc700 1 -- 172.21.15.90:0/314489911 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7faed0022420 con 0x55909dfc13c0 2022-07-05T12:10:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faed0017dd0 con 0x55909dfc13c0 2022-07-05T12:10:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faeb67fc700 1 -- 172.21.15.90:0/314489911 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7faed00227f0 con 0x55909dfc13c0 2022-07-05T12:10:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 10 client.6267 fetch_fsmap learned FSMap version 41 2022-07-05T12:10:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55909df846e0 con 0x55909dfc13c0 2022-07-05T12:10:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faeb67fc700 1 -- 172.21.15.90:0/314489911 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0017dd0 con 0x55909dfc13c0 2022-07-05T12:10:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faeb67fc700 1 -- 172.21.15.90:0/314489911 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7faed0022950 con 0x55909dfc13c0 2022-07-05T12:10:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 10 client.6267 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:10:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 10 client.6267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:10:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 20 client.6267 populate_metadata read hostname 'smithi090' 2022-07-05T12:10:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfbdb80 0x55909e04ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:10:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 4 client.6267 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:10:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55909dec0690 con 0x55909dfbdb80 2022-07-05T12:10:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.148+0000 7faedbfff700 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfbdb80 0x55909e04ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:10:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faeb67fc700 10 client.6267 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faedbfff700 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfbdb80 0x55909e04ee80 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=179c68375c8ae06a server_cookie=e6d5d15223ef785 in_seq=0 out_seq=0 2022-07-05T12:10:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faeb67fc700 1 -- 172.21.15.90:0/314489911 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55909dec0690 con 0x55909dfbdb80 2022-07-05T12:10:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faeb67fc700 10 client.6267 handle_command_reply: tid=0 2022-07-05T12:10:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 client.6267 shutdown 2022-07-05T12:10:46.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 msgr2=0x55909df7eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909df7eac0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7faed0017520 tx=0x7faed002c000).stop 2022-07-05T12:10:46.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 shutdown_connections 2022-07-05T12:10:46.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55909dfbdb80 0x55909e04ee80 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55909dfc17a0 0x55909e0031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faeb67fc700 0 client.6267 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:10:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55909df7dcb0 0x55909e0593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 --2- 172.21.15.90:0/314489911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55909dfc13c0 0x55909df7eac0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 >> 172.21.15.90:0/314489911 conn(0x55909ddec1c0 msgr2=0x55909df814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 shutdown_connections 2022-07-05T12:10:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 1 -- 172.21.15.90:0/314489911 wait complete. 2022-07-05T12:10:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.149+0000 7faef43b4b80 20 client.6267 trim_cache size 0 max 16384 2022-07-05T12:10:46.348 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:10:46.348 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:10:46.348 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:10:46.349 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:10:46.349 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:10:46.349 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:10:46.349 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:10:46.349 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:10:46.350 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:10:46.350 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:10:46.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faebc08ba40 msgr2=0x7faebc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faebc08ba40 0x7faebc08df00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7faedc0c5b80 tx=0x7faed0007d20).stop 2022-07-05T12:10:46.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 msgr2=0x7faedc171880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:10:46.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc171880 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7faedc088a70 tx=0x7faecc017000).stop 2022-07-05T12:10:46.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 shutdown_connections 2022-07-05T12:10:46.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7faebc08ba40 0x7faebc08df00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faedc17f3b0 0x7faedc17a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc178610 0x7faedc171880 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 --2- 172.21.15.90:0/3851254658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc17e100 0x7faedc171d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:10:46.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 >> 172.21.15.90:0/3851254658 conn(0x7faedc0f2210 msgr2=0x7faedc17d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:10:46.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 shutdown_connections 2022-07-05T12:10:46.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:10:46.150+0000 7faee2a28700 1 -- 172.21.15.90:0/3851254658 wait complete. 2022-07-05T12:10:46.356 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:10:54.515 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:10:54.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:10:54.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:10:56.054 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:10:56.054+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42472) UID: 0 2022-07-05T12:10:56.055 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:10:56.054+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42472) UID: 0 2022-07-05T12:10:56.056 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:10:56.055+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42472) UID: 0 2022-07-05T12:11:16.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:11:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.485+0000 7f538e081700 1 Processor -- start 2022-07-05T12:11:16.486 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.485+0000 7f538e081700 1 -- start start 2022-07-05T12:11:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.486+0000 7f538e081700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5388062f20 0x7f538817f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.486+0000 7f538e081700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538817d560 con 0x7f5388178610 2022-07-05T12:11:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.486+0000 7f538e081700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538817c670 con 0x7f53881789f0 2022-07-05T12:11:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.486+0000 7f538e081700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538817f8a0 con 0x7f5388062f20 2022-07-05T12:11:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f5387fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5388062f20 0x7f538817f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f53877fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5388178610 0x7f538817d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53694/0 (socket says 172.21.15.90:53694) 2022-07-05T12:11:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f53877fe700 1 -- 172.21.15.90:0/3403757164 learned_addr learned my addr 172.21.15.90:0/3403757164 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:11:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f5387fff700 1 -- 172.21.15.90:0/3403757164 >> v1:172.21.15.149:6789/0 conn(0x7f53881789f0 legacy=0x7f5388063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f5387fff700 1 -- 172.21.15.90:0/3403757164 >> v1:172.21.15.90:6789/0 conn(0x7f5388178610 legacy=0x7f538817d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f5387fff700 1 -- 172.21.15.90:0/3403757164 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538817c950 con 0x7f5388062f20 2022-07-05T12:11:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f53867fc700 1 -- 172.21.15.90:0/3403757164 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594196097 0 0) 0x7f538817d560 con 0x7f5388178610 2022-07-05T12:11:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f5387fff700 1 --2- 172.21.15.90:0/3403757164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538817f3b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f5380009e60 tx=0x7f5380009780).ready entity=mon.0 client_cookie=91ef1f920c493770 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f53867fc700 1 -- 172.21.15.90:0/3403757164 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000e070 con 0x7f5388062f20 2022-07-05T12:11:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f53867fc700 1 -- 172.21.15.90:0/3403757164 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538000bc30 con 0x7f5388062f20 2022-07-05T12:11:16.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.487+0000 7f53867fc700 1 -- 172.21.15.90:0/3403757164 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380012410 con 0x7f5388062f20 2022-07-05T12:11:16.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.488+0000 7f538e081700 1 -- 172.21.15.90:0/3403757164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 msgr2=0x7f538817f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.517 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.488+0000 7f538e081700 1 --2- 172.21.15.90:0/3403757164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538817f3b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f5380009e60 tx=0x7f5380009780).stop 2022-07-05T12:11:16.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.488+0000 7f538e081700 1 -- 172.21.15.90:0/3403757164 shutdown_connections 2022-07-05T12:11:16.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.488+0000 7f538e081700 1 --2- 172.21.15.90:0/3403757164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538817f3b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.518 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.488+0000 7f538e081700 1 -- 172.21.15.90:0/3403757164 >> 172.21.15.90:0/3403757164 conn(0x7f53880f2210 msgr2=0x7f5388069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.488+0000 7f538e081700 1 -- 172.21.15.90:0/3403757164 shutdown_connections 2022-07-05T12:11:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.488+0000 7f538e081700 1 -- 172.21.15.90:0/3403757164 wait complete. 2022-07-05T12:11:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.489+0000 7f538e081700 1 Processor -- start 2022-07-05T12:11:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.489+0000 7f538e081700 1 -- start start 2022-07-05T12:11:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f538e081700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f538e081700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5388178610 0x7f538814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f538e081700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53881789f0 0x7f538817a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f538e081700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388179ee0 con 0x7f5388062f20 2022-07-05T12:11:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f538e081700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388178ff0 con 0x7f5388178610 2022-07-05T12:11:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f538e081700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881792d0 con 0x7f53881789f0 2022-07-05T12:11:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f53877fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f53877fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538814f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60760/0 (socket says 172.21.15.90:60760) 2022-07-05T12:11:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f53877fe700 1 -- 172.21.15.90:0/3195858103 learned_addr learned my addr 172.21.15.90:0/3195858103 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.490+0000 7f5387fff700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53881789f0 0x7f538817a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f5386ffd700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5388178610 0x7f538814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f53877fe700 1 -- 172.21.15.90:0/3195858103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53881789f0 msgr2=0x7f538817a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f53877fe700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53881789f0 0x7f538817a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f53877fe700 1 -- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5388178610 msgr2=0x7f538814f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f53877fe700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5388178610 0x7f538814f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f53877fe700 1 -- 172.21.15.90:0/3195858103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380009a20 con 0x7f5388062f20 2022-07-05T12:11:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f5386ffd700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5388178610 0x7f538814f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:11:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f53877fe700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538814f480 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f5378001eb0 tx=0x7f5378007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f536f7fe700 1 -- 172.21.15.90:0/3195858103 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800ce90 con 0x7f5388062f20 2022-07-05T12:11:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f536f7fe700 1 -- 172.21.15.90:0/3195858103 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53780072e0 con 0x7f5388062f20 2022-07-05T12:11:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53881795b0 con 0x7f5388062f20 2022-07-05T12:11:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f536f7fe700 1 -- 172.21.15.90:0/3195858103 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378007680 con 0x7f5388062f20 2022-07-05T12:11:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.491+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5388179b70 con 0x7f5388062f20 2022-07-05T12:11:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.493+0000 7f536f7fe700 1 -- 172.21.15.90:0/3195858103 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f537801a060 con 0x7f5388062f20 2022-07-05T12:11:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.493+0000 7f536f7fe700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f536808ba40 0x7f536808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.493+0000 7f536f7fe700 1 -- 172.21.15.90:0/3195858103 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f53780b0020 con 0x7f5388062f20 2022-07-05T12:11:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.494+0000 7f5386ffd700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f536808ba40 0x7f536808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.494+0000 7f5386ffd700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f536808ba40 0x7f536808df00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f53880c5b20 tx=0x7f537c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:16.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.495+0000 7f539fa0db80 1 Processor -- start 2022-07-05T12:11:16.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.495+0000 7f539fa0db80 1 -- start start 2022-07-05T12:11:16.527 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c3c0 0x5616954587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c7a0 0x56169549cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f539fa0db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616954222d0 con 0x56169549c7a0 2022-07-05T12:11:16.528 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f539fa0db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695399aa0 con 0x561695458cb0 2022-07-05T12:11:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f539fa0db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616953ae950 con 0x56169549c3c0 2022-07-05T12:11:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c3c0 0x5616954587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c3c0 0x5616954587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:42164/0 (socket says 172.21.15.90:42164) 2022-07-05T12:11:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f5387fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c7a0 0x56169549cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 -- 172.21.15.90:0/4220046855 learned_addr learned my addr 172.21.15.90:0/4220046855 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f5386ffd700 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 -- 172.21.15.90:0/4220046855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 msgr2=0x5616954a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954a6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 -- 172.21.15.90:0/4220046855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c7a0 msgr2=0x56169549cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c7a0 0x56169549cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f53877fe700 1 -- 172.21.15.90:0/4220046855 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616951e09e0 con 0x56169549c3c0 2022-07-05T12:11:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.496+0000 7f5386ffd700 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:11:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f53877fe700 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c3c0 0x5616954587c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5378084580 tx=0x7f5378080d30).ready entity=mon.2 client_cookie=ad8797a18bcc385f server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f536cff9700 1 -- 172.21.15.90:0/4220046855 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378082ce0 con 0x56169549c3c0 2022-07-05T12:11:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f536cff9700 1 -- 172.21.15.90:0/4220046855 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5378081050 con 0x56169549c3c0 2022-07-05T12:11:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f536cff9700 1 -- 172.21.15.90:0/4220046855 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378084040 con 0x56169549c3c0 2022-07-05T12:11:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f539fa0db80 1 -- 172.21.15.90:0/4220046855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c3c0 msgr2=0x5616954587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f539fa0db80 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c3c0 0x5616954587c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5378084580 tx=0x7f5378080d30).stop 2022-07-05T12:11:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f539fa0db80 1 -- 172.21.15.90:0/4220046855 shutdown_connections 2022-07-05T12:11:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f539fa0db80 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c7a0 0x56169549cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f539fa0db80 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c3c0 0x5616954587c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f539fa0db80 1 --2- 172.21.15.90:0/4220046855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.497+0000 7f539fa0db80 1 -- 172.21.15.90:0/4220046855 >> 172.21.15.90:0/4220046855 conn(0x5616952c71c0 msgr2=0x56169545bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.498+0000 7f539fa0db80 1 -- 172.21.15.90:0/4220046855 shutdown_connections 2022-07-05T12:11:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.498+0000 7f539fa0db80 1 -- 172.21.15.90:0/4220046855 wait complete. 2022-07-05T12:11:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.498+0000 7f539fa0db80 1 -- start start 2022-07-05T12:11:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.498+0000 7f539fa0db80 1 Processor -- start 2022-07-05T12:11:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561695458cb0 0x5616954cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56169549c3c0 0x5616954c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616954c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f539fa0db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695376120 con 0x561695458cb0 2022-07-05T12:11:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f539fa0db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616954cec50 con 0x56169549c3c0 2022-07-05T12:11:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f539fa0db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616954cdaf0 con 0x56169549c7a0 2022-07-05T12:11:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f539fa0db80 10 client.0 ll_register_callbacks cb 0x56169541c1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:11:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f53877fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561695458cb0 0x5616954cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f53877fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561695458cb0 0x5616954cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60774/0 (socket says 172.21.15.90:60774) 2022-07-05T12:11:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.499+0000 7f53877fe700 1 -- 172.21.15.90:0/2708351440 learned_addr learned my addr 172.21.15.90:0/2708351440 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5387fff700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616954c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5386ffd700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56169549c3c0 0x5616954c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f53877fe700 1 -- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 msgr2=0x5616954c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f53877fe700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616954c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f53877fe700 1 -- 172.21.15.90:0/2708351440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56169549c3c0 msgr2=0x5616954c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f53877fe700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56169549c3c0 0x5616954c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f53877fe700 1 -- 172.21.15.90:0/2708351440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5388179b70 con 0x561695458cb0 2022-07-05T12:11:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5386ffd700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56169549c3c0 0x5616954c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:11:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f53877fe700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561695458cb0 0x5616954cdf80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f53780848d0 tx=0x7f5378087000).ready entity=mon.0 client_cookie=96f15c692410d7b9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5361ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:11:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5361ffb700 1 -- 172.21.15.90:0/2708351440 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378082ce0 con 0x561695458cb0 2022-07-05T12:11:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5361ffb700 1 -- 172.21.15.90:0/2708351440 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f5378089d90 con 0x561695458cb0 2022-07-05T12:11:16.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561695456440 con 0x561695458cb0 2022-07-05T12:11:16.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5361ffb700 1 -- 172.21.15.90:0/2708351440 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5378080730 con 0x561695458cb0 2022-07-05T12:11:16.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 10 client.6282 fetch_fsmap learned FSMap version 41 2022-07-05T12:11:16.541 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x56169524fcd0 con 0x561695458cb0 2022-07-05T12:11:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5361ffb700 1 -- 172.21.15.90:0/2708351440 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561695456440 con 0x561695458cb0 2022-07-05T12:11:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f5361ffb700 1 -- 172.21.15.90:0/2708351440 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f5378080890 con 0x561695458cb0 2022-07-05T12:11:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 10 client.6282 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:11:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 10 client.6282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:11:16.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 20 client.6282 populate_metadata read hostname 'smithi090' 2022-07-05T12:11:16.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954da600 0x5616954da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 4 client.6282 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:11:16.543 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.500+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616953a47f0 con 0x5616954da600 2022-07-05T12:11:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.501+0000 7f5386ffd700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954da600 0x5616954da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.501+0000 7f5361ffb700 10 client.6282 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.501+0000 7f5386ffd700 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954da600 0x5616954da9e0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=621394a35eba0cf6 server_cookie=1a8392df7e312ff4 in_seq=0 out_seq=0 2022-07-05T12:11:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f5361ffb700 1 -- 172.21.15.90:0/2708351440 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5616953a47f0 con 0x5616954da600 2022-07-05T12:11:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f5361ffb700 10 client.6282 handle_command_reply: tid=0 2022-07-05T12:11:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 client.6282 shutdown 2022-07-05T12:11:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561695458cb0 msgr2=0x5616954cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561695458cb0 0x5616954cdf80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f53780848d0 tx=0x7f5378087000).stop 2022-07-05T12:11:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 shutdown_connections 2022-07-05T12:11:16.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954da600 0x5616954da9e0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616954c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561695458cb0 0x5616954cdf80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.546 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f5361ffb700 0 client.6282 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2708351440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56169549c3c0 0x5616954c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 >> 172.21.15.90:0/2708351440 conn(0x5616952c71c0 msgr2=0x5616954c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 shutdown_connections 2022-07-05T12:11:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 1 -- 172.21.15.90:0/2708351440 wait complete. 2022-07-05T12:11:16.548 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.502+0000 7f539fa0db80 20 client.6282 trim_cache size 0 max 16384 2022-07-05T12:11:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.517+0000 7f539fa0db80 1 Processor -- start 2022-07-05T12:11:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.518+0000 7f539fa0db80 1 -- start start 2022-07-05T12:11:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.518+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954dacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.518+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x5616954980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.518+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x561695529440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f539fa0db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616954db1b0 con 0x56169549c3c0 2022-07-05T12:11:16.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f539fa0db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x56169545be90 con 0x561695458cb0 2022-07-05T12:11:16.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f539fa0db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616954a4940 con 0x56169549c7a0 2022-07-05T12:11:16.557 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x5616954980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x5616954980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60786/0 (socket says 172.21.15.90:60786) 2022-07-05T12:11:16.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 -- 172.21.15.90:0/2371900782 learned_addr learned my addr 172.21.15.90:0/2371900782 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:16.558 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5387fff700 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x561695529440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f53877fe700 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954dacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 -- 172.21.15.90:0/2371900782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 msgr2=0x561695529440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x561695529440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.559 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 -- 172.21.15.90:0/2371900782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 msgr2=0x5616954dacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954dacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 -- 172.21.15.90:0/2371900782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56169521dfd0 con 0x56169549c3c0 2022-07-05T12:11:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5387fff700 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x561695529440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:11:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f5386ffd700 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x5616954980d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x561695478300 tx=0x7f537c012000).ready entity=mon.0 client_cookie=f73b995676b5663d server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f536d7fa700 1 -- 172.21.15.90:0/2371900782 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c017040 con 0x56169549c3c0 2022-07-05T12:11:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f536d7fa700 1 -- 172.21.15.90:0/2371900782 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c018040 con 0x56169549c3c0 2022-07-05T12:11:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f536d7fa700 1 -- 172.21.15.90:0/2371900782 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c007240 con 0x56169549c3c0 2022-07-05T12:11:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f539fa0db80 1 -- 172.21.15.90:0/2371900782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 msgr2=0x5616954980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.519+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x5616954980d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x561695478300 tx=0x7f537c012000).stop 2022-07-05T12:11:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 -- 172.21.15.90:0/2371900782 shutdown_connections 2022-07-05T12:11:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x561695529440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954dacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 --2- 172.21.15.90:0/2371900782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x5616954980d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 -- 172.21.15.90:0/2371900782 >> 172.21.15.90:0/2371900782 conn(0x5616952c71c0 msgr2=0x561695452b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 -- 172.21.15.90:0/2371900782 shutdown_connections 2022-07-05T12:11:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 -- 172.21.15.90:0/2371900782 wait complete. 2022-07-05T12:11:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 -- start start 2022-07-05T12:11:16.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.520+0000 7f539fa0db80 1 Processor -- start 2022-07-05T12:11:16.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x561695528940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.564 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f539fa0db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616955209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f539fa0db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616955242f0 con 0x56169549c3c0 2022-07-05T12:11:16.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f539fa0db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695520ed0 con 0x561695458cb0 2022-07-05T12:11:16.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f539fa0db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695533dc0 con 0x56169549c7a0 2022-07-05T12:11:16.565 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f539fa0db80 10 client.0 ll_register_callbacks cb 0x56169541c1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:11:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f5386ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x561695528940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f5386ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x561695528940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60790/0 (socket says 172.21.15.90:60790) 2022-07-05T12:11:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f5386ffd700 1 -- 172.21.15.90:0/662550287 learned_addr learned my addr 172.21.15.90:0/662550287 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f5387fff700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616955209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.521+0000 7f53877fe700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5386ffd700 1 -- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 msgr2=0x5616955209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5386ffd700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616955209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.567 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5386ffd700 1 -- 172.21.15.90:0/662550287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 msgr2=0x5616954cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5386ffd700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5386ffd700 1 -- 172.21.15.90:0/662550287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538817c670 con 0x56169549c3c0 2022-07-05T12:11:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f53877fe700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:11:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5386ffd700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x561695528940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f53880c5e30 tx=0x7f537c019000).ready entity=mon.0 client_cookie=a4a8d43afd6a4025 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5361ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:11:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5361ffb700 1 -- 172.21.15.90:0/662550287 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c0068b0 con 0x56169549c3c0 2022-07-05T12:11:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5361ffb700 1 -- 172.21.15.90:0/662550287 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f537c017070 con 0x56169549c3c0 2022-07-05T12:11:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5378081050 con 0x56169549c3c0 2022-07-05T12:11:16.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5361ffb700 1 -- 172.21.15.90:0/662550287 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f537c006c20 con 0x56169549c3c0 2022-07-05T12:11:16.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 10 client.6288 fetch_fsmap learned FSMap version 41 2022-07-05T12:11:16.570 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x561695533a50 con 0x56169549c3c0 2022-07-05T12:11:16.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5361ffb700 1 -- 172.21.15.90:0/662550287 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5378081050 con 0x56169549c3c0 2022-07-05T12:11:16.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f5361ffb700 1 -- 172.21.15.90:0/662550287 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f537c01d020 con 0x56169549c3c0 2022-07-05T12:11:16.572 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 10 client.6288 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:11:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 10 client.6288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:11:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 20 client.6288 populate_metadata read hostname 'smithi090' 2022-07-05T12:11:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954d7ae0 0x561695523660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 4 client.6288 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:11:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56169539b690 con 0x5616954d7ae0 2022-07-05T12:11:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.522+0000 7f53877fe700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954d7ae0 0x561695523660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f5361ffb700 10 client.6288 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f53877fe700 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954d7ae0 0x561695523660 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d04d5c2a4c89c9f1 server_cookie=725eb9ee88888800 in_seq=0 out_seq=0 2022-07-05T12:11:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f5361ffb700 1 -- 172.21.15.90:0/662550287 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56169539b690 con 0x5616954d7ae0 2022-07-05T12:11:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f5361ffb700 10 client.6288 handle_command_reply: tid=0 2022-07-05T12:11:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 client.6288 shutdown 2022-07-05T12:11:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 msgr2=0x561695528940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x561695528940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f53880c5e30 tx=0x7f537c019000).stop 2022-07-05T12:11:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 shutdown_connections 2022-07-05T12:11:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5616954d7ae0 0x561695523660 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56169549c7a0 0x5616955209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f5361ffb700 0 client.6288 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:16.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561695458cb0 0x5616954cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 --2- 172.21.15.90:0/662550287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56169549c3c0 0x561695528940 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 >> 172.21.15.90:0/662550287 conn(0x5616952c71c0 msgr2=0x5616954982f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:16.577 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 shutdown_connections 2022-07-05T12:11:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 1 -- 172.21.15.90:0/662550287 wait complete. 2022-07-05T12:11:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.523+0000 7f539fa0db80 20 client.6288 trim_cache size 0 max 16384 2022-07-05T12:11:16.578 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:11:16.582 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:11:16.583 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:11:16.583 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:11:16.583 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:11:16.584 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:11:16.584 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:11:16.587 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:11:16.587 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:11:16.587 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:11:16.591 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f536808ba40 msgr2=0x7f536808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f536808ba40 0x7f536808df00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f53880c5b20 tx=0x7f537c009040).stop 2022-07-05T12:11:16.592 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 msgr2=0x7f538814f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538814f480 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f5378001eb0 tx=0x7f5378007e90).stop 2022-07-05T12:11:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 shutdown_connections 2022-07-05T12:11:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f536808ba40 0x7f536808df00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53881789f0 0x7f538817a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5388062f20 0x7f538814f480 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 --2- 172.21.15.90:0/3195858103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5388178610 0x7f538814f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 >> 172.21.15.90:0/3195858103 conn(0x7f53880f2210 msgr2=0x7f5388069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 shutdown_connections 2022-07-05T12:11:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:16.524+0000 7f538e081700 1 -- 172.21.15.90:0/3195858103 wait complete. 2022-07-05T12:11:16.595 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:11:46.597 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:11:46.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.722+0000 7fb8987ea700 1 Processor -- start 2022-07-05T12:11:46.723 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.723+0000 7fb8987ea700 1 -- start start 2022-07-05T12:11:46.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb8987ea700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8901720c0 0x7fb8900edd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb8987ea700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89017cac0 con 0x7fb8900c7330 2022-07-05T12:11:46.730 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb8987ea700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900c8610 con 0x7fb89017d660 2022-07-05T12:11:46.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb8987ea700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900c7a90 con 0x7fb8901720c0 2022-07-05T12:11:46.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb895d85700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb8900c7330 0x7fb89017cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53740/0 (socket says 172.21.15.90:53740) 2022-07-05T12:11:46.731 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb895d85700 1 -- 172.21.15.90:0/3238862211 learned_addr learned my addr 172.21.15.90:0/3238862211 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:11:46.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb896586700 1 --2- 172.21.15.90:0/3238862211 >> v2:172.21.15.110:3300/0 conn(0x7fb8901720c0 0x7fb8900edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680800188 0 0) 0x7fb89017cac0 con 0x7fb8900c7330 2022-07-05T12:11:46.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8780033f0 con 0x7fb8900c7330 2022-07-05T12:11:46.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 <== mon.2 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666195238 0 0) 0x7fb8900c8610 con 0x7fb89017d660 2022-07-05T12:11:46.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb89017cac0 con 0x7fb89017d660 2022-07-05T12:11:46.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454781045 0 0) 0x7fb8780033f0 con 0x7fb8900c7330 2022-07-05T12:11:46.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb896586700 1 -- 172.21.15.90:0/3238862211 >> v1:172.21.15.149:6789/0 conn(0x7fb89017d660 legacy=0x7fb890083570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb896586700 1 -- 172.21.15.90:0/3238862211 >> v1:172.21.15.90:6789/0 conn(0x7fb8900c7330 legacy=0x7fb89017cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.724+0000 7fb896586700 1 -- 172.21.15.90:0/3238862211 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900c7d70 con 0x7fb8901720c0 2022-07-05T12:11:46.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb896586700 1 --2- 172.21.15.90:0/3238862211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb8900edd60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fb88c009e60 tx=0x7fb88c009780).ready entity=mon.1 client_cookie=82bd04c38415bca9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:46.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00e070 con 0x7fb8901720c0 2022-07-05T12:11:46.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00b7a0 con 0x7fb8901720c0 2022-07-05T12:11:46.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb895584700 1 -- 172.21.15.90:0/3238862211 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880001470 con 0x7fb8901720c0 2022-07-05T12:11:46.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb8987ea700 1 -- 172.21.15.90:0/3238862211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 msgr2=0x7fb8900edd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb8987ea700 1 --2- 172.21.15.90:0/3238862211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb8900edd60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fb88c009e60 tx=0x7fb88c009780).stop 2022-07-05T12:11:46.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb8987ea700 1 -- 172.21.15.90:0/3238862211 shutdown_connections 2022-07-05T12:11:46.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb8987ea700 1 --2- 172.21.15.90:0/3238862211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb8900edd60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb8987ea700 1 -- 172.21.15.90:0/3238862211 >> 172.21.15.90:0/3238862211 conn(0x7fb89005d9a0 msgr2=0x7fb89005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:46.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb8987ea700 1 -- 172.21.15.90:0/3238862211 shutdown_connections 2022-07-05T12:11:46.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.725+0000 7fb8987ea700 1 -- 172.21.15.90:0/3238862211 wait complete. 2022-07-05T12:11:46.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.727+0000 7fb8987ea700 1 Processor -- start 2022-07-05T12:11:46.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.727+0000 7fb8987ea700 1 -- start start 2022-07-05T12:11:46.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb8987ea700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8900c7330 0x7fb89016b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb8987ea700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb890067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb8987ea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb89017d660 0x7fb890067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb8987ea700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb890067620 con 0x7fb8900c7330 2022-07-05T12:11:46.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb8987ea700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900672d0 con 0x7fb8901720c0 2022-07-05T12:11:46.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb8987ea700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89016bb20 con 0x7fb89017d660 2022-07-05T12:11:46.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8900c7330 0x7fb89016b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8900c7330 0x7fb89016b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60802/0 (socket says 172.21.15.90:60802) 2022-07-05T12:11:46.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 -- 172.21.15.90:0/2827241457 learned_addr learned my addr 172.21.15.90:0/2827241457 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:46.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896d87700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb89017d660 0x7fb890067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb895d85700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb890067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 -- 172.21.15.90:0/2827241457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb89017d660 msgr2=0x7fb890067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb89017d660 0x7fb890067fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 -- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 msgr2=0x7fb890067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb890067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 -- 172.21.15.90:0/2827241457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c009a20 con 0x7fb8900c7330 2022-07-05T12:11:46.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb895d85700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb890067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:11:46.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb896586700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8900c7330 0x7fb89016b150 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fb890085e50 tx=0x7fb88c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:46.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.728+0000 7fb87e7fc700 1 -- 172.21.15.90:0/2827241457 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00bd80 con 0x7fb8900c7330 2022-07-05T12:11:46.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.729+0000 7fb87e7fc700 1 -- 172.21.15.90:0/2827241457 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c01e440 con 0x7fb8900c7330 2022-07-05T12:11:46.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.729+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89016be00 con 0x7fb8900c7330 2022-07-05T12:11:46.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.729+0000 7fb87e7fc700 1 -- 172.21.15.90:0/2827241457 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00bee0 con 0x7fb8900c7330 2022-07-05T12:11:46.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.729+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb890069cf0 con 0x7fb8900c7330 2022-07-05T12:11:46.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.730+0000 7fb87e7fc700 1 -- 172.21.15.90:0/2827241457 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb88c025030 con 0x7fb8900c7330 2022-07-05T12:11:46.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.731+0000 7fb87e7fc700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb87008ba10 0x7fb87008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.731+0000 7fb87e7fc700 1 -- 172.21.15.90:0/2827241457 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fb88c0b2010 con 0x7fb8900c7330 2022-07-05T12:11:46.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.731+0000 7fb895d85700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb87008ba10 0x7fb87008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.731+0000 7fb895d85700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb87008ba10 0x7fb87008ded0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fb890171ae0 tx=0x7fb8800015a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:46.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.733+0000 7fb8aa176b80 1 Processor -- start 2022-07-05T12:11:46.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.733+0000 7fb8aa176b80 1 -- start start 2022-07-05T12:11:46.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a05cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a05cfcb0 0x5588a061d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a06137a0 0x5588a0613c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a05992d0 con 0x5588a06133c0 2022-07-05T12:11:46.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0510aa0 con 0x5588a06137a0 2022-07-05T12:11:46.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0525950 con 0x5588a05cfcb0 2022-07-05T12:11:46.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a05cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a05cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60810/0 (socket says 172.21.15.90:60810) 2022-07-05T12:11:46.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb895d85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a05cfcb0 0x5588a061d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 -- 172.21.15.90:0/1735366112 learned_addr learned my addr 172.21.15.90:0/1735366112 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:46.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896d87700 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a06137a0 0x5588a0613c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 -- 172.21.15.90:0/1735366112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a05cfcb0 msgr2=0x5588a061d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a05cfcb0 0x5588a061d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 -- 172.21.15.90:0/1735366112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a06137a0 msgr2=0x5588a0613c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a06137a0 0x5588a0613c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 -- 172.21.15.90:0/1735366112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588a03579e0 con 0x5588a06133c0 2022-07-05T12:11:46.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896d87700 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a06137a0 0x5588a0613c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:11:46.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb896586700 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a05cf7c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fb88c086700 tx=0x7fb88c009460).ready entity=mon.0 client_cookie=670d2b650704ec25 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:46.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb86f7fe700 1 -- 172.21.15.90:0/1735366112 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c08c190 con 0x5588a06133c0 2022-07-05T12:11:46.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb86f7fe700 1 -- 172.21.15.90:0/1735366112 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c084c50 con 0x5588a06133c0 2022-07-05T12:11:46.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.734+0000 7fb86f7fe700 1 -- 172.21.15.90:0/1735366112 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c085da0 con 0x5588a06133c0 2022-07-05T12:11:46.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1735366112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 msgr2=0x5588a05cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a05cf7c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fb88c086700 tx=0x7fb88c009460).stop 2022-07-05T12:11:46.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1735366112 shutdown_connections 2022-07-05T12:11:46.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a06137a0 0x5588a0613c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a05cf7c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1735366112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a05cfcb0 0x5588a061d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1735366112 >> 172.21.15.90:0/1735366112 conn(0x5588a043e1c0 msgr2=0x5588a05d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:46.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1735366112 shutdown_connections 2022-07-05T12:11:46.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.735+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1735366112 wait complete. 2022-07-05T12:11:46.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.736+0000 7fb8aa176b80 1 -- start start 2022-07-05T12:11:46.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.736+0000 7fb8aa176b80 1 Processor -- start 2022-07-05T12:11:46.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a05d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a060e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06137a0 0x5588a06082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a04ed120 con 0x5588a06133c0 2022-07-05T12:11:46.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a05d4220 con 0x5588a05cfcb0 2022-07-05T12:11:46.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a06438d0 con 0x5588a06137a0 2022-07-05T12:11:46.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb8aa176b80 10 client.0 ll_register_callbacks cb 0x5588a05931b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:11:46.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a060e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a060e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60818/0 (socket says 172.21.15.90:60818) 2022-07-05T12:11:46.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 -- 172.21.15.90:0/1697876452 learned_addr learned my addr 172.21.15.90:0/1697876452 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:46.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb896d87700 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06137a0 0x5588a06082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb896586700 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a05d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 -- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06137a0 msgr2=0x5588a06082a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06137a0 0x5588a06082a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 -- 172.21.15.90:0/1697876452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 msgr2=0x5588a05d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a05d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 -- 172.21.15.90:0/1697876452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb890069cf0 con 0x5588a06133c0 2022-07-05T12:11:46.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb895d85700 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a060e8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fb8800187c0 tx=0x7fb88000a000).ready entity=mon.0 client_cookie=140a40d78a255b00 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:46.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.737+0000 7fb86cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:11:46.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb86cff9700 1 -- 172.21.15.90:0/1697876452 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88001d070 con 0x5588a06133c0 2022-07-05T12:11:46.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb86cff9700 1 -- 172.21.15.90:0/1697876452 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fb880016650 con 0x5588a06133c0 2022-07-05T12:11:46.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588a05cd440 con 0x5588a06133c0 2022-07-05T12:11:46.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb86cff9700 1 -- 172.21.15.90:0/1697876452 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb880016a20 con 0x5588a06133c0 2022-07-05T12:11:46.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 10 client.6300 fetch_fsmap learned FSMap version 41 2022-07-05T12:11:46.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5588a03c6cd0 con 0x5588a06133c0 2022-07-05T12:11:46.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb86cff9700 1 -- 172.21.15.90:0/1697876452 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588a05cd440 con 0x5588a06133c0 2022-07-05T12:11:46.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb86cff9700 1 -- 172.21.15.90:0/1697876452 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fb880016b80 con 0x5588a06133c0 2022-07-05T12:11:46.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 10 client.6300 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:11:46.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 10 client.6300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:11:46.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 20 client.6300 populate_metadata read hostname 'smithi090' 2022-07-05T12:11:46.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06116e0 0x5588a0611af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 4 client.6300 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:11:46.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588a051b7f0 con 0x5588a06116e0 2022-07-05T12:11:46.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.738+0000 7fb896586700 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06116e0 0x5588a0611af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.739+0000 7fb86cff9700 10 client.6300 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:46.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.739+0000 7fb896586700 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06116e0 0x5588a0611af0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=263d721aff277754 server_cookie=f8ebb296108832d3 in_seq=0 out_seq=0 2022-07-05T12:11:46.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.739+0000 7fb86cff9700 1 -- 172.21.15.90:0/1697876452 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5588a051b7f0 con 0x5588a06116e0 2022-07-05T12:11:46.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.739+0000 7fb86cff9700 10 client.6300 handle_command_reply: tid=0 2022-07-05T12:11:46.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 client.6300 shutdown 2022-07-05T12:11:46.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 msgr2=0x5588a060e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a060e8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fb8800187c0 tx=0x7fb88000a000).stop 2022-07-05T12:11:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 shutdown_connections 2022-07-05T12:11:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06116e0 0x5588a0611af0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06137a0 0x5588a06082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb86cff9700 0 client.6300 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a05d3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/1697876452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a060e8f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 >> 172.21.15.90:0/1697876452 conn(0x5588a043e1c0 msgr2=0x5588a0640150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 shutdown_connections 2022-07-05T12:11:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 1 -- 172.21.15.90:0/1697876452 wait complete. 2022-07-05T12:11:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.740+0000 7fb8aa176b80 20 client.6300 trim_cache size 0 max 16384 2022-07-05T12:11:46.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.756+0000 7fb8aa176b80 1 Processor -- start 2022-07-05T12:11:46.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.756+0000 7fb8aa176b80 1 -- start start 2022-07-05T12:11:46.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a0646500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06116e0 0x5588a061c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06133c0 0x5588a0608e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a05d32b0 con 0x5588a06116e0 2022-07-05T12:11:46.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0609310 con 0x5588a05cfcb0 2022-07-05T12:11:46.787 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0613f00 con 0x5588a06133c0 2022-07-05T12:11:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06116e0 0x5588a061c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06116e0 0x5588a061c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60826/0 (socket says 172.21.15.90:60826) 2022-07-05T12:11:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 -- 172.21.15.90:0/535069870 learned_addr learned my addr 172.21.15.90:0/535069870 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb896d87700 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06133c0 0x5588a0608e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb896586700 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a0646500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 -- 172.21.15.90:0/535069870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06133c0 msgr2=0x5588a0608e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06133c0 0x5588a0608e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 -- 172.21.15.90:0/535069870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 msgr2=0x5588a0646500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a0646500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 -- 172.21.15.90:0/535069870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588a0394fd0 con 0x5588a06116e0 2022-07-05T12:11:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb895d85700 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06116e0 0x5588a061c180 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fb88000e4c0 tx=0x7fb88001a000).ready entity=mon.0 client_cookie=4cade9a8a8d81975 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb86ffff700 1 -- 172.21.15.90:0/535069870 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000eed0 con 0x5588a06116e0 2022-07-05T12:11:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb86ffff700 1 -- 172.21.15.90:0/535069870 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb880016650 con 0x5588a06116e0 2022-07-05T12:11:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.757+0000 7fb86ffff700 1 -- 172.21.15.90:0/535069870 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880001b10 con 0x5588a06116e0 2022-07-05T12:11:46.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 -- 172.21.15.90:0/535069870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06116e0 msgr2=0x5588a061c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06116e0 0x5588a061c180 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fb88000e4c0 tx=0x7fb88001a000).stop 2022-07-05T12:11:46.791 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 -- 172.21.15.90:0/535069870 shutdown_connections 2022-07-05T12:11:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06133c0 0x5588a0608e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a0646500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/535069870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06116e0 0x5588a061c180 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 -- 172.21.15.90:0/535069870 >> 172.21.15.90:0/535069870 conn(0x5588a043e1c0 msgr2=0x5588a0640150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 -- 172.21.15.90:0/535069870 shutdown_connections 2022-07-05T12:11:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 -- 172.21.15.90:0/535069870 wait complete. 2022-07-05T12:11:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 -- start start 2022-07-05T12:11:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.758+0000 7fb8aa176b80 1 Processor -- start 2022-07-05T12:11:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a063eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06116e0 0x5588a0655600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a0608c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a069dfd0 con 0x5588a06133c0 2022-07-05T12:11:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a069e6f0 con 0x5588a05cfcb0 2022-07-05T12:11:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0654bb0 con 0x5588a06116e0 2022-07-05T12:11:46.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 10 client.0 ll_register_callbacks cb 0x5588a05931b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:11:46.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a0608c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a0608c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60834/0 (socket says 172.21.15.90:60834) 2022-07-05T12:11:46.795 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 -- 172.21.15.90:0/2162502938 learned_addr learned my addr 172.21.15.90:0/2162502938 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:11:46.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb895d85700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06116e0 0x5588a0655600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896586700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a063eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 -- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06116e0 msgr2=0x5588a0655600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06116e0 0x5588a0655600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.796 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 -- 172.21.15.90:0/2162502938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 msgr2=0x5588a063eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:11:46.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a063eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 -- 172.21.15.90:0/2162502938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588a03c6cd0 con 0x5588a06133c0 2022-07-05T12:11:46.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896586700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a063eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:11:46.797 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb896d87700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a0608c10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fb8880166c0 tx=0x7fb888009040).ready entity=mon.0 client_cookie=c0688b0a9d61e663 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:11:46.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb86cff9700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:11:46.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb86cff9700 1 -- 172.21.15.90:0/2162502938 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880035f0 con 0x5588a06133c0 2022-07-05T12:11:46.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb88c084c50 con 0x5588a06133c0 2022-07-05T12:11:46.798 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb86cff9700 1 -- 172.21.15.90:0/2162502938 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fb888017710 con 0x5588a06133c0 2022-07-05T12:11:46.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb86cff9700 1 -- 172.21.15.90:0/2162502938 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb888017ae0 con 0x5588a06133c0 2022-07-05T12:11:46.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 10 client.6306 fetch_fsmap learned FSMap version 41 2022-07-05T12:11:46.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5588a0654e00 con 0x5588a06133c0 2022-07-05T12:11:46.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.760+0000 7fb86cff9700 1 -- 172.21.15.90:0/2162502938 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c084c50 con 0x5588a06133c0 2022-07-05T12:11:46.799 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb86cff9700 1 -- 172.21.15.90:0/2162502938 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fb888017c40 con 0x5588a06133c0 2022-07-05T12:11:46.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 10 client.6306 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:11:46.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 10 client.6306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:11:46.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 20 client.6306 populate_metadata read hostname 'smithi090' 2022-07-05T12:11:46.800 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06137a0 0x5588a0652070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:11:46.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 4 client.6306 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:11:46.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5588a0512690 con 0x5588a06137a0 2022-07-05T12:11:46.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb896586700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06137a0 0x5588a0652070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:11:46.801 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb896586700 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06137a0 0x5588a0652070 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=61a97ecaf6e1f274 server_cookie=950956dcdc28974d in_seq=0 out_seq=0 2022-07-05T12:11:46.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb86cff9700 10 client.6306 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:46.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb86cff9700 1 -- 172.21.15.90:0/2162502938 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5588a0512690 con 0x5588a06137a0 2022-07-05T12:11:46.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb86cff9700 10 client.6306 handle_command_reply: tid=0 2022-07-05T12:11:46.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 1 client.6306 shutdown 2022-07-05T12:11:46.802 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 msgr2=0x5588a0608c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.761+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a0608c10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fb8880166c0 tx=0x7fb888009040).stop 2022-07-05T12:11:46.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 shutdown_connections 2022-07-05T12:11:46.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5588a06137a0 0x5588a0652070 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.803 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5588a06133c0 0x5588a0608c10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb86cff9700 0 client.6306 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:11:46.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5588a05cfcb0 0x5588a063eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 --2- 172.21.15.90:0/2162502938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5588a06116e0 0x5588a0655600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 >> 172.21.15.90:0/2162502938 conn(0x5588a043e1c0 msgr2=0x5588a0608400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:46.804 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 shutdown_connections 2022-07-05T12:11:46.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 1 -- 172.21.15.90:0/2162502938 wait complete. 2022-07-05T12:11:46.805 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8aa176b80 20 client.6306 trim_cache size 0 max 16384 2022-07-05T12:11:46.805 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:11:46.806 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:11:46.806 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:11:46.806 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:11:46.806 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:11:46.807 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:11:46.807 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:11:46.807 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:11:46.807 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:11:46.808 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:11:46.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb87008ba10 msgr2=0x7fb87008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb87008ba10 0x7fb87008ded0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fb890171ae0 tx=0x7fb8800015a0).stop 2022-07-05T12:11:46.810 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8900c7330 msgr2=0x7fb89016b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:11:46.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8900c7330 0x7fb89016b150 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fb890085e50 tx=0x7fb88c009780).stop 2022-07-05T12:11:46.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 shutdown_connections 2022-07-05T12:11:46.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fb87008ba10 0x7fb87008ded0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.811 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb89017d660 0x7fb890067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8900c7330 0x7fb89016b150 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 --2- 172.21.15.90:0/2827241457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8901720c0 0x7fb890067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:11:46.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 >> 172.21.15.90:0/2827241457 conn(0x7fb89005d9a0 msgr2=0x7fb8900ec580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:11:46.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 shutdown_connections 2022-07-05T12:11:46.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:11:46.762+0000 7fb8987ea700 1 -- 172.21.15.90:0/2827241457 wait complete. 2022-07-05T12:11:46.813 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:12:16.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:12:16.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.958+0000 7f700202e700 1 Processor -- start 2022-07-05T12:12:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.958+0000 7f700202e700 1 -- start start 2022-07-05T12:12:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.959+0000 7f700202e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ffc178610 0x7f6ffc1789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.959+0000 7f700202e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ffc17f3b0 0x7f6ffc17d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.959+0000 7f700202e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ffc17dee0 0x7f6ffc181e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.959+0000 7f700202e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc17d560 con 0x7f6ffc17dee0 2022-07-05T12:12:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.959+0000 7f700202e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc17f830 con 0x7f6ffc17f3b0 2022-07-05T12:12:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.959+0000 7f700202e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc17c670 con 0x7f6ffc178610 2022-07-05T12:12:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ffc17dee0 0x7f6ffc181e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ffc17dee0 0x7f6ffc181e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60838/0 (socket says 172.21.15.90:60838) 2022-07-05T12:12:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2061212780 learned_addr learned my addr 172.21.15.90:0/2061212780 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2061212780 >> v2:172.21.15.110:3300/0 conn(0x7f6ffc17f3b0 0x7f6ffc17d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2061212780 >> v2:172.21.15.149:3300/0 conn(0x7f6ffc178610 msgr2=0x7f6ffc1789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2061212780 >> v2:172.21.15.149:3300/0 conn(0x7f6ffc178610 0x7f6ffc1789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:12:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2061212780 >> v2:172.21.15.110:3300/0 conn(0x7f6ffc17f3b0 msgr2=0x7f6ffc17d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2061212780 >> v2:172.21.15.110:3300/0 conn(0x7f6ffc17f3b0 0x7f6ffc17d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2061212780 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc17c950 con 0x7f6ffc17dee0 2022-07-05T12:12:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2061212780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17dee0 0x7f6ffc181e30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f6ffc05ff10 tx=0x7f6ff40090f0).ready entity=mon.0 client_cookie=922fa3062233933a server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffa7fc700 1 -- 172.21.15.90:0/2061212780 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40058d0 con 0x7f6ffc17dee0 2022-07-05T12:12:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffa7fc700 1 -- 172.21.15.90:0/2061212780 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff4005a30 con 0x7f6ffc17dee0 2022-07-05T12:12:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.960+0000 7f6ffa7fc700 1 -- 172.21.15.90:0/2061212780 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4005db0 con 0x7f6ffc17dee0 2022-07-05T12:12:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 -- 172.21.15.90:0/2061212780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17dee0 msgr2=0x7f6ffc181e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 --2- 172.21.15.90:0/2061212780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17dee0 0x7f6ffc181e30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f6ffc05ff10 tx=0x7f6ff40090f0).stop 2022-07-05T12:12:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 -- 172.21.15.90:0/2061212780 shutdown_connections 2022-07-05T12:12:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 --2- 172.21.15.90:0/2061212780 >> v2:172.21.15.149:3300/0 conn(0x7f6ffc178610 0x7f6ffc1789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-07-05T12:12:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 --2- 172.21.15.90:0/2061212780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17dee0 0x7f6ffc181e30 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:16.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 --2- 172.21.15.90:0/2061212780 >> v2:172.21.15.110:3300/0 conn(0x7f6ffc17f3b0 0x7f6ffc17d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:16.996 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 -- 172.21.15.90:0/2061212780 >> 172.21.15.90:0/2061212780 conn(0x7f6ffc0f2210 msgr2=0x7f6ffc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:16.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 -- 172.21.15.90:0/2061212780 shutdown_connections 2022-07-05T12:12:16.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.961+0000 7f700202e700 1 -- 172.21.15.90:0/2061212780 wait complete. 2022-07-05T12:12:16.997 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.962+0000 7f700202e700 1 Processor -- start 2022-07-05T12:12:16.998 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.962+0000 7f700202e700 1 -- start start 2022-07-05T12:12:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f700202e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ffc178610 0x7f6ffc17b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f700202e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ffc17dee0 0x7f6ffc1715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f700202e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17f3b0 0x7f6ffc1792e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f700202e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc0c8420 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.000 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f700202e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc17b100 con 0x7f6ffc17dee0 2022-07-05T12:12:17.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f700202e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc17a4f0 con 0x7f6ffc178610 2022-07-05T12:12:17.001 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f6ffbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17f3b0 0x7f6ffc1792e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f6ffbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17f3b0 0x7f6ffc1792e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60844/0 (socket says 172.21.15.90:60844) 2022-07-05T12:12:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f6ffbfff700 1 -- 172.21.15.90:0/500813582 learned_addr learned my addr 172.21.15.90:0/500813582 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.963+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ffc178610 0x7f6ffc17b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ffc17dee0 0x7f6ffc1715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6ffbfff700 1 -- 172.21.15.90:0/500813582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ffc178610 msgr2=0x7f6ffc17b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ffc178610 0x7f6ffc17b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6ffbfff700 1 -- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ffc17dee0 msgr2=0x7f6ffc1715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ffc17dee0 0x7f6ffc1715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6ffbfff700 1 -- 172.21.15.90:0/500813582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff4009350 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17f3b0 0x7f6ffc1792e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f6ff4000ea0 tx=0x7f6ff4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6fe37fe700 1 -- 172.21.15.90:0/500813582 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40058d0 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6fe37fe700 1 -- 172.21.15.90:0/500813582 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff400b810 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc17a7d0 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f6fe37fe700 1 -- 172.21.15.90:0/500813582 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400bbd0 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.964+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc17ad90 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.966+0000 7f6fe37fe700 1 -- 172.21.15.90:0/500813582 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6ff400f070 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.966+0000 7f6fe37fe700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fdc08ba40 0x7f6fdc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.966+0000 7f6fe37fe700 1 -- 172.21.15.90:0/500813582 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6ff40b0fb0 con 0x7f6ffc17f3b0 2022-07-05T12:12:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.967+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fdc08ba40 0x7f6fdc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.967+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fdc08ba40 0x7f6fdc08df00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f6fec007580 tx=0x7f6fec009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.968+0000 7f70139bab80 1 Processor -- start 2022-07-05T12:12:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.968+0000 7f70139bab80 1 -- start start 2022-07-05T12:12:17.070 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f70139bab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae057c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f70139bab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae53990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f70139bab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae497a0 0x557dcae49c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.071 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f70139bab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcadcf2d0 con 0x557dcae497a0 2022-07-05T12:12:17.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f70139bab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcad46aa0 con 0x557dcae493c0 2022-07-05T12:12:17.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f70139bab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcad5b950 con 0x557dcae05cb0 2022-07-05T12:12:17.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f6ffbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae497a0 0x557dcae49c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f6ffbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae497a0 0x557dcae49c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60852/0 (socket says 172.21.15.90:60852) 2022-07-05T12:12:17.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2252087524 learned_addr learned my addr 172.21.15.90:0/2252087524 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:17.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.969+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae53990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2252087524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 msgr2=0x557dcae53990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae53990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2252087524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 msgr2=0x557dcae057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae057c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffbfff700 1 -- 172.21.15.90:0/2252087524 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dcab8d9e0 con 0x557dcae497a0 2022-07-05T12:12:17.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:12:17.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae497a0 0x557dcae49c20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f6ff4081d70 tx=0x7f6ff4006e50).ready entity=mon.0 client_cookie=97b8a7ec5950f709 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:17.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6fe0ff9700 1 -- 172.21.15.90:0/2252087524 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40858d0 con 0x557dcae497a0 2022-07-05T12:12:17.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6fe0ff9700 1 -- 172.21.15.90:0/2252087524 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff408b1b0 con 0x557dcae497a0 2022-07-05T12:12:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.970+0000 7f6fe0ff9700 1 -- 172.21.15.90:0/2252087524 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40ae700 con 0x557dcae497a0 2022-07-05T12:12:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 -- 172.21.15.90:0/2252087524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae497a0 msgr2=0x557dcae49c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae497a0 0x557dcae49c20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f6ff4081d70 tx=0x7f6ff4006e50).stop 2022-07-05T12:12:17.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 -- 172.21.15.90:0/2252087524 shutdown_connections 2022-07-05T12:12:17.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae497a0 0x557dcae49c20 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 --2- 172.21.15.90:0/2252087524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae53990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 -- 172.21.15.90:0/2252087524 >> 172.21.15.90:0/2252087524 conn(0x557dcac741c0 msgr2=0x557dcae08ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 -- 172.21.15.90:0/2252087524 shutdown_connections 2022-07-05T12:12:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 -- 172.21.15.90:0/2252087524 wait complete. 2022-07-05T12:12:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.971+0000 7f70139bab80 1 -- start start 2022-07-05T12:12:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.972+0000 7f70139bab80 1 Processor -- start 2022-07-05T12:12:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.972+0000 7f70139bab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae05cb0 0x557dcae89130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae77690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcae37320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcad23120 con 0x557dcae05cb0 2022-07-05T12:12:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae792d0 con 0x557dcae493c0 2022-07-05T12:12:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae89e00 con 0x557dcae497a0 2022-07-05T12:12:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 10 client.0 ll_register_callbacks cb 0x557dcadc91b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:12:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae05cb0 0x557dcae89130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae05cb0 0x557dcae89130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60854/0 (socket says 172.21.15.90:60854) 2022-07-05T12:12:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 -- 172.21.15.90:0/1087395265 learned_addr learned my addr 172.21.15.90:0/1087395265 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcae37320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae77690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 -- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 msgr2=0x557dcae37320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcae37320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 -- 172.21.15.90:0/1087395265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 msgr2=0x557dcae77690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae77690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 -- 172.21.15.90:0/1087395265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc17ad90 con 0x557dcae05cb0 2022-07-05T12:12:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae77690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:12:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae05cb0 0x557dcae89130 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f6fec014410 tx=0x7f6fec012000).ready entity=mon.0 client_cookie=e4e09e1119d420d2 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6fd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:12:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/1087395265 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0170d0 con 0x557dcae05cb0 2022-07-05T12:12:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/1087395265 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6fec017230 con 0x557dcae05cb0 2022-07-05T12:12:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557dcae03440 con 0x557dcae05cb0 2022-07-05T12:12:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/1087395265 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fec015600 con 0x557dcae05cb0 2022-07-05T12:12:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 10 client.6318 fetch_fsmap learned FSMap version 41 2022-07-05T12:12:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x557dcabfccd0 con 0x557dcae05cb0 2022-07-05T12:12:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.973+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/1087395265 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec02c020 con 0x557dcae05cb0 2022-07-05T12:12:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/1087395265 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f6fec015760 con 0x557dcae05cb0 2022-07-05T12:12:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f70139bab80 10 client.6318 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:12:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f70139bab80 10 client.6318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:12:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f70139bab80 20 client.6318 populate_metadata read hostname 'smithi090' 2022-07-05T12:12:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f70139bab80 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcae8af60 0x557dcae8b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f70139bab80 4 client.6318 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:12:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557dcad517f0 con 0x557dcae8af60 2022-07-05T12:12:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcae8af60 0x557dcae8b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f6fd5ffb700 10 client.6318 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.974+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcae8af60 0x557dcae8b340 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7a3261ce9a9ef86d server_cookie=d661d80a89d93eed in_seq=0 out_seq=0 2022-07-05T12:12:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/1087395265 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x557dcad517f0 con 0x557dcae8af60 2022-07-05T12:12:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f6fd5ffb700 10 client.6318 handle_command_reply: tid=0 2022-07-05T12:12:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 client.6318 shutdown 2022-07-05T12:12:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae05cb0 msgr2=0x557dcae89130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae05cb0 0x557dcae89130 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f6fec014410 tx=0x7f6fec012000).stop 2022-07-05T12:12:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 shutdown_connections 2022-07-05T12:12:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcae8af60 0x557dcae8b340 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcae37320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f6fd5ffb700 0 client.6318 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae05cb0 0x557dcae89130 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 --2- 172.21.15.90:0/1087395265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae493c0 0x557dcae77690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 >> 172.21.15.90:0/1087395265 conn(0x557dcac741c0 msgr2=0x557dcae76150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 shutdown_connections 2022-07-05T12:12:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 1 -- 172.21.15.90:0/1087395265 wait complete. 2022-07-05T12:12:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.975+0000 7f70139bab80 20 client.6318 trim_cache size 0 max 16384 2022-07-05T12:12:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.991+0000 7f70139bab80 1 Processor -- start 2022-07-05T12:12:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.991+0000 7f70139bab80 1 -- start start 2022-07-05T12:12:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f70139bab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae48540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f70139bab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcae45270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f70139bab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae497a0 0x557dcae7b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f70139bab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae092b0 con 0x557dcae493c0 2022-07-05T12:12:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f70139bab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae08a10 con 0x557dcae497a0 2022-07-05T12:12:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f70139bab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae870e0 con 0x557dcae05cb0 2022-07-05T12:12:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcae45270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcae45270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60864/0 (socket says 172.21.15.90:60864) 2022-07-05T12:12:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2115709547 learned_addr learned my addr 172.21.15.90:0/2115709547 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae48540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae497a0 0x557dcae7b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2115709547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 msgr2=0x557dcae48540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae48540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2115709547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae497a0 msgr2=0x557dcae7b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae497a0 0x557dcae7b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2115709547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dcabcafd0 con 0x557dcae493c0 2022-07-05T12:12:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcae45270 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f6ff0006cb0 tx=0x7f6ff0008040).ready entity=mon.0 client_cookie=ee5363440fea4441 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6fe17fa700 1 -- 172.21.15.90:0/2115709547 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00180d0 con 0x557dcae493c0 2022-07-05T12:12:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6fe17fa700 1 -- 172.21.15.90:0/2115709547 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff000c040 con 0x557dcae493c0 2022-07-05T12:12:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.992+0000 7f6fe17fa700 1 -- 172.21.15.90:0/2115709547 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0018810 con 0x557dcae493c0 2022-07-05T12:12:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 -- 172.21.15.90:0/2115709547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 msgr2=0x557dcae45270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcae45270 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f6ff0006cb0 tx=0x7f6ff0008040).stop 2022-07-05T12:12:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 -- 172.21.15.90:0/2115709547 shutdown_connections 2022-07-05T12:12:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae497a0 0x557dcae7b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae05cb0 0x557dcae48540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 --2- 172.21.15.90:0/2115709547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcae45270 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 -- 172.21.15.90:0/2115709547 >> 172.21.15.90:0/2115709547 conn(0x557dcac741c0 msgr2=0x557dcae518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 -- 172.21.15.90:0/2115709547 shutdown_connections 2022-07-05T12:12:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 -- 172.21.15.90:0/2115709547 wait complete. 2022-07-05T12:12:17.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 -- start start 2022-07-05T12:12:17.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.993+0000 7f70139bab80 1 Processor -- start 2022-07-05T12:12:17.123 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.994+0000 7f70139bab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae05cb0 0x557dcae04090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.994+0000 7f70139bab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcaecf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.994+0000 7f70139bab80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcaeca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.994+0000 7f70139bab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae04d60 con 0x557dcae493c0 2022-07-05T12:12:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.994+0000 7f70139bab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae530a0 con 0x557dcae05cb0 2022-07-05T12:12:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.994+0000 7f70139bab80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcae07410 con 0x557dcae497a0 2022-07-05T12:12:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.994+0000 7f70139bab80 10 client.0 ll_register_callbacks cb 0x557dcadc91b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:12:17.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcaecf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.127 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcaecf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60870/0 (socket says 172.21.15.90:60870) 2022-07-05T12:12:17.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2954915108 learned_addr learned my addr 172.21.15.90:0/2954915108 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:17.128 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffbfff700 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcaeca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae05cb0 0x557dcae04090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.129 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 msgr2=0x557dcaeca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcaeca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.130 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2954915108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae05cb0 msgr2=0x557dcae04090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:17.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae05cb0 0x557dcae04090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.131 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 -- 172.21.15.90:0/2954915108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff000a9e0 con 0x557dcae493c0 2022-07-05T12:12:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6ffaffd700 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcaecf980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x557dcae09440 tx=0x7f6ff0024000).ready entity=mon.0 client_cookie=8c412ed5e5d4bcc server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6fd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:12:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/2954915108 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0018bc0 con 0x557dcae493c0 2022-07-05T12:12:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/2954915108 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7f6ff0018d20 con 0x557dcae493c0 2022-07-05T12:12:17.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ff408b1b0 con 0x557dcae493c0 2022-07-05T12:12:17.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/2954915108 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ff000a490 con 0x557dcae493c0 2022-07-05T12:12:17.134 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f70139bab80 10 client.6324 fetch_fsmap learned FSMap version 41 2022-07-05T12:12:17.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x557dcae52d90 con 0x557dcae493c0 2022-07-05T12:12:17.135 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/2954915108 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff408b1b0 con 0x557dcae493c0 2022-07-05T12:12:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/2954915108 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7f6ff0011040 con 0x557dcae493c0 2022-07-05T12:12:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f70139bab80 10 client.6324 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:12:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f70139bab80 10 client.6324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:12:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f70139bab80 20 client.6324 populate_metadata read hostname 'smithi090' 2022-07-05T12:12:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.995+0000 7f70139bab80 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcaed0310 0x557dcae06ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 4 client.6324 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:12:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557dcad48690 con 0x557dcaed0310 2022-07-05T12:12:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcaed0310 0x557dcae06ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f6fd5ffb700 10 client.6324 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f6ffb7fe700 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcaed0310 0x557dcae06ad0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5da4c287612cf852 server_cookie=db2c128b683e3021 in_seq=0 out_seq=0 2022-07-05T12:12:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f6fd5ffb700 1 -- 172.21.15.90:0/2954915108 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557dcad48690 con 0x557dcaed0310 2022-07-05T12:12:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f6fd5ffb700 10 client.6324 handle_command_reply: tid=0 2022-07-05T12:12:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 client.6324 shutdown 2022-07-05T12:12:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 msgr2=0x557dcaecf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcaecf980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x557dcae09440 tx=0x7f6ff0024000).stop 2022-07-05T12:12:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 shutdown_connections 2022-07-05T12:12:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x557dcaed0310 0x557dcae06ad0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dcae497a0 0x557dcaeca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dcae05cb0 0x557dcae04090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 --2- 172.21.15.90:0/2954915108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557dcae493c0 0x557dcaecf980 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f6fd5ffb700 0 client.6324 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 >> 172.21.15.90:0/2954915108 conn(0x557dcac741c0 msgr2=0x557dcae08b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 shutdown_connections 2022-07-05T12:12:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.996+0000 7f70139bab80 1 -- 172.21.15.90:0/2954915108 wait complete. 2022-07-05T12:12:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f70139bab80 20 client.6324 trim_cache size 0 max 16384 2022-07-05T12:12:17.146 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:12:17.147 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:12:17.147 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:12:17.148 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:12:17.148 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:12:17.149 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:12:17.149 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:12:17.150 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:12:17.150 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:12:17.151 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:12:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fdc08ba40 msgr2=0x7f6fdc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fdc08ba40 0x7f6fdc08df00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f6fec007580 tx=0x7f6fec009780).stop 2022-07-05T12:12:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17f3b0 msgr2=0x7f6ffc1792e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:17.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17f3b0 0x7f6ffc1792e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f6ff4000ea0 tx=0x7f6ff4016000).stop 2022-07-05T12:12:17.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 shutdown_connections 2022-07-05T12:12:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7f6fdc08ba40 0x7f6fdc08df00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ffc17f3b0 0x7f6ffc1792e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ffc178610 0x7f6ffc17b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 --2- 172.21.15.90:0/500813582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ffc17dee0 0x7f6ffc1715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 >> 172.21.15.90:0/500813582 conn(0x7f6ffc0f2210 msgr2=0x7f6ffc0c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 shutdown_connections 2022-07-05T12:12:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:16.997+0000 7f700202e700 1 -- 172.21.15.90:0/500813582 wait complete. 2022-07-05T12:12:17.161 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:12:47.163 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:12:47.330 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.296+0000 7fd7edd44700 1 Processor -- start 2022-07-05T12:12:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.296+0000 7fd7edd44700 1 -- start start 2022-07-05T12:12:47.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7edd44700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd7e817dcd0 0x7fd7e8063200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.332 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7edd44700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd7e80636f0 0x7fd7e8063b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7edd44700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8061f10 con 0x7fd7e817e4b0 2022-07-05T12:12:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7edd44700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e8062d70 con 0x7fd7e80636f0 2022-07-05T12:12:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7edd44700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e8062160 con 0x7fd7e817dcd0 2022-07-05T12:12:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7e7fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd7e80636f0 0x7fd7e8063b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7e7fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd7e80636f0 0x7fd7e8063b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60876/0 (socket says 172.21.15.90:60876) 2022-07-05T12:12:47.335 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7e7fff700 1 -- 172.21.15.90:0/3793538313 learned_addr learned my addr 172.21.15.90:0/3793538313 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:47.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.297+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/3793538313 >> v2:172.21.15.110:3300/0 conn(0x7fd7e817dcd0 0x7fd7e8063200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.336 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e7fff700 1 -- 172.21.15.90:0/3793538313 >> v2:172.21.15.110:3300/0 conn(0x7fd7e817dcd0 msgr2=0x7fd7e8063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.337 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/3793538313 >> v2:172.21.15.110:3300/0 conn(0x7fd7e817dcd0 0x7fd7e8063200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e7fff700 1 -- 172.21.15.90:0/3793538313 >> v1:172.21.15.149:6789/0 conn(0x7fd7e817e4b0 legacy=0x7fd7e817e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.338 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e7fff700 1 -- 172.21.15.90:0/3793538313 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8062440 con 0x7fd7e80636f0 2022-07-05T12:12:47.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/3793538313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e8063b70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fd7e8088bc0 tx=0x7fd7dc0090f0).ready entity=mon.0 client_cookie=b518ec521a250ca7 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:47.339 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e77fe700 1 -- 172.21.15.90:0/3793538313 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00b600 con 0x7fd7e80636f0 2022-07-05T12:12:47.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e77fe700 1 -- 172.21.15.90:0/3793538313 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc00b760 con 0x7fd7e80636f0 2022-07-05T12:12:47.340 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7e77fe700 1 -- 172.21.15.90:0/3793538313 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00bb00 con 0x7fd7e80636f0 2022-07-05T12:12:47.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7edd44700 1 -- 172.21.15.90:0/3793538313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 msgr2=0x7fd7e8063b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.341 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7edd44700 1 --2- 172.21.15.90:0/3793538313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e8063b70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fd7e8088bc0 tx=0x7fd7dc0090f0).stop 2022-07-05T12:12:47.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7edd44700 1 -- 172.21.15.90:0/3793538313 shutdown_connections 2022-07-05T12:12:47.342 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7edd44700 1 --2- 172.21.15.90:0/3793538313 >> v2:172.21.15.110:3300/0 conn(0x7fd7e817dcd0 0x7fd7e8063200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7edd44700 1 --2- 172.21.15.90:0/3793538313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e8063b70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7edd44700 1 -- 172.21.15.90:0/3793538313 >> 172.21.15.90:0/3793538313 conn(0x7fd7e80f5470 msgr2=0x7fd7e80f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:47.343 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.298+0000 7fd7edd44700 1 -- 172.21.15.90:0/3793538313 shutdown_connections 2022-07-05T12:12:47.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.299+0000 7fd7edd44700 1 -- 172.21.15.90:0/3793538313 wait complete. 2022-07-05T12:12:47.344 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.300+0000 7fd7edd44700 1 Processor -- start 2022-07-05T12:12:47.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.300+0000 7fd7edd44700 1 -- start start 2022-07-05T12:12:47.345 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7edd44700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7edd44700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7e817dcd0 0x7fd7e8191990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7edd44700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7e817e4b0 0x7fd7e8191e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7edd44700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80cb3d0 con 0x7fd7e80636f0 2022-07-05T12:12:47.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7edd44700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80ca4e0 con 0x7fd7e817e4b0 2022-07-05T12:12:47.347 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7edd44700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80ca7c0 con 0x7fd7e817dcd0 2022-07-05T12:12:47.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7ecd42700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.348 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7ecd42700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e815dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60880/0 (socket says 172.21.15.90:60880) 2022-07-05T12:12:47.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7ecd42700 1 -- 172.21.15.90:0/1974585392 learned_addr learned my addr 172.21.15.90:0/1974585392 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:47.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7e817dcd0 0x7fd7e8191990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.349 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.301+0000 7fd7ed543700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7e817e4b0 0x7fd7e8191e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7ecd42700 1 -- 172.21.15.90:0/1974585392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7e817dcd0 msgr2=0x7fd7e8191990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.350 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7e817dcd0 0x7fd7e8191990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7ecd42700 1 -- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7e817e4b0 msgr2=0x7fd7e8191e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.351 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7e817e4b0 0x7fd7e8191e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7ecd42700 1 -- 172.21.15.90:0/1974585392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc009370 con 0x7fd7e80636f0 2022-07-05T12:12:47.352 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7ed543700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7e817e4b0 0x7fd7e8191e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:12:47.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e815dad0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fd7e0009fa0 tx=0x7fd7e0009880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:47.353 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7e4ff9700 1 -- 172.21.15.90:0/1974585392 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000ec70 con 0x7fd7e80636f0 2022-07-05T12:12:47.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7e4ff9700 1 -- 172.21.15.90:0/1974585392 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000edd0 con 0x7fd7e80636f0 2022-07-05T12:12:47.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e80caaa0 con 0x7fd7e80636f0 2022-07-05T12:12:47.354 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7e4ff9700 1 -- 172.21.15.90:0/1974585392 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0014610 con 0x7fd7e80636f0 2022-07-05T12:12:47.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.302+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e80cb060 con 0x7fd7e80636f0 2022-07-05T12:12:47.355 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.304+0000 7fd7e4ff9700 1 -- 172.21.15.90:0/1974585392 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd7e001b030 con 0x7fd7e80636f0 2022-07-05T12:12:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.304+0000 7fd7e4ff9700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd7c808ba40 0x7fd7c808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.304+0000 7fd7e4ff9700 1 -- 172.21.15.90:0/1974585392 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fd7e00b0bf0 con 0x7fd7e80636f0 2022-07-05T12:12:47.357 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.304+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd7c808ba40 0x7fd7c808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.358 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.305+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd7c808ba40 0x7fd7c808df00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fd7dc00b3c0 tx=0x7fd7dc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:47.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.306+0000 7fd800932b80 1 Processor -- start 2022-07-05T12:12:47.359 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.306+0000 7fd800932b80 1 -- start start 2022-07-05T12:12:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd800932b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad44b0 0x55fcafa908b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd800932b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafa90da0 0x55fcafadea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd800932b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafad4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.364 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd800932b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafa5a2d0 con 0x55fcafa90da0 2022-07-05T12:12:47.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd800932b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcaf9d1aa0 con 0x55fcafad4890 2022-07-05T12:12:47.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd800932b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcaf9e6950 con 0x55fcafad44b0 2022-07-05T12:12:47.365 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafa90da0 0x55fcafadea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafa90da0 0x55fcafadea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60890/0 (socket says 172.21.15.90:60890) 2022-07-05T12:12:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 -- 172.21.15.90:0/201703411 learned_addr learned my addr 172.21.15.90:0/201703411 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:47.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad44b0 0x55fcafa908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.367 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7ed543700 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafad4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 -- 172.21.15.90:0/201703411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad44b0 msgr2=0x55fcafa908b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.368 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad44b0 0x55fcafa908b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 -- 172.21.15.90:0/201703411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 msgr2=0x55fcafad4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafad4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.369 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 -- 172.21.15.90:0/201703411 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcaf8189e0 con 0x55fcafa90da0 2022-07-05T12:12:47.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.307+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafa90da0 0x55fcafadea80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7fd7dc00bff0 tx=0x7fd7dc01e040).ready entity=mon.0 client_cookie=ddf6e5b000eae90b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:47.370 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd7cdffb700 1 -- 172.21.15.90:0/201703411 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02a070 con 0x55fcafa90da0 2022-07-05T12:12:47.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd7cdffb700 1 -- 172.21.15.90:0/201703411 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc01a680 con 0x55fcafa90da0 2022-07-05T12:12:47.371 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd7cdffb700 1 -- 172.21.15.90:0/201703411 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc01aa20 con 0x55fcafa90da0 2022-07-05T12:12:47.372 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 -- 172.21.15.90:0/201703411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafa90da0 msgr2=0x55fcafadea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafa90da0 0x55fcafadea80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7fd7dc00bff0 tx=0x7fd7dc01e040).stop 2022-07-05T12:12:47.373 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 -- 172.21.15.90:0/201703411 shutdown_connections 2022-07-05T12:12:47.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafad4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad44b0 0x55fcafa908b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.374 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 --2- 172.21.15.90:0/201703411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafa90da0 0x55fcafadea80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.375 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 -- 172.21.15.90:0/201703411 >> 172.21.15.90:0/201703411 conn(0x55fcaf8ff1c0 msgr2=0x55fcafa93ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:47.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 -- 172.21.15.90:0/201703411 shutdown_connections 2022-07-05T12:12:47.377 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.308+0000 7fd800932b80 1 -- 172.21.15.90:0/201703411 wait complete. 2022-07-05T12:12:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.309+0000 7fd800932b80 1 -- start start 2022-07-05T12:12:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.309+0000 7fd800932b80 1 Processor -- start 2022-07-05T12:12:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd800932b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafa90da0 0x55fcafac92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd800932b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafacef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.379 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd800932b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad4890 0x55fcafa94c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd800932b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcaf9ae120 con 0x55fcafad44b0 2022-07-05T12:12:47.380 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd800932b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcaface530 con 0x55fcafa90da0 2022-07-05T12:12:47.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd800932b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafac97a0 con 0x55fcafad4890 2022-07-05T12:12:47.381 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd800932b80 10 client.0 ll_register_callbacks cb 0x55fcafa54380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:12:47.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafacef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.382 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafacef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60896/0 (socket says 172.21.15.90:60896) 2022-07-05T12:12:47.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd7e7fff700 1 -- 172.21.15.90:0/741486521 learned_addr learned my addr 172.21.15.90:0/741486521 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:47.383 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.310+0000 7fd7ed543700 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad4890 0x55fcafa94c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafa90da0 0x55fcafac92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.384 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7e7fff700 1 -- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad4890 msgr2=0x55fcafa94c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.386 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad4890 0x55fcafa94c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7e7fff700 1 -- 172.21.15.90:0/741486521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafa90da0 msgr2=0x55fcafac92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.387 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafa90da0 0x55fcafac92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7e7fff700 1 -- 172.21.15.90:0/741486521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e8062440 con 0x55fcafad44b0 2022-07-05T12:12:47.388 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafacef40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fd7dc00bff0 tx=0x7fd7dc026000).ready entity=mon.0 client_cookie=8a355f7143488e9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:47.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:12:47.389 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/741486521 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02a040 con 0x55fcafad44b0 2022-07-05T12:12:47.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/741486521 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fd7dc01c630 con 0x55fcafad44b0 2022-07-05T12:12:47.390 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcafa8e690 con 0x55fcafad44b0 2022-07-05T12:12:47.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/741486521 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7dc01ca00 con 0x55fcafad44b0 2022-07-05T12:12:47.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd800932b80 10 client.6336 fetch_fsmap learned FSMap version 41 2022-07-05T12:12:47.391 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55fcaf887cd0 con 0x55fcafad44b0 2022-07-05T12:12:47.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/741486521 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fcafa8e690 con 0x55fcafad44b0 2022-07-05T12:12:47.392 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/741486521 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fd7dc01cb60 con 0x55fcafad44b0 2022-07-05T12:12:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd800932b80 10 client.6336 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:12:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.311+0000 7fd800932b80 10 client.6336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:12:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.312+0000 7fd800932b80 20 client.6336 populate_metadata read hostname 'smithi090' 2022-07-05T12:12:47.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.312+0000 7fd800932b80 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad2b60 0x55fcafb12590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.394 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.312+0000 7fd800932b80 4 client.6336 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:12:47.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.312+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcaf9dc7f0 con 0x55fcafad2b60 2022-07-05T12:12:47.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.312+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad2b60 0x55fcafb12590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.395 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.312+0000 7fd7c2ffd700 10 client.6336 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:47.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.312+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad2b60 0x55fcafb12590 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=29d69a20e8e81ec1 server_cookie=3213c3d416eccdf2 in_seq=0 out_seq=0 2022-07-05T12:12:47.396 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/741486521 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55fcaf9dc7f0 con 0x55fcafad2b60 2022-07-05T12:12:47.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd7c2ffd700 10 client.6336 handle_command_reply: tid=0 2022-07-05T12:12:47.397 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 client.6336 shutdown 2022-07-05T12:12:47.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 msgr2=0x55fcafacef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafacef40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fd7dc00bff0 tx=0x7fd7dc026000).stop 2022-07-05T12:12:47.398 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 shutdown_connections 2022-07-05T12:12:47.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad2b60 0x55fcafb12590 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafad4890 0x55fcafa94c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd7c2ffd700 0 client.6336 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:47.399 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafa90da0 0x55fcafac92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 --2- 172.21.15.90:0/741486521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafacef40 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 >> 172.21.15.90:0/741486521 conn(0x55fcaf8ff1c0 msgr2=0x55fcafb01270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:47.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 shutdown_connections 2022-07-05T12:12:47.400 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 1 -- 172.21.15.90:0/741486521 wait complete. 2022-07-05T12:12:47.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.313+0000 7fd800932b80 20 client.6336 trim_cache size 0 max 16384 2022-07-05T12:12:47.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.328+0000 7fd800932b80 1 Processor -- start 2022-07-05T12:12:47.401 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.329+0000 7fd800932b80 1 -- start start 2022-07-05T12:12:47.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.329+0000 7fd800932b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafb166c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.329+0000 7fd800932b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafb01240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.329+0000 7fd800932b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafadcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.411 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd800932b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafa94100 con 0x55fcafad44b0 2022-07-05T12:12:47.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd800932b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafa907a0 con 0x55fcafad4890 2022-07-05T12:12:47.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd800932b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafb01730 con 0x55fcafa90da0 2022-07-05T12:12:47.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafb01240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.412 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafb01240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60902/0 (socket says 172.21.15.90:60902) 2022-07-05T12:12:47.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 -- 172.21.15.90:0/674829603 learned_addr learned my addr 172.21.15.90:0/674829603 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:47.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafb166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7ed543700 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafadcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.413 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 -- 172.21.15.90:0/674829603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 msgr2=0x55fcafb166c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafb166c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 -- 172.21.15.90:0/674829603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 msgr2=0x55fcafadcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafadcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.414 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 -- 172.21.15.90:0/674829603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcaf855fd0 con 0x55fcafad44b0 2022-07-05T12:12:47.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7ed543700 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafadcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:12:47.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafb01240 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fd7dc009fa0 tx=0x7fd7dc02e000).ready entity=mon.0 client_cookie=a157b1b2834a67c9 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:47.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7ce7fc700 1 -- 172.21.15.90:0/674829603 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02a070 con 0x55fcafad44b0 2022-07-05T12:12:47.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7ce7fc700 1 -- 172.21.15.90:0/674829603 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc00bc60 con 0x55fcafad44b0 2022-07-05T12:12:47.415 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.330+0000 7fd7ce7fc700 1 -- 172.21.15.90:0/674829603 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc01ca00 con 0x55fcafad44b0 2022-07-05T12:12:47.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 -- 172.21.15.90:0/674829603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 msgr2=0x55fcafb01240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafb01240 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fd7dc009fa0 tx=0x7fd7dc02e000).stop 2022-07-05T12:12:47.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 -- 172.21.15.90:0/674829603 shutdown_connections 2022-07-05T12:12:47.416 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafadcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafb166c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 --2- 172.21.15.90:0/674829603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafb01240 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.417 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 -- 172.21.15.90:0/674829603 >> 172.21.15.90:0/674829603 conn(0x55fcaf8ff1c0 msgr2=0x55fcafb12df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:47.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 -- 172.21.15.90:0/674829603 shutdown_connections 2022-07-05T12:12:47.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 -- 172.21.15.90:0/674829603 wait complete. 2022-07-05T12:12:47.418 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.331+0000 7fd800932b80 1 -- start start 2022-07-05T12:12:47.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.332+0000 7fd800932b80 1 Processor -- start 2022-07-05T12:12:47.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafad1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafac98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.419 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafb00050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafaca5b0 con 0x55fcafad44b0 2022-07-05T12:12:47.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafaffbc0 con 0x55fcafad4890 2022-07-05T12:12:47.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcafb6bfb0 con 0x55fcafa90da0 2022-07-05T12:12:47.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 10 client.0 ll_register_callbacks cb 0x55fcafa54380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:12:47.420 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafac98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafac98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60908/0 (socket says 172.21.15.90:60908) 2022-07-05T12:12:47.421 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 -- 172.21.15.90:0/1672228713 learned_addr learned my addr 172.21.15.90:0/1672228713 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:12:47.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafad1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7ed543700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafb00050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.422 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 -- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 msgr2=0x55fcafad1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafad1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 -- 172.21.15.90:0/1672228713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 msgr2=0x55fcafb00050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:12:47.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafb00050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 -- 172.21.15.90:0/1672228713 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fcaf887cd0 con 0x55fcafad44b0 2022-07-05T12:12:47.423 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7ed543700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafb00050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:12:47.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7e7fff700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafac98e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fd7dc01ce10 tx=0x7fd7dc01d000).ready entity=mon.0 client_cookie=fd73124e25a54c4e server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:12:47.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:12:47.424 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/1672228713 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02a040 con 0x55fcafad44b0 2022-07-05T12:12:47.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/1672228713 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fd7dc02f5b0 con 0x55fcafad44b0 2022-07-05T12:12:47.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7dc01a680 con 0x55fcafad44b0 2022-07-05T12:12:47.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/1672228713 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7dc01ca80 con 0x55fcafad44b0 2022-07-05T12:12:47.425 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 10 client.6342 fetch_fsmap learned FSMap version 41 2022-07-05T12:12:47.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.333+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55fcafb6b6e0 con 0x55fcafad44b0 2022-07-05T12:12:47.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/1672228713 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc01a680 con 0x55fcafad44b0 2022-07-05T12:12:47.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/1672228713 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fd7dc02f980 con 0x55fcafad44b0 2022-07-05T12:12:47.426 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd800932b80 10 client.6342 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:12:47.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd800932b80 10 client.6342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:12:47.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd800932b80 20 client.6342 populate_metadata read hostname 'smithi090' 2022-07-05T12:12:47.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd800932b80 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad3bb0 0x55fcafaceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:12:47.427 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd800932b80 4 client.6342 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:12:47.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fcaf9d3690 con 0x55fcafad3bb0 2022-07-05T12:12:47.428 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad3bb0 0x55fcafaceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:12:47.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd7c2ffd700 10 client.6342 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:47.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd7ecd42700 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad3bb0 0x55fcafaceb00 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=93e73def958bd8fc server_cookie=fd6dca46f042a39d in_seq=0 out_seq=0 2022-07-05T12:12:47.429 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd7c2ffd700 1 -- 172.21.15.90:0/1672228713 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fcaf9d3690 con 0x55fcafad3bb0 2022-07-05T12:12:47.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd7c2ffd700 10 client.6342 handle_command_reply: tid=0 2022-07-05T12:12:47.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.334+0000 7fd800932b80 1 client.6342 shutdown 2022-07-05T12:12:47.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 msgr2=0x55fcafac98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.430 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafac98e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fd7dc01ce10 tx=0x7fd7dc01d000).stop 2022-07-05T12:12:47.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 shutdown_connections 2022-07-05T12:12:47.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55fcafad3bb0 0x55fcafaceb00 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fcafad4890 0x55fcafb00050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.431 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fcafa90da0 0x55fcafad1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 --2- 172.21.15.90:0/1672228713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fcafad44b0 0x55fcafac98e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 >> 172.21.15.90:0/1672228713 conn(0x55fcaf8ff1c0 msgr2=0x55fcafb12df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:47.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7c2ffd700 0 client.6342 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:12:47.432 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 shutdown_connections 2022-07-05T12:12:47.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 1 -- 172.21.15.90:0/1672228713 wait complete. 2022-07-05T12:12:47.433 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd800932b80 20 client.6342 trim_cache size 0 max 16384 2022-07-05T12:12:47.434 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:12:47.434 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:12:47.434 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:12:47.434 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:12:47.435 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:12:47.435 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:12:47.435 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:12:47.435 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:12:47.436 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:12:47.436 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:12:47.438 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd7c808ba40 msgr2=0x7fd7c808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd7c808ba40 0x7fd7c808df00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fd7dc00b3c0 tx=0x7fd7dc017000).stop 2022-07-05T12:12:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 msgr2=0x7fd7e815dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:12:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e815dad0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fd7e0009fa0 tx=0x7fd7e0009880).stop 2022-07-05T12:12:47.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 shutdown_connections 2022-07-05T12:12:47.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fd7c808ba40 0x7fd7c808df00 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7e817e4b0 0x7fd7e8191e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.440 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7e80636f0 0x7fd7e815dad0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 --2- 172.21.15.90:0/1974585392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7e817dcd0 0x7fd7e8191990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:12:47.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 >> 172.21.15.90:0/1974585392 conn(0x7fd7e80f5470 msgr2=0x7fd7e8064100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:12:47.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 shutdown_connections 2022-07-05T12:12:47.441 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:12:47.335+0000 7fd7edd44700 1 -- 172.21.15.90:0/1974585392 wait complete. 2022-07-05T12:12:47.442 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:13:17.444 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:13:17.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.577+0000 7fe6488c2700 1 Processor -- start 2022-07-05T12:13:17.579 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.577+0000 7fe6488c2700 1 -- start start 2022-07-05T12:13:17.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe6488c2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe644063910 0x7fe6440ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.626 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe6488c2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6440ef830 0x7fe6440efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe6488c2700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe644061f10 con 0x7fe64417dcd0 2022-07-05T12:13:17.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe6488c2700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe644062d70 con 0x7fe644063910 2022-07-05T12:13:17.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe6488c2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe644062160 con 0x7fe6440ef830 2022-07-05T12:13:17.627 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe64259c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe644063910 0x7fe6440ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe642d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe64417dcd0 0x7fe644063200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53854/0 (socket says 172.21.15.90:53854) 2022-07-05T12:13:17.628 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe642d9d700 1 -- 172.21.15.90:0/2481886104 learned_addr learned my addr 172.21.15.90:0/2481886104 (peer_addr_for_me v1:172.21.15.90:0/0) 2022-07-05T12:13:17.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.578+0000 7fe64359e700 1 --2- 172.21.15.90:0/2481886104 >> v2:172.21.15.110:3300/0 conn(0x7fe6440ef830 0x7fe6440efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe64259c700 1 -- 172.21.15.90:0/2481886104 >> v2:172.21.15.110:3300/0 conn(0x7fe6440ef830 msgr2=0x7fe6440efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.629 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe64259c700 1 --2- 172.21.15.90:0/2481886104 >> v2:172.21.15.110:3300/0 conn(0x7fe6440ef830 0x7fe6440efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe64259c700 1 -- 172.21.15.90:0/2481886104 >> v1:172.21.15.90:6789/0 conn(0x7fe64417dcd0 legacy=0x7fe644063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe641d9b700 1 -- 172.21.15.90:0/2481886104 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359117856 0 0) 0x7fe644061f10 con 0x7fe64417dcd0 2022-07-05T12:13:17.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe64259c700 1 -- 172.21.15.90:0/2481886104 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644062440 con 0x7fe644063910 2022-07-05T12:13:17.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe64259c700 1 --2- 172.21.15.90:0/2481886104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe644063910 0x7fe6440ef340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fe644062ce0 tx=0x7fe638009060).ready entity=mon.0 client_cookie=53ecf51883ebbf44 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:17.630 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe641d9b700 1 -- 172.21.15.90:0/2481886104 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380090d0 con 0x7fe644063910 2022-07-05T12:13:17.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe641d9b700 1 -- 172.21.15.90:0/2481886104 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63800b580 con 0x7fe644063910 2022-07-05T12:13:17.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe641d9b700 1 -- 172.21.15.90:0/2481886104 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63800b900 con 0x7fe644063910 2022-07-05T12:13:17.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 -- 172.21.15.90:0/2481886104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe644063910 msgr2=0x7fe6440ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.631 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2481886104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe644063910 0x7fe6440ef340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fe644062ce0 tx=0x7fe638009060).stop 2022-07-05T12:13:17.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 -- 172.21.15.90:0/2481886104 shutdown_connections 2022-07-05T12:13:17.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2481886104 >> v2:172.21.15.110:3300/0 conn(0x7fe6440ef830 0x7fe6440efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2481886104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe644063910 0x7fe6440ef340 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.632 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 -- 172.21.15.90:0/2481886104 >> 172.21.15.90:0/2481886104 conn(0x7fe6440f5470 msgr2=0x7fe6440f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:17.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 -- 172.21.15.90:0/2481886104 shutdown_connections 2022-07-05T12:13:17.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.579+0000 7fe6488c2700 1 -- 172.21.15.90:0/2481886104 wait complete. 2022-07-05T12:13:17.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.581+0000 7fe6488c2700 1 Processor -- start 2022-07-05T12:13:17.633 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.581+0000 7fe6488c2700 1 -- start start 2022-07-05T12:13:17.634 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe6488c2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe644063910 0x7fe64418fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe6488c2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6440ef830 0x7fe6440c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe6488c2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe64417dcd0 0x7fe64418eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe6488c2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6441900f0 con 0x7fe64417dcd0 2022-07-05T12:13:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe6488c2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c3ff0 con 0x7fe644063910 2022-07-05T12:13:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe6488c2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c5130 con 0x7fe6440ef830 2022-07-05T12:13:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe64417dcd0 0x7fe64418eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe64417dcd0 0x7fe64418eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60922/0 (socket says 172.21.15.90:60922) 2022-07-05T12:13:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 -- 172.21.15.90:0/2435670015 learned_addr learned my addr 172.21.15.90:0/2435670015 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64259c700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6440ef830 0x7fe6440c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe642d9d700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe644063910 0x7fe64418fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 -- 172.21.15.90:0/2435670015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6440ef830 msgr2=0x7fe6440c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6440ef830 0x7fe6440c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 -- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe644063910 msgr2=0x7fe64418fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe644063910 0x7fe64418fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 -- 172.21.15.90:0/2435670015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380092a0 con 0x7fe64417dcd0 2022-07-05T12:13:17.639 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.582+0000 7fe64359e700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe64417dcd0 0x7fe64418eeb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fe634007f20 tx=0x7fe634009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:17.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.583+0000 7fe62affd700 1 -- 172.21.15.90:0/2435670015 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400eb90 con 0x7fe64417dcd0 2022-07-05T12:13:17.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.583+0000 7fe62affd700 1 -- 172.21.15.90:0/2435670015 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63400ecf0 con 0x7fe64417dcd0 2022-07-05T12:13:17.640 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.583+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6440c4240 con 0x7fe64417dcd0 2022-07-05T12:13:17.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.583+0000 7fe62affd700 1 -- 172.21.15.90:0/2435670015 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634014610 con 0x7fe64417dcd0 2022-07-05T12:13:17.641 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.583+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6440c4800 con 0x7fe64417dcd0 2022-07-05T12:13:17.642 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.584+0000 7fe62affd700 1 -- 172.21.15.90:0/2435670015 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe63401b030 con 0x7fe64417dcd0 2022-07-05T12:13:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.585+0000 7fe62affd700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe62408ba40 0x7fe62408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.585+0000 7fe62affd700 1 -- 172.21.15.90:0/2435670015 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fe6340b0be0 con 0x7fe64417dcd0 2022-07-05T12:13:17.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.585+0000 7fe642d9d700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe62408ba40 0x7fe62408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.586+0000 7fe642d9d700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe62408ba40 0x7fe62408df00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fe6440f4440 tx=0x7fe63c007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:17.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.587+0000 7fe65aa4fb80 1 Processor -- start 2022-07-05T12:13:17.647 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.587+0000 7fe65aa4fb80 1 -- start start 2022-07-05T12:13:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d826bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d8270da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d82703d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d826892d0 con 0x555d82703890 2022-07-05T12:13:17.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82600aa0 con 0x555d827034b0 2022-07-05T12:13:17.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82615950 con 0x555d826bfda0 2022-07-05T12:13:17.649 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d82703d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.650 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d82703d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60930/0 (socket says 172.21.15.90:60930) 2022-07-05T12:13:17.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 -- 172.21.15.90:0/4154312901 learned_addr learned my addr 172.21.15.90:0/4154312901 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:17.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe642d9d700 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d826bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.651 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64259c700 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d8270da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 -- 172.21.15.90:0/4154312901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 msgr2=0x555d8270da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d8270da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 -- 172.21.15.90:0/4154312901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 msgr2=0x555d826bf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.652 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d826bf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 -- 172.21.15.90:0/4154312901 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d824479e0 con 0x555d82703890 2022-07-05T12:13:17.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe64359e700 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d82703d10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fe634084f40 tx=0x7fe634081840).ready entity=mon.0 client_cookie=957e884ff656bc03 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:17.653 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe61ffff700 1 -- 172.21.15.90:0/4154312901 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634085500 con 0x555d82703890 2022-07-05T12:13:17.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe61ffff700 1 -- 172.21.15.90:0/4154312901 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63408ade0 con 0x555d82703890 2022-07-05T12:13:17.672 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.588+0000 7fe61ffff700 1 -- 172.21.15.90:0/4154312901 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634081c10 con 0x555d82703890 2022-07-05T12:13:17.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/4154312901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 msgr2=0x555d82703d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d82703d10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fe634084f40 tx=0x7fe634081840).stop 2022-07-05T12:13:17.673 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/4154312901 shutdown_connections 2022-07-05T12:13:17.674 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d82703d10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d826bf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/4154312901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d8270da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/4154312901 >> 172.21.15.90:0/4154312901 conn(0x555d8252e1c0 msgr2=0x555d826c2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:17.694 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/4154312901 shutdown_connections 2022-07-05T12:13:17.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.589+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/4154312901 wait complete. 2022-07-05T12:13:17.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.590+0000 7fe65aa4fb80 1 -- start start 2022-07-05T12:13:17.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.590+0000 7fe65aa4fb80 1 Processor -- start 2022-07-05T12:13:17.695 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d82742360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82744df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d825dd120 con 0x555d82703890 2022-07-05T12:13:17.696 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82732d70 con 0x555d827034b0 2022-07-05T12:13:17.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82741ed0 con 0x555d826bfda0 2022-07-05T12:13:17.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe65aa4fb80 10 client.0 ll_register_callbacks cb 0x555d82683380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:13:17.697 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe642d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d82742360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60936/0 (socket says 172.21.15.90:60936) 2022-07-05T12:13:17.698 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe64359e700 1 -- 172.21.15.90:0/3752576561 learned_addr learned my addr 172.21.15.90:0/3752576561 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:17.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe64259c700 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82744df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe64359e700 1 -- 172.21.15.90:0/3752576561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 msgr2=0x555d82742360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.591+0000 7fe64359e700 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d82742360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.699 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe64359e700 1 -- 172.21.15.90:0/3752576561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 msgr2=0x555d82744df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.703 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe64359e700 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82744df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe64359e700 1 -- 172.21.15.90:0/3752576561 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6440c4800 con 0x555d82703890 2022-07-05T12:13:17.704 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe64359e700 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826ca5f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fe634085200 tx=0x7fe634055000).ready entity=mon.0 client_cookie=680f2d0cd8721e18 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:17.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe61d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:13:17.705 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe61d7fa700 1 -- 172.21.15.90:0/3752576561 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634084c00 con 0x555d82703890 2022-07-05T12:13:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe61d7fa700 1 -- 172.21.15.90:0/3752576561 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fe63408a950 con 0x555d82703890 2022-07-05T12:13:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d826bd690 con 0x555d82703890 2022-07-05T12:13:17.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe61d7fa700 1 -- 172.21.15.90:0/3752576561 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6340812f0 con 0x555d82703890 2022-07-05T12:13:17.728 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 10 client.6357 fetch_fsmap learned FSMap version 41 2022-07-05T12:13:17.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x555d824b6cd0 con 0x555d82703890 2022-07-05T12:13:17.729 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe61d7fa700 1 -- 172.21.15.90:0/3752576561 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d826bd690 con 0x555d82703890 2022-07-05T12:13:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe61d7fa700 1 -- 172.21.15.90:0/3752576561 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fe634081450 con 0x555d82703890 2022-07-05T12:13:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 10 client.6357 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:13:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 10 client.6357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:13:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 20 client.6357 populate_metadata read hostname 'smithi090' 2022-07-05T12:13:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d8270d080 0x555d826f2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 4 client.6357 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:13:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d8260b7f0 con 0x555d8270d080 2022-07-05T12:13:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.592+0000 7fe642d9d700 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d8270d080 0x555d826f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.593+0000 7fe61d7fa700 10 client.6357 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:17.736 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.593+0000 7fe642d9d700 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d8270d080 0x555d826f2680 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9563fcf159591717 server_cookie=3f06ad2ca28cd9f5 in_seq=0 out_seq=0 2022-07-05T12:13:17.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.593+0000 7fe61d7fa700 1 -- 172.21.15.90:0/3752576561 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x555d8260b7f0 con 0x555d8270d080 2022-07-05T12:13:17.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.593+0000 7fe61d7fa700 10 client.6357 handle_command_reply: tid=0 2022-07-05T12:13:17.737 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.593+0000 7fe65aa4fb80 1 client.6357 shutdown 2022-07-05T12:13:17.744 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.593+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 msgr2=0x555d826ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.593+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826ca5f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fe634085200 tx=0x7fe634055000).stop 2022-07-05T12:13:17.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 shutdown_connections 2022-07-05T12:13:17.745 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d8270d080 0x555d826f2680 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826ca5f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.746 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d82742360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/3752576561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82744df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.747 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe61d7fa700 0 client.6357 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:17.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 >> 172.21.15.90:0/3752576561 conn(0x555d8252e1c0 msgr2=0x555d82730240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:17.748 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 shutdown_connections 2022-07-05T12:13:17.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/3752576561 wait complete. 2022-07-05T12:13:17.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.594+0000 7fe65aa4fb80 20 client.6357 trim_cache size 0 max 16384 2022-07-05T12:13:17.749 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.609+0000 7fe65aa4fb80 1 Processor -- start 2022-07-05T12:13:17.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.609+0000 7fe65aa4fb80 1 -- start start 2022-07-05T12:13:17.750 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d826c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82740e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.751 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82731960 con 0x555d82703890 2022-07-05T12:13:17.752 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82703f10 con 0x555d827034b0 2022-07-05T12:13:17.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d826b9aa0 con 0x555d826bfda0 2022-07-05T12:13:17.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.753 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826b95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60944/0 (socket says 172.21.15.90:60944) 2022-07-05T12:13:17.754 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe64359e700 1 -- 172.21.15.90:0/1629810390 learned_addr learned my addr 172.21.15.90:0/1629810390 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:17.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe642d9d700 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d826c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.755 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe64259c700 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82740e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.610+0000 7fe64359e700 1 -- 172.21.15.90:0/1629810390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 msgr2=0x555d826c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe64359e700 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d826c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.756 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe64359e700 1 -- 172.21.15.90:0/1629810390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 msgr2=0x555d82740e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe64359e700 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82740e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.757 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe64359e700 1 -- 172.21.15.90:0/1629810390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d82484fd0 con 0x555d82703890 2022-07-05T12:13:17.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe64259c700 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82740e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:13:17.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe64359e700 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826b95b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fe63400e6a0 tx=0x7fe63408e000).ready entity=mon.0 client_cookie=15cde25ea85aa63 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:17.758 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe628bd3700 1 -- 172.21.15.90:0/1629810390 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400ee60 con 0x555d82703890 2022-07-05T12:13:17.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe628bd3700 1 -- 172.21.15.90:0/1629810390 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63408a950 con 0x555d82703890 2022-07-05T12:13:17.759 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe628bd3700 1 -- 172.21.15.90:0/1629810390 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634085500 con 0x555d82703890 2022-07-05T12:13:17.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/1629810390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 msgr2=0x555d826b95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826b95b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fe63400e6a0 tx=0x7fe63408e000).stop 2022-07-05T12:13:17.760 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/1629810390 shutdown_connections 2022-07-05T12:13:17.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d826b95b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.761 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d826bfda0 0x555d826c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/1629810390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d827034b0 0x555d82740e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/1629810390 >> 172.21.15.90:0/1629810390 conn(0x555d8252e1c0 msgr2=0x555d8270bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:17.762 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/1629810390 shutdown_connections 2022-07-05T12:13:17.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.611+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/1629810390 wait complete. 2022-07-05T12:13:17.763 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.612+0000 7fe65aa4fb80 1 -- start start 2022-07-05T12:13:17.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.612+0000 7fe65aa4fb80 1 Processor -- start 2022-07-05T12:13:17.764 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d826bfda0 0x555d826c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.765 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d827034b0 0x555d826bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe65aa4fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d8272f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.766 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82791eb0 con 0x555d82703890 2022-07-05T12:13:17.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8272f210 con 0x555d826bfda0 2022-07-05T12:13:17.767 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe65aa4fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d82791720 con 0x555d827034b0 2022-07-05T12:13:17.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe65aa4fb80 10 client.0 ll_register_callbacks cb 0x555d82683380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:13:17.768 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d8272f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe64359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d8272f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60950/0 (socket says 172.21.15.90:60950) 2022-07-05T12:13:17.769 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe64359e700 1 -- 172.21.15.90:0/2979952245 learned_addr learned my addr 172.21.15.90:0/2979952245 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:17.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe64259c700 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d827034b0 0x555d826bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.770 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.613+0000 7fe642d9d700 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d826bfda0 0x555d826c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe64359e700 1 -- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d827034b0 msgr2=0x555d826bf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe64359e700 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d827034b0 0x555d826bf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.771 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe64359e700 1 -- 172.21.15.90:0/2979952245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d826bfda0 msgr2=0x555d826c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:17.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe64359e700 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d826bfda0 0x555d826c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.772 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe64359e700 1 -- 172.21.15.90:0/2979952245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d824b6cd0 con 0x555d82703890 2022-07-05T12:13:17.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe64359e700 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d8272f6a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fe634085200 tx=0x7fe63408d000).ready entity=mon.0 client_cookie=c2ea4cf0bd1ca771 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:17.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe61d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:13:17.773 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe61d7fa700 1 -- 172.21.15.90:0/2979952245 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634085580 con 0x555d82703890 2022-07-05T12:13:17.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe63408ade0 con 0x555d82703890 2022-07-05T12:13:17.774 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe61d7fa700 1 -- 172.21.15.90:0/2979952245 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7fe634081500 con 0x555d82703890 2022-07-05T12:13:17.775 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe61d7fa700 1 -- 172.21.15.90:0/2979952245 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe634084670 con 0x555d82703890 2022-07-05T12:13:17.776 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 10 client.6363 fetch_fsmap learned FSMap version 41 2022-07-05T12:13:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x555d824b6cd0 con 0x555d82703890 2022-07-05T12:13:17.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe61d7fa700 1 -- 172.21.15.90:0/2979952245 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63408ade0 con 0x555d82703890 2022-07-05T12:13:17.778 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe61d7fa700 1 -- 172.21.15.90:0/2979952245 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7fe634085790 con 0x555d82703890 2022-07-05T12:13:17.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 10 client.6363 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:13:17.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 10 client.6363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:13:17.779 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 20 client.6363 populate_metadata read hostname 'smithi090' 2022-07-05T12:13:17.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d82704320 0x555d8270b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:17.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 4 client.6363 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:13:17.780 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.614+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555d82602690 con 0x555d82704320 2022-07-05T12:13:17.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe642d9d700 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d82704320 0x555d8270b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:17.781 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe61d7fa700 10 client.6363 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:17.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe642d9d700 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d82704320 0x555d8270b9c0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b5fa20c019127f5a server_cookie=248526873134e0c8 in_seq=0 out_seq=0 2022-07-05T12:13:17.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe61d7fa700 1 -- 172.21.15.90:0/2979952245 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555d82602690 con 0x555d82704320 2022-07-05T12:13:17.782 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe61d7fa700 10 client.6363 handle_command_reply: tid=0 2022-07-05T12:13:17.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 client.6363 shutdown 2022-07-05T12:13:17.783 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 msgr2=0x555d8272f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d8272f6a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fe634085200 tx=0x7fe63408d000).stop 2022-07-05T12:13:17.784 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 shutdown_connections 2022-07-05T12:13:17.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x555d82704320 0x555d8270b9c0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555d82703890 0x555d8272f6a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.785 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555d826bfda0 0x555d826c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.786 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe61d7fa700 0 client.6363 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:17.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 --2- 172.21.15.90:0/2979952245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555d827034b0 0x555d826bf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 >> 172.21.15.90:0/2979952245 conn(0x555d8252e1c0 msgr2=0x555d826b9890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:17.788 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 shutdown_connections 2022-07-05T12:13:17.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 1 -- 172.21.15.90:0/2979952245 wait complete. 2022-07-05T12:13:17.789 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.615+0000 7fe65aa4fb80 20 client.6363 trim_cache size 0 max 16384 2022-07-05T12:13:17.790 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:13:17.791 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:13:17.791 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:13:17.792 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:13:17.792 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:13:17.792 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:13:17.793 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:13:17.793 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:13:17.808 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:13:17.809 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:13:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe62408ba40 msgr2=0x7fe62408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe62408ba40 0x7fe62408df00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fe6440f4440 tx=0x7fe63c007b90).stop 2022-07-05T12:13:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe64417dcd0 msgr2=0x7fe64418eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:17.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe64417dcd0 0x7fe64418eeb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fe634007f20 tx=0x7fe634009860).stop 2022-07-05T12:13:17.814 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 shutdown_connections 2022-07-05T12:13:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7fe62408ba40 0x7fe62408df00 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe64417dcd0 0x7fe64418eeb0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe644063910 0x7fe64418fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 --2- 172.21.15.90:0/2435670015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6440ef830 0x7fe6440c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:17.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 >> 172.21.15.90:0/2435670015 conn(0x7fe6440f5470 msgr2=0x7fe64417e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:17.818 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 shutdown_connections 2022-07-05T12:13:17.819 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:17.616+0000 7fe6488c2700 1 -- 172.21.15.90:0/2435670015 wait complete. 2022-07-05T12:13:17.819 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:13:47.822 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2022-07-05T12:13:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.949+0000 7efd6d091700 1 Processor -- start 2022-07-05T12:13:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.949+0000 7efd6d091700 1 -- start start 2022-07-05T12:13:47.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.950+0000 7efd6d091700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd68188530 0x7efd68188910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:47.975 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.950+0000 7efd6d091700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd680ee6f0 0x7efd680eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:47.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.950+0000 7efd6d091700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd680f0160 con 0x7efd68189000 2022-07-05T12:13:47.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.950+0000 7efd6d091700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680ef090 con 0x7efd680ee6f0 2022-07-05T12:13:47.976 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.950+0000 7efd6d091700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680f05f0 con 0x7efd68188530 2022-07-05T12:13:47.977 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.951+0000 7efd66d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd68188530 0x7efd68188910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.951+0000 7efd66d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd68188530 0x7efd68188910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:42350/0 (socket says 172.21.15.90:42350) 2022-07-05T12:13:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.951+0000 7efd66d9d700 1 -- 172.21.15.90:0/2610824984 learned_addr learned my addr 172.21.15.90:0/2610824984 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.951+0000 7efd6659c700 1 --2- 172.21.15.90:0/2610824984 >> v2:172.21.15.110:3300/0 conn(0x7efd680ee6f0 0x7efd680eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:47.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.951+0000 7efd65d9b700 1 -- 172.21.15.90:0/2610824984 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343367989 0 0) 0x7efd680f0160 con 0x7efd68189000 2022-07-05T12:13:47.981 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.961+0000 7efd65d9b700 1 -- 172.21.15.90:0/2610824984 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd50005600 con 0x7efd68189000 2022-07-05T12:13:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.961+0000 7efd66d9d700 1 -- 172.21.15.90:0/2610824984 >> v2:172.21.15.110:3300/0 conn(0x7efd680ee6f0 msgr2=0x7efd680eeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.961+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2610824984 >> v2:172.21.15.110:3300/0 conn(0x7efd680ee6f0 0x7efd680eeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:47.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.961+0000 7efd66d9d700 1 -- 172.21.15.90:0/2610824984 >> v1:172.21.15.110:6789/0 conn(0x7efd68189000 legacy=0x7efd68189410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:47.983 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.961+0000 7efd66d9d700 1 -- 172.21.15.90:0/2610824984 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68188e00 con 0x7efd68188530 2022-07-05T12:13:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.961+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2610824984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68188530 0x7efd68188910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7efd68083290 tx=0x7efd58009c90).ready entity=mon.2 client_cookie=4f81c2e7e2406737 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd65d9b700 1 -- 172.21.15.90:0/2610824984 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800b920 con 0x7efd68188530 2022-07-05T12:13:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd65d9b700 1 -- 172.21.15.90:0/2610824984 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800ba80 con 0x7efd68188530 2022-07-05T12:13:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd65d9b700 1 -- 172.21.15.90:0/2610824984 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800be00 con 0x7efd68188530 2022-07-05T12:13:48.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 -- 172.21.15.90:0/2610824984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68188530 msgr2=0x7efd68188910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.027 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 --2- 172.21.15.90:0/2610824984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68188530 0x7efd68188910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7efd68083290 tx=0x7efd58009c90).stop 2022-07-05T12:13:48.028 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 -- 172.21.15.90:0/2610824984 shutdown_connections 2022-07-05T12:13:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 --2- 172.21.15.90:0/2610824984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68188530 0x7efd68188910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 --2- 172.21.15.90:0/2610824984 >> v2:172.21.15.110:3300/0 conn(0x7efd680ee6f0 0x7efd680eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.034 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 -- 172.21.15.90:0/2610824984 >> 172.21.15.90:0/2610824984 conn(0x7efd680edd60 msgr2=0x7efd6805d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 -- 172.21.15.90:0/2610824984 shutdown_connections 2022-07-05T12:13:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.962+0000 7efd6d091700 1 -- 172.21.15.90:0/2610824984 wait complete. 2022-07-05T12:13:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.964+0000 7efd6d091700 1 Processor -- start 2022-07-05T12:13:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.964+0000 7efd6d091700 1 -- start start 2022-07-05T12:13:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6d091700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680ee6f0 0x7efd68180820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6d091700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd68188530 0x7efd6817f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.037 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6d091700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68189000 0x7efd680c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6d091700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68181770 con 0x7efd68188530 2022-07-05T12:13:48.038 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6d091700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6817f8a0 con 0x7efd680ee6f0 2022-07-05T12:13:48.039 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6d091700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68064b30 con 0x7efd68189000 2022-07-05T12:13:48.040 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd68188530 0x7efd6817f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd68188530 0x7efd6817f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60962/0 (socket says 172.21.15.90:60962) 2022-07-05T12:13:48.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 -- 172.21.15.90:0/2650720754 learned_addr learned my addr 172.21.15.90:0/2650720754 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:48.041 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6759e700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68189000 0x7efd680c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.042 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680ee6f0 0x7efd68180820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 -- 172.21.15.90:0/2650720754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68189000 msgr2=0x7efd680c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.051 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68189000 0x7efd680c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 -- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680ee6f0 msgr2=0x7efd68180820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.052 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680ee6f0 0x7efd68180820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 -- 172.21.15.90:0/2650720754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5800d040 con 0x7efd68188530 2022-07-05T12:13:48.053 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6659c700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd68188530 0x7efd6817f3b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7efd5c007c80 tx=0x7efd5c00c6b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd4effd700 1 -- 172.21.15.90:0/2650720754 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0127d0 con 0x7efd68188530 2022-07-05T12:13:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd4effd700 1 -- 172.21.15.90:0/2650720754 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c014040 con 0x7efd68188530 2022-07-05T12:13:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd4effd700 1 -- 172.21.15.90:0/2650720754 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c012b40 con 0x7efd68188530 2022-07-05T12:13:48.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.965+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd680c4760 con 0x7efd68188530 2022-07-05T12:13:48.074 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.966+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd681811b0 con 0x7efd68188530 2022-07-05T12:13:48.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.967+0000 7efd4effd700 1 -- 172.21.15.90:0/2650720754 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7efd5c01f030 con 0x7efd68188530 2022-07-05T12:13:48.075 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.968+0000 7efd4effd700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd4808ba40 0x7efd4808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.968+0000 7efd4effd700 1 -- 172.21.15.90:0/2650720754 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7efd5c0b4000 con 0x7efd68188530 2022-07-05T12:13:48.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.968+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd4808ba40 0x7efd4808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.076 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.968+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd4808ba40 0x7efd4808df00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7efd58009cd0 tx=0x7efd680f00d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:48.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.969+0000 7efd7ea1db80 1 Processor -- start 2022-07-05T12:13:48.077 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.969+0000 7efd7ea1db80 1 -- start start 2022-07-05T12:13:48.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.970+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.078 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.970+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560706990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.970+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.970+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555606822d0 con 0x5555606fc3c0 2022-07-05T12:13:48.079 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.970+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555605f9aa0 con 0x5555606b8cb0 2022-07-05T12:13:48.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.970+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55556060e950 con 0x5555606fc7a0 2022-07-05T12:13:48.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.080 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60968/0 (socket says 172.21.15.90:60968) 2022-07-05T12:13:48.081 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 -- 172.21.15.90:0/3848610475 learned_addr learned my addr 172.21.15.90:0/3848610475 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:48.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd6759e700 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.082 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd6659c700 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560706990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.083 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 -- 172.21.15.90:0/3848610475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 msgr2=0x5555606fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.085 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 -- 172.21.15.90:0/3848610475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 msgr2=0x555560706990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.086 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560706990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 -- 172.21.15.90:0/3848610475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555604409e0 con 0x5555606fc3c0 2022-07-05T12:13:48.087 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd66d9d700 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b87c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7efd680c5fc0 tx=0x7efd5801d000).ready entity=mon.0 client_cookie=b7df35e15f1ac17b server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:48.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd43fff700 1 -- 172.21.15.90:0/3848610475 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5802b070 con 0x5555606fc3c0 2022-07-05T12:13:48.088 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd43fff700 1 -- 172.21.15.90:0/3848610475 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58012d70 con 0x5555606fc3c0 2022-07-05T12:13:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.971+0000 7efd43fff700 1 -- 172.21.15.90:0/3848610475 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58027670 con 0x5555606fc3c0 2022-07-05T12:13:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 -- 172.21.15.90:0/3848610475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 msgr2=0x5555606b87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b87c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7efd680c5fc0 tx=0x7efd5801d000).stop 2022-07-05T12:13:48.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 -- 172.21.15.90:0/3848610475 shutdown_connections 2022-07-05T12:13:48.091 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b87c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/3848610475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560706990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.092 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 -- 172.21.15.90:0/3848610475 >> 172.21.15.90:0/3848610475 conn(0x5555605271c0 msgr2=0x5555606bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:48.094 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 -- 172.21.15.90:0/3848610475 shutdown_connections 2022-07-05T12:13:48.138 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.972+0000 7efd7ea1db80 1 -- 172.21.15.90:0/3848610475 wait complete. 2022-07-05T12:13:48.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.973+0000 7efd7ea1db80 1 -- start start 2022-07-05T12:13:48.139 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.973+0000 7efd7ea1db80 1 Processor -- start 2022-07-05T12:13:48.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606b8cb0 0x55556073ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x555560725160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.140 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x55556072f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555605d6120 con 0x5555606b8cb0 2022-07-05T12:13:48.141 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55556073b7b0 con 0x5555606fc3c0 2022-07-05T12:13:48.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55556073be20 con 0x5555606fc7a0 2022-07-05T12:13:48.142 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd7ea1db80 10 client.0 ll_register_callbacks cb 0x55556067c1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:13:48.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606b8cb0 0x55556073ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606b8cb0 0x55556073ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60974/0 (socket says 172.21.15.90:60974) 2022-07-05T12:13:48.143 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 -- 172.21.15.90:0/2978732402 learned_addr learned my addr 172.21.15.90:0/2978732402 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:48.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd6759e700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x55556072f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.144 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd6659c700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x555560725160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.145 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 -- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 msgr2=0x55556072f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.152 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x55556072f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.153 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 -- 172.21.15.90:0/2978732402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 msgr2=0x555560725160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x555560725160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.155 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 -- 172.21.15.90:0/2978732402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd68188e00 con 0x5555606b8cb0 2022-07-05T12:13:48.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd6659c700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x555560725160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:13:48.156 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606b8cb0 0x55556073ada0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x55556072ec70 tx=0x7efd58027000).ready entity=mon.0 client_cookie=7feb36d0d70c96df server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:48.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.974+0000 7efd417fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:13:48.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd417fa700 1 -- 172.21.15.90:0/2978732402 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5802b040 con 0x5555606b8cb0 2022-07-05T12:13:48.157 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd417fa700 1 -- 172.21.15.90:0/2978732402 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7efd58027dc0 con 0x5555606b8cb0 2022-07-05T12:13:48.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555606b6440 con 0x5555606b8cb0 2022-07-05T12:13:48.158 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd417fa700 1 -- 172.21.15.90:0/2978732402 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd58030650 con 0x5555606b8cb0 2022-07-05T12:13:48.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 10 client.6372 fetch_fsmap learned FSMap version 41 2022-07-05T12:13:48.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5555604afcd0 con 0x5555606b8cb0 2022-07-05T12:13:48.159 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd417fa700 1 -- 172.21.15.90:0/2978732402 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555606b6440 con 0x5555606b8cb0 2022-07-05T12:13:48.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd417fa700 1 -- 172.21.15.90:0/2978732402 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7efd58024030 con 0x5555606b8cb0 2022-07-05T12:13:48.160 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 10 client.6372 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:13:48.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 10 client.6372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:13:48.171 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 20 client.6372 populate_metadata read hostname 'smithi090' 2022-07-05T12:13:48.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55556072eca0 0x55556072a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.172 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 4 client.6372 mds_command: new command op to 4371 tid=0[{"prefix": "get_command_descriptions"}] 2022-07-05T12:13:48.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555606047f0 con 0x55556072eca0 2022-07-05T12:13:48.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.975+0000 7efd6659c700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55556072eca0 0x55556072a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.173 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.976+0000 7efd417fa700 10 client.6372 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:48.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.976+0000 7efd6659c700 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55556072eca0 0x55556072a0e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=28072525ba1399b2 server_cookie=11914ddb6ed8279f in_seq=0 out_seq=0 2022-07-05T12:13:48.174 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.976+0000 7efd417fa700 1 -- 172.21.15.90:0/2978732402 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5555606047f0 con 0x55556072eca0 2022-07-05T12:13:48.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.976+0000 7efd417fa700 10 client.6372 handle_command_reply: tid=0 2022-07-05T12:13:48.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.976+0000 7efd7ea1db80 1 client.6372 shutdown 2022-07-05T12:13:48.175 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.976+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606b8cb0 msgr2=0x55556073ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.976+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606b8cb0 0x55556073ada0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x55556072ec70 tx=0x7efd58027000).stop 2022-07-05T12:13:48.176 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 shutdown_connections 2022-07-05T12:13:48.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x55556072eca0 0x55556072a0e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.177 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x55556072f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606b8cb0 0x55556073ada0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2978732402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x555560725160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.178 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd417fa700 0 client.6372 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:48.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 >> 172.21.15.90:0/2978732402 conn(0x5555605271c0 msgr2=0x555560729150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:48.179 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 shutdown_connections 2022-07-05T12:13:48.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2978732402 wait complete. 2022-07-05T12:13:48.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.977+0000 7efd7ea1db80 20 client.6372 trim_cache size 0 max 16384 2022-07-05T12:13:48.180 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.992+0000 7efd7ea1db80 1 Processor -- start 2022-07-05T12:13:48.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.992+0000 7efd7ea1db80 1 -- start start 2022-07-05T12:13:48.181 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560725160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.182 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555606b2c60 con 0x5555606fc3c0 2022-07-05T12:13:48.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555606bc4a0 con 0x5555606b8cb0 2022-07-05T12:13:48.183 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560725650 con 0x5555606fc7a0 2022-07-05T12:13:48.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd6659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.184 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd6659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60986/0 (socket says 172.21.15.90:60986) 2022-07-05T12:13:48.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.993+0000 7efd6659c700 1 -- 172.21.15.90:0/2221221137 learned_addr learned my addr 172.21.15.90:0/2221221137 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:48.185 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd6759e700 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.187 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560725160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd6659c700 1 -- 172.21.15.90:0/2221221137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 msgr2=0x5555606ba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.188 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd6659c700 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606ba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd6659c700 1 -- 172.21.15.90:0/2221221137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 msgr2=0x555560725160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd6659c700 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560725160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.189 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd6659c700 1 -- 172.21.15.90:0/2221221137 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555606bd100 con 0x5555606fc3c0 2022-07-05T12:13:48.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd66d9d700 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560725160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-07-05T12:13:48.191 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd6659c700 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b9b10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7efd5c088ad0 tx=0x7efd5c0b3040).ready entity=mon.0 client_cookie=b8e283ef5b007c91 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:48.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd4cbd3700 1 -- 172.21.15.90:0/2221221137 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c086cc0 con 0x5555606fc3c0 2022-07-05T12:13:48.192 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd4cbd3700 1 -- 172.21.15.90:0/2221221137 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c085030 con 0x5555606fc3c0 2022-07-05T12:13:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd4cbd3700 1 -- 172.21.15.90:0/2221221137 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c088020 con 0x5555606fc3c0 2022-07-05T12:13:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2221221137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 msgr2=0x5555606b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b9b10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7efd5c088ad0 tx=0x7efd5c0b3040).stop 2022-07-05T12:13:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2221221137 shutdown_connections 2022-07-05T12:13:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606fc7a0 0x5555606ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606b8cb0 0x555560725160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/2221221137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc3c0 0x5555606b9b10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.195 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.994+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2221221137 >> 172.21.15.90:0/2221221137 conn(0x5555605271c0 msgr2=0x5555606bba10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:48.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.995+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2221221137 shutdown_connections 2022-07-05T12:13:48.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.995+0000 7efd7ea1db80 1 -- 172.21.15.90:0/2221221137 wait complete. 2022-07-05T12:13:48.196 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.995+0000 7efd7ea1db80 1 -- start start 2022-07-05T12:13:48.197 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.995+0000 7efd7ea1db80 1 Processor -- start 2022-07-05T12:13:48.197 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.996+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606b8cb0 0x5555606ee560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.197 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.996+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x5555607854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.996+0000 7efd7ea1db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc7a0 0x5555606fa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.198 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.996+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555606fb240 con 0x5555606fc7a0 2022-07-05T12:13:48.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.996+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560790a60 con 0x5555606fc3c0 2022-07-05T12:13:48.199 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.996+0000 7efd7ea1db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555606fac80 con 0x5555606b8cb0 2022-07-05T12:13:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.996+0000 7efd7ea1db80 10 client.0 ll_register_callbacks cb 0x55556067c1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-07-05T12:13:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc7a0 0x5555606fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc7a0 0x5555606fa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60992/0 (socket says 172.21.15.90:60992) 2022-07-05T12:13:48.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 -- 172.21.15.90:0/1336780823 learned_addr learned my addr 172.21.15.90:0/1336780823 (peer_addr_for_me v2:172.21.15.90:0/0) 2022-07-05T12:13:48.201 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd66d9d700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606b8cb0 0x5555606ee560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6659c700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x5555607854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.202 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 -- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606b8cb0 msgr2=0x5555606ee560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606b8cb0 0x5555606ee560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 -- 172.21.15.90:0/1336780823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 msgr2=0x5555607854b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-07-05T12:13:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x5555607854b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 -- 172.21.15.90:0/1336780823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd681811b0 con 0x5555606fc7a0 2022-07-05T12:13:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6659c700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x5555607854b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-07-05T12:13:48.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd6759e700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc7a0 0x5555606fa380 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7efd60000f60 tx=0x7efd60007b70).ready entity=mon.0 client_cookie=b6fe9ece30e05c17 server_cookie=0 in_seq=0 out_seq=0 2022-07-05T12:13:48.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd417fa700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2022-07-05T12:13:48.205 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd417fa700 1 -- 172.21.15.90:0/1336780823 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6001b070 con 0x5555606fc7a0 2022-07-05T12:13:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd417fa700 1 -- 172.21.15.90:0/1336780823 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8846+0+0 (secure 0 0 0) 0x7efd60015610 con 0x5555606fc7a0 2022-07-05T12:13:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd58012d70 con 0x5555606fc7a0 2022-07-05T12:13:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd417fa700 1 -- 172.21.15.90:0/1336780823 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd60003840 con 0x5555606fc7a0 2022-07-05T12:13:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd7ea1db80 10 client.6378 fetch_fsmap learned FSMap version 41 2022-07-05T12:13:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55556047dfd0 con 0x5555606fc7a0 2022-07-05T12:13:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd417fa700 1 -- 172.21.15.90:0/1336780823 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58012d70 con 0x5555606fc7a0 2022-07-05T12:13:48.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd417fa700 1 -- 172.21.15.90:0/1336780823 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 41) v1 ==== 5821+0+0 (secure 0 0 0) 0x7efd600159e0 con 0x5555606fc7a0 2022-07-05T12:13:48.217 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd7ea1db80 10 client.6378 fetch_fsmap finished waiting for FSMap version 41 2022-07-05T12:13:48.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd7ea1db80 10 client.6378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.f 2022-07-05T12:13:48.218 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.997+0000 7efd7ea1db80 20 client.6378 populate_metadata read hostname 'smithi090' 2022-07-05T12:13:48.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5555607066d0 0x5555606b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-07-05T12:13:48.219 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 4 client.6378 mds_command: new command op to 4371 tid=0[{"prefix": "scrub status"}] 2022-07-05T12:13:48.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 --> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5555605fb690 con 0x5555607066d0 2022-07-05T12:13:48.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd66d9d700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5555607066d0 0x5555606b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-07-05T12:13:48.220 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd417fa700 10 client.6378 ms_handle_connect on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:48.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd66d9d700 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5555607066d0 0x5555606b7b10 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=36a3de55a625859 server_cookie=7a04ff53d41b8fb0 in_seq=0 out_seq=0 2022-07-05T12:13:48.221 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd417fa700 1 -- 172.21.15.90:0/1336780823 <== mds.0 v2:172.21.15.149:6836/3440068716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5555605fb690 con 0x5555607066d0 2022-07-05T12:13:48.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd417fa700 10 client.6378 handle_command_reply: tid=0 2022-07-05T12:13:48.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 client.6378 shutdown 2022-07-05T12:13:48.222 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc7a0 msgr2=0x5555606fa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc7a0 0x5555606fa380 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7efd60000f60 tx=0x7efd60007b70).stop 2022-07-05T12:13:48.223 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 shutdown_connections 2022-07-05T12:13:48.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:6836/3440068716,v1:172.21.15.149:6837/3440068716] conn(0x5555607066d0 0x5555606b7b10 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.224 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5555606fc7a0 0x5555606fa380 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5555606b8cb0 0x5555606ee560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.225 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 --2- 172.21.15.90:0/1336780823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5555606fc3c0 0x5555607854b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd417fa700 0 client.6378 ms_handle_reset on v2:172.21.15.149:6836/3440068716 2022-07-05T12:13:48.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 >> 172.21.15.90:0/1336780823 conn(0x5555605271c0 msgr2=0x5555606bc610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:48.226 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 shutdown_connections 2022-07-05T12:13:48.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.998+0000 7efd7ea1db80 1 -- 172.21.15.90:0/1336780823 wait complete. 2022-07-05T12:13:48.227 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd7ea1db80 20 client.6378 trim_cache size 0 max 16384 2022-07-05T12:13:48.229 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2022-07-05T12:13:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "status": "IDLE (waiting for more scrubs)", 2022-07-05T12:13:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "scrubs": { 2022-07-05T12:13:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "dde4467b-5f4f-4522-9258-7ec677a98d19": { 2022-07-05T12:13:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "path": "/", 2022-07-05T12:13:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "tag": "dde4467b-5f4f-4522-9258-7ec677a98d19", 2022-07-05T12:13:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "options": "recursive,force" 2022-07-05T12:13:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:13:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: } 2022-07-05T12:13:48.232 INFO:teuthology.orchestra.run.smithi090.stdout:} 2022-07-05T12:13:48.235 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd4808ba40 msgr2=0x7efd4808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd4808ba40 0x7efd4808df00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7efd58009cd0 tx=0x7efd680f00d0).stop 2022-07-05T12:13:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd68188530 msgr2=0x7efd6817f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-07-05T12:13:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd68188530 0x7efd6817f3b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7efd5c007c80 tx=0x7efd5c00c6b0).stop 2022-07-05T12:13:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 shutdown_connections 2022-07-05T12:13:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:6800/36906,v1:172.21.15.110:6801/36906] conn(0x7efd4808ba40 0x7efd4808df00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd68189000 0x7efd680c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680ee6f0 0x7efd68180820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 --2- 172.21.15.90:0/2650720754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd68188530 0x7efd6817f3b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-07-05T12:13:48.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 >> 172.21.15.90:0/2650720754 conn(0x7efd680edd60 msgr2=0x7efd68181c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-07-05T12:13:48.239 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 shutdown_connections 2022-07-05T12:13:48.240 INFO:teuthology.orchestra.run.smithi090.stderr:2022-07-05T12:13:47.999+0000 7efd6d091700 1 -- 172.21.15.90:0/2650720754 wait complete. 2022-07-05T12:13:48.240 INFO:tasks.cephfs.filesystem:scrub status for tag:dde4467b-5f4f-4522-9258-7ec677a98d19 - {'path': '/', 'tag': 'dde4467b-5f4f-4522-9258-7ec677a98d19', 'options': 'recursive,force'} 2022-07-05T12:13:48.241 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa/tasks/fwd_scrub.py", line 77, in _scrub timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph_c4a8e5d15163d588b25b033c25ae416600cffaa5/qa/tasks/cephfs/filesystem.py", line 1605, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (30) after waiting for 900 seconds 2022-07-05T12:18:39.717 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-07-05T12:18:39.728 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-07-05T12:21:42.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:21:42.083 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:21:42.088 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:21:43.110 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:21:43.109+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42590) UID: 0 2022-07-05T12:21:43.111 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:21:43.109+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42590) UID: 0 2022-07-05T12:21:43.112 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:21:43.109+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42590) UID: 0 2022-07-05T12:32:04.144 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:32:04.139+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42687) UID: 0 2022-07-05T12:32:04.175 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:32:04.139+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42687) UID: 0 2022-07-05T12:32:04.177 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:32:04.139+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42687) UID: 0 2022-07-05T12:37:52.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:37:52.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:37:52.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:38:25.576 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:38:25.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:38:25.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:38:56.686 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:38:56.690 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:38:56.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:38:57.202 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:38:57.175+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42798) UID: 0 2022-07-05T12:38:57.203 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:38:57.175+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42798) UID: 0 2022-07-05T12:38:57.203 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:38:57.175+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42798) UID: 0 2022-07-05T12:42:42.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:42:43.715 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:42:43.729 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:43:16.226 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:43:16.236 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:43:16.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:43:47.376 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:43:47.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:43:47.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:43:48.349 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:43:48.347+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42897) UID: 0 2022-07-05T12:43:48.351 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:43:48.347+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42897) UID: 0 2022-07-05T12:43:48.352 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:43:48.348+0000 7f89f80c4700 -1 Fail to open '/proc/42897/cmdline' error = (2) No such file or directory 2022-07-05T12:43:48.352 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:43:48.348+0000 7f89f80c4700 -1 received signal: Hangup from (PID: 42897) UID: 0 2022-07-05T12:47:05.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:47:05.347 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:47:05.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:47:06.551 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:47:06.549+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42944) UID: 0 2022-07-05T12:47:06.552 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:47:06.549+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42944) UID: 0 2022-07-05T12:47:06.553 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:47:06.549+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42944) UID: 0 2022-07-05T12:51:37.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:51:37.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:51:37.340 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:51:37.530 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:51:37.527+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43009) UID: 0 2022-07-05T12:51:37.532 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:51:37.527+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43009) UID: 0 2022-07-05T12:51:37.533 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:51:37.527+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43009) UID: 0 2022-07-05T12:52:56.338 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-07-05T12:52:56.342 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-07-05T12:58:57.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:58:57.205 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:58:57.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T12:58:57.388 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T12:58:57.386+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43089) UID: 0 2022-07-05T12:58:57.389 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T12:58:57.386+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43089) UID: 0 2022-07-05T12:58:57.390 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T12:58:57.386+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43089) UID: 0 2022-07-05T13:11:22.796 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:11:22.804 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:11:22.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:11:24.601 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T13:11:24.599+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43237) UID: 0 2022-07-05T13:11:24.602 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T13:11:24.599+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43237) UID: 0 2022-07-05T13:11:24.602 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T13:11:24.599+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43237) UID: 0 2022-07-05T13:28:21.677 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:28:21.703 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:28:21.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:28:24.084 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T13:28:24.071+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43403) UID: 0 2022-07-05T13:28:24.085 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T13:28:24.071+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43403) UID: 0 2022-07-05T13:28:24.086 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T13:28:24.071+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43403) UID: 0 2022-07-05T13:48:36.555 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:48:36.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:48:36.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T13:48:38.343 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T13:48:38.341+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43818) UID: 0 2022-07-05T13:48:38.344 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T13:48:38.341+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43818) UID: 0 2022-07-05T13:48:38.345 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T13:48:38.341+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43818) UID: 0 2022-07-05T14:08:36.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:08:36.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:08:36.120 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:08:38.048 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T14:08:38.044+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44023) UID: 0 2022-07-05T14:08:38.049 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T14:08:38.044+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44023) UID: 0 2022-07-05T14:08:38.050 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T14:08:38.044+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44023) UID: 0 2022-07-05T14:26:58.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:26:58.344 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:26:58.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:26:59.984 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T14:26:59.980+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44199) UID: 0 2022-07-05T14:26:59.985 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T14:26:59.980+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44199) UID: 0 2022-07-05T14:26:59.986 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T14:26:59.980+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44199) UID: 0 2022-07-05T14:43:14.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:43:14.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:43:14.883 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:43:16.576 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T14:43:16.569+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44362) UID: 0 2022-07-05T14:43:16.577 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T14:43:16.569+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44362) UID: 0 2022-07-05T14:43:16.578 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T14:43:16.569+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44362) UID: 0 2022-07-05T14:57:57.901 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:57:57.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:57:57.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T14:57:59.808 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T14:57:59.801+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44510) UID: 0 2022-07-05T14:57:59.809 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T14:57:59.801+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44510) UID: 0 2022-07-05T14:57:59.810 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T14:57:59.801+0000 7f89f80c4700 -1 Fail to open '/proc/44510/cmdline' error = (2) No such file or directory 2022-07-05T14:57:59.810 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T14:57:59.801+0000 7f89f80c4700 -1 received signal: Hangup from (PID: 44510) UID: 0 2022-07-05T15:11:40.712 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:11:40.751 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:11:40.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:11:42.829 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T15:11:42.821+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44664) UID: 0 2022-07-05T15:11:42.830 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T15:11:42.821+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44664) UID: 0 2022-07-05T15:11:42.831 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T15:11:42.821+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44664) UID: 0 2022-07-05T15:24:53.651 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:24:53.658 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:24:53.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:24:56.755 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T15:24:56.754+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44797) UID: 0 2022-07-05T15:24:56.756 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T15:24:56.754+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44797) UID: 0 2022-07-05T15:24:56.757 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T15:24:56.755+0000 7f5c718fc700 -1 Fail to open '/proc/44797/cmdline' error = (2) No such file or directory 2022-07-05T15:24:56.757 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T15:24:56.755+0000 7f5c718fc700 -1 received signal: Hangup from (PID: 44797) UID: 0 2022-07-05T15:38:12.317 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:38:12.346 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:38:12.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:38:14.690 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T15:38:14.687+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44929) UID: 0 2022-07-05T15:38:14.691 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T15:38:14.687+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44929) UID: 0 2022-07-05T15:38:14.692 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T15:38:14.687+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44929) UID: 0 2022-07-05T15:50:21.474 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:50:21.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:50:21.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T15:50:22.154 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T15:50:22.153+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45223) UID: 0 2022-07-05T15:50:22.155 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T15:50:22.153+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45223) UID: 0 2022-07-05T15:50:22.156 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T15:50:22.153+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45223) UID: 0 2022-07-05T16:01:47.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:01:47.444 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:01:47.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:01:47.964 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T16:01:47.961+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45361) UID: 0 2022-07-05T16:01:47.965 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T16:01:47.961+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45361) UID: 0 2022-07-05T16:01:47.966 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T16:01:47.961+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45361) UID: 0 2022-07-05T16:21:35.659 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:21:35.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:21:35.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:21:38.026 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T16:21:38.022+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45556) UID: 0 2022-07-05T16:21:38.027 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T16:21:38.023+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45556) UID: 0 2022-07-05T16:21:38.028 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T16:21:38.023+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45556) UID: 0 2022-07-05T16:44:32.841 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:44:32.874 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:44:32.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T16:44:35.461 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T16:44:35.459+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45775) UID: 0 2022-07-05T16:44:35.462 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T16:44:35.459+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45775) UID: 0 2022-07-05T16:44:35.463 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T16:44:35.460+0000 7f89f80c4700 -1 Fail to open '/proc/45775/cmdline' error = (2) No such file or directory 2022-07-05T16:44:35.463 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T16:44:35.460+0000 7f89f80c4700 -1 received signal: Hangup from (PID: 45775) UID: 0 2022-07-05T17:04:30.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:04:30.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:04:30.954 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:04:33.262 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T17:04:33.256+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45980) UID: 0 2022-07-05T17:04:33.262 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T17:04:33.256+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45980) UID: 0 2022-07-05T17:04:33.263 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T17:04:33.256+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45980) UID: 0 2022-07-05T17:23:30.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:23:30.200 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:23:30.210 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:23:33.073 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T17:23:33.070+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46164) UID: 0 2022-07-05T17:23:33.074 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T17:23:33.070+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46164) UID: 0 2022-07-05T17:23:33.075 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T17:23:33.070+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46164) UID: 0 2022-07-05T17:40:19.095 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:40:19.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:40:19.151 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:40:21.175 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T17:40:21.172+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46408) UID: 0 2022-07-05T17:40:21.176 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T17:40:21.172+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46408) UID: 0 2022-07-05T17:40:21.176 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T17:40:21.173+0000 7f5c718fc700 -1 Fail to open '/proc/46408/cmdline' error = (2) No such file or directory 2022-07-05T17:40:21.177 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T17:40:21.173+0000 7f5c718fc700 -1 received signal: Hangup from (PID: 46408) UID: 0 2022-07-05T17:54:23.864 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:54:23.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:54:23.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T17:54:25.694 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T17:54:25.690+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46695) UID: 0 2022-07-05T17:54:25.695 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T17:54:25.690+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46695) UID: 0 2022-07-05T17:54:25.696 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T17:54:25.690+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46695) UID: 0 2022-07-05T18:08:01.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:08:01.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:08:01.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:08:03.402 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T18:08:03.394+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46846) UID: 0 2022-07-05T18:08:03.403 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T18:08:03.394+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46846) UID: 0 2022-07-05T18:08:03.403 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T18:08:03.394+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46846) UID: 0 2022-07-05T18:20:59.687 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:20:59.715 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:20:59.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:21:01.553 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T18:21:01.545+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46982) UID: 0 2022-07-05T18:21:01.554 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T18:21:01.545+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46982) UID: 0 2022-07-05T18:21:01.554 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T18:21:01.545+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46982) UID: 0 2022-07-05T18:32:40.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:32:41.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:32:41.014 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:32:43.550 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T18:32:43.542+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47106) UID: 0 2022-07-05T18:32:43.551 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T18:32:43.542+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47106) UID: 0 2022-07-05T18:32:43.552 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T18:32:43.542+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47106) UID: 0 2022-07-05T18:43:49.769 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:43:49.803 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:43:49.806 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:43:52.553 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T18:43:52.547+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47223) UID: 0 2022-07-05T18:43:52.554 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T18:43:52.547+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47223) UID: 0 2022-07-05T18:43:52.591 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T18:43:52.547+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47223) UID: 0 2022-07-05T18:50:41.419 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:50:41.430 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:50:41.434 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T18:50:42.139 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T18:50:42.131+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47305) UID: 0 2022-07-05T18:50:42.140 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T18:50:42.131+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47305) UID: 0 2022-07-05T18:50:42.140 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T18:50:42.131+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47305) UID: 0 2022-07-05T19:00:23.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:00:23.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:00:23.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:00:24.916 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T19:00:24.908+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47400) UID: 0 2022-07-05T19:00:24.918 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T19:00:24.908+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47400) UID: 0 2022-07-05T19:00:24.919 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T19:00:24.908+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47400) UID: 0 2022-07-05T19:13:12.561 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:13:12.603 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:13:12.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:13:14.087 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T19:13:14.080+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47545) UID: 0 2022-07-05T19:13:14.088 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T19:13:14.080+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47545) UID: 0 2022-07-05T19:13:14.089 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T19:13:14.081+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47545) UID: 0 2022-07-05T19:32:22.063 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:32:22.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:32:22.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:32:22.252 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T19:32:22.242+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47726) UID: 0 2022-07-05T19:32:22.253 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T19:32:22.242+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47726) UID: 0 2022-07-05T19:32:22.254 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T19:32:22.242+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47726) UID: 0 2022-07-05T19:59:32.476 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:59:32.524 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:59:32.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T19:59:34.339 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T19:59:34.333+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48167) UID: 0 2022-07-05T19:59:34.340 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T19:59:34.333+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48167) UID: 0 2022-07-05T19:59:34.341 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T19:59:34.333+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48167) UID: 0 2022-07-05T20:34:45.551 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T20:34:45.567 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T20:34:45.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T20:34:46.040 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T20:34:46.036+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48503) UID: 0 2022-07-05T20:34:46.042 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T20:34:46.036+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48503) UID: 0 2022-07-05T20:34:46.043 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T20:34:46.036+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48503) UID: 0 2022-07-05T21:23:01.725 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T21:23:01.764 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T21:23:01.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T21:23:02.607 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T21:23:02.606+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48950) UID: 0 2022-07-05T21:23:02.608 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T21:23:02.606+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48950) UID: 0 2022-07-05T21:23:02.609 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T21:23:02.606+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48950) UID: 0 2022-07-05T22:32:25.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T22:32:25.471 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T22:32:25.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-07-05T22:32:27.229 INFO:tasks.ceph.mds.c.smithi149.stderr:2022-07-05T22:32:27.227+0000 7f5c718fc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49889) UID: 0 2022-07-05T22:32:27.230 INFO:tasks.ceph.mds.f.smithi149.stderr:2022-07-05T22:32:27.227+0000 7fc1225cb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49889) UID: 0 2022-07-05T22:32:27.230 INFO:tasks.ceph.mds.l.smithi149.stderr:2022-07-05T22:32:27.227+0000 7f89f80c4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49889) UID: 0 2022-07-05T23:38:38.825 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-07-05T23:38:38.866 DEBUG:teuthology.task.console_log:Killing console logger for smithi090 2022-07-05T23:38:38.869 DEBUG:teuthology.task.console_log:Killing console logger for smithi110 2022-07-05T23:38:38.869 DEBUG:teuthology.task.console_log:Killing console logger for smithi149 2022-07-05T23:38:38.890 DEBUG:teuthology.exit:Finished running handlers